Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260620 07:00:50.343127 388 test_util.cc:268] Using random seed: -131094358
2026-06-20T07:00:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T07:00:50Z Disabled control of system clock
I20260620 07:00:50.380254 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4u_93S/build/asan/bin/kudu
/tmp/dist-test-task4u_93S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:36007
--webserver_interface=127.0.97.62
--webserver_port=0
--builtin_ntp_servers=127.0.97.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 07:00:50.720837 396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 07:00:50.721221 396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 07:00:50.721375 396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 07:00:50.729045 396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 07:00:50.729198 396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 07:00:50.729291 396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 07:00:50.729393 396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 07:00:50.739809 396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:36007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.97.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 06:01:36 UTC on ccycloud.quasar-ouulox.root.comops.site
build id 4457022
ASAN enabled
I20260620 07:00:50.741277 396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 07:00:50.743268 396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 07:00:50.756903 401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:50.756914 402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:50.756945 404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:00:50.758111 396 server_base.cc:1034] running on GCE node
I20260620 07:00:50.759131 396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 07:00:50.760738 396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 07:00:50.762033 396 hybrid_clock.cc:648] HybridClock initialized: now 1781938850761880 us; error 138 us; skew 500 ppm
I20260620 07:00:50.762408 396 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 07:00:50.765036 396 webserver.cc:460] Webserver started at http://127.0.97.62:36191/ using document root <none> and password file <none>
I20260620 07:00:50.765810 396 fs_manager.cc:359] Metadata directory not provided
I20260620 07:00:50.765959 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 07:00:50.766306 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 07:00:50.769188 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/data/instance:
uuid: "2fe29008ed9b430ea13d40e54e3ddfcc"
format_stamp: "Formatted at 2026-06-20 07:00:50 on dist-test-slave-jd6w"
I20260620 07:00:50.770066 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/wal/instance:
uuid: "2fe29008ed9b430ea13d40e54e3ddfcc"
format_stamp: "Formatted at 2026-06-20 07:00:50 on dist-test-slave-jd6w"
I20260620 07:00:50.776016 396 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260620 07:00:50.780824 410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:50.782984 396 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260620 07:00:50.783207 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/data,/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/wal
uuid: "2fe29008ed9b430ea13d40e54e3ddfcc"
format_stamp: "Formatted at 2026-06-20 07:00:50 on dist-test-slave-jd6w"
I20260620 07:00:50.783476 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 07:00:50.804399 396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 07:00:50.805213 396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 07:00:50.805496 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 07:00:50.826128 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.62:36007
I20260620 07:00:50.826156 461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.62:36007 every 8 connection(s)
I20260620 07:00:50.827666 396 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/data/info.pb
I20260620 07:00:50.832125 462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:50.838524 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4u_93S/build/asan/bin/kudu as pid 396
I20260620 07:00:50.838889 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-0/wal/instance
I20260620 07:00:50.839279 462 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } has no permanent_uuid. Determining permanent_uuid...
I20260620 07:00:50.841475 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4u_93S/build/asan/bin/kudu
/tmp/dist-test-task4u_93S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:33455
--webserver_interface=127.0.97.61
--webserver_port=0
--builtin_ntp_servers=127.0.97.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 07:00:50.858244 462 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } has no permanent_uuid. Determining permanent_uuid...
W20260620 07:00:50.859650 413 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111)
W20260620 07:00:50.861800 462 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:33455: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111)
I20260620 07:00:50.911201 462 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } attempt: 1
W20260620 07:00:50.913230 462 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:33455: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111)
I20260620 07:00:50.981581 462 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } attempt: 2
W20260620 07:00:50.983978 462 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:33455: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111)
I20260620 07:00:51.075325 462 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } attempt: 3
W20260620 07:00:51.077616 462 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:33455: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111)
W20260620 07:00:51.193403 466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 07:00:51.193718 466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 07:00:51.193864 466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 07:00:51.201434 466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 07:00:51.201550 466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 07:00:51.201635 466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 07:00:51.201713 466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 07:00:51.211726 466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:33455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 06:01:36 UTC on ccycloud.quasar-ouulox.root.comops.site
build id 4457022
ASAN enabled
I20260620 07:00:51.213152 466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 07:00:51.215088 466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 07:00:51.220944 462 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } attempt: 4
W20260620 07:00:51.223304 462 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:33455: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111)
W20260620 07:00:51.229041 472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:51.229038 473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:51.229038 475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:00:51.229429 466 server_base.cc:1034] running on GCE node
I20260620 07:00:51.230847 466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 07:00:51.232404 466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 07:00:51.233657 466 hybrid_clock.cc:648] HybridClock initialized: now 1781938851233593 us; error 35 us; skew 500 ppm
I20260620 07:00:51.234035 466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 07:00:51.240170 466 webserver.cc:460] Webserver started at http://127.0.97.61:38159/ using document root <none> and password file <none>
I20260620 07:00:51.240974 466 fs_manager.cc:359] Metadata directory not provided
I20260620 07:00:51.241083 466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 07:00:51.241441 466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 07:00:51.244261 466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data/instance:
uuid: "2395d394cd84440ebae89d1ecfa13fb5"
format_stamp: "Formatted at 2026-06-20 07:00:51 on dist-test-slave-jd6w"
I20260620 07:00:51.245067 466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal/instance:
uuid: "2395d394cd84440ebae89d1ecfa13fb5"
format_stamp: "Formatted at 2026-06-20 07:00:51 on dist-test-slave-jd6w"
I20260620 07:00:51.251031 466 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260620 07:00:51.258244 481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:51.260692 466 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260620 07:00:51.260919 466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data,/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
uuid: "2395d394cd84440ebae89d1ecfa13fb5"
format_stamp: "Formatted at 2026-06-20 07:00:51 on dist-test-slave-jd6w"
I20260620 07:00:51.261195 466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 07:00:51.281536 466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 07:00:51.282505 466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 07:00:51.282850 466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 07:00:51.304664 466 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:33455
I20260620 07:00:51.304697 532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:33455 every 8 connection(s)
I20260620 07:00:51.306115 466 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data/info.pb
I20260620 07:00:51.310104 533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:51.310276 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4u_93S/build/asan/bin/kudu as pid 466
I20260620 07:00:51.310429 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal/instance
I20260620 07:00:51.311756 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4u_93S/build/asan/bin/kudu
/tmp/dist-test-task4u_93S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:46775
--webserver_interface=127.0.97.60
--webserver_port=0
--builtin_ntp_servers=127.0.97.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 07:00:51.319319 533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } has no permanent_uuid. Determining permanent_uuid...
I20260620 07:00:51.338968 533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } has no permanent_uuid. Determining permanent_uuid...
I20260620 07:00:51.349581 533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } has no permanent_uuid. Determining permanent_uuid...
W20260620 07:00:51.351068 483 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
W20260620 07:00:51.353236 533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:51.402619 533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } attempt: 1
W20260620 07:00:51.404680 533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:51.472970 533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } attempt: 2
W20260620 07:00:51.474943 533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:51.522617 462 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } attempt: 5
I20260620 07:00:51.531819 462 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } has no permanent_uuid. Determining permanent_uuid...
W20260620 07:00:51.533869 462 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:51.566188 533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } attempt: 3
W20260620 07:00:51.568240 533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:51.585160 462 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } attempt: 1
W20260620 07:00:51.587394 462 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:51.655655 462 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } attempt: 2
W20260620 07:00:51.657651 462 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
W20260620 07:00:51.685767 535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 07:00:51.686067 535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 07:00:51.686149 535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 07:00:51.694989 535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 07:00:51.695170 535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 07:00:51.695231 535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 07:00:51.695287 535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 07:00:51.705248 535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:46775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 06:01:36 UTC on ccycloud.quasar-ouulox.root.comops.site
build id 4457022
ASAN enabled
I20260620 07:00:51.706624 535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 07:00:51.709223 535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 07:00:51.711508 533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } attempt: 4
W20260620 07:00:51.713575 533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
W20260620 07:00:51.722451 543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:51.722589 546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:51.722712 544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:00:51.723963 535 server_base.cc:1034] running on GCE node
I20260620 07:00:51.724915 535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 07:00:51.726480 535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 07:00:51.727756 535 hybrid_clock.cc:648] HybridClock initialized: now 1781938851727665 us; error 78 us; skew 500 ppm
I20260620 07:00:51.728166 535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 07:00:51.731035 535 webserver.cc:460] Webserver started at http://127.0.97.60:44063/ using document root <none> and password file <none>
I20260620 07:00:51.731820 535 fs_manager.cc:359] Metadata directory not provided
I20260620 07:00:51.731974 535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 07:00:51.732319 535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 07:00:51.735494 535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/instance:
uuid: "f32c3995c70946c38ce1a3094aaaffb1"
format_stamp: "Formatted at 2026-06-20 07:00:51 on dist-test-slave-jd6w"
I20260620 07:00:51.736801 535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal/instance:
uuid: "f32c3995c70946c38ce1a3094aaaffb1"
format_stamp: "Formatted at 2026-06-20 07:00:51 on dist-test-slave-jd6w"
I20260620 07:00:51.743139 535 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260620 07:00:51.747463 552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:51.749164 535 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260620 07:00:51.749377 535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data,/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
uuid: "f32c3995c70946c38ce1a3094aaaffb1"
format_stamp: "Formatted at 2026-06-20 07:00:51 on dist-test-slave-jd6w"
I20260620 07:00:51.749608 535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 07:00:51.763893 462 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } attempt: 3
W20260620 07:00:51.766058 462 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:51.767696 535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 07:00:51.768603 535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 07:00:51.768930 535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 07:00:51.789932 535 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.60:46775
I20260620 07:00:51.790045 603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.60:46775 every 8 connection(s)
I20260620 07:00:51.791499 535 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/info.pb
I20260620 07:00:51.792017 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4u_93S/build/asan/bin/kudu as pid 535
I20260620 07:00:51.792212 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal/instance
I20260620 07:00:51.795642 604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:51.804816 604 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } has no permanent_uuid. Determining permanent_uuid...
I20260620 07:00:51.821827 604 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } has no permanent_uuid. Determining permanent_uuid...
I20260620 07:00:51.831866 604 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } has no permanent_uuid. Determining permanent_uuid...
I20260620 07:00:51.848466 604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: Bootstrap starting.
I20260620 07:00:51.852526 604 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:51.853688 604 log.cc:824] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: Log is configured to *not* fsync() on all Append() calls
I20260620 07:00:51.856429 604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: No bootstrap required, opened a new log
I20260620 07:00:51.863878 604 raft_consensus.cc:348] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:51.864264 604 raft_consensus.cc:374] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:51.864410 604 raft_consensus.cc:729] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f32c3995c70946c38ce1a3094aaaffb1, State: Initialized, Role: FOLLOWER
I20260620 07:00:51.865022 604 consensus_queue.cc:260] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:51.866400 613 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:51.866750 613 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:51.867648 604 sys_catalog.cc:564] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: configured and running, proceeding with master startup.
W20260620 07:00:51.877352 624 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 07:00:51.877513 624 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 07:00:51.877514 535 master_runner.cc:186] Error getting master registration for 127.0.97.62:36007: OK, instance_id { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" instance_seqno: 1781938850820512 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 07:00:51.885432 535 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 07:00:51.943328 462 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } attempt: 4
I20260620 07:00:51.955348 462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Bootstrap starting.
I20260620 07:00:51.958544 462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:51.960304 462 log.cc:824] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Log is configured to *not* fsync() on all Append() calls
I20260620 07:00:51.963219 462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: No bootstrap required, opened a new log
I20260620 07:00:51.971768 462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:51.972112 462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:51.972254 462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fe29008ed9b430ea13d40e54e3ddfcc, State: Initialized, Role: FOLLOWER
I20260620 07:00:51.972966 462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:51.978104 627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:51.980235 627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:51.980717 462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: configured and running, proceeding with master startup.
W20260620 07:00:51.991675 638 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 07:00:51.991926 638 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 07:00:51.990808 396 master_runner.cc:186] Error getting master registration for 127.0.97.61:33455: OK, instance_id { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" instance_seqno: 1781938851299001 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 07:00:52.003594 396 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 07:00:52.012831 533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } attempt: 5
W20260620 07:00:52.021597 558 tablet.cc:2369] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 07:00:52.027684 533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: Bootstrap starting.
I20260620 07:00:52.031904 533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:52.033211 533 log.cc:824] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: Log is configured to *not* fsync() on all Append() calls
I20260620 07:00:52.036847 533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: No bootstrap required, opened a new log
I20260620 07:00:52.048964 533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:52.049404 533 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:52.049577 533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2395d394cd84440ebae89d1ecfa13fb5, State: Initialized, Role: FOLLOWER
I20260620 07:00:52.050298 533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:52.051353 641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:52.051870 641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:52.052755 533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: configured and running, proceeding with master startup.
W20260620 07:00:52.059122 416 tablet.cc:2369] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 07:00:52.076422 652 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 07:00:52.076683 652 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 07:00:52.084976 466 master_runner.cc:263] No leader master found from master 2395d394cd84440ebae89d1ecfa13fb5
I20260620 07:00:52.085129 466 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 07:00:52.183676 627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:52.184093 627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:52.188027 579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f32c3995c70946c38ce1a3094aaaffb1" is_pre_election: true
I20260620 07:00:52.188814 579 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fe29008ed9b430ea13d40e54e3ddfcc in term 0.
I20260620 07:00:52.189623 508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5" is_pre_election: true
I20260620 07:00:52.190306 508 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fe29008ed9b430ea13d40e54e3ddfcc in term 0.
I20260620 07:00:52.191308 413 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2395d394cd84440ebae89d1ecfa13fb5, 2fe29008ed9b430ea13d40e54e3ddfcc; no voters:
I20260620 07:00:52.192358 627 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455), f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775)
I20260620 07:00:52.192723 627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:52.192932 627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:52.193080 627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:52.281068 627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:52.285385 579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f32c3995c70946c38ce1a3094aaaffb1"
W20260620 07:00:52.285681 487 tablet.cc:2369] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 07:00:52.285684 579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:52.289702 579 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fe29008ed9b430ea13d40e54e3ddfcc in term 1.
I20260620 07:00:52.290498 412 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fe29008ed9b430ea13d40e54e3ddfcc, f32c3995c70946c38ce1a3094aaaffb1; no voters:
I20260620 07:00:52.291496 508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5"
I20260620 07:00:52.291736 508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:52.295210 508 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fe29008ed9b430ea13d40e54e3ddfcc in term 1.
I20260620 07:00:52.296116 627 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 1 election: Requested vote from peers 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455), f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775)
I20260620 07:00:52.296129 654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:52.296686 654 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 1 LEADER]: Becoming Leader. State: Replica: 2fe29008ed9b430ea13d40e54e3ddfcc, State: Running, Role: LEADER
I20260620 07:00:52.297623 654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:52.311337 627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe29008ed9b430ea13d40e54e3ddfcc. Latest consensus state: current_term: 1 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:52.311656 627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: LEADER
I20260620 07:00:52.323231 656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 07:00:52.325721 656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 07:00:52.361299 579 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 1 FOLLOWER]: Refusing update from remote peer 2fe29008ed9b430ea13d40e54e3ddfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:00:52.362460 627 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:52.370561 508 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 1 FOLLOWER]: Refusing update from remote peer 2fe29008ed9b430ea13d40e54e3ddfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:00:52.371932 627 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:52.387428 613 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe29008ed9b430ea13d40e54e3ddfcc. Latest consensus state: current_term: 1 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:52.387787 613 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:52.393213 657 mvcc.cc:205] Tried to move back new op lower bound from 7298821539257016320 to 7298821539017916416. Current Snapshot: MvccSnapshot[applied={T|T < 7298821539257016320}]
I20260620 07:00:52.400566 641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe29008ed9b430ea13d40e54e3ddfcc. Latest consensus state: current_term: 1 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:52.400883 641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:52.404562 659 mvcc.cc:205] Tried to move back new op lower bound from 7298821539257016320 to 7298821539017916416. Current Snapshot: MvccSnapshot[applied={T|T < 7298821539257016320}]
I20260620 07:00:52.405758 641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:52.406035 641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:52.407279 654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:52.407590 654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: LEADER
I20260620 07:00:52.408133 654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:52.408382 654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: LEADER
I20260620 07:00:52.409716 656 catalog_manager.cc:1347] Generated new cluster ID: f5f6212dc8bc4fbd93e00bcd73ee0625
I20260620 07:00:52.409812 656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 07:00:52.410473 613 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:52.410742 613 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:52.441274 656 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 07:00:52.443434 656 catalog_manager.cc:1504] Loading token signing keys...
I20260620 07:00:52.465860 656 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Generated new TSK 0
I20260620 07:00:52.467161 656 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 07:00:52.489054 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4u_93S/build/asan/bin/kudu
/tmp/dist-test-task4u_93S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.97.1:0
--local_ip_for_outbound_sockets=127.0.97.1
--webserver_interface=127.0.97.1
--webserver_port=0
--tserver_master_addrs=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--builtin_ntp_servers=127.0.97.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260620 07:00:52.871181 665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 07:00:52.871513 665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 07:00:52.871685 665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260620 07:00:52.880144 624 catalog_manager.cc:1259] Loaded cluster ID: f5f6212dc8bc4fbd93e00bcd73ee0625
I20260620 07:00:52.880268 624 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: loading cluster ID for follower catalog manager: success
W20260620 07:00:52.880651 665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 07:00:52.880884 665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.97.1
I20260620 07:00:52.884060 624 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: acquiring CA information for follower catalog manager: success
I20260620 07:00:52.886688 624 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 07:00:52.892563 665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.97.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.97.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.97.1
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 06:01:36 UTC on ccycloud.quasar-ouulox.root.comops.site
build id 4457022
ASAN enabled
I20260620 07:00:52.893883 665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 07:00:52.895772 665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 07:00:52.911152 670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:52.911173 671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:52.911434 673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:00:52.912900 665 server_base.cc:1034] running on GCE node
I20260620 07:00:52.913817 665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 07:00:52.915238 665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 07:00:52.916527 665 hybrid_clock.cc:648] HybridClock initialized: now 1781938852916434 us; error 66 us; skew 500 ppm
I20260620 07:00:52.917364 665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 07:00:52.920728 665 webserver.cc:460] Webserver started at http://127.0.97.1:43507/ using document root <none> and password file <none>
I20260620 07:00:52.921730 665 fs_manager.cc:359] Metadata directory not provided
I20260620 07:00:52.921876 665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 07:00:52.922243 665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 07:00:52.926404 665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/data/instance:
uuid: "2b84cae646b24bc7bd424eb8434ad425"
format_stamp: "Formatted at 2026-06-20 07:00:52 on dist-test-slave-jd6w"
I20260620 07:00:52.927533 665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/instance:
uuid: "2b84cae646b24bc7bd424eb8434ad425"
format_stamp: "Formatted at 2026-06-20 07:00:52 on dist-test-slave-jd6w"
I20260620 07:00:52.935158 665 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260620 07:00:52.940451 679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:52.942293 665 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260620 07:00:52.942498 665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/data,/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal
uuid: "2b84cae646b24bc7bd424eb8434ad425"
format_stamp: "Formatted at 2026-06-20 07:00:52 on dist-test-slave-jd6w"
I20260620 07:00:52.942773 665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 07:00:52.966475 684 raft_consensus.cc:482] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fe29008ed9b430ea13d40e54e3ddfcc)
I20260620 07:00:52.966686 684 raft_consensus.cc:504] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:52.970045 437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" is_pre_election: true
I20260620 07:00:52.978845 665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 07:00:52.979243 508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5" is_pre_election: true
I20260620 07:00:52.979616 508 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f32c3995c70946c38ce1a3094aaaffb1 in term 1.
I20260620 07:00:52.980062 665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 07:00:52.980430 665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 07:00:52.980302 555 leader_election.cc:302] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2395d394cd84440ebae89d1ecfa13fb5, f32c3995c70946c38ce1a3094aaaffb1; no voters: 2fe29008ed9b430ea13d40e54e3ddfcc
I20260620 07:00:52.983176 685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fe29008ed9b430ea13d40e54e3ddfcc)
I20260620 07:00:52.983523 685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:52.985607 685 leader_election.cc:288] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fe29008ed9b430ea13d40e54e3ddfcc (127.0.97.62:36007), f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775)
I20260620 07:00:52.989841 684 leader_election.cc:288] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fe29008ed9b430ea13d40e54e3ddfcc (127.0.97.62:36007), 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455)
I20260620 07:00:52.990659 684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 07:00:52.991521 684 raft_consensus.cc:482] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fe29008ed9b430ea13d40e54e3ddfcc)
I20260620 07:00:52.992091 684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 1 FOLLOWER]: Advancing to term 2
I20260620 07:00:52.995275 665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 07:00:53.002951 578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2395d394cd84440ebae89d1ecfa13fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f32c3995c70946c38ce1a3094aaaffb1" is_pre_election: true
I20260620 07:00:53.003923 665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 07:00:53.004052 665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:53.004213 665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 07:00:53.004287 665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:53.005149 684 raft_consensus.cc:504] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:53.006271 578 raft_consensus.cc:2379] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2395d394cd84440ebae89d1ecfa13fb5 in current term 2: Already voted for candidate f32c3995c70946c38ce1a3094aaaffb1 in this term.
I20260620 07:00:53.007166 579 raft_consensus.cc:1226] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 2 FOLLOWER]: Rejecting Update request from peer 2fe29008ed9b430ea13d40e54e3ddfcc for earlier term 1. Current term is 2. Ops: []
I20260620 07:00:53.009955 437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc"
I20260620 07:00:53.011180 686 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 07:00:53.012630 508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5"
I20260620 07:00:53.012943 508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260620 07:00:53.017390 508 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f32c3995c70946c38ce1a3094aaaffb1 in term 2.
I20260620 07:00:53.018420 555 leader_election.cc:302] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2395d394cd84440ebae89d1ecfa13fb5, f32c3995c70946c38ce1a3094aaaffb1; no voters: 2fe29008ed9b430ea13d40e54e3ddfcc
I20260620 07:00:53.019001 687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 07:00:53.020416 684 leader_election.cc:288] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 2 election: Requested vote from peers 2fe29008ed9b430ea13d40e54e3ddfcc (127.0.97.62:36007), 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455)
I20260620 07:00:53.020107 437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2395d394cd84440ebae89d1ecfa13fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" is_pre_election: true
I20260620 07:00:53.021394 482 leader_election.cc:302] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2395d394cd84440ebae89d1ecfa13fb5; no voters: 2fe29008ed9b430ea13d40e54e3ddfcc, f32c3995c70946c38ce1a3094aaaffb1
I20260620 07:00:53.021874 685 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:00:53.022715 686 raft_consensus.cc:3032] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 1 LEADER]: Stepping down as leader of term 1
I20260620 07:00:53.023684 686 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fe29008ed9b430ea13d40e54e3ddfcc, State: Running, Role: LEADER
I20260620 07:00:53.024232 686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:53.025246 687 raft_consensus.cc:686] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 2 LEADER]: Becoming Leader. State: Replica: f32c3995c70946c38ce1a3094aaaffb1, State: Running, Role: LEADER
I20260620 07:00:53.025977 687 consensus_queue.cc:237] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:53.028891 684 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f32c3995c70946c38ce1a3094aaaffb1. Latest consensus state: current_term: 2 leader_uuid: "f32c3995c70946c38ce1a3094aaaffb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:53.029328 684 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: This master's current role is: LEADER
I20260620 07:00:53.030088 686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 1 FOLLOWER]: Advancing to term 2
I20260620 07:00:53.033386 508 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 2 FOLLOWER]: Rejecting Update request from peer 2fe29008ed9b430ea13d40e54e3ddfcc for earlier term 1. Current term is 2. Ops: []
I20260620 07:00:53.035337 696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 07:00:53.037681 696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 07:00:53.038856 696 catalog_manager.cc:1259] Loaded cluster ID: f5f6212dc8bc4fbd93e00bcd73ee0625
I20260620 07:00:53.038990 696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 07:00:53.040086 696 catalog_manager.cc:1504] Loading token signing keys...
I20260620 07:00:53.041240 696 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: Loaded TSK: 0
I20260620 07:00:53.043025 696 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 07:00:53.079383 652 catalog_manager.cc:1259] Loaded cluster ID: f5f6212dc8bc4fbd93e00bcd73ee0625
I20260620 07:00:53.079509 652 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: loading cluster ID for follower catalog manager: success
I20260620 07:00:53.082619 665 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.1:34639
I20260620 07:00:53.082633 798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.1:34639 every 8 connection(s)
I20260620 07:00:53.083458 652 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: acquiring CA information for follower catalog manager: success
I20260620 07:00:53.084671 665 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/data/info.pb
I20260620 07:00:53.085538 652 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 07:00:53.093863 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4u_93S/build/asan/bin/kudu as pid 665
I20260620 07:00:53.094081 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/instance
I20260620 07:00:53.103516 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4u_93S/build/asan/bin/kudu
/tmp/dist-test-task4u_93S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.97.2:0
--local_ip_for_outbound_sockets=127.0.97.2
--webserver_interface=127.0.97.2
--webserver_port=0
--tserver_master_addrs=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--builtin_ntp_servers=127.0.97.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260620 07:00:53.118870 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:00:53.119335 801 heartbeater.cc:464] Registering TS with master...
I20260620 07:00:53.120616 801 heartbeater.cc:511] Master 127.0.97.61:33455 requested a full tablet report, sending...
I20260620 07:00:53.123342 498 ts_manager.cc:194] Registered new tserver with Master: 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:53.124683 799 heartbeater.cc:347] Connected to a master server at 127.0.97.60:46775
I20260620 07:00:53.124843 799 heartbeater.cc:464] Registering TS with master...
I20260620 07:00:53.125387 799 heartbeater.cc:511] Master 127.0.97.60:46775 requested a full tablet report, sending...
I20260620 07:00:53.127374 569 ts_manager.cc:194] Registered new tserver with Master: 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:53.128515 800 heartbeater.cc:347] Connected to a master server at 127.0.97.62:36007
I20260620 07:00:53.128648 800 heartbeater.cc:464] Registering TS with master...
I20260620 07:00:53.129081 800 heartbeater.cc:511] Master 127.0.97.62:36007 requested a full tablet report, sending...
I20260620 07:00:53.129983 569 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.97.1:47601
I20260620 07:00:53.131487 427 ts_manager.cc:194] Registered new tserver with Master: 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:00:53.468402 809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 07:00:53.468722 809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 07:00:53.468881 809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260620 07:00:53.471982 508 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 2 FOLLOWER]: Refusing update from remote peer f32c3995c70946c38ce1a3094aaaffb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 07:00:53.472692 684 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 07:00:53.474519 685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f32c3995c70946c38ce1a3094aaaffb1. Latest consensus state: current_term: 2 leader_uuid: "f32c3995c70946c38ce1a3094aaaffb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:53.474828 685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:53.475451 686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:53.475703 686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:53.476559 686 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455), f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775)
I20260620 07:00:53.477322 507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5" is_pre_election: true
I20260620 07:00:53.478993 579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f32c3995c70946c38ce1a3094aaaffb1" is_pre_election: true
I20260620 07:00:53.479808 412 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fe29008ed9b430ea13d40e54e3ddfcc; no voters: 2395d394cd84440ebae89d1ecfa13fb5, f32c3995c70946c38ce1a3094aaaffb1
I20260620 07:00:53.480398 686 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 07:00:53.481110 809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 07:00:53.481348 809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.97.2
I20260620 07:00:53.481834 685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f32c3995c70946c38ce1a3094aaaffb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:53.482051 685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:53.482208 693 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f32c3995c70946c38ce1a3094aaaffb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:53.482594 693 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: This master's current role is: LEADER
I20260620 07:00:53.482657 437 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Refusing update from remote peer f32c3995c70946c38ce1a3094aaaffb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 07:00:53.483290 687 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 07:00:53.485822 689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f32c3995c70946c38ce1a3094aaaffb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:53.486095 689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:53.486039 686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader f32c3995c70946c38ce1a3094aaaffb1. Latest consensus state: current_term: 2 leader_uuid: "f32c3995c70946c38ce1a3094aaaffb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:53.486330 686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:53.492913 809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.97.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.97.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.97.2
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 06:01:36 UTC on ccycloud.quasar-ouulox.root.comops.site
build id 4457022
ASAN enabled
I20260620 07:00:53.494320 809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 07:00:53.496146 809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 07:00:53.510074 822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:53.510104 819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:53.510156 820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:00:53.511129 809 server_base.cc:1034] running on GCE node
I20260620 07:00:53.511762 809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 07:00:53.512820 809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 07:00:53.514092 809 hybrid_clock.cc:648] HybridClock initialized: now 1781938853514016 us; error 50 us; skew 500 ppm
I20260620 07:00:53.514406 809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 07:00:53.516811 809 webserver.cc:460] Webserver started at http://127.0.97.2:45861/ using document root <none> and password file <none>
I20260620 07:00:53.517578 809 fs_manager.cc:359] Metadata directory not provided
I20260620 07:00:53.517724 809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 07:00:53.518039 809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 07:00:53.520838 809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/data/instance:
uuid: "978f112862c64141b1009856bef3d624"
format_stamp: "Formatted at 2026-06-20 07:00:53 on dist-test-slave-jd6w"
I20260620 07:00:53.521688 809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/instance:
uuid: "978f112862c64141b1009856bef3d624"
format_stamp: "Formatted at 2026-06-20 07:00:53 on dist-test-slave-jd6w"
I20260620 07:00:53.527639 809 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260620 07:00:53.531298 828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:53.532866 809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260620 07:00:53.533092 809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/data,/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal
uuid: "978f112862c64141b1009856bef3d624"
format_stamp: "Formatted at 2026-06-20 07:00:53 on dist-test-slave-jd6w"
I20260620 07:00:53.533299 809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 07:00:53.546645 809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 07:00:53.547580 809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 07:00:53.547866 809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 07:00:53.549295 809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 07:00:53.550920 809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 07:00:53.551021 809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:53.551172 809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 07:00:53.551240 809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:53.589253 809 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.2:39311
I20260620 07:00:53.589289 940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.2:39311 every 8 connection(s)
I20260620 07:00:53.590624 809 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/data/info.pb
I20260620 07:00:53.594152 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4u_93S/build/asan/bin/kudu as pid 809
I20260620 07:00:53.594305 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/instance
I20260620 07:00:53.599149 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4u_93S/build/asan/bin/kudu
/tmp/dist-test-task4u_93S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.97.3:0
--local_ip_for_outbound_sockets=127.0.97.3
--webserver_interface=127.0.97.3
--webserver_port=0
--tserver_master_addrs=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--builtin_ntp_servers=127.0.97.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260620 07:00:53.611263 941 heartbeater.cc:347] Connected to a master server at 127.0.97.60:46775
I20260620 07:00:53.611634 941 heartbeater.cc:464] Registering TS with master...
I20260620 07:00:53.612152 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:00:53.612291 943 heartbeater.cc:464] Registering TS with master...
I20260620 07:00:53.612588 942 heartbeater.cc:347] Connected to a master server at 127.0.97.62:36007
I20260620 07:00:53.612708 942 heartbeater.cc:464] Registering TS with master...
I20260620 07:00:53.612869 943 heartbeater.cc:511] Master 127.0.97.61:33455 requested a full tablet report, sending...
I20260620 07:00:53.612908 941 heartbeater.cc:511] Master 127.0.97.60:46775 requested a full tablet report, sending...
I20260620 07:00:53.613135 942 heartbeater.cc:511] Master 127.0.97.62:36007 requested a full tablet report, sending...
I20260620 07:00:53.614617 569 ts_manager.cc:194] Registered new tserver with Master: 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:53.614652 498 ts_manager.cc:194] Registered new tserver with Master: 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:53.614655 427 ts_manager.cc:194] Registered new tserver with Master: 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:53.615954 569 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.97.2:58961
I20260620 07:00:53.633327 799 heartbeater.cc:503] Master 127.0.97.60:46775 was elected leader, sending a full tablet report...
W20260620 07:00:53.958570 948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 07:00:53.958946 948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 07:00:53.959105 948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 07:00:53.967317 948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 07:00:53.967625 948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.97.3
I20260620 07:00:53.977485 948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.97.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.97.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.97.3
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 06:01:36 UTC on ccycloud.quasar-ouulox.root.comops.site
build id 4457022
ASAN enabled
I20260620 07:00:53.978884 948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 07:00:53.980746 948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 07:00:53.985476 686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f32c3995c70946c38ce1a3094aaaffb1)
I20260620 07:00:53.985704 686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:53.986526 686 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455), f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775)
I20260620 07:00:53.987032 508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5" is_pre_election: true
I20260620 07:00:53.987177 579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f32c3995c70946c38ce1a3094aaaffb1" is_pre_election: true
I20260620 07:00:53.987771 412 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fe29008ed9b430ea13d40e54e3ddfcc; no voters: 2395d394cd84440ebae89d1ecfa13fb5, f32c3995c70946c38ce1a3094aaaffb1
I20260620 07:00:53.988183 686 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 07:00:53.995177 638 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260620 07:00:53.995747 954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:53.995800 953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:00:53.995883 956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:00:53.997121 948 server_base.cc:1034] running on GCE node
I20260620 07:00:53.997735 948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 07:00:53.999281 948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 07:00:54.000525 948 hybrid_clock.cc:648] HybridClock initialized: now 1781938854000472 us; error 39 us; skew 500 ppm
I20260620 07:00:54.000854 948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 07:00:54.003379 687 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f32c3995c70946c38ce1a3094aaaffb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:54.003710 687 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: This master's current role is: LEADER
I20260620 07:00:54.005286 948 webserver.cc:460] Webserver started at http://127.0.97.3:46549/ using document root <none> and password file <none>
I20260620 07:00:54.006009 948 fs_manager.cc:359] Metadata directory not provided
I20260620 07:00:54.006115 948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 07:00:54.006364 948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 07:00:54.009092 948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/data/instance:
uuid: "06a32ef63b2b495a9ade1de48c024ae9"
format_stamp: "Formatted at 2026-06-20 07:00:54 on dist-test-slave-jd6w"
I20260620 07:00:54.009908 948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/instance:
uuid: "06a32ef63b2b495a9ade1de48c024ae9"
format_stamp: "Formatted at 2026-06-20 07:00:54 on dist-test-slave-jd6w"
I20260620 07:00:54.015492 948 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260620 07:00:54.019172 965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:54.020784 948 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260620 07:00:54.020995 948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/data,/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal
uuid: "06a32ef63b2b495a9ade1de48c024ae9"
format_stamp: "Formatted at 2026-06-20 07:00:54 on dist-test-slave-jd6w"
I20260620 07:00:54.021227 948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 07:00:54.047302 948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 07:00:54.048277 948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 07:00:54.048573 948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 07:00:54.049597 948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 07:00:54.051263 948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 07:00:54.051337 948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:54.051476 948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 07:00:54.051527 948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:54.091744 948 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.3:42041
I20260620 07:00:54.091804 1077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.3:42041 every 8 connection(s)
I20260620 07:00:54.093022 948 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/data/info.pb
I20260620 07:00:54.102084 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4u_93S/build/asan/bin/kudu as pid 948
I20260620 07:00:54.102293 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/instance
I20260620 07:00:54.118010 1078 heartbeater.cc:347] Connected to a master server at 127.0.97.60:46775
I20260620 07:00:54.118376 1078 heartbeater.cc:464] Registering TS with master...
I20260620 07:00:54.118942 941 heartbeater.cc:503] Master 127.0.97.60:46775 was elected leader, sending a full tablet report...
I20260620 07:00:54.119472 1078 heartbeater.cc:511] Master 127.0.97.60:46775 requested a full tablet report, sending...
I20260620 07:00:54.121052 569 ts_manager.cc:194] Registered new tserver with Master: 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:54.121609 1080 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:00:54.121712 1080 heartbeater.cc:464] Registering TS with master...
I20260620 07:00:54.122148 569 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.97.3:59269
I20260620 07:00:54.122200 1080 heartbeater.cc:511] Master 127.0.97.61:33455 requested a full tablet report, sending...
I20260620 07:00:54.122728 1079 heartbeater.cc:347] Connected to a master server at 127.0.97.62:36007
I20260620 07:00:54.122898 1079 heartbeater.cc:464] Registering TS with master...
I20260620 07:00:54.123194 498 ts_manager.cc:194] Registered new tserver with Master: 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:54.123234 1079 heartbeater.cc:511] Master 127.0.97.62:36007 requested a full tablet report, sending...
I20260620 07:00:54.124202 427 ts_manager.cc:194] Registered new tserver with Master: 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:54.130225 388 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 07:00:54.165304 569 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_eec07c5102244557abacd9c44e888718"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.165623 562 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_f8300cf3a9d64342b0e70ad76747a5d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.165347 564 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_6cfa9b753c6743f4a2bd829e8729679f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.165541 568 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_37201202f7954f329938c4b54ab3e04b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.165868 566 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_a0c74951a2bc48058fcc978050945714"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.166371 560 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_57faae531a534091b91e16a33e168364"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.166617 565 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_9ddc36f011e0483aa4df6534c18833b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:54.167554 569 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eec07c5102244557abacd9c44e888718 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.167719 565 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ddc36f011e0483aa4df6534c18833b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.167765 564 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cfa9b753c6743f4a2bd829e8729679f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.167902 560 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57faae531a534091b91e16a33e168364 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.168392 562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8300cf3a9d64342b0e70ad76747a5d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:54.168231 563 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_e9b512d264174c649e6a3c69acaa5e63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:54.168781 568 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37201202f7954f329938c4b54ab3e04b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.168857 563 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9b512d264174c649e6a3c69acaa5e63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:54.169432 561 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_b49584af882b49408617bf017f65a7a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:54.169986 561 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b49584af882b49408617bf017f65a7a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:54.166939 567 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_ec59546bfd21408b8a9ab4ae8a5fd621"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:54.170750 567 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec59546bfd21408b8a9ab4ae8a5fd621 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.171921 566 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0c74951a2bc48058fcc978050945714 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:54.204882 562 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_f8300cf3a9d64342b0e70ad76747a5d9" } new_table_name: "default.Table_398f50af22bd40008b41c5ce88eaa157" modify_external_catalogs: true
I20260620 07:00:54.261637 564 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_6cfa9b753c6743f4a2bd829e8729679f" } new_table_name: "default.Table_03c395e17b1f49b9bde867f4929851eb" modify_external_catalogs: true
I20260620 07:00:54.261837 568 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_e9b512d264174c649e6a3c69acaa5e63" } new_table_name: "default.Table_55bc520e1ef24a7d98cf79d483dc79ff" modify_external_catalogs: true
I20260620 07:00:54.262347 561 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_b49584af882b49408617bf017f65a7a0" } new_table_name: "default.Table_2e14bcdcad144d3ebf3d7a65c097c729" modify_external_catalogs: true
I20260620 07:00:54.261760 563 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_57faae531a534091b91e16a33e168364" } modify_external_catalogs: true
I20260620 07:00:54.262604 563 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_57faae531a534091b91e16a33e168364" } modify_external_catalogs: true
I20260620 07:00:54.266881 567 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_eec07c5102244557abacd9c44e888718" } modify_external_catalogs: true
I20260620 07:00:54.267148 567 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_eec07c5102244557abacd9c44e888718" } modify_external_catalogs: true
I20260620 07:00:54.268383 566 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_9ddc36f011e0483aa4df6534c18833b2" } modify_external_catalogs: true
I20260620 07:00:54.268554 566 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_9ddc36f011e0483aa4df6534c18833b2" } modify_external_catalogs: true
I20260620 07:00:54.268567 569 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_a0c74951a2bc48058fcc978050945714" } modify_external_catalogs: true
I20260620 07:00:54.268841 569 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_a0c74951a2bc48058fcc978050945714" } modify_external_catalogs: true
I20260620 07:00:54.270511 565 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_ec59546bfd21408b8a9ab4ae8a5fd621" } modify_external_catalogs: true
I20260620 07:00:54.270512 560 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_37201202f7954f329938c4b54ab3e04b" } new_table_name: "default.Table_cefa8bd4295444b196d9e85f5bfbb5d2" modify_external_catalogs: true
W20260620 07:00:54.271126 562 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20941e688226436f8b83c84d4b871c7d consensus state has no leader
I20260620 07:00:54.272837 565 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57830:
table { table_name: "default.Table_ec59546bfd21408b8a9ab4ae8a5fd621" } modify_external_catalogs: true
W20260620 07:00:54.288898 568 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd08d2c1cf62472eb6ca5421d5299ef8 has no consensus state
W20260620 07:00:54.289208 564 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f3c14821df43c5a2ab950ccaed0605 has no consensus state
W20260620 07:00:54.298635 561 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca8f81380ffc4b5c9c55469dc9b726b9 has no consensus state
I20260620 07:00:54.299403 563 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet a20c06743654490ca7d3c5916b9825dc
I20260620 07:00:54.299943 567 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet ace1f0326c7345b58d120cf03bb4ee58
I20260620 07:00:54.302443 569 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 38f934cbf0364329a2a57889e13090c5
I20260620 07:00:54.304251 565 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 51916a7cb5ea4f79ad280f7ea53728b6
I20260620 07:00:54.305380 566 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet bbee0de56c294dbdad1eb3790dd2a44c
W20260620 07:00:54.307638 560 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47a0058cdf2e421bae206981f81486b4 has no consensus state
W20260620 07:00:54.307672 554 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 20941e688226436f8b83c84d4b871c7d (table default.Table_398f50af22bd40008b41c5ce88eaa157 [id=83a85bbc8fae4e44a8341d9c182e8282], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 20941e688226436f8b83c84d4b871c7d consensus state has no leader
I20260620 07:00:54.330482 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4u_93S/build/asan/bin/kudu pid 535
I20260620 07:00:54.331818 599 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 07:00:54.457551 560 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57830:
name: "default.Table_d984bbf6a33e4099b8809ddbcac68b00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:54.458259 560 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d984bbf6a33e4099b8809ddbcac68b00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:54.458564 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4u_93S/build/asan/bin/kudu with pid 535
W20260620 07:00:54.480912 1137 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 07:00:54.275874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49202 (local address 127.0.97.1:34639)
0620 07:00:54.285427 (+ 9553us) server_negotiation.cc:206] Beginning negotiation
0620 07:00:54.285449 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0620 07:00:54.455810 (+170361us) server_negotiation.cc:407] Connection header received
0620 07:00:54.455935 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 07:00:54.455946 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 07:00:54.456260 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 07:00:54.456488 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 07:00:54.479798 (+ 23310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49202: BlockingRecv error: recv got EOF from 127.0.0.1:49202 (error 108)
Metrics: {"server-negotiator.queue_time_us":9282,"thread_start_us":9144,"threads_started":1}
W20260620 07:00:54.481009 1121 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 07:00:54.272740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45976 (local address 127.0.97.2:39311)
0620 07:00:54.275175 (+ 2435us) server_negotiation.cc:206] Beginning negotiation
0620 07:00:54.275185 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 07:00:54.284640 (+ 9455us) server_negotiation.cc:407] Connection header received
0620 07:00:54.294636 (+ 9996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 07:00:54.294646 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 07:00:54.294769 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 07:00:54.294946 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 07:00:54.325793 (+ 30847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 07:00:54.327434 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 07:00:54.453842 (+126408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 07:00:54.455218 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 07:00:54.455370 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 07:00:54.455689 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0620 07:00:54.479833 (+ 24144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45976: BlockingRecv error: recv got EOF from 127.0.0.1:45976 (error 108)
Metrics: {"server-negotiator.queue_time_us":2237}
W20260620 07:00:54.481043 1135 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 07:00:54.274738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41210 (local address 127.0.97.3:42041)
0620 07:00:54.324127 (+ 49389us) server_negotiation.cc:206] Beginning negotiation
0620 07:00:54.324142 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0620 07:00:54.324194 (+ 52us) server_negotiation.cc:407] Connection header received
0620 07:00:54.324334 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 07:00:54.324348 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 07:00:54.335869 (+ 11521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 07:00:54.336557 (+ 688us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 07:00:54.457814 (+121257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 07:00:54.459710 (+ 1896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 07:00:54.479815 (+ 20105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41210: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":49143,"thread_start_us":49853,"threads_started":1}
W20260620 07:00:54.481406 1086 connection.cc:535] client connection to 127.0.97.60:46775 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 07:00:54.482437 1086 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.60:46775)
W20260620 07:00:54.482857 1086 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.60:46775)
W20260620 07:00:54.622511 941 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:46775 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:54.625684 1078 heartbeater.cc:503] Master 127.0.97.60:46775 was elected leader, sending a full tablet report...
W20260620 07:00:54.627228 1078 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:46775 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
W20260620 07:00:54.639485 799 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:46775 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
W20260620 07:00:54.657768 1086 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.60:46775)
I20260620 07:00:54.828792 1147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f32c3995c70946c38ce1a3094aaaffb1)
I20260620 07:00:54.828992 1147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:54.829653 1147 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455), f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775)
I20260620 07:00:54.830070 508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 27 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5" is_pre_election: true
I20260620 07:00:54.830328 508 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fe29008ed9b430ea13d40e54e3ddfcc in term 2.
I20260620 07:00:54.830890 413 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2395d394cd84440ebae89d1ecfa13fb5, 2fe29008ed9b430ea13d40e54e3ddfcc; no voters:
W20260620 07:00:54.831728 412 leader_election.cc:334] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775): Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:54.831806 1147 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 07:00:54.831915 1147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Starting leader election (detected failure of leader f32c3995c70946c38ce1a3094aaaffb1)
I20260620 07:00:54.832058 1147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 2 FOLLOWER]: Advancing to term 3
I20260620 07:00:54.836419 1147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:54.837235 1147 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 election: Requested vote from peers 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455), f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775)
I20260620 07:00:54.837808 508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 27 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5"
I20260620 07:00:54.838039 508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 2 FOLLOWER]: Advancing to term 3
W20260620 07:00:54.840417 412 leader_election.cc:334] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775): Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111)
I20260620 07:00:54.840678 508 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fe29008ed9b430ea13d40e54e3ddfcc in term 3.
I20260620 07:00:54.841123 413 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2395d394cd84440ebae89d1ecfa13fb5, 2fe29008ed9b430ea13d40e54e3ddfcc; no voters: f32c3995c70946c38ce1a3094aaaffb1
I20260620 07:00:54.841441 1147 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 3 FOLLOWER]: Leader election won for term 3
I20260620 07:00:54.841827 1147 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [term 3 LEADER]: Becoming Leader. State: Replica: 2fe29008ed9b430ea13d40e54e3ddfcc, State: Running, Role: LEADER
I20260620 07:00:54.842123 1147 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 2.27, Last appended by leader: 27, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:00:54.843207 1150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe29008ed9b430ea13d40e54e3ddfcc. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:54.843544 1150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: LEADER
I20260620 07:00:54.844178 1151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 07:00:54.847692 1151 catalog_manager.cc:669] Loaded metadata for table default.Table_398f50af22bd40008b41c5ce88eaa157 [id=83a85bbc8fae4e44a8341d9c182e8282]
I20260620 07:00:54.848090 1151 catalog_manager.cc:669] Loaded metadata for table default.Table_03c395e17b1f49b9bde867f4929851eb [id=85b77490846f4368895b1be9df5df22f]
I20260620 07:00:54.848474 1151 catalog_manager.cc:669] Loaded metadata for table default.Table_55bc520e1ef24a7d98cf79d483dc79ff [id=c0b383a11fe1422591fccd1269e37431]
I20260620 07:00:54.848907 1151 catalog_manager.cc:669] Loaded metadata for table default.Table_2e14bcdcad144d3ebf3d7a65c097c729 [id=cf7d070aa3fa4911b5013a757fac7022]
I20260620 07:00:54.849287 1151 catalog_manager.cc:669] Loaded metadata for table default.Table_cefa8bd4295444b196d9e85f5bfbb5d2 [id=d14098a69297478f977ebed80518623b]
I20260620 07:00:54.851011 1151 tablet_loader.cc:96] loaded metadata for tablet 20941e688226436f8b83c84d4b871c7d (table default.Table_398f50af22bd40008b41c5ce88eaa157 [id=83a85bbc8fae4e44a8341d9c182e8282])
I20260620 07:00:54.851456 1151 tablet_loader.cc:96] loaded metadata for tablet 47a0058cdf2e421bae206981f81486b4 (table default.Table_cefa8bd4295444b196d9e85f5bfbb5d2 [id=d14098a69297478f977ebed80518623b])
I20260620 07:00:54.852118 1151 tablet_loader.cc:96] loaded metadata for tablet ca8f81380ffc4b5c9c55469dc9b726b9 (table default.Table_2e14bcdcad144d3ebf3d7a65c097c729 [id=cf7d070aa3fa4911b5013a757fac7022])
I20260620 07:00:54.852408 1151 tablet_loader.cc:96] loaded metadata for tablet d7f3c14821df43c5a2ab950ccaed0605 (table default.Table_03c395e17b1f49b9bde867f4929851eb [id=85b77490846f4368895b1be9df5df22f])
I20260620 07:00:54.852754 1151 tablet_loader.cc:96] loaded metadata for tablet fd08d2c1cf62472eb6ca5421d5299ef8 (table default.Table_55bc520e1ef24a7d98cf79d483dc79ff [id=c0b383a11fe1422591fccd1269e37431])
I20260620 07:00:54.852990 1151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 07:00:54.854104 1151 catalog_manager.cc:1259] Loaded cluster ID: f5f6212dc8bc4fbd93e00bcd73ee0625
I20260620 07:00:54.854174 1151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 07:00:54.855545 1151 catalog_manager.cc:1504] Loading token signing keys...
I20260620 07:00:54.856376 1151 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Loaded TSK: 0
I20260620 07:00:54.856961 1151 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 07:00:54.869652 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_03c395e17b1f49b9bde867f4929851eb" } new_table_name: "default.Table_9a9c6e366f88478c9c4f8e05a5c79ae7" modify_external_catalogs: true
I20260620 07:00:54.872152 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_258536942d834dd1a9368c4d31c92785"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.870636 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_86605476230543e2aa5d48e04e0ca260"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.872184 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_770fed048dfe48919062ea2b1eb2bfc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.872676 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.874567 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d510df80b7bd4ff9a13c38d83044ece5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.873983 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4b04007c96234b9bba97fc8737871504"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:54.876919 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86605476230543e2aa5d48e04e0ca260 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.877012 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_258536942d834dd1a9368c4d31c92785 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.877161 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.877229 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b04007c96234b9bba97fc8737871504 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:54.873373 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2c9bafc30b0d425abfb4060a59e6eccc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:54.877616 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_770fed048dfe48919062ea2b1eb2bfc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.877777 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c9bafc30b0d425abfb4060a59e6eccc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:54.872481 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b10bef5fd1a44505a1607590eaa1f382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.874356 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4921e4d884bb4c26a886078eecef48d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:54.878286 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b10bef5fd1a44505a1607590eaa1f382 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.878527 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4921e4d884bb4c26a886078eecef48d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:54.880542 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d510df80b7bd4ff9a13c38d83044ece5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:54.884924 508 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Refusing update from remote peer 2fe29008ed9b430ea13d40e54e3ddfcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 3 index: 29. (index mismatch)
W20260620 07:00:54.885589 412 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc -> Peer f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775): Couldn't send request to peer f32c3995c70946c38ce1a3094aaaffb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 07:00:54.885793 1150 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260620 07:00:54.889050 1153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe29008ed9b430ea13d40e54e3ddfcc. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:54.889390 1153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: This master's current role is: FOLLOWER
W20260620 07:00:54.893046 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f3c14821df43c5a2ab950ccaed0605 consensus state has no leader
I20260620 07:00:54.900930 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_398f50af22bd40008b41c5ce88eaa157" } new_table_name: "default.Table_78806154ed5e4ad793503183c6f5c31c" modify_external_catalogs: true
I20260620 07:00:54.902482 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d984bbf6a33e4099b8809ddbcac68b00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:54.902547 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_55bc520e1ef24a7d98cf79d483dc79ff" } new_table_name: "default.Table_6468c56c50d5452abb0d324b47afe044" modify_external_catalogs: true
W20260620 07:00:54.903023 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d984bbf6a33e4099b8809ddbcac68b00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:54.903309 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2e14bcdcad144d3ebf3d7a65c097c729" } modify_external_catalogs: true
I20260620 07:00:54.903628 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2e14bcdcad144d3ebf3d7a65c097c729" } modify_external_catalogs: true
I20260620 07:00:54.903986 1150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:54.904310 1150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: LEADER
I20260620 07:00:54.906024 1153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:00:54.906265 1153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:00:54.909276 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_258536942d834dd1a9368c4d31c92785" } modify_external_catalogs: true
I20260620 07:00:54.909554 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_258536942d834dd1a9368c4d31c92785" } modify_external_catalogs: true
I20260620 07:00:54.910138 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_86605476230543e2aa5d48e04e0ca260" } modify_external_catalogs: true
I20260620 07:00:54.910347 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_86605476230543e2aa5d48e04e0ca260" } modify_external_catalogs: true
I20260620 07:00:54.911830 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_770fed048dfe48919062ea2b1eb2bfc9" } modify_external_catalogs: true
I20260620 07:00:54.912158 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_770fed048dfe48919062ea2b1eb2bfc9" } modify_external_catalogs: true
I20260620 07:00:54.912815 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cefa8bd4295444b196d9e85f5bfbb5d2" } new_table_name: "default.Table_068af2ef8683477b897abe7821977669" modify_external_catalogs: true
I20260620 07:00:54.914933 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9a9c6e366f88478c9c4f8e05a5c79ae7" } new_table_name: "default.Table_03432e4f372f45f7811fee73a4055330" modify_external_catalogs: true
I20260620 07:00:54.917014 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4b04007c96234b9bba97fc8737871504" } modify_external_catalogs: true
I20260620 07:00:54.917199 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4b04007c96234b9bba97fc8737871504" } modify_external_catalogs: true
W20260620 07:00:54.919054 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20941e688226436f8b83c84d4b871c7d consensus state has no leader
W20260620 07:00:54.919730 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd08d2c1cf62472eb6ca5421d5299ef8 consensus state has no leader
W20260620 07:00:54.935467 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet d7f3c14821df43c5a2ab950ccaed0605 (table default.Table_9a9c6e366f88478c9c4f8e05a5c79ae7 [id=85b77490846f4368895b1be9df5df22f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7f3c14821df43c5a2ab950ccaed0605 consensus state has no leader
W20260620 07:00:54.936375 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47a0058cdf2e421bae206981f81486b4 consensus state has no leader
I20260620 07:00:54.936676 424 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 57d8d7c3eaa940ca8db1bc0d4734ea5f
W20260620 07:00:54.937875 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f3c14821df43c5a2ab950ccaed0605 consensus state has no leader
I20260620 07:00:54.937510 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c (DEFAULT_TABLE table=default.Table_258536942d834dd1a9368c4d31c92785 [id=5c38d983b35e40809c5298cf96fb58f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.937453 1013 tablet_service.cc:1467] Processing CreateTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab (DEFAULT_TABLE table=default.Table_770fed048dfe48919062ea2b1eb2bfc9 [id=f2ca1f9c9e3244ddb7629af8a5af2793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.939090 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37f131000b084e8f9bdeb32de31e7d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.939595 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6e6c6f7d5094fb09d84da0cc37b9bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.939762 876 tablet_service.cc:1467] Processing CreateTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab (DEFAULT_TABLE table=default.Table_770fed048dfe48919062ea2b1eb2bfc9 [id=f2ca1f9c9e3244ddb7629af8a5af2793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.940971 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6e6c6f7d5094fb09d84da0cc37b9bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.944629 875 tablet_service.cc:1467] Processing CreateTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c (DEFAULT_TABLE table=default.Table_258536942d834dd1a9368c4d31c92785 [id=5c38d983b35e40809c5298cf96fb58f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.945050 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37f131000b084e8f9bdeb32de31e7d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.950527 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 37f131000b084e8f9bdeb32de31e7d9c
I20260620 07:00:54.950996 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ca8f81380ffc4b5c9c55469dc9b726b9
I20260620 07:00:54.951622 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e6e6c6f7d5094fb09d84da0cc37b9bab
I20260620 07:00:54.952149 873 tablet_service.cc:1514] Processing DeleteTablet for tablet ca8f81380ffc4b5c9c55469dc9b726b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:54.952337 419 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 5b636eacb2414c64b609056ba1e6d98f
I20260620 07:00:54.952556 872 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:54.952824 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:54.955732 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet ca8f81380ffc4b5c9c55469dc9b726b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:54.956334 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:54.955653 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:54.965502 731 tablet_service.cc:1514] Processing DeleteTablet for tablet ca8f81380ffc4b5c9c55469dc9b726b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:54.967270 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:54.967864 730 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:54.969398 733 tablet_service.cc:1467] Processing CreateTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c (DEFAULT_TABLE table=default.Table_258536942d834dd1a9368c4d31c92785 [id=5c38d983b35e40809c5298cf96fb58f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.969352 734 tablet_service.cc:1467] Processing CreateTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab (DEFAULT_TABLE table=default.Table_770fed048dfe48919062ea2b1eb2bfc9 [id=f2ca1f9c9e3244ddb7629af8a5af2793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.971310 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37f131000b084e8f9bdeb32de31e7d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.972815 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6e6c6f7d5094fb09d84da0cc37b9bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.983673 874 tablet_service.cc:1467] Processing CreateTablet for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (DEFAULT_TABLE table=default.Table_2c9bafc30b0d425abfb4060a59e6eccc [id=a53fbb10c3c84cb698f8973d0e23bce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.983912 872 tablet_service.cc:1467] Processing CreateTablet for tablet 69453d2d22224925a4aaedb53a43d2d7 (DEFAULT_TABLE table=default.Table_d510df80b7bd4ff9a13c38d83044ece5 [id=b2dba1a50b6d4e09914512ed5809870b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.984265 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.984649 871 tablet_service.cc:1467] Processing CreateTablet for tablet f8791a8dd68b4c1a8fe8d877f246d6ca (DEFAULT_TABLE table=default.Table_4921e4d884bb4c26a886078eecef48d7 [id=ceeb98c4fe424431b5e7cb258fe9800c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.984753 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (DEFAULT_TABLE table=default.Table_2c9bafc30b0d425abfb4060a59e6eccc [id=a53fbb10c3c84cb698f8973d0e23bce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.984948 870 tablet_service.cc:1467] Processing CreateTablet for tablet 96c21823c59d475ca0949de3dc972df1 (DEFAULT_TABLE table=default.Table_b10bef5fd1a44505a1607590eaa1f382 [id=21226cda9fcd401c9739960d9154d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.985154 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8791a8dd68b4c1a8fe8d877f246d6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.985224 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.985417 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96c21823c59d475ca0949de3dc972df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.986045 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 69453d2d22224925a4aaedb53a43d2d7 (DEFAULT_TABLE table=default.Table_d510df80b7bd4ff9a13c38d83044ece5 [id=b2dba1a50b6d4e09914512ed5809870b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.986496 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69453d2d22224925a4aaedb53a43d2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.987015 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69453d2d22224925a4aaedb53a43d2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.987103 1009 tablet_service.cc:1467] Processing CreateTablet for tablet f8791a8dd68b4c1a8fe8d877f246d6ca (DEFAULT_TABLE table=default.Table_4921e4d884bb4c26a886078eecef48d7 [id=ceeb98c4fe424431b5e7cb258fe9800c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.987571 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8791a8dd68b4c1a8fe8d877f246d6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.992616 422 master_service.cc:946] ReplaceTablet: received request to replace tablet e6e6c6f7d5094fb09d84da0cc37b9bab from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:54.992677 732 tablet_service.cc:1467] Processing CreateTablet for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (DEFAULT_TABLE table=default.Table_2c9bafc30b0d425abfb4060a59e6eccc [id=a53fbb10c3c84cb698f8973d0e23bce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.993176 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.993278 419 master_service.cc:946] ReplaceTablet: received request to replace tablet e6e6c6f7d5094fb09d84da0cc37b9bab from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:54.994392 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 37f131000b084e8f9bdeb32de31e7d9c from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:54.994874 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 37f131000b084e8f9bdeb32de31e7d9c from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:54.995504 427 master_service.cc:946] ReplaceTablet: received request to replace tablet e6e6c6f7d5094fb09d84da0cc37b9bab from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:54.996272 730 tablet_service.cc:1467] Processing CreateTablet for tablet 69453d2d22224925a4aaedb53a43d2d7 (DEFAULT_TABLE table=default.Table_d510df80b7bd4ff9a13c38d83044ece5 [id=b2dba1a50b6d4e09914512ed5809870b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.996737 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69453d2d22224925a4aaedb53a43d2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:54.999208 729 tablet_service.cc:1467] Processing CreateTablet for tablet f8791a8dd68b4c1a8fe8d877f246d6ca (DEFAULT_TABLE table=default.Table_4921e4d884bb4c26a886078eecef48d7 [id=ceeb98c4fe424431b5e7cb258fe9800c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:54.999678 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8791a8dd68b4c1a8fe8d877f246d6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.002190 876 tablet_service.cc:1467] Processing CreateTablet for tablet 9bd966fa009d44bf94bcd865f6231f78 (DEFAULT_TABLE table=default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47 [id=c8fb3e499488487d8d0d5b5a9f0b9eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.002686 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bd966fa009d44bf94bcd865f6231f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.003238 728 tablet_service.cc:1467] Processing CreateTablet for tablet 96c21823c59d475ca0949de3dc972df1 (DEFAULT_TABLE table=default.Table_b10bef5fd1a44505a1607590eaa1f382 [id=21226cda9fcd401c9739960d9154d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.003773 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96c21823c59d475ca0949de3dc972df1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:55.008097 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ca8f81380ffc4b5c9c55469dc9b726b9 because the tablet was not found. No further retry: Not found: Tablet not found: ca8f81380ffc4b5c9c55469dc9b726b9
W20260620 07:00:55.008934 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet e6e6c6f7d5094fb09d84da0cc37b9bab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6e6c6f7d5094fb09d84da0cc37b9bab already in progress: creating tablet
W20260620 07:00:55.009660 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 37f131000b084e8f9bdeb32de31e7d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37f131000b084e8f9bdeb32de31e7d9c already in progress: creating tablet
W20260620 07:00:55.010512 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ca8f81380ffc4b5c9c55469dc9b726b9 because the tablet was not found. No further retry: Not found: Tablet not found: ca8f81380ffc4b5c9c55469dc9b726b9
W20260620 07:00:55.013441 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ca8f81380ffc4b5c9c55469dc9b726b9 because the tablet was not found. No further retry: Not found: Tablet not found: ca8f81380ffc4b5c9c55469dc9b726b9
W20260620 07:00:55.013944 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet e6e6c6f7d5094fb09d84da0cc37b9bab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6e6c6f7d5094fb09d84da0cc37b9bab already in progress: creating tablet
W20260620 07:00:55.014230 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 37f131000b084e8f9bdeb32de31e7d9c because the tablet was not found. No further retry: Not found: Tablet not found: 37f131000b084e8f9bdeb32de31e7d9c
I20260620 07:00:55.014549 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 6f1b6177bfb245dc83a36e181ecc73b9 (DEFAULT_TABLE table=default.Table_d984bbf6a33e4099b8809ddbcac68b00 [id=b9309b34f61c4ab49b30b941c1c3a271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.015125 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f1b6177bfb245dc83a36e181ecc73b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.015177 727 tablet_service.cc:1467] Processing CreateTablet for tablet 6f1b6177bfb245dc83a36e181ecc73b9 (DEFAULT_TABLE table=default.Table_d984bbf6a33e4099b8809ddbcac68b00 [id=b9309b34f61c4ab49b30b941c1c3a271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.015712 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f1b6177bfb245dc83a36e181ecc73b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.022365 874 tablet_service.cc:1467] Processing CreateTablet for tablet 6f1b6177bfb245dc83a36e181ecc73b9 (DEFAULT_TABLE table=default.Table_d984bbf6a33e4099b8809ddbcac68b00 [id=b9309b34f61c4ab49b30b941c1c3a271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.022980 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f1b6177bfb245dc83a36e181ecc73b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.024073 1168 tablet_bootstrap.cc:492] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:00:55.025345 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e6e6c6f7d5094fb09d84da0cc37b9bab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6e6c6f7d5094fb09d84da0cc37b9bab already in progress: creating tablet
W20260620 07:00:55.025956 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 37f131000b084e8f9bdeb32de31e7d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37f131000b084e8f9bdeb32de31e7d9c already in progress: creating tablet
I20260620 07:00:55.027139 731 tablet_service.cc:1467] Processing CreateTablet for tablet 9bd966fa009d44bf94bcd865f6231f78 (DEFAULT_TABLE table=default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47 [id=c8fb3e499488487d8d0d5b5a9f0b9eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.027616 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bd966fa009d44bf94bcd865f6231f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.033025 1167 tablet_bootstrap.cc:492] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.033929 1168 tablet_bootstrap.cc:654] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.035753 1170 tablet_bootstrap.cc:492] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:55.035789 1168 log.cc:824] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: Log is configured to *not* fsync() on all Append() calls
I20260620 07:00:55.037045 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 9bd966fa009d44bf94bcd865f6231f78 (DEFAULT_TABLE table=default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47 [id=c8fb3e499488487d8d0d5b5a9f0b9eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.039357 1168 tablet_bootstrap.cc:492] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.039719 1168 ts_tablet_manager.cc:1397] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.000s
I20260620 07:00:55.039752 1170 tablet_bootstrap.cc:654] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.040943 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bd966fa009d44bf94bcd865f6231f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.041062 1170 log.cc:824] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: Log is configured to *not* fsync() on all Append() calls
I20260620 07:00:55.041152 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 96c21823c59d475ca0949de3dc972df1 (DEFAULT_TABLE table=default.Table_b10bef5fd1a44505a1607590eaa1f382 [id=21226cda9fcd401c9739960d9154d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.042008 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96c21823c59d475ca0949de3dc972df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.042300 1167 tablet_bootstrap.cc:654] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.043700 1167 log.cc:824] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: Log is configured to *not* fsync() on all Append() calls
I20260620 07:00:55.052338 1168 raft_consensus.cc:348] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.052843 1168 raft_consensus.cc:374] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.052958 1168 raft_consensus.cc:729] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.053401 1167 tablet_bootstrap.cc:492] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.053699 1167 ts_tablet_manager.cc:1397] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.006s
I20260620 07:00:55.053668 1168 consensus_queue.cc:260] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.056790 1168 ts_tablet_manager.cc:1428] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.017s user 0.014s sys 0.000s
I20260620 07:00:55.058126 1168 tablet_bootstrap.cc:492] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.059475 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.059554 942 heartbeater.cc:503] Master 127.0.97.62:36007 was elected leader, sending a full tablet report...
I20260620 07:00:55.060446 1165 tablet_replica.cc:330] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.060843 1165 raft_consensus.cc:2229] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.060910 1168 tablet_bootstrap.cc:654] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.061271 1165 raft_consensus.cc:2258] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.063184 1165 ts_tablet_manager.cc:1905] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.065488 876 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.068411 1170 tablet_bootstrap.cc:492] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:55.068797 1170 ts_tablet_manager.cc:1397] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.004s
I20260620 07:00:55.069670 1165 ts_tablet_manager.cc:1918] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.069845 1165 log.cc:1196] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/37f131000b084e8f9bdeb32de31e7d9c
I20260620 07:00:55.070065 1168 tablet_bootstrap.cc:492] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.070211 1168 ts_tablet_manager.cc:1397] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260620 07:00:55.070322 1165 ts_tablet_manager.cc:1939] T 37f131000b084e8f9bdeb32de31e7d9c P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.071240 1168 raft_consensus.cc:348] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:00:55.071496 1168 raft_consensus.cc:374] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.071593 1168 raft_consensus.cc:729] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.072029 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 37f131000b084e8f9bdeb32de31e7d9c (table default.Table_258536942d834dd1a9368c4d31c92785 [id=5c38d983b35e40809c5298cf96fb58f8]) successfully deleted
W20260620 07:00:55.072379 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e6e6c6f7d5094fb09d84da0cc37b9bab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6e6c6f7d5094fb09d84da0cc37b9bab already in progress: creating tablet
I20260620 07:00:55.072718 1168 consensus_queue.cc:260] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:00:55.073267 1168 ts_tablet_manager.cc:1428] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:00:55.073442 1167 raft_consensus.cc:348] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.074553 1168 tablet_bootstrap.cc:492] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.073938 1167 raft_consensus.cc:374] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.075657 1167 raft_consensus.cc:729] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.076488 876 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.076550 1167 consensus_queue.cc:260] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.076794 1168 tablet_bootstrap.cc:654] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.079879 1165 tablet_replica.cc:330] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.080245 1165 raft_consensus.cc:2229] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.080536 1165 raft_consensus.cc:2258] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.080597 1170 raft_consensus.cc:348] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:00:55.081142 1170 raft_consensus.cc:374] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.081260 1170 raft_consensus.cc:729] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.081552 1165 ts_tablet_manager.cc:1905] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.081974 1168 tablet_bootstrap.cc:492] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.082144 1168 ts_tablet_manager.cc:1397] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260620 07:00:55.082062 1170 consensus_queue.cc:260] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:00:55.083236 1168 raft_consensus.cc:348] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.083580 1168 raft_consensus.cc:374] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.083711 1168 raft_consensus.cc:729] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.084080 1168 consensus_queue.cc:260] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.084820 1168 ts_tablet_manager.cc:1428] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:00:55.085204 1168 tablet_bootstrap.cc:492] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.087397 1168 tablet_bootstrap.cc:654] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.094445 1165 ts_tablet_manager.cc:1918] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:00:55.094514 944 tablet.cc:2369] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 07:00:55.094712 1165 log.cc:1196] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/e6e6c6f7d5094fb09d84da0cc37b9bab
I20260620 07:00:55.095125 1165 ts_tablet_manager.cc:1939] T e6e6c6f7d5094fb09d84da0cc37b9bab P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.096184 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet e6e6c6f7d5094fb09d84da0cc37b9bab (table default.Table_770fed048dfe48919062ea2b1eb2bfc9 [id=f2ca1f9c9e3244ddb7629af8a5af2793]) successfully deleted
I20260620 07:00:55.098280 1170 ts_tablet_manager.cc:1428] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.029s user 0.022s sys 0.004s
I20260620 07:00:55.099658 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_62b64e3064814fd98928a194b9bc93e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.099802 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6468c56c50d5452abb0d324b47afe044" } new_table_name: "default.Table_050efd464b134d498f2d90b04ead9a4b" modify_external_catalogs: true
I20260620 07:00:55.100186 1168 tablet_bootstrap.cc:492] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
W20260620 07:00:55.100337 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62b64e3064814fd98928a194b9bc93e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.100384 1168 ts_tablet_manager.cc:1397] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.003s
I20260620 07:00:55.101488 1168 raft_consensus.cc:348] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.101847 1168 raft_consensus.cc:374] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.101994 1168 raft_consensus.cc:729] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.102360 1168 consensus_queue.cc:260] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.103470 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_70cd2b21da3a42e99c045dd88f19eb5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.104010 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70cd2b21da3a42e99c045dd88f19eb5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.104121 734 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.104427 1169 tablet_replica.cc:330] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:55.104449 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.104924 1169 raft_consensus.cc:2229] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.105252 1170 tablet_bootstrap.cc:492] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:55.105154 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8ed79bc911ed43f3946a5b263547ef46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.105361 1169 raft_consensus.cc:2258] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:55.105680 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ed79bc911ed43f3946a5b263547ef46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.105850 1168 ts_tablet_manager.cc:1428] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260620 07:00:55.106160 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 37f131000b084e8f9bdeb32de31e7d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37f131000b084e8f9bdeb32de31e7d9c already in progress: creating tablet
I20260620 07:00:55.106868 1170 tablet_bootstrap.cc:654] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.107059 1168 tablet_bootstrap.cc:492] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.107969 800 heartbeater.cc:503] Master 127.0.97.62:36007 was elected leader, sending a full tablet report...
I20260620 07:00:55.109031 1168 tablet_bootstrap.cc:654] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:55.117564 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd08d2c1cf62472eb6ca5421d5299ef8 consensus state has no leader
I20260620 07:00:55.123378 1169 ts_tablet_manager.cc:1905] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.125985 1167 ts_tablet_manager.cc:1428] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.072s user 0.016s sys 0.002s
I20260620 07:00:55.126418 1079 heartbeater.cc:503] Master 127.0.97.62:36007 was elected leader, sending a full tablet report...
I20260620 07:00:55.130304 1167 tablet_bootstrap.cc:492] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.132697 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.134128 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8e4f88d8836d4bb5b6f20564a8718ac5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.134876 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e4f88d8836d4bb5b6f20564a8718ac5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.136732 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5eac0783e8764131a00149ad28f756a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.136983 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_360d657828684b34847ea70d3e4e5f65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.137286 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5eac0783e8764131a00149ad28f756a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:55.137387 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_360d657828684b34847ea70d3e4e5f65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.138338 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0c5e7592b74d47cd8e103fc05680d1f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.139259 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_90a79f8cdc2a444ab5401e28a4bbb8c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.139729 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90a79f8cdc2a444ab5401e28a4bbb8c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:55.140056 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c5e7592b74d47cd8e103fc05680d1f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.142710 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_03432e4f372f45f7811fee73a4055330" } new_table_name: "default.Table_51c76473d8d04cb08ad1027b38f03024" modify_external_catalogs: true
I20260620 07:00:55.143028 1167 tablet_bootstrap.cc:654] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.148488 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4bf9e61e2cc14bc8bd728c894a49e779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.149041 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bf9e61e2cc14bc8bd728c894a49e779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.154021 1167 tablet_bootstrap.cc:492] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.154239 1167 ts_tablet_manager.cc:1397] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260620 07:00:55.155604 1167 raft_consensus.cc:348] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:00:55.156049 1167 raft_consensus.cc:374] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.156174 1167 raft_consensus.cc:729] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.156548 1167 consensus_queue.cc:260] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:00:55.160693 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2c9bafc30b0d425abfb4060a59e6eccc" } new_table_name: "default.Table_59ab9a5c124e45bfa2e1f020df7a756a" modify_external_catalogs: true
I20260620 07:00:55.160997 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_050efd464b134d498f2d90b04ead9a4b" } new_table_name: "default.Table_e720dace05aa4fafac0ab8675235cce3" modify_external_catalogs: true
I20260620 07:00:55.163630 1167 ts_tablet_manager.cc:1428] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260620 07:00:55.171972 1167 tablet_bootstrap.cc:492] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.173050 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b10bef5fd1a44505a1607590eaa1f382" } new_table_name: "default.Table_45bc9d5cae2547f38e9729f15afa1677" modify_external_catalogs: true
I20260620 07:00:55.174014 1167 tablet_bootstrap.cc:654] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.174865 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d984bbf6a33e4099b8809ddbcac68b00" } modify_external_catalogs: true
I20260620 07:00:55.175109 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d984bbf6a33e4099b8809ddbcac68b00" } modify_external_catalogs: true
I20260620 07:00:55.176003 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5b650174e77b47b4a6283f9b22fb701d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.176746 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b650174e77b47b4a6283f9b22fb701d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.178488 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47" } modify_external_catalogs: true
I20260620 07:00:55.178750 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47" } modify_external_catalogs: true
I20260620 07:00:55.179503 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d510df80b7bd4ff9a13c38d83044ece5" } modify_external_catalogs: true
I20260620 07:00:55.179771 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d510df80b7bd4ff9a13c38d83044ece5" } modify_external_catalogs: true
I20260620 07:00:55.184326 1169 ts_tablet_manager.cc:1918] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.186355 1169 log.cc:1196] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/e6e6c6f7d5094fb09d84da0cc37b9bab
I20260620 07:00:55.187034 1169 ts_tablet_manager.cc:1939] T e6e6c6f7d5094fb09d84da0cc37b9bab P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:55.189198 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet e6e6c6f7d5094fb09d84da0cc37b9bab (table default.Table_770fed048dfe48919062ea2b1eb2bfc9 [id=f2ca1f9c9e3244ddb7629af8a5af2793]) successfully deleted
I20260620 07:00:55.192262 1167 tablet_bootstrap.cc:492] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.192667 1167 ts_tablet_manager.cc:1397] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.000s
W20260620 07:00:55.192875 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f3c14821df43c5a2ab950ccaed0605 consensus state has no leader
W20260620 07:00:55.192940 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd08d2c1cf62472eb6ca5421d5299ef8 consensus state has no leader
I20260620 07:00:55.193257 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4921e4d884bb4c26a886078eecef48d7" } modify_external_catalogs: true
I20260620 07:00:55.193279 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_068af2ef8683477b897abe7821977669" } modify_external_catalogs: true
I20260620 07:00:55.193532 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4921e4d884bb4c26a886078eecef48d7" } modify_external_catalogs: true
I20260620 07:00:55.193553 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_068af2ef8683477b897abe7821977669" } modify_external_catalogs: true
I20260620 07:00:55.193681 1167 raft_consensus.cc:348] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.193992 1167 raft_consensus.cc:374] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.194077 1167 raft_consensus.cc:729] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.194411 1167 consensus_queue.cc:260] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.196686 876 tablet_service.cc:1467] Processing CreateTablet for tablet 14975b8743c14594ad2dcf82027e1658 (DEFAULT_TABLE table=default.Table_62b64e3064814fd98928a194b9bc93e2 [id=8395cc24724942e9b6eeefe1ae52f0db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.197149 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14975b8743c14594ad2dcf82027e1658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.199775 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 14975b8743c14594ad2dcf82027e1658 (DEFAULT_TABLE table=default.Table_62b64e3064814fd98928a194b9bc93e2 [id=8395cc24724942e9b6eeefe1ae52f0db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.200259 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14975b8743c14594ad2dcf82027e1658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.206420 734 tablet_service.cc:1467] Processing CreateTablet for tablet 14975b8743c14594ad2dcf82027e1658 (DEFAULT_TABLE table=default.Table_62b64e3064814fd98928a194b9bc93e2 [id=8395cc24724942e9b6eeefe1ae52f0db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.206912 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14975b8743c14594ad2dcf82027e1658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.210565 1167 ts_tablet_manager.cc:1428] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260620 07:00:55.211210 426 master_service.cc:946] ReplaceTablet: received request to replace tablet 96c21823c59d475ca0949de3dc972df1 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.214938 1167 tablet_bootstrap.cc:492] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.217931 1167 tablet_bootstrap.cc:654] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.219473 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 96c21823c59d475ca0949de3dc972df1 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.227090 1167 tablet_bootstrap.cc:492] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.227288 1167 ts_tablet_manager.cc:1397] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260620 07:00:55.228271 1167 raft_consensus.cc:348] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.228628 1167 raft_consensus.cc:374] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.228741 1167 raft_consensus.cc:729] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.229046 1167 consensus_queue.cc:260] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.231791 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 47a0058cdf2e421bae206981f81486b4
I20260620 07:00:55.232558 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 6f1b6177bfb245dc83a36e181ecc73b9 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.233495 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 47a0058cdf2e421bae206981f81486b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:55.234182 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 47a0058cdf2e421bae206981f81486b4 because the tablet was not found. No further retry: Not found: Tablet not found: 47a0058cdf2e421bae206981f81486b4
I20260620 07:00:55.234251 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 47a0058cdf2e421bae206981f81486b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:00:55.235005 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 47a0058cdf2e421bae206981f81486b4 because the tablet was not found. No further retry: Not found: Tablet not found: 47a0058cdf2e421bae206981f81486b4
I20260620 07:00:55.235765 1167 ts_tablet_manager.cc:1428] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
W20260620 07:00:55.237689 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96c21823c59d475ca0949de3dc972df1 consensus state has no leader
I20260620 07:00:55.237962 421 master_service.cc:946] ReplaceTablet: received request to replace tablet f8791a8dd68b4c1a8fe8d877f246d6ca from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.238483 421 master_service.cc:946] ReplaceTablet: received request to replace tablet 9bd966fa009d44bf94bcd865f6231f78 from {username='slave'} at 127.0.0.1:42866
W20260620 07:00:55.239002 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ab6d4ca89c4482d835eaad2a66bc8ed consensus state has no leader
I20260620 07:00:55.239326 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f8791a8dd68b4c1a8fe8d877f246d6ca
I20260620 07:00:55.239951 1167 tablet_bootstrap.cc:492] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.240195 874 tablet_service.cc:1514] Processing DeleteTablet for tablet f8791a8dd68b4c1a8fe8d877f246d6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:55.240788 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f8791a8dd68b4c1a8fe8d877f246d6ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8791a8dd68b4c1a8fe8d877f246d6ca already in progress: creating tablet
I20260620 07:00:55.241866 1167 tablet_bootstrap.cc:654] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.243544 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet f8791a8dd68b4c1a8fe8d877f246d6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:00:55.244412 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f8791a8dd68b4c1a8fe8d877f246d6ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8791a8dd68b4c1a8fe8d877f246d6ca already in progress: creating tablet
I20260620 07:00:55.245450 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 47a0058cdf2e421bae206981f81486b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.247187 731 tablet_service.cc:1514] Processing DeleteTablet for tablet f8791a8dd68b4c1a8fe8d877f246d6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:55.252108 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 37f131000b084e8f9bdeb32de31e7d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37f131000b084e8f9bdeb32de31e7d9c already in progress: creating tablet
W20260620 07:00:55.252741 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 47a0058cdf2e421bae206981f81486b4 because the tablet was not found. No further retry: Not found: Tablet not found: 47a0058cdf2e421bae206981f81486b4
I20260620 07:00:55.253266 1167 tablet_bootstrap.cc:492] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.253539 1167 ts_tablet_manager.cc:1397] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.007s
I20260620 07:00:55.254701 1167 raft_consensus.cc:348] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.255129 1167 raft_consensus.cc:374] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.255272 1167 raft_consensus.cc:729] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.255687 1167 consensus_queue.cc:260] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.256191 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 69453d2d22224925a4aaedb53a43d2d7
I20260620 07:00:55.256942 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9bd966fa009d44bf94bcd865f6231f78
I20260620 07:00:55.257081 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 69453d2d22224925a4aaedb53a43d2d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.257371 1165 tablet_replica.cc:330] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.257560 1165 raft_consensus.cc:2229] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.257766 1165 raft_consensus.cc:2258] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.257974 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bd966fa009d44bf94bcd865f6231f78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.258152 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bd966fa009d44bf94bcd865f6231f78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.258584 1165 ts_tablet_manager.cc:1905] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:00:55.258961 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9bd966fa009d44bf94bcd865f6231f78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd966fa009d44bf94bcd865f6231f78 already in progress: creating tablet
I20260620 07:00:55.259472 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6f1b6177bfb245dc83a36e181ecc73b9
I20260620 07:00:55.259994 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 69453d2d22224925a4aaedb53a43d2d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.260234 1166 tablet_replica.cc:330] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.260772 1166 raft_consensus.cc:2229] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.261085 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f1b6177bfb245dc83a36e181ecc73b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.261189 1166 raft_consensus.cc:2258] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.262940 1166 ts_tablet_manager.cc:1905] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.264580 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.264792 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e6c6f7d5094fb09d84da0cc37b9bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.264820 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet f8791a8dd68b4c1a8fe8d877f246d6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.265501 1165 ts_tablet_manager.cc:1918] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.265686 1165 log.cc:1196] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/69453d2d22224925a4aaedb53a43d2d7
I20260620 07:00:55.266139 1165 ts_tablet_manager.cc:1939] T 69453d2d22224925a4aaedb53a43d2d7 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.266409 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 96c21823c59d475ca0949de3dc972df1
I20260620 07:00:55.266978 426 catalog_manager.cc:6565] ReplaceTablet: tablet 96c21823c59d475ca0949de3dc972df1 deleted and replaced by tablet aaba6014285c4db4b8127d26df1e0625
I20260620 07:00:55.267808 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 69453d2d22224925a4aaedb53a43d2d7 (table default.Table_d510df80b7bd4ff9a13c38d83044ece5 [id=b2dba1a50b6d4e09914512ed5809870b]) successfully deleted
W20260620 07:00:55.268096 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9bd966fa009d44bf94bcd865f6231f78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd966fa009d44bf94bcd865f6231f78 already in progress: creating tablet
I20260620 07:00:55.268616 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 96c21823c59d475ca0949de3dc972df1 with delete_type TABLET_DATA_DELETED (replaced by tablet aaba6014285c4db4b8127d26df1e0625) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.268869 1165 tablet_replica.cc:330] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.269106 1165 raft_consensus.cc:2229] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.269315 1165 raft_consensus.cc:2258] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.269333 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 96c21823c59d475ca0949de3dc972df1 with delete_type TABLET_DATA_DELETED (replaced by tablet aaba6014285c4db4b8127d26df1e0625) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.270087 1165 ts_tablet_manager.cc:1905] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.270298 1166 ts_tablet_manager.cc:1918] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.270457 1166 log.cc:1196] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/69453d2d22224925a4aaedb53a43d2d7
I20260620 07:00:55.270952 1166 ts_tablet_manager.cc:1939] T 69453d2d22224925a4aaedb53a43d2d7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:55.272696 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 69453d2d22224925a4aaedb53a43d2d7 (table default.Table_d510df80b7bd4ff9a13c38d83044ece5 [id=b2dba1a50b6d4e09914512ed5809870b]) successfully deleted
I20260620 07:00:55.273203 1167 ts_tablet_manager.cc:1428] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260620 07:00:55.275363 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f1b6177bfb245dc83a36e181ecc73b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.276922 1167 tablet_bootstrap.cc:492] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.277577 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bd966fa009d44bf94bcd865f6231f78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.278563 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f1b6177bfb245dc83a36e181ecc73b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.278860 1167 tablet_bootstrap.cc:654] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.279512 1165 ts_tablet_manager.cc:1918] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.279927 1166 tablet_replica.cc:330] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.280148 1166 raft_consensus.cc:2229] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.280175 1165 log.cc:1196] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/96c21823c59d475ca0949de3dc972df1
I20260620 07:00:55.280339 1166 raft_consensus.cc:2258] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.281114 1166 ts_tablet_manager.cc:1905] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.281352 1165 ts_tablet_manager.cc:1939] T 96c21823c59d475ca0949de3dc972df1 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.281949 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 96c21823c59d475ca0949de3dc972df1 with delete_type TABLET_DATA_DELETED (replaced by tablet aaba6014285c4db4b8127d26df1e0625) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.282963 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 69453d2d22224925a4aaedb53a43d2d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.283000 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 96c21823c59d475ca0949de3dc972df1 (table default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]) successfully deleted
W20260620 07:00:55.283565 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f8791a8dd68b4c1a8fe8d877f246d6ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8791a8dd68b4c1a8fe8d877f246d6ca already in progress: creating tablet
W20260620 07:00:55.285653 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 9bd966fa009d44bf94bcd865f6231f78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd966fa009d44bf94bcd865f6231f78 already in progress: creating tablet
I20260620 07:00:55.286235 1167 tablet_bootstrap.cc:492] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:00:55.286247 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6f1b6177bfb245dc83a36e181ecc73b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f1b6177bfb245dc83a36e181ecc73b9 already in progress: creating tablet
I20260620 07:00:55.286371 1167 ts_tablet_manager.cc:1397] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
W20260620 07:00:55.286643 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6f1b6177bfb245dc83a36e181ecc73b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f1b6177bfb245dc83a36e181ecc73b9 already in progress: creating tablet
W20260620 07:00:55.286842 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 96c21823c59d475ca0949de3dc972df1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96c21823c59d475ca0949de3dc972df1 already in progress: creating tablet
I20260620 07:00:55.287390 1167 raft_consensus.cc:348] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.287704 1167 raft_consensus.cc:374] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.287818 1167 raft_consensus.cc:729] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.288139 1167 consensus_queue.cc:260] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.291712 1166 ts_tablet_manager.cc:1918] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.291648 876 tablet_service.cc:1467] Processing CreateTablet for tablet 2906fe0a195149d2844232cc8d83f6dd (DEFAULT_TABLE table=default.Table_90a79f8cdc2a444ab5401e28a4bbb8c3 [id=f12e60a2a8a341c8b574d0dc90fa315a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.292112 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2906fe0a195149d2844232cc8d83f6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.292455 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bd966fa009d44bf94bcd865f6231f78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.292900 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 2906fe0a195149d2844232cc8d83f6dd (DEFAULT_TABLE table=default.Table_90a79f8cdc2a444ab5401e28a4bbb8c3 [id=f12e60a2a8a341c8b574d0dc90fa315a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.295315 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2906fe0a195149d2844232cc8d83f6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.296121 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 3ecf5c1d0fa64004bc4a01e96147167e (DEFAULT_TABLE table=default.Table_5eac0783e8764131a00149ad28f756a8 [id=5c8493166f2448dea6f711457ba8c1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.296629 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ecf5c1d0fa64004bc4a01e96147167e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.294070 1167 ts_tablet_manager.cc:1428] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260620 07:00:55.306092 1167 tablet_bootstrap.cc:492] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.307279 874 tablet_service.cc:1467] Processing CreateTablet for tablet 3ecf5c1d0fa64004bc4a01e96147167e (DEFAULT_TABLE table=default.Table_5eac0783e8764131a00149ad28f756a8 [id=5c8493166f2448dea6f711457ba8c1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.307776 1167 tablet_bootstrap.cc:654] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.307809 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ecf5c1d0fa64004bc4a01e96147167e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.310527 1166 log.cc:1196] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/6f1b6177bfb245dc83a36e181ecc73b9
I20260620 07:00:55.310935 1166 ts_tablet_manager.cc:1939] T 6f1b6177bfb245dc83a36e181ecc73b9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:55.311978 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 6f1b6177bfb245dc83a36e181ecc73b9 (table default.Table_d984bbf6a33e4099b8809ddbcac68b00 [id=b9309b34f61c4ab49b30b941c1c3a271]) successfully deleted
I20260620 07:00:55.312404 1166 tablet_replica.cc:330] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.312634 1166 raft_consensus.cc:2229] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.312872 1166 raft_consensus.cc:2258] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.313130 1167 tablet_bootstrap.cc:492] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.313313 1167 ts_tablet_manager.cc:1397] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260620 07:00:55.313796 1166 ts_tablet_manager.cc:1905] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.314090 1167 raft_consensus.cc:348] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.314342 1167 raft_consensus.cc:374] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.314443 1167 raft_consensus.cc:729] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.314687 1167 consensus_queue.cc:260] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.315245 1167 ts_tablet_manager.cc:1428] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:00:55.315551 1167 tablet_bootstrap.cc:492] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.317149 1167 tablet_bootstrap.cc:654] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.317539 874 tablet_service.cc:1467] Processing CreateTablet for tablet 1accffd74f1a42b4bb2dc4f7110fddab (DEFAULT_TABLE table=default.Table_0c5e7592b74d47cd8e103fc05680d1f0 [id=d93e37b7b9b8436389982f544808fc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.317931 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1accffd74f1a42b4bb2dc4f7110fddab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.321637 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 1accffd74f1a42b4bb2dc4f7110fddab (DEFAULT_TABLE table=default.Table_0c5e7592b74d47cd8e103fc05680d1f0 [id=d93e37b7b9b8436389982f544808fc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.322098 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1accffd74f1a42b4bb2dc4f7110fddab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.324611 731 tablet_service.cc:1467] Processing CreateTablet for tablet 3ecf5c1d0fa64004bc4a01e96147167e (DEFAULT_TABLE table=default.Table_5eac0783e8764131a00149ad28f756a8 [id=5c8493166f2448dea6f711457ba8c1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.325094 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ecf5c1d0fa64004bc4a01e96147167e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.331631 732 tablet_service.cc:1467] Processing CreateTablet for tablet 1accffd74f1a42b4bb2dc4f7110fddab (DEFAULT_TABLE table=default.Table_0c5e7592b74d47cd8e103fc05680d1f0 [id=d93e37b7b9b8436389982f544808fc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.332156 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1accffd74f1a42b4bb2dc4f7110fddab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.338294 1166 ts_tablet_manager.cc:1918] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.338452 1166 log.cc:1196] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/37f131000b084e8f9bdeb32de31e7d9c
I20260620 07:00:55.338912 1166 ts_tablet_manager.cc:1939] T 37f131000b084e8f9bdeb32de31e7d9c P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:55.340101 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 37f131000b084e8f9bdeb32de31e7d9c (table default.Table_258536942d834dd1a9368c4d31c92785 [id=5c38d983b35e40809c5298cf96fb58f8]) successfully deleted
I20260620 07:00:55.341181 1167 tablet_bootstrap.cc:492] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.341364 1167 ts_tablet_manager.cc:1397] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.007s
I20260620 07:00:55.342684 1166 tablet_replica.cc:330] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.343077 1166 raft_consensus.cc:2229] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.343302 1166 raft_consensus.cc:2258] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.342374 1167 raft_consensus.cc:348] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.344194 1167 raft_consensus.cc:374] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.344306 1167 raft_consensus.cc:729] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.345067 1166 ts_tablet_manager.cc:1905] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.344977 734 tablet_service.cc:1467] Processing CreateTablet for tablet 2906fe0a195149d2844232cc8d83f6dd (DEFAULT_TABLE table=default.Table_90a79f8cdc2a444ab5401e28a4bbb8c3 [id=f12e60a2a8a341c8b574d0dc90fa315a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.345831 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2906fe0a195149d2844232cc8d83f6dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:55.347079 1081 tablet.cc:2369] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 07:00:55.348491 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (DEFAULT_TABLE table=default.Table_8ed79bc911ed43f3946a5b263547ef46 [id=2c07cdb2efd841a290e899541b97dcec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.349043 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a56f30ca69e45e3a9ddd41f117f61e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.349273 1167 consensus_queue.cc:260] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.354622 1167 ts_tablet_manager.cc:1428] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.013s user 0.002s sys 0.001s
I20260620 07:00:55.358716 1167 tablet_bootstrap.cc:492] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:00:55.360337 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 69453d2d22224925a4aaedb53a43d2d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69453d2d22224925a4aaedb53a43d2d7 already in progress: creating tablet
I20260620 07:00:55.360968 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_78806154ed5e4ad793503183c6f5c31c" } new_table_name: "default.Table_55fe5b5df2cf402f9ea60050d22be811" modify_external_catalogs: true
I20260620 07:00:55.362028 1167 tablet_bootstrap.cc:654] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.365072 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2f6560957a4c40c186a1ebb5e88f7123"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.365731 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f6560957a4c40c186a1ebb5e88f7123 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.368574 1166 ts_tablet_manager.cc:1918] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.368750 1166 log.cc:1196] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/e6e6c6f7d5094fb09d84da0cc37b9bab
I20260620 07:00:55.369177 1166 ts_tablet_manager.cc:1939] T e6e6c6f7d5094fb09d84da0cc37b9bab P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:55.369542 731 tablet_service.cc:1467] Processing CreateTablet for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (DEFAULT_TABLE table=default.Table_8ed79bc911ed43f3946a5b263547ef46 [id=2c07cdb2efd841a290e899541b97dcec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.370169 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a56f30ca69e45e3a9ddd41f117f61e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.370523 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet e6e6c6f7d5094fb09d84da0cc37b9bab (table default.Table_770fed048dfe48919062ea2b1eb2bfc9 [id=f2ca1f9c9e3244ddb7629af8a5af2793]) successfully deleted
I20260620 07:00:55.370977 1166 tablet_replica.cc:330] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.371791 1167 tablet_bootstrap.cc:492] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.371971 1167 ts_tablet_manager.cc:1397] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.003s
I20260620 07:00:55.372931 1167 raft_consensus.cc:348] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.373240 1167 raft_consensus.cc:374] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.373333 1167 raft_consensus.cc:729] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.373675 1167 consensus_queue.cc:260] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.378307 1167 ts_tablet_manager.cc:1428] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 07:00:55.382191 1167 tablet_bootstrap.cc:492] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.382951 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 654c6215d7634f8594cae155c436c175 (DEFAULT_TABLE table=default.Table_360d657828684b34847ea70d3e4e5f65 [id=b2c123464ea94601b142edcd222945ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.383554 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 654c6215d7634f8594cae155c436c175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.384647 1167 tablet_bootstrap.cc:654] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.385985 1166 raft_consensus.cc:2229] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.386255 1166 raft_consensus.cc:2258] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.387176 1166 ts_tablet_manager.cc:1905] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.388657 1167 tablet_bootstrap.cc:492] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.388834 1167 ts_tablet_manager.cc:1397] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260620 07:00:55.389978 1176 raft_consensus.cc:482] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:55.390297 1176 raft_consensus.cc:504] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.392472 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 52b0ef4797324c82832c11a1c98e2b42 (DEFAULT_TABLE table=default.Table_8e4f88d8836d4bb5b6f20564a8718ac5 [id=9fbfb3ec7f5348d3907734224702c69e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.393018 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52b0ef4797324c82832c11a1c98e2b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.397415 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (table default.Table_59ab9a5c124e45bfa2e1f020df7a756a [id=a53fbb10c3c84cb698f8973d0e23bce0]). Expected version 1 got 0
I20260620 07:00:55.399227 732 tablet_service.cc:1467] Processing CreateTablet for tablet 52b0ef4797324c82832c11a1c98e2b42 (DEFAULT_TABLE table=default.Table_8e4f88d8836d4bb5b6f20564a8718ac5 [id=9fbfb3ec7f5348d3907734224702c69e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.399715 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52b0ef4797324c82832c11a1c98e2b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.400134 1170 tablet_bootstrap.cc:492] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:55.400305 1170 ts_tablet_manager.cc:1397] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.295s user 0.086s sys 0.096s
I20260620 07:00:55.401371 1170 raft_consensus.cc:348] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.401639 1170 raft_consensus.cc:374] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.401752 1170 raft_consensus.cc:729] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.401996 1170 consensus_queue.cc:260] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.402258 729 tablet_service.cc:1467] Processing CreateTablet for tablet 654c6215d7634f8594cae155c436c175 (DEFAULT_TABLE table=default.Table_360d657828684b34847ea70d3e4e5f65 [id=b2c123464ea94601b142edcd222945ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.402614 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 654c6215d7634f8594cae155c436c175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.409819 875 tablet_service.cc:1467] Processing CreateTablet for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (DEFAULT_TABLE table=default.Table_8ed79bc911ed43f3946a5b263547ef46 [id=2c07cdb2efd841a290e899541b97dcec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.410457 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a56f30ca69e45e3a9ddd41f117f61e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.413995 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c7ad555de0774a6e9ecf9af82802275d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.414601 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7ad555de0774a6e9ecf9af82802275d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.415584 1170 ts_tablet_manager.cc:1428] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260620 07:00:55.416818 1170 tablet_bootstrap.cc:492] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:55.418540 1170 tablet_bootstrap.cc:654] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.418673 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_68cda40c45984d5facf4822b65e40a88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.419269 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68cda40c45984d5facf4822b65e40a88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.420712 1176 leader_election.cc:288] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:55.430903 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.431732 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.434124 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4u_93S/build/asan/bin/kudu
/tmp/dist-test-task4u_93S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:46775
--webserver_interface=127.0.97.60
--webserver_port=44063
--builtin_ntp_servers=127.0.97.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 07:00:55.436271 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c564f427e36645eaa41eb09a08173e96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.436930 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c564f427e36645eaa41eb09a08173e96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.437391 1166 ts_tablet_manager.cc:1918] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.437608 1166 log.cc:1196] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f8791a8dd68b4c1a8fe8d877f246d6ca
I20260620 07:00:55.438429 1166 ts_tablet_manager.cc:1939] T f8791a8dd68b4c1a8fe8d877f246d6ca P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:55.439250 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96c21823c59d475ca0949de3dc972df1" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:55.439819 1166 tablet_replica.cc:330] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.440122 1166 raft_consensus.cc:2229] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.440346 1166 raft_consensus.cc:2258] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:55.440456 968 leader_election.cc:341] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:55.441443 1166 ts_tablet_manager.cc:1905] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.441517 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a6ac4ea0133b41fe849335f60dba516e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.442243 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6ac4ea0133b41fe849335f60dba516e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.445847 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0d16742deb1e45ee86c610022bd3e4b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.446448 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d16742deb1e45ee86c610022bd3e4b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.449483 1167 raft_consensus.cc:348] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.449893 1167 raft_consensus.cc:374] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.450021 1167 raft_consensus.cc:729] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.449810 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_11cde52aaf3944eeb72cef8645b01d6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.450479 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11cde52aaf3944eeb72cef8645b01d6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.452811 1167 consensus_queue.cc:260] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.453771 873 tablet_service.cc:1467] Processing CreateTablet for tablet 52b0ef4797324c82832c11a1c98e2b42 (DEFAULT_TABLE table=default.Table_8e4f88d8836d4bb5b6f20564a8718ac5 [id=9fbfb3ec7f5348d3907734224702c69e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.453948 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_51c76473d8d04cb08ad1027b38f03024" } new_table_name: "default.Table_027da883eebd4e05b2f75373495c3d44" modify_external_catalogs: true
I20260620 07:00:55.454710 871 tablet_service.cc:1467] Processing CreateTablet for tablet 654c6215d7634f8594cae155c436c175 (DEFAULT_TABLE table=default.Table_360d657828684b34847ea70d3e4e5f65 [id=b2c123464ea94601b142edcd222945ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.456547 870 tablet_service.cc:1467] Processing CreateTablet for tablet d3b8e7056bd14418820032aa533be266 (DEFAULT_TABLE table=default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.459297 734 tablet_service.cc:1467] Processing CreateTablet for tablet d3b8e7056bd14418820032aa533be266 (DEFAULT_TABLE table=default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.459893 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3b8e7056bd14418820032aa533be266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.462441 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52b0ef4797324c82832c11a1c98e2b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.463702 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3b8e7056bd14418820032aa533be266. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:55.465359 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20941e688226436f8b83c84d4b871c7d consensus state has no leader
I20260620 07:00:55.469734 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 654c6215d7634f8594cae155c436c175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.495316 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5eac0783e8764131a00149ad28f756a8" } new_table_name: "default.Table_1502cae21371444ca45ba8693a352a84" modify_external_catalogs: true
I20260620 07:00:55.496100 868 tablet_service.cc:1467] Processing CreateTablet for tablet aaba6014285c4db4b8127d26df1e0625 (DEFAULT_TABLE table=default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:55.496549 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f3c14821df43c5a2ab950ccaed0605 consensus state has no leader
I20260620 07:00:55.496714 872 tablet_service.cc:1467] Processing CreateTablet for tablet 88635d3b7d83435f8fc8e89dc8de173b (DEFAULT_TABLE table=default.Table_4bf9e61e2cc14bc8bd728c894a49e779 [id=f28fed67d2244a1694c6688535cc5213]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.496963 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_95788477aff144d39aaeac52cbc127a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.497444 869 tablet_service.cc:1467] Processing CreateTablet for tablet 156b65f0b108434aba73e11b9785034b (DEFAULT_TABLE table=default.Table_5b650174e77b47b4a6283f9b22fb701d [id=b9587405857f4c8fbfcd41538fd20960]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:55.497557 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95788477aff144d39aaeac52cbc127a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.498346 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f7c2c9f418cd448a8905994508501609"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.499161 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5b650174e77b47b4a6283f9b22fb701d" } modify_external_catalogs: true
I20260620 07:00:55.499346 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5b650174e77b47b4a6283f9b22fb701d" } modify_external_catalogs: true
I20260620 07:00:55.500208 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8ed79bc911ed43f3946a5b263547ef46" } new_table_name: "default.Table_04030fe8e5944650b8eb6f7dd65772a8" modify_external_catalogs: true
W20260620 07:00:55.501174 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7c2c9f418cd448a8905994508501609 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.501713 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0c5e7592b74d47cd8e103fc05680d1f0" } modify_external_catalogs: true
I20260620 07:00:55.501911 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0c5e7592b74d47cd8e103fc05680d1f0" } modify_external_catalogs: true
I20260620 07:00:55.496795 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaba6014285c4db4b8127d26df1e0625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.502696 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4bf9e61e2cc14bc8bd728c894a49e779" } new_table_name: "default.Table_b623e145e58e4cb9b1d75359c4d1cf8e" modify_external_catalogs: true
I20260620 07:00:55.504750 1168 tablet_bootstrap.cc:492] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.504936 1168 ts_tablet_manager.cc:1397] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.398s user 0.128s sys 0.201s
I20260620 07:00:55.505517 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 14975b8743c14594ad2dcf82027e1658 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.506057 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88635d3b7d83435f8fc8e89dc8de173b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.509284 1167 ts_tablet_manager.cc:1428] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.120s user 0.003s sys 0.000s
I20260620 07:00:55.509622 1167 tablet_bootstrap.cc:492] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.510938 731 tablet_service.cc:1467] Processing CreateTablet for tablet 156b65f0b108434aba73e11b9785034b (DEFAULT_TABLE table=default.Table_5b650174e77b47b4a6283f9b22fb701d [id=b9587405857f4c8fbfcd41538fd20960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.511585 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 156b65f0b108434aba73e11b9785034b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.511499 729 tablet_service.cc:1467] Processing CreateTablet for tablet aaba6014285c4db4b8127d26df1e0625 (DEFAULT_TABLE table=default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.511904 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaba6014285c4db4b8127d26df1e0625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.515275 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 156b65f0b108434aba73e11b9785034b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.517621 1167 tablet_bootstrap.cc:654] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:55.523578 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ecf5c1d0fa64004bc4a01e96147167e consensus state has no leader
I20260620 07:00:55.523545 1013 tablet_service.cc:1467] Processing CreateTablet for tablet d3b8e7056bd14418820032aa533be266 (DEFAULT_TABLE table=default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.523990 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3b8e7056bd14418820032aa533be266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.524062 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_62b64e3064814fd98928a194b9bc93e2" } modify_external_catalogs: true
I20260620 07:00:55.524338 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_62b64e3064814fd98928a194b9bc93e2" } modify_external_catalogs: true
I20260620 07:00:55.525732 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e720dace05aa4fafac0ab8675235cce3" } modify_external_catalogs: true
I20260620 07:00:55.525961 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e720dace05aa4fafac0ab8675235cce3" } modify_external_catalogs: true
I20260620 07:00:55.527500 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 88635d3b7d83435f8fc8e89dc8de173b (DEFAULT_TABLE table=default.Table_4bf9e61e2cc14bc8bd728c894a49e779 [id=f28fed67d2244a1694c6688535cc5213]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.527561 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 156b65f0b108434aba73e11b9785034b (DEFAULT_TABLE table=default.Table_5b650174e77b47b4a6283f9b22fb701d [id=b9587405857f4c8fbfcd41538fd20960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.528211 1010 tablet_service.cc:1467] Processing CreateTablet for tablet aaba6014285c4db4b8127d26df1e0625 (DEFAULT_TABLE table=default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.528738 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88635d3b7d83435f8fc8e89dc8de173b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.529726 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaba6014285c4db4b8127d26df1e0625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.531059 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 156b65f0b108434aba73e11b9785034b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.534013 1166 ts_tablet_manager.cc:1918] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.534168 1166 log.cc:1196] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/96c21823c59d475ca0949de3dc972df1
I20260620 07:00:55.534559 1166 ts_tablet_manager.cc:1939] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:00:55.536950 969 leader_election.cc:341] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 96c21823c59d475ca0949de3dc972df1
I20260620 07:00:55.537185 969 leader_election.cc:302] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:00:55.537670 969 raft_consensus.cc:2670] T 96c21823c59d475ca0949de3dc972df1 P 06a32ef63b2b495a9ade1de48c024ae9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:00:55.541993 1167 tablet_bootstrap.cc:492] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.542201 1167 ts_tablet_manager.cc:1397] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.001s
I20260620 07:00:55.542479 1170 tablet_bootstrap.cc:492] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:55.542685 1170 ts_tablet_manager.cc:1397] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.126s user 0.038s sys 0.017s
I20260620 07:00:55.543184 1167 raft_consensus.cc:348] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.543565 1167 raft_consensus.cc:374] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.543700 1167 raft_consensus.cc:729] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.543843 1170 raft_consensus.cc:348] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.544185 1170 raft_consensus.cc:374] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.544027 1167 consensus_queue.cc:260] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.544278 1170 raft_consensus.cc:729] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.544801 1167 ts_tablet_manager.cc:1428] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:00:55.545228 1167 tablet_bootstrap.cc:492] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.548658 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (table default.Table_59ab9a5c124e45bfa2e1f020df7a756a [id=a53fbb10c3c84cb698f8973d0e23bce0]). Expected version 1 got 0
I20260620 07:00:55.549438 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_55fe5b5df2cf402f9ea60050d22be811" } modify_external_catalogs: true
I20260620 07:00:55.549643 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_55fe5b5df2cf402f9ea60050d22be811" } modify_external_catalogs: true
I20260620 07:00:55.551452 1167 tablet_bootstrap.cc:654] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.551894 872 tablet_service.cc:1467] Processing CreateTablet for tablet 329b18cc9b544cddbf0564d7de8a5c36 (DEFAULT_TABLE table=default.Table_2f6560957a4c40c186a1ebb5e88f7123 [id=a7b18d380f2a4a1b86f4c767c6a93221]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.552336 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 329b18cc9b544cddbf0564d7de8a5c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.553387 729 tablet_service.cc:1467] Processing CreateTablet for tablet 329b18cc9b544cddbf0564d7de8a5c36 (DEFAULT_TABLE table=default.Table_2f6560957a4c40c186a1ebb5e88f7123 [id=a7b18d380f2a4a1b86f4c767c6a93221]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.553661 1170 consensus_queue.cc:260] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.550861 732 tablet_service.cc:1467] Processing CreateTablet for tablet 88635d3b7d83435f8fc8e89dc8de173b (DEFAULT_TABLE table=default.Table_4bf9e61e2cc14bc8bd728c894a49e779 [id=f28fed67d2244a1694c6688535cc5213]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:55.555078 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a56f30ca69e45e3a9ddd41f117f61e2 consensus state has no leader
I20260620 07:00:55.555963 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 3ecf5c1d0fa64004bc4a01e96147167e from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.556753 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 329b18cc9b544cddbf0564d7de8a5c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.557185 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88635d3b7d83435f8fc8e89dc8de173b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.557381 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 3ecf5c1d0fa64004bc4a01e96147167e from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.557525 1170 ts_tablet_manager.cc:1428] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
W20260620 07:00:55.558928 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88635d3b7d83435f8fc8e89dc8de173b consensus state has no leader
I20260620 07:00:55.559091 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fd08d2c1cf62472eb6ca5421d5299ef8
I20260620 07:00:55.559219 421 master_service.cc:946] ReplaceTablet: received request to replace tablet f8791a8dd68b4c1a8fe8d877f246d6ca from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.559700 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 14975b8743c14594ad2dcf82027e1658 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.559996 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 156b65f0b108434aba73e11b9785034b
I20260620 07:00:55.560592 1170 tablet_bootstrap.cc:492] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:55.562109 1168 raft_consensus.cc:348] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.562506 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1accffd74f1a42b4bb2dc4f7110fddab
I20260620 07:00:55.563273 1168 raft_consensus.cc:374] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.563373 1168 raft_consensus.cc:729] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.564328 1168 consensus_queue.cc:260] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.565951 1176 raft_consensus.cc:482] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:55.566365 734 tablet_service.cc:1514] Processing DeleteTablet for tablet fd08d2c1cf62472eb6ca5421d5299ef8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.567417 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 156b65f0b108434aba73e11b9785034b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.567683 1176 raft_consensus.cc:504] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.568395 1176 leader_election.cc:288] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:55.568429 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 1accffd74f1a42b4bb2dc4f7110fddab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.570115 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ecf5c1d0fa64004bc4a01e96147167e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:55.570869 968 leader_election.cc:341] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:00:55.571954 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet fd08d2c1cf62472eb6ca5421d5299ef8 because the tablet was not found. No further retry: Not found: Tablet not found: fd08d2c1cf62472eb6ca5421d5299ef8
W20260620 07:00:55.572306 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 156b65f0b108434aba73e11b9785034b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 156b65f0b108434aba73e11b9785034b already in progress: creating tablet
W20260620 07:00:55.572535 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1accffd74f1a42b4bb2dc4f7110fddab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1accffd74f1a42b4bb2dc4f7110fddab already in progress: creating tablet
I20260620 07:00:55.572088 1170 tablet_bootstrap.cc:654] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.573719 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (table default.Table_59ab9a5c124e45bfa2e1f020df7a756a [id=a53fbb10c3c84cb698f8973d0e23bce0]). Expected version 1 got 0
I20260620 07:00:55.574414 871 tablet_service.cc:1514] Processing DeleteTablet for tablet fd08d2c1cf62472eb6ca5421d5299ef8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.576354 871 tablet_service.cc:1514] Processing DeleteTablet for tablet 156b65f0b108434aba73e11b9785034b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.576413 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 20941e688226436f8b83c84d4b871c7d
I20260620 07:00:55.577283 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 96c21823c59d475ca0949de3dc972df1 with delete_type TABLET_DATA_DELETED (replaced by tablet aaba6014285c4db4b8127d26df1e0625) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.577526 1169 tablet_replica.cc:330] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:55.577652 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 329b18cc9b544cddbf0564d7de8a5c36 (DEFAULT_TABLE table=default.Table_2f6560957a4c40c186a1ebb5e88f7123 [id=a7b18d380f2a4a1b86f4c767c6a93221]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.577729 1169 raft_consensus.cc:2229] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.577877 1169 raft_consensus.cc:2258] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.578056 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 329b18cc9b544cddbf0564d7de8a5c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.578621 1169 ts_tablet_manager.cc:1905] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.579262 1176 raft_consensus.cc:482] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:55.579432 1176 raft_consensus.cc:504] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.580243 1176 leader_election.cc:288] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:55.580657 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd966fa009d44bf94bcd865f6231f78" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:55.581355 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 1accffd74f1a42b4bb2dc4f7110fddab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:55.581368 968 leader_election.cc:341] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:55.582638 1168 ts_tablet_manager.cc:1428] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.078s user 0.001s sys 0.002s
I20260620 07:00:55.583041 1168 tablet_bootstrap.cc:492] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.584945 1168 tablet_bootstrap.cc:654] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.584950 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet fd08d2c1cf62472eb6ca5421d5299ef8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.585512 1169 ts_tablet_manager.cc:1918] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.585685 1169 log.cc:1196] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/96c21823c59d475ca0949de3dc972df1
I20260620 07:00:55.586030 1169 ts_tablet_manager.cc:1939] T 96c21823c59d475ca0949de3dc972df1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:55.586056 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 20941e688226436f8b83c84d4b871c7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.586102 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 156b65f0b108434aba73e11b9785034b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.586306 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 1accffd74f1a42b4bb2dc4f7110fddab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.586558 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f8791a8dd68b4c1a8fe8d877f246d6ca (table default.Table_4921e4d884bb4c26a886078eecef48d7 [id=ceeb98c4fe424431b5e7cb258fe9800c]) successfully deleted
I20260620 07:00:55.587232 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 96c21823c59d475ca0949de3dc972df1 (table default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]) successfully deleted
I20260620 07:00:55.588976 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (table default.Table_59ab9a5c124e45bfa2e1f020df7a756a [id=a53fbb10c3c84cb698f8973d0e23bce0]). Expected version 1 got 0
I20260620 07:00:55.576138 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ecf5c1d0fa64004bc4a01e96147167e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:00:55.590832 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fd08d2c1cf62472eb6ca5421d5299ef8 because the tablet was not found. No further retry: Not found: Tablet not found: fd08d2c1cf62472eb6ca5421d5299ef8
W20260620 07:00:55.591076 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 156b65f0b108434aba73e11b9785034b because the tablet was not found. No further retry: Not found: Tablet not found: 156b65f0b108434aba73e11b9785034b
I20260620 07:00:55.591303 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3ecf5c1d0fa64004bc4a01e96147167e
W20260620 07:00:55.591396 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1accffd74f1a42b4bb2dc4f7110fddab because the tablet was not found. No further retry: Not found: Tablet not found: 1accffd74f1a42b4bb2dc4f7110fddab
I20260620 07:00:55.591673 422 catalog_manager.cc:6565] ReplaceTablet: tablet 3ecf5c1d0fa64004bc4a01e96147167e deleted and replaced by tablet 33517843ce1d4d8786c91fd738d81ab2
I20260620 07:00:55.592913 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ecf5c1d0fa64004bc4a01e96147167e with delete_type TABLET_DATA_DELETED (replaced by tablet 33517843ce1d4d8786c91fd738d81ab2) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.581728 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd966fa009d44bf94bcd865f6231f78" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:00:55.594527 969 leader_election.cc:341] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:55.594714 969 leader_election.cc:302] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:00:55.595185 969 leader_election.cc:341] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:55.595315 969 leader_election.cc:302] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:00:55.595855 802 tablet.cc:2369] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 07:00:55.596406 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 96c21823c59d475ca0949de3dc972df1 (table default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]) successfully deleted
W20260620 07:00:55.596644 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3ecf5c1d0fa64004bc4a01e96147167e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ecf5c1d0fa64004bc4a01e96147167e already in progress: creating tablet
I20260620 07:00:55.597306 1176 raft_consensus.cc:2726] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:55.597584 1176 raft_consensus.cc:2726] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:55.598975 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 20941e688226436f8b83c84d4b871c7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.599309 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 20941e688226436f8b83c84d4b871c7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:55.599642 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 20941e688226436f8b83c84d4b871c7d because the tablet was not found. No further retry: Not found: Tablet not found: 20941e688226436f8b83c84d4b871c7d
W20260620 07:00:55.599902 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 20941e688226436f8b83c84d4b871c7d because the tablet was not found. No further retry: Not found: Tablet not found: 20941e688226436f8b83c84d4b871c7d
I20260620 07:00:55.600536 1167 tablet_bootstrap.cc:492] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.600751 1167 ts_tablet_manager.cc:1397] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260620 07:00:55.601517 1170 tablet_bootstrap.cc:492] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:55.601724 1170 ts_tablet_manager.cc:1397] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.003s
I20260620 07:00:55.601887 1167 raft_consensus.cc:348] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.602344 1167 raft_consensus.cc:374] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.602480 1167 raft_consensus.cc:729] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.602706 1170 raft_consensus.cc:348] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.602730 1167 consensus_queue.cc:260] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.603052 1170 raft_consensus.cc:374] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.603170 1170 raft_consensus.cc:729] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.603431 1170 consensus_queue.cc:260] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.605193 1166 tablet_replica.cc:330] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.605386 1166 raft_consensus.cc:2229] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.605592 1166 raft_consensus.cc:2258] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.607080 1167 ts_tablet_manager.cc:1428] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260620 07:00:55.607671 1170 ts_tablet_manager.cc:1428] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260620 07:00:55.609474 1167 tablet_bootstrap.cc:492] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.609474 1166 ts_tablet_manager.cc:1905] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.611474 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 37f131000b084e8f9bdeb32de31e7d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:54 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.611779 1169 tablet_replica.cc:330] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:55.611953 1169 raft_consensus.cc:2229] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.612162 1169 raft_consensus.cc:2258] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.612913 1170 tablet_bootstrap.cc:492] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:55.613258 1168 tablet_bootstrap.cc:492] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.613440 1168 ts_tablet_manager.cc:1397] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.004s
I20260620 07:00:55.614246 1168 raft_consensus.cc:348] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.614482 1168 raft_consensus.cc:374] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.614565 1167 tablet_bootstrap.cc:654] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.614588 1168 raft_consensus.cc:729] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.614856 1168 consensus_queue.cc:260] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.615253 1169 ts_tablet_manager.cc:1905] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.615427 1168 ts_tablet_manager.cc:1428] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:00:55.615711 1168 tablet_bootstrap.cc:492] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.617352 1168 tablet_bootstrap.cc:654] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.621397 1170 tablet_bootstrap.cc:654] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.624640 876 tablet_service.cc:1514] Processing DeleteTablet for tablet f8791a8dd68b4c1a8fe8d877f246d6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.625046 1165 tablet_replica.cc:330] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.625290 1165 raft_consensus.cc:2229] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.625547 1165 raft_consensus.cc:2258] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.626214 868 tablet_service.cc:1467] Processing CreateTablet for tablet c79a42afd7aa42d38e0fb673aebb3ed4 (DEFAULT_TABLE table=default.Table_a6ac4ea0133b41fe849335f60dba516e [id=55a13c7617e345339dde6677b11008be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.626449 1165 ts_tablet_manager.cc:1905] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.627170 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ecf5c1d0fa64004bc4a01e96147167e with delete_type TABLET_DATA_DELETED (replaced by tablet 33517843ce1d4d8786c91fd738d81ab2) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.628931 1169 ts_tablet_manager.cc:1918] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.629058 1169 log.cc:1196] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/37f131000b084e8f9bdeb32de31e7d9c
I20260620 07:00:55.629407 1169 ts_tablet_manager.cc:1939] T 37f131000b084e8f9bdeb32de31e7d9c P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:55.630481 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c79a42afd7aa42d38e0fb673aebb3ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.633143 1165 ts_tablet_manager.cc:1918] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.633327 1165 log.cc:1196] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f8791a8dd68b4c1a8fe8d877f246d6ca
I20260620 07:00:55.633745 1165 ts_tablet_manager.cc:1939] T f8791a8dd68b4c1a8fe8d877f246d6ca P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.634965 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f8791a8dd68b4c1a8fe8d877f246d6ca (table default.Table_4921e4d884bb4c26a886078eecef48d7 [id=ceeb98c4fe424431b5e7cb258fe9800c]) successfully deleted
W20260620 07:00:55.635730 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3ecf5c1d0fa64004bc4a01e96147167e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ecf5c1d0fa64004bc4a01e96147167e already in progress: creating tablet
I20260620 07:00:55.636103 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 37f131000b084e8f9bdeb32de31e7d9c (table default.Table_258536942d834dd1a9368c4d31c92785 [id=5c38d983b35e40809c5298cf96fb58f8]) successfully deleted
I20260620 07:00:55.637751 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 14975b8743c14594ad2dcf82027e1658
I20260620 07:00:55.638774 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 14975b8743c14594ad2dcf82027e1658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.639557 872 tablet_service.cc:1467] Processing CreateTablet for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 (DEFAULT_TABLE table=default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9 [id=7b71c48967844bf59fbd632ce967b1dc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:55.639694 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 14975b8743c14594ad2dcf82027e1658 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14975b8743c14594ad2dcf82027e1658 already in progress: creating tablet
I20260620 07:00:55.639890 732 tablet_service.cc:1467] Processing CreateTablet for tablet c79a42afd7aa42d38e0fb673aebb3ed4 (DEFAULT_TABLE table=default.Table_a6ac4ea0133b41fe849335f60dba516e [id=55a13c7617e345339dde6677b11008be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.640010 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.640393 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c79a42afd7aa42d38e0fb673aebb3ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.641628 1167 tablet_bootstrap.cc:492] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.641814 1167 ts_tablet_manager.cc:1397] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.020s
I20260620 07:00:55.642302 1166 ts_tablet_manager.cc:1918] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.642459 1166 log.cc:1196] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/9bd966fa009d44bf94bcd865f6231f78
I20260620 07:00:55.642912 1166 ts_tablet_manager.cc:1939] T 9bd966fa009d44bf94bcd865f6231f78 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:55.643275 1167 raft_consensus.cc:348] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.643567 1167 raft_consensus.cc:374] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.643712 1167 raft_consensus.cc:729] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.644064 1166 tablet_replica.cc:330] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.643973 1167 consensus_queue.cc:260] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.644191 876 tablet_service.cc:1467] Processing CreateTablet for tablet 61f53616121e4a52835b8b7da1fa5372 (DEFAULT_TABLE table=default.Table_11cde52aaf3944eeb72cef8645b01d6a [id=425c83c87160456590a08a72244d2065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.644284 1166 raft_consensus.cc:2229] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.644585 1166 raft_consensus.cc:2258] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.644659 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61f53616121e4a52835b8b7da1fa5372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.647675 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 14975b8743c14594ad2dcf82027e1658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.649716 734 tablet_service.cc:1467] Processing CreateTablet for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 (DEFAULT_TABLE table=default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9 [id=7b71c48967844bf59fbd632ce967b1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.649816 1166 ts_tablet_manager.cc:1905] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.650102 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.651721 1167 ts_tablet_manager.cc:1428] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260620 07:00:55.654444 874 tablet_service.cc:1467] Processing CreateTablet for tablet 1d97c42bcac24188bbc322f9d4ef2600 (DEFAULT_TABLE table=default.Table_c564f427e36645eaa41eb09a08173e96 [id=bfd61df271fe448da18b4aae768f19e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.654947 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d97c42bcac24188bbc322f9d4ef2600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.655264 876 tablet_service.cc:1467] Processing CreateTablet for tablet ba3862ba4ebf410baebcc1246b08ddc9 (DEFAULT_TABLE table=default.Table_c7ad555de0774a6e9ecf9af82802275d [id=cfbc4dc349434379b3eaabd5dc948327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.655562 1167 tablet_bootstrap.cc:492] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.655619 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba3862ba4ebf410baebcc1246b08ddc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.657097 734 tablet_service.cc:1467] Processing CreateTablet for tablet 61f53616121e4a52835b8b7da1fa5372 (DEFAULT_TABLE table=default.Table_11cde52aaf3944eeb72cef8645b01d6a [id=425c83c87160456590a08a72244d2065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.657393 1167 tablet_bootstrap.cc:654] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.657470 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61f53616121e4a52835b8b7da1fa5372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.659209 873 tablet_service.cc:1467] Processing CreateTablet for tablet ba907170f2df4bd0b5e42d4c2d29b21e (DEFAULT_TABLE table=default.Table_68cda40c45984d5facf4822b65e40a88 [id=156f143b869542dbac1e92fd120f0f36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.659742 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba907170f2df4bd0b5e42d4c2d29b21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.661252 868 tablet_service.cc:1467] Processing CreateTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 (DEFAULT_TABLE table=default.Table_95788477aff144d39aaeac52cbc127a2 [id=31b071f3fa7547fb8a222ac6b8bffd6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.661603 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1a7ae0a9b04fca9da8f441958c3280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.663565 729 tablet_service.cc:1467] Processing CreateTablet for tablet ba3862ba4ebf410baebcc1246b08ddc9 (DEFAULT_TABLE table=default.Table_c7ad555de0774a6e9ecf9af82802275d [id=cfbc4dc349434379b3eaabd5dc948327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.663992 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba3862ba4ebf410baebcc1246b08ddc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.665578 1167 tablet_bootstrap.cc:492] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.665730 1167 ts_tablet_manager.cc:1397] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.005s
I20260620 07:00:55.666661 1167 raft_consensus.cc:348] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.666934 1167 raft_consensus.cc:374] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.667047 1167 raft_consensus.cc:729] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.667088 1170 tablet_bootstrap.cc:492] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:55.667253 1170 ts_tablet_manager.cc:1397] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.001s
I20260620 07:00:55.667354 1167 consensus_queue.cc:260] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.668123 1170 raft_consensus.cc:348] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.668357 1170 raft_consensus.cc:374] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.668444 1170 raft_consensus.cc:729] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.668722 1170 consensus_queue.cc:260] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.671366 1168 tablet_bootstrap.cc:492] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.671553 1168 ts_tablet_manager.cc:1397] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.004s
I20260620 07:00:55.672123 1167 ts_tablet_manager.cc:1428] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:00:55.672468 1168 raft_consensus.cc:348] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.673200 1170 ts_tablet_manager.cc:1428] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:00:55.675153 729 tablet_service.cc:1467] Processing CreateTablet for tablet 1d97c42bcac24188bbc322f9d4ef2600 (DEFAULT_TABLE table=default.Table_c564f427e36645eaa41eb09a08173e96 [id=bfd61df271fe448da18b4aae768f19e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.675397 1167 tablet_bootstrap.cc:492] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.675694 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d97c42bcac24188bbc322f9d4ef2600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.675782 1168 raft_consensus.cc:374] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.675918 1168 raft_consensus.cc:729] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.676206 1170 tablet_bootstrap.cc:492] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:55.676239 1168 consensus_queue.cc:260] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.677292 1167 tablet_bootstrap.cc:654] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.677955 1170 tablet_bootstrap.cc:654] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.680187 874 tablet_service.cc:1467] Processing CreateTablet for tablet 1f0a3c36ff864f0083383103effe0ee8 (DEFAULT_TABLE table=default.Table_0d16742deb1e45ee86c610022bd3e4b9 [id=3da7a85c122648408588dea7ebe1fa5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.680591 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f0a3c36ff864f0083383103effe0ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.681313 1168 ts_tablet_manager.cc:1428] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260620 07:00:55.681759 731 tablet_service.cc:1467] Processing CreateTablet for tablet ba907170f2df4bd0b5e42d4c2d29b21e (DEFAULT_TABLE table=default.Table_68cda40c45984d5facf4822b65e40a88 [id=156f143b869542dbac1e92fd120f0f36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.681768 727 tablet_service.cc:1467] Processing CreateTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 (DEFAULT_TABLE table=default.Table_95788477aff144d39aaeac52cbc127a2 [id=31b071f3fa7547fb8a222ac6b8bffd6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.682184 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba907170f2df4bd0b5e42d4c2d29b21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.682367 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1a7ae0a9b04fca9da8f441958c3280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.685149 1168 tablet_bootstrap.cc:492] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.687726 1168 tablet_bootstrap.cc:654] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.697372 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_360d657828684b34847ea70d3e4e5f65" } new_table_name: "default.Table_2d526dc5dfb440378c303bf409947c65" modify_external_catalogs: true
I20260620 07:00:55.697628 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f1b6177bfb245dc83a36e181ecc73b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.698006 1165 tablet_replica.cc:330] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.698314 1165 raft_consensus.cc:2229] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.698561 1165 raft_consensus.cc:2258] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.699476 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_28d4fe83bbd14c4a9421d93152913831"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.699779 1165 ts_tablet_manager.cc:1905] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:00:55.699849 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 14975b8743c14594ad2dcf82027e1658 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14975b8743c14594ad2dcf82027e1658 already in progress: creating tablet
W20260620 07:00:55.700078 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28d4fe83bbd14c4a9421d93152913831 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.704241 731 tablet_service.cc:1467] Processing CreateTablet for tablet 1f0a3c36ff864f0083383103effe0ee8 (DEFAULT_TABLE table=default.Table_0d16742deb1e45ee86c610022bd3e4b9 [id=3da7a85c122648408588dea7ebe1fa5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.704799 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f0a3c36ff864f0083383103effe0ee8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:55.705435 412 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.60:46775, user_credentials={real_user=slave}} blocked reactor thread for 117784us
I20260620 07:00:55.707084 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 69453d2d22224925a4aaedb53a43d2d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.709295 1169 tablet_replica.cc:330] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:55.710084 1165 ts_tablet_manager.cc:1918] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.711198 1165 log.cc:1196] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/6f1b6177bfb245dc83a36e181ecc73b9
I20260620 07:00:55.711930 1169 raft_consensus.cc:2229] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.712255 1169 raft_consensus.cc:2258] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:55.712314 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 117106us
I20260620 07:00:55.713110 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 9bd966fa009d44bf94bcd865f6231f78 (table default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47 [id=c8fb3e499488487d8d0d5b5a9f0b9eee]) successfully deleted
I20260620 07:00:55.713586 1169 ts_tablet_manager.cc:1905] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.713608 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_95788477aff144d39aaeac52cbc127a2" } new_table_name: "default.Table_61741807e243431395868ee24844d1aa" modify_external_catalogs: true
W20260620 07:00:55.713826 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fd08d2c1cf62472eb6ca5421d5299ef8 because the tablet was not found. No further retry: Not found: Tablet not found: fd08d2c1cf62472eb6ca5421d5299ef8
W20260620 07:00:55.714325 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 20941e688226436f8b83c84d4b871c7d because the tablet was not found. No further retry: Not found: Tablet not found: 20941e688226436f8b83c84d4b871c7d
W20260620 07:00:55.714773 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 156b65f0b108434aba73e11b9785034b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 156b65f0b108434aba73e11b9785034b already in progress: creating tablet
I20260620 07:00:55.715999 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 96c21823c59d475ca0949de3dc972df1 with delete_type TABLET_DATA_DELETED (replaced by tablet aaba6014285c4db4b8127d26df1e0625) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.716010 1013 tablet_service.cc:1467] Processing CreateTablet for tablet c79a42afd7aa42d38e0fb673aebb3ed4 (DEFAULT_TABLE table=default.Table_a6ac4ea0133b41fe849335f60dba516e [id=55a13c7617e345339dde6677b11008be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.716470 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c79a42afd7aa42d38e0fb673aebb3ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.716634 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ecf5c1d0fa64004bc4a01e96147167e with delete_type TABLET_DATA_DELETED (replaced by tablet 33517843ce1d4d8786c91fd738d81ab2) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.716661 1010 tablet_service.cc:1467] Processing CreateTablet for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 (DEFAULT_TABLE table=default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9 [id=7b71c48967844bf59fbd632ce967b1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.716995 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.717276 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 14975b8743c14594ad2dcf82027e1658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.718242 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_de90b8a452cf4d7598cfab73f026c1fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.719439 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_45f4253095cd4fd8a48faf559ccb7385"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.719602 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1f7b560e0967428b810645d2b7d664cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.719755 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_361007b28d7e4f97b3d3b0f9d413c3e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.720901 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_90ac8c8b385b4d52a9c4a817223fd870"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.721597 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f7b560e0967428b810645d2b7d664cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.722541 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2ade8cca26704d6aba7c861dee7b87b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.722951 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_361007b28d7e4f97b3d3b0f9d413c3e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:55.722998 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90ac8c8b385b4d52a9c4a817223fd870 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:55.723080 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ade8cca26704d6aba7c861dee7b87b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:55.724033 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45f4253095cd4fd8a48faf559ccb7385 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.724366 1011 tablet_service.cc:1467] Processing CreateTablet for tablet ba3862ba4ebf410baebcc1246b08ddc9 (DEFAULT_TABLE table=default.Table_c7ad555de0774a6e9ecf9af82802275d [id=cfbc4dc349434379b3eaabd5dc948327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.724756 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba3862ba4ebf410baebcc1246b08ddc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.725368 1012 tablet_service.cc:1467] Processing CreateTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 (DEFAULT_TABLE table=default.Table_95788477aff144d39aaeac52cbc127a2 [id=31b071f3fa7547fb8a222ac6b8bffd6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.725682 1165 ts_tablet_manager.cc:1939] T 6f1b6177bfb245dc83a36e181ecc73b9 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.725733 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1a7ae0a9b04fca9da8f441958c3280. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:55.725958 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de90b8a452cf4d7598cfab73f026c1fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.726985 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 6f1b6177bfb245dc83a36e181ecc73b9 (table default.Table_d984bbf6a33e4099b8809ddbcac68b00 [id=b9309b34f61c4ab49b30b941c1c3a271]) successfully deleted
I20260620 07:00:55.728075 1168 tablet_bootstrap.cc:492] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.728295 1168 ts_tablet_manager.cc:1397] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.001s
I20260620 07:00:55.728451 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 1d97c42bcac24188bbc322f9d4ef2600 (DEFAULT_TABLE table=default.Table_c564f427e36645eaa41eb09a08173e96 [id=bfd61df271fe448da18b4aae768f19e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.728782 1008 tablet_service.cc:1467] Processing CreateTablet for tablet ba907170f2df4bd0b5e42d4c2d29b21e (DEFAULT_TABLE table=default.Table_68cda40c45984d5facf4822b65e40a88 [id=156f143b869542dbac1e92fd120f0f36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.729349 1168 raft_consensus.cc:348] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.729701 1168 raft_consensus.cc:374] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.729815 1168 raft_consensus.cc:729] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.725136 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 61f53616121e4a52835b8b7da1fa5372 (DEFAULT_TABLE table=default.Table_11cde52aaf3944eeb72cef8645b01d6a [id=425c83c87160456590a08a72244d2065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.730216 1168 consensus_queue.cc:260] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.735813 1170 tablet_bootstrap.cc:492] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:55.735991 1170 ts_tablet_manager.cc:1397] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.001s
I20260620 07:00:55.736018 1168 ts_tablet_manager.cc:1428] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260620 07:00:55.736235 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 1f0a3c36ff864f0083383103effe0ee8 (DEFAULT_TABLE table=default.Table_0d16742deb1e45ee86c610022bd3e4b9 [id=3da7a85c122648408588dea7ebe1fa5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.736967 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d97c42bcac24188bbc322f9d4ef2600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.736913 1170 raft_consensus.cc:348] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.737133 1170 raft_consensus.cc:374] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.737218 1170 raft_consensus.cc:729] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.737502 1170 consensus_queue.cc:260] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.738224 1166 ts_tablet_manager.cc:1918] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.738899 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f0a3c36ff864f0083383103effe0ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.741395 1167 tablet_bootstrap.cc:492] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.742182 1170 ts_tablet_manager.cc:1428] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260620 07:00:55.743083 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba907170f2df4bd0b5e42d4c2d29b21e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:55.747058 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb1a7ae0a9b04fca9da8f441958c3280 consensus state has no leader
I20260620 07:00:55.747269 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_76163e5d91214d9b9a2f003b085f6f6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.747879 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76163e5d91214d9b9a2f003b085f6f6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.751251 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]). Expected version 1 got 0
W20260620 07:00:55.751752 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 654c6215d7634f8594cae155c436c175 consensus state has no leader
I20260620 07:00:55.753899 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_90a79f8cdc2a444ab5401e28a4bbb8c3" } new_table_name: "default.Table_cc985be6e8f04878bceed73c459b61c4" modify_external_catalogs: true
I20260620 07:00:55.754979 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f4b16f2952d44c8eb44c7637495e016a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.755724 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4b16f2952d44c8eb44c7637495e016a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.756142 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f1b6177bfb245dc83a36e181ecc73b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.757900 872 tablet_service.cc:1467] Processing CreateTablet for tablet 13ea5f7db7b34922ac544b9ff2c76809 (DEFAULT_TABLE table=default.Table_f7c2c9f418cd448a8905994508501609 [id=1a7d8ddec9f247bfb0bc83027e152304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.758327 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13ea5f7db7b34922ac544b9ff2c76809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.763960 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_de90b8a452cf4d7598cfab73f026c1fa" } new_table_name: "default.Table_5c7875d7e8b1438ca620be079ce992c9" modify_external_catalogs: true
I20260620 07:00:55.764147 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8e4f88d8836d4bb5b6f20564a8718ac5" } new_table_name: "default.Table_36a1a1d73652453dbde01677f41a650a" modify_external_catalogs: true
I20260620 07:00:55.768008 729 tablet_service.cc:1467] Processing CreateTablet for tablet 13ea5f7db7b34922ac544b9ff2c76809 (DEFAULT_TABLE table=default.Table_f7c2c9f418cd448a8905994508501609 [id=1a7d8ddec9f247bfb0bc83027e152304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.771394 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 5ab6d4ca89c4482d835eaad2a66bc8ed from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.773779 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2d526dc5dfb440378c303bf409947c65" } modify_external_catalogs: true
I20260620 07:00:55.774011 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2d526dc5dfb440378c303bf409947c65" } modify_external_catalogs: true
I20260620 07:00:55.775328 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0d16742deb1e45ee86c610022bd3e4b9" } modify_external_catalogs: true
I20260620 07:00:55.775538 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0d16742deb1e45ee86c610022bd3e4b9" } modify_external_catalogs: true
I20260620 07:00:55.777297 1166 log.cc:1196] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/1accffd74f1a42b4bb2dc4f7110fddab
I20260620 07:00:55.777505 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61f53616121e4a52835b8b7da1fa5372. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:55.777504 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2906fe0a195149d2844232cc8d83f6dd consensus state has no leader
I20260620 07:00:55.778050 1166 ts_tablet_manager.cc:1939] T 1accffd74f1a42b4bb2dc4f7110fddab P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:55.778645 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_027da883eebd4e05b2f75373495c3d44" } modify_external_catalogs: true
I20260620 07:00:55.778923 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_027da883eebd4e05b2f75373495c3d44" } modify_external_catalogs: true
I20260620 07:00:55.779843 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 1accffd74f1a42b4bb2dc4f7110fddab (table default.Table_0c5e7592b74d47cd8e103fc05680d1f0 [id=d93e37b7b9b8436389982f544808fc14]) successfully deleted
I20260620 07:00:55.780488 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0820a2498d5941f396ff09b10011c330"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.781332 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0820a2498d5941f396ff09b10011c330 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.781757 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 13ea5f7db7b34922ac544b9ff2c76809 (DEFAULT_TABLE table=default.Table_f7c2c9f418cd448a8905994508501609 [id=1a7d8ddec9f247bfb0bc83027e152304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.782158 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13ea5f7db7b34922ac544b9ff2c76809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.785406 1168 tablet_bootstrap.cc:492] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.768491 1170 tablet_bootstrap.cc:492] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:00:55.790970 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 96c21823c59d475ca0949de3dc972df1 because the tablet was not found. No further retry: Not found: Tablet not found: 96c21823c59d475ca0949de3dc972df1
I20260620 07:00:55.791208 1166 tablet_replica.cc:330] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.790930 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f4b16f2952d44c8eb44c7637495e016a" } modify_external_catalogs: true
I20260620 07:00:55.791440 1166 raft_consensus.cc:2229] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.791682 1166 raft_consensus.cc:2258] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.791544 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f4b16f2952d44c8eb44c7637495e016a" } modify_external_catalogs: true
I20260620 07:00:55.793408 1166 ts_tablet_manager.cc:1905] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.794073 1168 tablet_bootstrap.cc:654] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.794726 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13ea5f7db7b34922ac544b9ff2c76809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.797935 876 tablet_service.cc:1467] Processing CreateTablet for tablet 33517843ce1d4d8786c91fd738d81ab2 (DEFAULT_TABLE table=default.Table_1502cae21371444ca45ba8693a352a84 [id=5c8493166f2448dea6f711457ba8c1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.798401 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33517843ce1d4d8786c91fd738d81ab2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:55.801402 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16a7e62b5af141ca8b5054ce8f46c2b6 has no consensus state
I20260620 07:00:55.803077 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bd966fa009d44bf94bcd865f6231f78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.803686 1165 tablet_replica.cc:330] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.803910 1165 raft_consensus.cc:2229] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.804116 1165 raft_consensus.cc:2258] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.804623 420 master_service.cc:946] ReplaceTablet: received request to replace tablet bb1a7ae0a9b04fca9da8f441958c3280 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.804623 424 master_service.cc:946] ReplaceTablet: received request to replace tablet aaba6014285c4db4b8127d26df1e0625 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.798965 734 tablet_service.cc:1467] Processing CreateTablet for tablet 33517843ce1d4d8786c91fd738d81ab2 (DEFAULT_TABLE table=default.Table_1502cae21371444ca45ba8693a352a84 [id=5c8493166f2448dea6f711457ba8c1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.806190 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33517843ce1d4d8786c91fd738d81ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.807243 1165 ts_tablet_manager.cc:1905] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:00:55.813288 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52b0ef4797324c82832c11a1c98e2b42 consensus state has no leader
I20260620 07:00:55.813898 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 654c6215d7634f8594cae155c436c175
I20260620 07:00:55.816247 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 654c6215d7634f8594cae155c436c175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.820448 1165 ts_tablet_manager.cc:1918] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.820632 1165 log.cc:1196] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/9bd966fa009d44bf94bcd865f6231f78
I20260620 07:00:55.821048 1165 ts_tablet_manager.cc:1939] T 9bd966fa009d44bf94bcd865f6231f78 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.822219 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 9bd966fa009d44bf94bcd865f6231f78 (table default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47 [id=c8fb3e499488487d8d0d5b5a9f0b9eee]) successfully deleted
I20260620 07:00:55.824013 1201 raft_consensus.cc:482] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:55.826205 1168 tablet_bootstrap.cc:492] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.826382 1168 ts_tablet_manager.cc:1397] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.003s
I20260620 07:00:55.827029 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5ab6d4ca89c4482d835eaad2a66bc8ed
I20260620 07:00:55.827219 1168 raft_consensus.cc:348] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.827504 418 catalog_manager.cc:6565] ReplaceTablet: tablet 5ab6d4ca89c4482d835eaad2a66bc8ed deleted and replaced by tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7
I20260620 07:00:55.827490 1168 raft_consensus.cc:374] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.827569 1168 raft_consensus.cc:729] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.827911 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d7f3c14821df43c5a2ab950ccaed0605
I20260620 07:00:55.827841 1168 consensus_queue.cc:260] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.829084 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed with delete_type TABLET_DATA_DELETED (replaced by tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.830495 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet bb1a7ae0a9b04fca9da8f441958c3280
I20260620 07:00:55.831410 420 catalog_manager.cc:6565] ReplaceTablet: tablet bb1a7ae0a9b04fca9da8f441958c3280 deleted and replaced by tablet 1f763b0e91544700bd672c2ef751b4d2
I20260620 07:00:55.832017 1168 ts_tablet_manager.cc:1428] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260620 07:00:55.832234 732 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f763b0e91544700bd672c2ef751b4d2) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.832369 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1f0a3c36ff864f0083383103effe0ee8
I20260620 07:00:55.833367 868 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f763b0e91544700bd672c2ef751b4d2) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.833725 422 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet a802794508e64c89b7354aff569e0927
I20260620 07:00:55.833762 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f0a3c36ff864f0083383103effe0ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.834048 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f0a3c36ff864f0083383103effe0ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.834277 1174 raft_consensus.cc:482] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:55.834522 1174 raft_consensus.cc:504] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.835898 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet aaba6014285c4db4b8127d26df1e0625
I20260620 07:00:55.836311 1174 leader_election.cc:288] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:55.836372 424 catalog_manager.cc:6565] ReplaceTablet: tablet aaba6014285c4db4b8127d26df1e0625 deleted and replaced by tablet 2060ea1520d8404daa6b862b8945226e
I20260620 07:00:55.836933 732 tablet_service.cc:1514] Processing DeleteTablet for tablet aaba6014285c4db4b8127d26df1e0625 with delete_type TABLET_DATA_DELETED (replaced by tablet 2060ea1520d8404daa6b862b8945226e) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.837385 1165 tablet_replica.cc:330] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.837630 1165 raft_consensus.cc:2229] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.837882 1165 raft_consensus.cc:2258] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.838390 872 tablet_service.cc:1514] Processing DeleteTablet for tablet d7f3c14821df43c5a2ab950ccaed0605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.838698 734 tablet_service.cc:1514] Processing DeleteTablet for tablet d7f3c14821df43c5a2ab950ccaed0605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.839248 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 654c6215d7634f8594cae155c436c175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.824229 1201 raft_consensus.cc:504] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.841701 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 33517843ce1d4d8786c91fd738d81ab2 (DEFAULT_TABLE table=default.Table_1502cae21371444ca45ba8693a352a84 [id=5c8493166f2448dea6f711457ba8c1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.841677 1167 ts_tablet_manager.cc:1397] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.066s user 0.014s sys 0.028s
I20260620 07:00:55.843524 1170 tablet_bootstrap.cc:654] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.843552 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33517843ce1d4d8786c91fd738d81ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.845326 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ab6d4ca89c4482d835eaad2a66bc8ed" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:55.845729 754 raft_consensus.cc:2454] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:55.845966 1165 ts_tablet_manager.cc:1905] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.846814 1201 leader_election.cc:288] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:55.846948 1169 ts_tablet_manager.cc:1918] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.847013 1176 raft_consensus.cc:482] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:55.847091 1169 log.cc:1196] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/69453d2d22224925a4aaedb53a43d2d7
I20260620 07:00:55.847429 1169 ts_tablet_manager.cc:1939] T 69453d2d22224925a4aaedb53a43d2d7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:55.848224 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet d7f3c14821df43c5a2ab950ccaed0605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.848572 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 654c6215d7634f8594cae155c436c175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.848574 968 leader_election.cc:302] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:55.849130 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f7c2c9f418cd448a8905994508501609" } modify_external_catalogs: true
I20260620 07:00:55.849342 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f7c2c9f418cd448a8905994508501609" } modify_external_catalogs: true
I20260620 07:00:55.849754 1168 tablet_bootstrap.cc:492] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.849921 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed with delete_type TABLET_DATA_DELETED (replaced by tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.851820 1168 tablet_bootstrap.cc:654] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.854036 1201 raft_consensus.cc:2781] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:55.848170 1176 raft_consensus.cc:504] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.854589 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 69453d2d22224925a4aaedb53a43d2d7 (table default.Table_d510df80b7bd4ff9a13c38d83044ece5 [id=b2dba1a50b6d4e09914512ed5809870b]) successfully deleted
I20260620 07:00:55.854053 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ab6d4ca89c4482d835eaad2a66bc8ed with delete_type TABLET_DATA_DELETED (replaced by tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.854928 1169 tablet_replica.cc:330] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:55.855023 1176 leader_election.cc:288] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:55.855110 1169 raft_consensus.cc:2229] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.855293 1169 raft_consensus.cc:2258] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.856132 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 14975b8743c14594ad2dcf82027e1658 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.855786 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14975b8743c14594ad2dcf82027e1658" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:55.857489 1169 ts_tablet_manager.cc:1905] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.861694 1201 raft_consensus.cc:482] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:55.861723 425 master_service.cc:946] ReplaceTablet: received request to replace tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:55.861868 1201 raft_consensus.cc:3037] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:55.858595 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f0a3c36ff864f0083383103effe0ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.862931 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f763b0e91544700bd672c2ef751b4d2) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.858390 1170 tablet_bootstrap.cc:492] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:00:55.863286 968 leader_election.cc:341] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:55.863481 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet aaba6014285c4db4b8127d26df1e0625 with delete_type TABLET_DATA_DELETED (replaced by tablet 2060ea1520d8404daa6b862b8945226e) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.863802 1170 ts_tablet_manager.cc:1397] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.095s user 0.002s sys 0.002s
I20260620 07:00:55.865188 874 tablet_service.cc:1514] Processing DeleteTablet for tablet aaba6014285c4db4b8127d26df1e0625 with delete_type TABLET_DATA_DELETED (replaced by tablet 2060ea1520d8404daa6b862b8945226e) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.864624 1170 raft_consensus.cc:348] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.865756 1170 raft_consensus.cc:374] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.866818 1170 raft_consensus.cc:729] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.867101 1170 consensus_queue.cc:260] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.867908 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 14975b8743c14594ad2dcf82027e1658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.872701 731 tablet_service.cc:1514] Processing DeleteTablet for tablet f8791a8dd68b4c1a8fe8d877f246d6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.873270 1170 ts_tablet_manager.cc:1428] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260620 07:00:55.866441 1167 raft_consensus.cc:348] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.878130 1201 raft_consensus.cc:504] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.878743 1165 ts_tablet_manager.cc:1918] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.879949 1201 leader_election.cc:288] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:55.880287 1167 raft_consensus.cc:374] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.882444 1167 raft_consensus.cc:729] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.879792 1168 tablet_bootstrap.cc:492] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.882850 1168 ts_tablet_manager.cc:1397] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.004s
I20260620 07:00:55.882947 1167 consensus_queue.cc:260] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.883539 1167 ts_tablet_manager.cc:1428] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260620 07:00:55.884218 1167 tablet_bootstrap.cc:492] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:55.884069 1168 raft_consensus.cc:348] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.884426 1168 raft_consensus.cc:374] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.884562 1168 raft_consensus.cc:729] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.884912 1168 consensus_queue.cc:260] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.879544 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ab6d4ca89c4482d835eaad2a66bc8ed" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:55.885447 754 raft_consensus.cc:3037] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:55.888686 754 raft_consensus.cc:2454] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:55.889266 968 leader_election.cc:302] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:55.889745 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ecf5c1d0fa64004bc4a01e96147167e with delete_type TABLET_DATA_DELETED (replaced by tablet 33517843ce1d4d8786c91fd738d81ab2) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.890327 1201 raft_consensus.cc:2781] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:55.890599 1201 raft_consensus.cc:686] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:55.891150 1201 consensus_queue.cc:237] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.894129 1168 ts_tablet_manager.cc:1428] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260620 07:00:55.898052 1168 tablet_bootstrap.cc:492] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.900542 1168 tablet_bootstrap.cc:654] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.903164 1170 tablet_bootstrap.cc:492] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:55.903029 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14975b8743c14594ad2dcf82027e1658" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:55.904745 1170 tablet_bootstrap.cc:654] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.901346 1165 log.cc:1196] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/5ab6d4ca89c4482d835eaad2a66bc8ed
W20260620 07:00:55.903944 831 leader_election.cc:341] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:55.906520 1165 ts_tablet_manager.cc:1939] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.907568 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (table default.Table_59ab9a5c124e45bfa2e1f020df7a756a [id=a53fbb10c3c84cb698f8973d0e23bce0]) successfully deleted
W20260620 07:00:55.909397 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet bb1a7ae0a9b04fca9da8f441958c3280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb1a7ae0a9b04fca9da8f441958c3280 already in progress: creating tablet
I20260620 07:00:55.909641 1167 tablet_bootstrap.cc:654] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:55.910516 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1f0a3c36ff864f0083383103effe0ee8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f0a3c36ff864f0083383103effe0ee8 already in progress: creating tablet
W20260620 07:00:55.911878 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d7f3c14821df43c5a2ab950ccaed0605 because the tablet was not found. No further retry: Not found: Tablet not found: d7f3c14821df43c5a2ab950ccaed0605
W20260620 07:00:55.912925 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 654c6215d7634f8594cae155c436c175 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 654c6215d7634f8594cae155c436c175 already in progress: creating tablet
W20260620 07:00:55.916419 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet aaba6014285c4db4b8127d26df1e0625 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaba6014285c4db4b8127d26df1e0625 already in progress: creating tablet
I20260620 07:00:55.917217 1165 tablet_replica.cc:330] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.917654 1169 ts_tablet_manager.cc:1918] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.918295 1165 raft_consensus.cc:2229] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.918668 1170 tablet_bootstrap.cc:492] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:55.918859 1170 ts_tablet_manager.cc:1397] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260620 07:00:55.920413 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14975b8743c14594ad2dcf82027e1658" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:00:55.921706 969 leader_election.cc:341] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 5ab6d4ca89c4482d835eaad2a66bc8ed
W20260620 07:00:55.922104 969 leader_election.cc:341] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 5ab6d4ca89c4482d835eaad2a66bc8ed
I20260620 07:00:55.922372 1165 raft_consensus.cc:2258] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:55.923728 969 leader_election.cc:341] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:55.923923 969 leader_election.cc:302] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:00:55.924372 427 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 52b0ef4797324c82832c11a1c98e2b42 (table default.Table_36a1a1d73652453dbde01677f41a650a [id=9fbfb3ec7f5348d3907734224702c69e]). Expected version 1 got 0
I20260620 07:00:55.925274 1201 raft_consensus.cc:2726] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:55.926023 1168 tablet_bootstrap.cc:492] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.926199 1168 ts_tablet_manager.cc:1397] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260620 07:00:55.927004 1168 raft_consensus.cc:348] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.927269 1168 raft_consensus.cc:374] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.927398 1168 raft_consensus.cc:729] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.927655 1168 consensus_queue.cc:260] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.928812 1165 ts_tablet_manager.cc:1905] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.928900 1166 ts_tablet_manager.cc:1918] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.929042 1166 log.cc:1196] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/3ecf5c1d0fa64004bc4a01e96147167e
I20260620 07:00:55.929474 1166 ts_tablet_manager.cc:1939] T 3ecf5c1d0fa64004bc4a01e96147167e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:55.931010 1168 ts_tablet_manager.cc:1428] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:00:55.931211 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 13ea5f7db7b34922ac544b9ff2c76809
I20260620 07:00:55.932080 1178 raft_consensus.cc:482] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:55.932186 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 13ea5f7db7b34922ac544b9ff2c76809 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.932269 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 13ea5f7db7b34922ac544b9ff2c76809 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.932292 1178 raft_consensus.cc:504] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.933774 1168 tablet_bootstrap.cc:492] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.934072 1178 leader_election.cc:288] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:55.935755 1168 tablet_bootstrap.cc:654] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:55.939105 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 52b0ef4797324c82832c11a1c98e2b42 (table default.Table_36a1a1d73652453dbde01677f41a650a [id=9fbfb3ec7f5348d3907734224702c69e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 52b0ef4797324c82832c11a1c98e2b42 consensus state has no leader
I20260620 07:00:55.940644 1165 ts_tablet_manager.cc:1918] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.940874 1165 log.cc:1196] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/14975b8743c14594ad2dcf82027e1658
I20260620 07:00:55.941375 1165 ts_tablet_manager.cc:1939] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.942968 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 13ea5f7db7b34922ac544b9ff2c76809 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.946218 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ae5ccd8edf6b4f50a1c9b1d2353e7678
I20260620 07:00:55.946663 425 catalog_manager.cc:6565] ReplaceTablet: tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 deleted and replaced by tablet 98385b3c486146a08b63a9507b060d80
I20260620 07:00:55.947505 876 tablet_service.cc:1514] Processing DeleteTablet for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 with delete_type TABLET_DATA_DELETED (replaced by tablet 98385b3c486146a08b63a9507b060d80) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.948406 1165 tablet_replica.cc:330] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.948546 729 tablet_service.cc:1514] Processing DeleteTablet for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 with delete_type TABLET_DATA_DELETED (replaced by tablet 98385b3c486146a08b63a9507b060d80) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:55.948853 1165 raft_consensus.cc:2229] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.948843 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 14975b8743c14594ad2dcf82027e1658 (table default.Table_62b64e3064814fd98928a194b9bc93e2 [id=8395cc24724942e9b6eeefe1ae52f0db]) successfully deleted
I20260620 07:00:55.949123 1165 raft_consensus.cc:2258] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.949828 1165 ts_tablet_manager.cc:1905] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.949817 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3af9336a4cfa48b3b6676f4277e37b01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.950457 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3af9336a4cfa48b3b6676f4277e37b01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.951653 1167 tablet_bootstrap.cc:492] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:55.951929 1167 ts_tablet_manager.cc:1397] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.068s user 0.000s sys 0.004s
I20260620 07:00:55.953858 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cc985be6e8f04878bceed73c459b61c4" } new_table_name: "default.Table_07215f09fe3e4b7d9c1b0786ef82d218" modify_external_catalogs: true
I20260620 07:00:55.953773 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_df4947332dd4432aae26fc8c5e2f6c8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.954613 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df4947332dd4432aae26fc8c5e2f6c8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.955681 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a77c53a332ef44b584f6cdedaf0fa001"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.956209 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a77c53a332ef44b584f6cdedaf0fa001 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.956130 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6510f8e09f87485e8843c40b0523f68f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.956616 1168 tablet_bootstrap.cc:492] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
W20260620 07:00:55.956647 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6510f8e09f87485e8843c40b0523f68f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.956772 1168 ts_tablet_manager.cc:1397] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.012s
I20260620 07:00:55.957666 1168 raft_consensus.cc:348] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.957782 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6114f9a7dc6143338db6a4d5e2d30761"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.957962 1168 raft_consensus.cc:374] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.958057 1168 raft_consensus.cc:729] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:00:55.958259 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6114f9a7dc6143338db6a4d5e2d30761 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.958331 1168 consensus_queue.cc:260] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:55.959010 1165 ts_tablet_manager.cc:1918] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.961549 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8150c6274659447da7ba165c9ca49a19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.962155 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8150c6274659447da7ba165c9ca49a19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.962379 1165 log.cc:1196] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/3ecf5c1d0fa64004bc4a01e96147167e
W20260620 07:00:55.962285 683 leader_election.cc:341] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f8791a8dd68b4c1a8fe8d877f246d6ca
I20260620 07:00:55.962484 1167 raft_consensus.cc:348] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.962770 1167 raft_consensus.cc:374] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.960965 1168 ts_tablet_manager.cc:1428] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:00:55.962894 1167 raft_consensus.cc:729] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.963124 1167 consensus_queue.cc:260] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.963570 1165 ts_tablet_manager.cc:1939] T 3ecf5c1d0fa64004bc4a01e96147167e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.965152 1168 tablet_bootstrap.cc:492] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.965289 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_59ab9a5c124e45bfa2e1f020df7a756a" } new_table_name: "default.Table_c3a21b866a364f0e97c74a240faf1dff" modify_external_catalogs: true
I20260620 07:00:55.966482 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 3ecf5c1d0fa64004bc4a01e96147167e (table default.Table_1502cae21371444ca45ba8693a352a84 [id=5c8493166f2448dea6f711457ba8c1bc]) successfully deleted
W20260620 07:00:55.967031 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 13ea5f7db7b34922ac544b9ff2c76809 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13ea5f7db7b34922ac544b9ff2c76809 already in progress: creating tablet
I20260620 07:00:55.967125 1168 tablet_bootstrap.cc:654] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:55.967382 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 already in progress: creating tablet
I20260620 07:00:55.975419 1168 tablet_bootstrap.cc:492] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:55.975625 1168 ts_tablet_manager.cc:1397] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260620 07:00:55.977483 1168 raft_consensus.cc:348] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:55.977802 1168 raft_consensus.cc:374] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:55.977883 1168 raft_consensus.cc:729] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:55.977735 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e580e9992f4d43f38e5740b9bc550766"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:55.978137 1168 consensus_queue.cc:260] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:55.978363 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e580e9992f4d43f38e5740b9bc550766 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.980367 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14975b8743c14594ad2dcf82027e1658" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:55.980621 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 654c6215d7634f8594cae155c436c175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:55.980890 1165 tablet_replica.cc:330] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:55.980835 1033 raft_consensus.cc:2454] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:55.981241 1165 raft_consensus.cc:2229] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.981449 1168 ts_tablet_manager.cc:1428] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 07:00:55.981451 1165 raft_consensus.cc:2258] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.981494 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 with delete_type TABLET_DATA_DELETED (replaced by tablet 98385b3c486146a08b63a9507b060d80) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:55.982369 1165 ts_tablet_manager.cc:1905] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:55.982614 830 leader_election.cc:302] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:00:55.983023 830 raft_consensus.cc:2670] T 14975b8743c14594ad2dcf82027e1658 P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:00:55.985210 876 tablet_service.cc:1467] Processing CreateTablet for tablet 289405cbf0784916b971b038279309d8 (DEFAULT_TABLE table=default.Table_0820a2498d5941f396ff09b10011c330 [id=ca68189e4cd34f43a8fbdb53a834be16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.985661 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 289405cbf0784916b971b038279309d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:55.985697 729 tablet_service.cc:1467] Processing CreateTablet for tablet 289405cbf0784916b971b038279309d8 (DEFAULT_TABLE table=default.Table_0820a2498d5941f396ff09b10011c330 [id=ca68189e4cd34f43a8fbdb53a834be16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.986153 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 289405cbf0784916b971b038279309d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:55.986630 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2906fe0a195149d2844232cc8d83f6dd consensus state has no leader
I20260620 07:00:55.988165 1167 ts_tablet_manager.cc:1428] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.036s user 0.000s sys 0.002s
I20260620 07:00:55.988560 1166 tablet_replica.cc:330] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:55.988742 1166 raft_consensus.cc:2229] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:55.988920 1166 raft_consensus.cc:2258] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:55.989332 1165 ts_tablet_manager.cc:1918] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:55.989457 1165 log.cc:1196] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/654c6215d7634f8594cae155c436c175
I20260620 07:00:55.989842 1165 ts_tablet_manager.cc:1939] T 654c6215d7634f8594cae155c436c175 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:55.991271 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 3ecf5c1d0fa64004bc4a01e96147167e (table default.Table_1502cae21371444ca45ba8693a352a84 [id=5c8493166f2448dea6f711457ba8c1bc]) successfully deleted
I20260620 07:00:55.992159 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_551c55403131424c87aee4c019ca1466"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:55.993119 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_551c55403131424c87aee4c019ca1466 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:55.994518 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_361007b28d7e4f97b3d3b0f9d413c3e7" } new_table_name: "default.Table_b6b971bcac4546f18c57e342e7f4c804" modify_external_catalogs: true
I20260620 07:00:55.995214 1168 tablet_bootstrap.cc:492] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:55.997267 1168 tablet_bootstrap.cc:654] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:55.997738 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 289405cbf0784916b971b038279309d8 (DEFAULT_TABLE table=default.Table_0820a2498d5941f396ff09b10011c330 [id=ca68189e4cd34f43a8fbdb53a834be16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:55.998703 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 654c6215d7634f8594cae155c436c175 (table default.Table_2d526dc5dfb440378c303bf409947c65 [id=b2c123464ea94601b142edcd222945ca]) successfully deleted
I20260620 07:00:56.001276 876 tablet_service.cc:1467] Processing CreateTablet for tablet 6fcb42f643c24e869fb0d7e2893ffa57 (DEFAULT_TABLE table=default.Table_76163e5d91214d9b9a2f003b085f6f6f [id=04c170b69f3b43eb88b51e1654ec86df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.001698 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fcb42f643c24e869fb0d7e2893ffa57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.002009 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 289405cbf0784916b971b038279309d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.005007 1167 tablet_bootstrap.cc:492] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.007579 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 6fcb42f643c24e869fb0d7e2893ffa57 (DEFAULT_TABLE table=default.Table_76163e5d91214d9b9a2f003b085f6f6f [id=04c170b69f3b43eb88b51e1654ec86df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.008000 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fcb42f643c24e869fb0d7e2893ffa57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.009029 1167 tablet_bootstrap.cc:654] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.010867 1166 ts_tablet_manager.cc:1905] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.016443 876 tablet_service.cc:1467] Processing CreateTablet for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 (DEFAULT_TABLE table=default.Table_5c7875d7e8b1438ca620be079ce992c9 [id=c6b286f7e44a496aa9f070c73a885062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.016950 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16a7e62b5af141ca8b5054ce8f46c2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.017519 423 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 88635d3b7d83435f8fc8e89dc8de173b (table default.Table_b623e145e58e4cb9b1d75359c4d1cf8e [id=f28fed67d2244a1694c6688535cc5213]). Expected version 1 got 0
I20260620 07:00:56.020159 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_85568ce0333b42d4958c533a98d966b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.020768 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85568ce0333b42d4958c533a98d966b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.022099 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2ade8cca26704d6aba7c861dee7b87b7" } new_table_name: "default.Table_8a02f49391a247dd913a1eee7a6dcd61" modify_external_catalogs: true
I20260620 07:00:56.023814 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_df4947332dd4432aae26fc8c5e2f6c8c" } new_table_name: "default.Table_676ef4f879c44d9a94d209ec74b4da67" modify_external_catalogs: true
I20260620 07:00:56.025193 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 (DEFAULT_TABLE table=default.Table_5c7875d7e8b1438ca620be079ce992c9 [id=c6b286f7e44a496aa9f070c73a885062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.025611 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16a7e62b5af141ca8b5054ce8f46c2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.028066 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2f6560957a4c40c186a1ebb5e88f7123" } modify_external_catalogs: true
I20260620 07:00:56.028389 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2f6560957a4c40c186a1ebb5e88f7123" } modify_external_catalogs: true
I20260620 07:00:56.035044 876 tablet_service.cc:1467] Processing CreateTablet for tablet e5e2d0beac44480daaa7c2757ac7b178 (DEFAULT_TABLE table=default.Table_90ac8c8b385b4d52a9c4a817223fd870 [id=24931029acfd4661a09a5bf4656596f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.035480 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5e2d0beac44480daaa7c2757ac7b178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.036924 1012 tablet_service.cc:1467] Processing CreateTablet for tablet e5e2d0beac44480daaa7c2757ac7b178 (DEFAULT_TABLE table=default.Table_90ac8c8b385b4d52a9c4a817223fd870 [id=24931029acfd4661a09a5bf4656596f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.038443 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5e2d0beac44480daaa7c2757ac7b178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.039901 731 tablet_service.cc:1467] Processing CreateTablet for tablet 6fcb42f643c24e869fb0d7e2893ffa57 (DEFAULT_TABLE table=default.Table_76163e5d91214d9b9a2f003b085f6f6f [id=04c170b69f3b43eb88b51e1654ec86df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.040658 1167 tablet_bootstrap.cc:492] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.040655 732 tablet_service.cc:1467] Processing CreateTablet for tablet e5e2d0beac44480daaa7c2757ac7b178 (DEFAULT_TABLE table=default.Table_90ac8c8b385b4d52a9c4a817223fd870 [id=24931029acfd4661a09a5bf4656596f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.040861 1167 ts_tablet_manager.cc:1397] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260620 07:00:56.041792 734 tablet_service.cc:1467] Processing CreateTablet for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 (DEFAULT_TABLE table=default.Table_5c7875d7e8b1438ca620be079ce992c9 [id=c6b286f7e44a496aa9f070c73a885062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.041908 1167 raft_consensus.cc:348] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.042282 1167 raft_consensus.cc:374] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.042335 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5e2d0beac44480daaa7c2757ac7b178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.042433 1167 raft_consensus.cc:729] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.043049 1167 consensus_queue.cc:260] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.045310 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16a7e62b5af141ca8b5054ce8f46c2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.048269 1167 ts_tablet_manager.cc:1428] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260620 07:00:56.051445 1167 tablet_bootstrap.cc:492] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.054579 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fcb42f643c24e869fb0d7e2893ffa57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.059154 1166 ts_tablet_manager.cc:1918] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.059878 1166 log.cc:1196] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/14975b8743c14594ad2dcf82027e1658
I20260620 07:00:56.060384 1166 ts_tablet_manager.cc:1939] T 14975b8743c14594ad2dcf82027e1658 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:56.061447 1166 tablet_replica.cc:330] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:56.061713 1166 raft_consensus.cc:2229] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.063424 1166 raft_consensus.cc:2258] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.059739 1167 tablet_bootstrap.cc:654] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.062450 1170 raft_consensus.cc:348] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.064800 1168 tablet_bootstrap.cc:492] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.064965 1168 ts_tablet_manager.cc:1397] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.070s user 0.015s sys 0.030s
I20260620 07:00:56.065160 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 14975b8743c14594ad2dcf82027e1658 (table default.Table_62b64e3064814fd98928a194b9bc93e2 [id=8395cc24724942e9b6eeefe1ae52f0db]) successfully deleted
I20260620 07:00:56.065637 1166 ts_tablet_manager.cc:1905] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.065951 1168 raft_consensus.cc:348] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.066190 1168 raft_consensus.cc:374] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.066327 1168 raft_consensus.cc:729] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.066682 1168 consensus_queue.cc:260] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.069039 1168 ts_tablet_manager.cc:1428] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 07:00:56.070996 1170 raft_consensus.cc:374] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.071156 1170 raft_consensus.cc:729] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.071209 1168 tablet_bootstrap.cc:492] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.071477 1170 consensus_queue.cc:260] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.073160 1168 tablet_bootstrap.cc:654] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.073915 1170 ts_tablet_manager.cc:1428] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.155s user 0.002s sys 0.000s
I20260620 07:00:56.074230 1170 tablet_bootstrap.cc:492] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.076553 1170 tablet_bootstrap.cc:654] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.079090 1166 ts_tablet_manager.cc:1918] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.079762 1166 log.cc:1196] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/654c6215d7634f8594cae155c436c175
I20260620 07:00:56.080832 1166 ts_tablet_manager.cc:1939] T 654c6215d7634f8594cae155c436c175 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:56.082551 1166 tablet_replica.cc:330] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:56.084010 1166 raft_consensus.cc:2229] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:56.084910 1168 tablet_bootstrap.cc:492] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.085121 1168 ts_tablet_manager.cc:1397] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.008s
I20260620 07:00:56.085409 1166 pending_rounds.cc:62] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:00:56.085696 1166 pending_rounds.cc:68] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821553734651904 op_type: NO_OP noop_request { }
I20260620 07:00:56.085994 1168 raft_consensus.cc:348] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.086285 1168 raft_consensus.cc:374] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.086369 1168 raft_consensus.cc:729] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.086499 1166 raft_consensus.cc:2866] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:56.086853 1166 raft_consensus.cc:2258] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.086742 1168 consensus_queue.cc:260] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.088317 1166 ts_tablet_manager.cc:1905] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.089267 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 654c6215d7634f8594cae155c436c175 (table default.Table_2d526dc5dfb440378c303bf409947c65 [id=b2c123464ea94601b142edcd222945ca]) successfully deleted
I20260620 07:00:56.089588 1168 ts_tablet_manager.cc:1428] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
W20260620 07:00:56.089815 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d7f3c14821df43c5a2ab950ccaed0605 because the tablet was not found. No further retry: Not found: Tablet not found: d7f3c14821df43c5a2ab950ccaed0605
I20260620 07:00:56.090821 1168 tablet_bootstrap.cc:492] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.103749 876 tablet_service.cc:1467] Processing CreateTablet for tablet 2060ea1520d8404daa6b862b8945226e (DEFAULT_TABLE table=default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.104302 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2060ea1520d8404daa6b862b8945226e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.104861 1166 ts_tablet_manager.cc:1918] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:56.105005 1166 log.cc:1196] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/5ab6d4ca89c4482d835eaad2a66bc8ed
I20260620 07:00:56.105449 1166 ts_tablet_manager.cc:1939] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:56.110209 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (table default.Table_59ab9a5c124e45bfa2e1f020df7a756a [id=a53fbb10c3c84cb698f8973d0e23bce0]) successfully deleted
I20260620 07:00:56.110322 1166 tablet_replica.cc:330] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:56.110538 1166 raft_consensus.cc:2229] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260620 07:00:56.110705 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1f0a3c36ff864f0083383103effe0ee8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f0a3c36ff864f0083383103effe0ee8 already in progress: creating tablet
I20260620 07:00:56.110841 1166 raft_consensus.cc:2258] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:56.111145 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet bb1a7ae0a9b04fca9da8f441958c3280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb1a7ae0a9b04fca9da8f441958c3280 already in progress: creating tablet
W20260620 07:00:56.111441 412 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111) [suppressed 12 similar messages]
I20260620 07:00:56.112439 427 master_service.cc:946] ReplaceTablet: received request to replace tablet aaba6014285c4db4b8127d26df1e0625 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:56.112854 1166 ts_tablet_manager.cc:1905] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.113319 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9" } modify_external_catalogs: true
I20260620 07:00:56.113544 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9" } modify_external_catalogs: true
I20260620 07:00:56.114409 1168 tablet_bootstrap.cc:654] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.115530 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3af9336a4cfa48b3b6676f4277e37b01" } modify_external_catalogs: true
I20260620 07:00:56.115767 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3af9336a4cfa48b3b6676f4277e37b01" } modify_external_catalogs: true
W20260620 07:00:56.119760 413 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.61:33455, user_credentials={real_user=slave}} blocked reactor thread for 84160.4us
I20260620 07:00:56.123629 731 tablet_service.cc:1467] Processing CreateTablet for tablet 2060ea1520d8404daa6b862b8945226e (DEFAULT_TABLE table=default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.124379 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2060ea1520d8404daa6b862b8945226e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.127326 1166 ts_tablet_manager.cc:1918] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.127517 1166 log.cc:1196] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/aaba6014285c4db4b8127d26df1e0625
I20260620 07:00:56.127774 1169 log.cc:1196] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/6f1b6177bfb245dc83a36e181ecc73b9
I20260620 07:00:56.129163 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 2060ea1520d8404daa6b862b8945226e (DEFAULT_TABLE table=default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.127995 1166 ts_tablet_manager.cc:1939] T aaba6014285c4db4b8127d26df1e0625 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:56.129679 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2060ea1520d8404daa6b862b8945226e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.132290 1168 tablet_bootstrap.cc:492] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.132481 1168 ts_tablet_manager.cc:1397] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.002s
I20260620 07:00:56.133607 1168 raft_consensus.cc:348] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.133903 1168 raft_consensus.cc:374] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.134003 1168 raft_consensus.cc:729] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.134374 1168 consensus_queue.cc:260] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.135564 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet aaba6014285c4db4b8127d26df1e0625 (table default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]) successfully deleted
W20260620 07:00:56.135962 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 13ea5f7db7b34922ac544b9ff2c76809 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13ea5f7db7b34922ac544b9ff2c76809 already in progress: creating tablet
W20260620 07:00:56.136293 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 already in progress: creating tablet
I20260620 07:00:56.139815 1168 ts_tablet_manager.cc:1428] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 07:00:56.140565 1169 ts_tablet_manager.cc:1939] T 6f1b6177bfb245dc83a36e181ecc73b9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:56.142916 876 tablet_service.cc:1467] Processing CreateTablet for tablet fcc92630252b40a6a306c3a578fa3e59 (DEFAULT_TABLE table=default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.143467 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcc92630252b40a6a306c3a578fa3e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.147118 1006 tablet_service.cc:1467] Processing CreateTablet for tablet fcc92630252b40a6a306c3a578fa3e59 (DEFAULT_TABLE table=default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.147715 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcc92630252b40a6a306c3a578fa3e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.152815 1168 tablet_bootstrap.cc:492] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.155779 874 tablet_service.cc:1467] Processing CreateTablet for tablet 62ef9a12e3684d27b6696f631c68a5af (DEFAULT_TABLE table=default.Table_1f7b560e0967428b810645d2b7d664cf [id=01b6d66971e346cd98085dba5d3376ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.156322 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62ef9a12e3684d27b6696f631c68a5af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.161146 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 62ef9a12e3684d27b6696f631c68a5af (DEFAULT_TABLE table=default.Table_1f7b560e0967428b810645d2b7d664cf [id=01b6d66971e346cd98085dba5d3376ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.161754 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62ef9a12e3684d27b6696f631c68a5af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.165578 729 tablet_service.cc:1467] Processing CreateTablet for tablet fcc92630252b40a6a306c3a578fa3e59 (DEFAULT_TABLE table=default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.166493 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcc92630252b40a6a306c3a578fa3e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.171783 1168 tablet_bootstrap.cc:654] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.167619 734 tablet_service.cc:1467] Processing CreateTablet for tablet 62ef9a12e3684d27b6696f631c68a5af (DEFAULT_TABLE table=default.Table_1f7b560e0967428b810645d2b7d664cf [id=01b6d66971e346cd98085dba5d3376ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.182260 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62ef9a12e3684d27b6696f631c68a5af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.182729 1168 tablet_bootstrap.cc:492] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.182999 1168 ts_tablet_manager.cc:1397] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260620 07:00:56.184067 1168 raft_consensus.cc:348] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.184418 1168 raft_consensus.cc:374] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.184515 1168 raft_consensus.cc:729] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.184875 1168 consensus_queue.cc:260] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:56.187790 681 leader_election.cc:341] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: f8791a8dd68b4c1a8fe8d877f246d6ca
I20260620 07:00:56.188060 681 leader_election.cc:302] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:00:56.188557 1178 raft_consensus.cc:2726] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.190124 1170 tablet_bootstrap.cc:492] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.190011 874 tablet_service.cc:1467] Processing CreateTablet for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 (DEFAULT_TABLE table=default.Table_59ab9a5c124e45bfa2e1f020df7a756a [id=a53fbb10c3c84cb698f8973d0e23bce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.190294 1170 ts_tablet_manager.cc:1397] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.116s user 0.004s sys 0.000s
I20260620 07:00:56.190436 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.191133 1170 raft_consensus.cc:348] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.191371 1170 raft_consensus.cc:374] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.191449 1170 raft_consensus.cc:729] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.191699 1170 consensus_queue.cc:260] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.192267 1170 ts_tablet_manager.cc:1428] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:00:56.192943 1170 tablet_bootstrap.cc:492] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.194643 1170 tablet_bootstrap.cc:654] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.197858 1168 ts_tablet_manager.cc:1428] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260620 07:00:56.199429 1169 tablet_replica.cc:330] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:56.199729 1169 raft_consensus.cc:2229] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.200031 1169 raft_consensus.cc:2258] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.200922 1170 tablet_bootstrap.cc:492] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.202301 1170 ts_tablet_manager.cc:1397] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260620 07:00:56.201784 1169 ts_tablet_manager.cc:1905] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.204411 1168 tablet_bootstrap.cc:492] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.204885 1170 raft_consensus.cc:348] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.205133 1170 raft_consensus.cc:374] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.205233 1170 raft_consensus.cc:729] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.205868 1170 consensus_queue.cc:260] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.206565 1168 tablet_bootstrap.cc:654] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.207170 1201 raft_consensus.cc:482] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.207330 1201 raft_consensus.cc:504] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.208000 1201 leader_election.cc:288] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:00:56.210256 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 consensus state has no leader
I20260620 07:00:56.212335 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906fe0a195149d2844232cc8d83f6dd" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:00:56.213078 969 leader_election.cc:341] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.213932 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 6f1b6177bfb245dc83a36e181ecc73b9 (table default.Table_d984bbf6a33e4099b8809ddbcac68b00 [id=b9309b34f61c4ab49b30b941c1c3a271]) successfully deleted
W20260620 07:00:56.214370 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 654c6215d7634f8594cae155c436c175 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 654c6215d7634f8594cae155c436c175 already in progress: creating tablet
W20260620 07:00:56.214849 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet bb1a7ae0a9b04fca9da8f441958c3280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb1a7ae0a9b04fca9da8f441958c3280 already in progress: creating tablet
W20260620 07:00:56.215140 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1f0a3c36ff864f0083383103effe0ee8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f0a3c36ff864f0083383103effe0ee8 already in progress: creating tablet
W20260620 07:00:56.215396 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet aaba6014285c4db4b8127d26df1e0625 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaba6014285c4db4b8127d26df1e0625 already in progress: creating tablet
W20260620 07:00:56.215718 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d7f3c14821df43c5a2ab950ccaed0605 because the tablet was not found. No further retry: Not found: Tablet not found: d7f3c14821df43c5a2ab950ccaed0605
I20260620 07:00:56.216838 1168 tablet_bootstrap.cc:492] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.217002 1168 ts_tablet_manager.cc:1397] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260620 07:00:56.218253 1168 raft_consensus.cc:348] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.218475 1168 raft_consensus.cc:374] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.218564 1168 raft_consensus.cc:729] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.218852 1168 consensus_queue.cc:260] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.220930 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6510f8e09f87485e8843c40b0523f68f" } modify_external_catalogs: true
I20260620 07:00:56.221156 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6510f8e09f87485e8843c40b0523f68f" } modify_external_catalogs: true
I20260620 07:00:56.223040 1168 ts_tablet_manager.cc:1428] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 07:00:56.223309 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9a3e71613faa4670b104d7f0b524034e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.223855 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a3e71613faa4670b104d7f0b524034e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.225679 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 156b65f0b108434aba73e11b9785034b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.226404 1166 tablet_replica.cc:330] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:56.226593 1166 raft_consensus.cc:2229] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.226812 1166 raft_consensus.cc:2258] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.227883 1166 ts_tablet_manager.cc:1905] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.235702 1166 ts_tablet_manager.cc:1918] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.235975 1166 log.cc:1196] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/156b65f0b108434aba73e11b9785034b
I20260620 07:00:56.236388 1166 ts_tablet_manager.cc:1939] T 156b65f0b108434aba73e11b9785034b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:56.236478 1168 tablet_bootstrap.cc:492] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.237617 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 156b65f0b108434aba73e11b9785034b (table default.Table_5b650174e77b47b4a6283f9b22fb701d [id=b9587405857f4c8fbfcd41538fd20960]) successfully deleted
I20260620 07:00:56.239089 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 (DEFAULT_TABLE table=default.Table_c3a21b866a364f0e97c74a240faf1dff [id=a53fbb10c3c84cb698f8973d0e23bce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.239197 1168 tablet_bootstrap.cc:654] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.239477 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.249513 1168 tablet_bootstrap.cc:492] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.249699 1168 ts_tablet_manager.cc:1397] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.001s
I20260620 07:00:56.250702 1168 raft_consensus.cc:348] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.251075 1168 raft_consensus.cc:374] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.251173 1168 raft_consensus.cc:729] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.251515 1168 consensus_queue.cc:260] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.256393 874 tablet_service.cc:1467] Processing CreateTablet for tablet ba760b5fe1204df2932edd15bdcbaadf (DEFAULT_TABLE table=default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.256578 1008 tablet_service.cc:1467] Processing CreateTablet for tablet ba760b5fe1204df2932edd15bdcbaadf (DEFAULT_TABLE table=default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.256896 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba760b5fe1204df2932edd15bdcbaadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.257012 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba760b5fe1204df2932edd15bdcbaadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.262143 876 tablet_service.cc:1467] Processing CreateTablet for tablet 9d05d17792e54877b29431754676dcad (DEFAULT_TABLE table=default.Table_361007b28d7e4f97b3d3b0f9d413c3e7 [id=6f4392721f754cce90275aa5e1f094ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.262655 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d05d17792e54877b29431754676dcad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.272137 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 9d05d17792e54877b29431754676dcad (DEFAULT_TABLE table=default.Table_361007b28d7e4f97b3d3b0f9d413c3e7 [id=6f4392721f754cce90275aa5e1f094ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.272683 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d05d17792e54877b29431754676dcad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.276865 1168 ts_tablet_manager.cc:1428] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260620 07:00:56.282506 876 tablet_service.cc:1467] Processing CreateTablet for tablet 537ab1626d4e44c38d8cca8c51921424 (DEFAULT_TABLE table=default.Table_2ade8cca26704d6aba7c861dee7b87b7 [id=403d8690063647f8a96225625f58531d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.284111 1201 raft_consensus.cc:482] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.284341 1201 raft_consensus.cc:504] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.284967 1201 leader_election.cc:288] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:56.285370 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 537ab1626d4e44c38d8cca8c51921424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.285763 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a56f30ca69e45e3a9ddd41f117f61e2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:56.286046 895 raft_consensus.cc:2454] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:56.284924 1168 tablet_bootstrap.cc:492] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.286561 969 leader_election.cc:302] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.287196 1201 raft_consensus.cc:2781] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:56.287303 1201 raft_consensus.cc:482] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:56.287405 1201 raft_consensus.cc:3037] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.289122 1168 tablet_bootstrap.cc:654] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.290694 1201 raft_consensus.cc:504] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.292511 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a56f30ca69e45e3a9ddd41f117f61e2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:56.292744 895 raft_consensus.cc:3037] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.294960 1201 leader_election.cc:288] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:56.296741 895 raft_consensus.cc:2454] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:56.297271 969 leader_election.cc:302] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.297689 1201 raft_consensus.cc:2781] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:56.299346 1201 raft_consensus.cc:686] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:56.299682 1201 consensus_queue.cc:237] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.301483 1170 ts_tablet_manager.cc:1428] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260620 07:00:56.301894 1170 tablet_bootstrap.cc:492] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.303433 874 tablet_service.cc:1467] Processing CreateTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 (DEFAULT_TABLE table=default.Table_61741807e243431395868ee24844d1aa [id=31b071f3fa7547fb8a222ac6b8bffd6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.303985 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f763b0e91544700bd672c2ef751b4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.304526 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906fe0a195149d2844232cc8d83f6dd" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:56.306663 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 16a7e62b5af141ca8b5054ce8f46c2b6 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:56.309038 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 6fcb42f643c24e869fb0d7e2893ffa57 from {username='slave'} at 127.0.0.1:42866
W20260620 07:00:56.311048 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d05d17792e54877b29431754676dcad consensus state has no leader
I20260620 07:00:56.311415 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 1f0a3c36ff864f0083383103effe0ee8 from {username='slave'} at 127.0.0.1:42866
W20260620 07:00:56.311822 968 leader_election.cc:341] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.312011 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_45bc9d5cae2547f38e9729f15afa1677" } modify_external_catalogs: true
I20260620 07:00:56.312048 968 leader_election.cc:302] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:00:56.312203 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_45bc9d5cae2547f38e9729f15afa1677" } modify_external_catalogs: true
I20260620 07:00:56.312633 1176 raft_consensus.cc:2726] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.313441 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 (DEFAULT_TABLE table=default.Table_61741807e243431395868ee24844d1aa [id=31b071f3fa7547fb8a222ac6b8bffd6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.313848 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f763b0e91544700bd672c2ef751b4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.314885 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a56f30ca69e45e3a9ddd41f117f61e2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:56.315464 1178 raft_consensus.cc:482] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.315634 1178 raft_consensus.cc:504] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.316247 1178 leader_election.cc:288] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:56.316988 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a56f30ca69e45e3a9ddd41f117f61e2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
W20260620 07:00:56.317085 968 leader_election.cc:341] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.317920 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1accffd74f1a42b4bb2dc4f7110fddab" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:00:56.318274 968 leader_election.cc:341] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.318701 895 raft_consensus.cc:2454] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:00:56.318064 1168 tablet_bootstrap.cc:492] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.320019 1168 ts_tablet_manager.cc:1397] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.000s
I20260620 07:00:56.320163 732 tablet_service.cc:1467] Processing CreateTablet for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 (DEFAULT_TABLE table=default.Table_59ab9a5c124e45bfa2e1f020df7a756a [id=a53fbb10c3c84cb698f8973d0e23bce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.320864 1168 raft_consensus.cc:348] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.321110 1168 raft_consensus.cc:374] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.321210 1168 raft_consensus.cc:729] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.321493 1168 consensus_queue.cc:260] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.324652 1168 ts_tablet_manager.cc:1428] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:00:56.324986 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 537ab1626d4e44c38d8cca8c51921424 (DEFAULT_TABLE table=default.Table_2ade8cca26704d6aba7c861dee7b87b7 [id=403d8690063647f8a96225625f58531d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.326120 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 537ab1626d4e44c38d8cca8c51921424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.327272 1168 tablet_bootstrap.cc:492] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.333428 1168 tablet_bootstrap.cc:654] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.337384 730 tablet_service.cc:1467] Processing CreateTablet for tablet ba760b5fe1204df2932edd15bdcbaadf (DEFAULT_TABLE table=default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.337677 1174 raft_consensus.cc:482] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.337855 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bd966fa009d44bf94bcd865f6231f78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.337883 1174 raft_consensus.cc:504] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.338622 1174 leader_election.cc:288] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:00:56.339956 681 leader_election.cc:341] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 1accffd74f1a42b4bb2dc4f7110fddab
I20260620 07:00:56.340090 1168 tablet_bootstrap.cc:492] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.340255 1168 ts_tablet_manager.cc:1397] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20260620 07:00:56.341276 1168 raft_consensus.cc:348] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.341542 1168 raft_consensus.cc:374] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.341616 1168 raft_consensus.cc:729] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.341883 1168 consensus_queue.cc:260] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.343647 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.343652 1168 ts_tablet_manager.cc:1428] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:00:56.343907 727 tablet_service.cc:1467] Processing CreateTablet for tablet 9d05d17792e54877b29431754676dcad (DEFAULT_TABLE table=default.Table_361007b28d7e4f97b3d3b0f9d413c3e7 [id=6f4392721f754cce90275aa5e1f094ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.344630 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d05d17792e54877b29431754676dcad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.345749 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba760b5fe1204df2932edd15bdcbaadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.346225 1168 tablet_bootstrap.cc:492] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.349962 733 tablet_service.cc:1467] Processing CreateTablet for tablet 537ab1626d4e44c38d8cca8c51921424 (DEFAULT_TABLE table=default.Table_2ade8cca26704d6aba7c861dee7b87b7 [id=403d8690063647f8a96225625f58531d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.351791 728 tablet_service.cc:1467] Processing CreateTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 (DEFAULT_TABLE table=default.Table_61741807e243431395868ee24844d1aa [id=31b071f3fa7547fb8a222ac6b8bffd6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.352315 1178 raft_consensus.cc:482] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.352622 1170 tablet_bootstrap.cc:654] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.353541 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 537ab1626d4e44c38d8cca8c51921424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.357512 1178 raft_consensus.cc:504] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:56.363055 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe79bcf487fc4d118a91f4c62628d8a5 has no consensus state
I20260620 07:00:56.364037 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 329b18cc9b544cddbf0564d7de8a5c36
I20260620 07:00:56.365106 426 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 98385b3c486146a08b63a9507b060d80
W20260620 07:00:56.366091 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 537ab1626d4e44c38d8cca8c51921424 consensus state has no leader
I20260620 07:00:56.366371 420 master_service.cc:946] ReplaceTablet: received request to replace tablet fcc92630252b40a6a306c3a578fa3e59 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:56.368621 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 329b18cc9b544cddbf0564d7de8a5c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.368920 1165 tablet_replica.cc:330] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:56.369143 1165 raft_consensus.cc:2229] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.369309 1165 raft_consensus.cc:2258] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.358367 683 leader_election.cc:302] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:00:56.370114 1165 ts_tablet_manager.cc:1905] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.372048 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f763b0e91544700bd672c2ef751b4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.378487 1165 ts_tablet_manager.cc:1918] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.378854 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906fe0a195149d2844232cc8d83f6dd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:56.379133 1033 raft_consensus.cc:2454] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:56.379659 830 leader_election.cc:302] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.381160 1174 raft_consensus.cc:2781] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:56.381287 1174 raft_consensus.cc:482] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:56.381405 1174 raft_consensus.cc:3037] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.384413 1174 raft_consensus.cc:504] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.385911 1174 leader_election.cc:288] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.386245 1165 log.cc:1196] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/329b18cc9b544cddbf0564d7de8a5c36
I20260620 07:00:56.387486 1178 leader_election.cc:288] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.387764 1178 raft_consensus.cc:2781] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:56.387928 1178 raft_consensus.cc:482] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:56.388080 1178 raft_consensus.cc:3037] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.392115 1165 ts_tablet_manager.cc:1939] T 329b18cc9b544cddbf0564d7de8a5c36 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:56.392344 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 329b18cc9b544cddbf0564d7de8a5c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.392664 1169 ts_tablet_manager.cc:1918] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.394387 1168 tablet_bootstrap.cc:654] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.395507 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 329b18cc9b544cddbf0564d7de8a5c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.395565 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 329b18cc9b544cddbf0564d7de8a5c36 (table default.Table_2f6560957a4c40c186a1ebb5e88f7123 [id=a7b18d380f2a4a1b86f4c767c6a93221]) successfully deleted
I20260620 07:00:56.395781 1167 tablet_bootstrap.cc:492] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.395967 1167 ts_tablet_manager.cc:1397] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.345s user 0.078s sys 0.098s
I20260620 07:00:56.396921 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906fe0a195149d2844232cc8d83f6dd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:56.397159 1033 raft_consensus.cc:3037] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:00:56.397789 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 329b18cc9b544cddbf0564d7de8a5c36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 329b18cc9b544cddbf0564d7de8a5c36 already in progress: creating tablet
I20260620 07:00:56.400437 1167 raft_consensus.cc:348] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.400830 1167 raft_consensus.cc:374] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.401422 1167 raft_consensus.cc:729] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
W20260620 07:00:56.402525 681 leader_election.cc:341] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 9bd966fa009d44bf94bcd865f6231f78
I20260620 07:00:56.403088 1169 log.cc:1196] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/5ab6d4ca89c4482d835eaad2a66bc8ed
I20260620 07:00:56.403656 1169 ts_tablet_manager.cc:1939] T 5ab6d4ca89c4482d835eaad2a66bc8ed P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:56.405210 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 5ab6d4ca89c4482d835eaad2a66bc8ed (table default.Table_c3a21b866a364f0e97c74a240faf1dff [id=a53fbb10c3c84cb698f8973d0e23bce0]) successfully deleted
I20260620 07:00:56.409742 427 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 8cfe67bb67b04a48a84283263d8582e5
I20260620 07:00:56.409652 1178 raft_consensus.cc:504] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.410401 419 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 4e12d9e3c05c4230a16b584470e91446
I20260620 07:00:56.413260 1178 leader_election.cc:288] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:00:56.413946 681 leader_election.cc:341] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 1accffd74f1a42b4bb2dc4f7110fddab
I20260620 07:00:56.418448 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_09cf5a5a891a4f53be1f8c6f66b3759f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:56.418882 1169 tablet_replica.cc:330] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:00:56.419579 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09cf5a5a891a4f53be1f8c6f66b3759f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.423324 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a6ac4ea0133b41fe849335f60dba516e" } new_table_name: "default.Table_614fec7417f54a76bcc7d96e1e25ba56" modify_external_catalogs: true
I20260620 07:00:56.428210 423 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]). Expected version 1 got 0
I20260620 07:00:56.428449 423 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 52b0ef4797324c82832c11a1c98e2b42 (table default.Table_36a1a1d73652453dbde01677f41a650a [id=9fbfb3ec7f5348d3907734224702c69e]). Expected version 1 got 0
I20260620 07:00:56.423790 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_460e696ec5ea4e19a45d0da357d29439"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.429217 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_460e696ec5ea4e19a45d0da357d29439 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.424415 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_066c84335e324028aaab00d42e0e5aec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.431668 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_066c84335e324028aaab00d42e0e5aec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.424576 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_89bf00306e9c44a0a0de2e0a7235f436"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.435487 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89bf00306e9c44a0a0de2e0a7235f436 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.439422 1169 raft_consensus.cc:2229] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.439978 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 16a7e62b5af141ca8b5054ce8f46c2b6
I20260620 07:00:56.440047 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 1accffd74f1a42b4bb2dc4f7110fddab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.440541 422 catalog_manager.cc:6565] ReplaceTablet: tablet 16a7e62b5af141ca8b5054ce8f46c2b6 deleted and replaced by tablet 978f99d2a7d6448aba8dcd2611b75af3
I20260620 07:00:56.442260 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 978f99d2a7d6448aba8dcd2611b75af3) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.401525 1033 raft_consensus.cc:2454] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:56.441599 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 978f99d2a7d6448aba8dcd2611b75af3) from {username='slave'} at 127.0.0.1:41218
W20260620 07:00:56.443502 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16a7e62b5af141ca8b5054ce8f46c2b6 already in progress: creating tablet
I20260620 07:00:56.443418 1167 consensus_queue.cc:260] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.444165 1167 ts_tablet_manager.cc:1428] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.048s user 0.002s sys 0.001s
I20260620 07:00:56.444456 1169 raft_consensus.cc:2258] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.445108 1169 ts_tablet_manager.cc:1905] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.447783 830 leader_election.cc:302] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.448205 1174 raft_consensus.cc:2781] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:56.432868 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 14975b8743c14594ad2dcf82027e1658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:56.448794 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16a7e62b5af141ca8b5054ce8f46c2b6 already in progress: creating tablet
I20260620 07:00:56.449232 1167 tablet_bootstrap.cc:492] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.451541 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6fcb42f643c24e869fb0d7e2893ffa57
I20260620 07:00:56.451506 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 978f99d2a7d6448aba8dcd2611b75af3) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.452003 424 catalog_manager.cc:6565] ReplaceTablet: tablet 6fcb42f643c24e869fb0d7e2893ffa57 deleted and replaced by tablet 83451bba9a3c4c209dddf4250fea8806
I20260620 07:00:56.453740 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fcb42f643c24e869fb0d7e2893ffa57 with delete_type TABLET_DATA_DELETED (replaced by tablet 83451bba9a3c4c209dddf4250fea8806) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.454202 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fcb42f643c24e869fb0d7e2893ffa57 with delete_type TABLET_DATA_DELETED (replaced by tablet 83451bba9a3c4c209dddf4250fea8806) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:56.454428 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6fcb42f643c24e869fb0d7e2893ffa57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fcb42f643c24e869fb0d7e2893ffa57 already in progress: creating tablet
W20260620 07:00:56.454977 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6fcb42f643c24e869fb0d7e2893ffa57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fcb42f643c24e869fb0d7e2893ffa57 already in progress: creating tablet
I20260620 07:00:56.455220 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fcb42f643c24e869fb0d7e2893ffa57 with delete_type TABLET_DATA_DELETED (replaced by tablet 83451bba9a3c4c209dddf4250fea8806) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.456527 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2060ea1520d8404daa6b862b8945226e
I20260620 07:00:56.459827 423 master_service.cc:946] ReplaceTablet: received request to replace tablet bb1a7ae0a9b04fca9da8f441958c3280 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:56.461606 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 2060ea1520d8404daa6b862b8945226e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.461679 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 2060ea1520d8404daa6b862b8945226e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:56.462987 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2060ea1520d8404daa6b862b8945226e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2060ea1520d8404daa6b862b8945226e already in progress: creating tablet
I20260620 07:00:56.463357 1170 tablet_bootstrap.cc:492] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.463600 868 tablet_service.cc:1514] Processing DeleteTablet for tablet aaba6014285c4db4b8127d26df1e0625 with delete_type TABLET_DATA_DELETED (replaced by tablet 2060ea1520d8404daa6b862b8945226e) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:56.463560 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 141894us
I20260620 07:00:56.463794 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 1accffd74f1a42b4bb2dc4f7110fddab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.463923 1165 tablet_replica.cc:330] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:56.464028 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 329b18cc9b544cddbf0564d7de8a5c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.464143 1165 raft_consensus.cc:2229] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.464264 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 156b65f0b108434aba73e11b9785034b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.464367 1165 raft_consensus.cc:2258] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.464646 1170 ts_tablet_manager.cc:1397] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.162s user 0.007s sys 0.021s
I20260620 07:00:56.463569 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 2060ea1520d8404daa6b862b8945226e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.465438 1165 ts_tablet_manager.cc:1905] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.466545 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1accffd74f1a42b4bb2dc4f7110fddab" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:56.466833 895 raft_consensus.cc:3037] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.467819 1169 ts_tablet_manager.cc:1918] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.470634 895 raft_consensus.cc:2454] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:00:56.471989 1167 tablet_bootstrap.cc:654] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.472465 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906fe0a195149d2844232cc8d83f6dd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:56.473110 1170 raft_consensus.cc:348] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.473456 1170 raft_consensus.cc:374] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.473515 1169 log.cc:1196] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f8791a8dd68b4c1a8fe8d877f246d6ca
I20260620 07:00:56.473883 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906fe0a195149d2844232cc8d83f6dd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:56.474064 1169 ts_tablet_manager.cc:1939] T f8791a8dd68b4c1a8fe8d877f246d6ca P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:56.474711 1165 ts_tablet_manager.cc:1918] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.475203 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f8791a8dd68b4c1a8fe8d877f246d6ca (table default.Table_4921e4d884bb4c26a886078eecef48d7 [id=ceeb98c4fe424431b5e7cb258fe9800c]) successfully deleted
W20260620 07:00:56.475490 683 leader_election.cc:341] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 9bd966fa009d44bf94bcd865f6231f78
W20260620 07:00:56.474922 831 leader_election.cc:341] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:00:56.475924 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 13ea5f7db7b34922ac544b9ff2c76809 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13ea5f7db7b34922ac544b9ff2c76809 already in progress: creating tablet
W20260620 07:00:56.475998 831 leader_election.cc:341] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.475095 1174 raft_consensus.cc:686] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:56.476832 1174 consensus_queue.cc:237] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.477906 683 leader_election.cc:302] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:00:56.473555 1170 raft_consensus.cc:729] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.474876 1165 log.cc:1196] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/aaba6014285c4db4b8127d26df1e0625
I20260620 07:00:56.478502 1170 consensus_queue.cc:260] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.480662 1170 ts_tablet_manager.cc:1428] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260620 07:00:56.480540 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_76163e5d91214d9b9a2f003b085f6f6f" } new_table_name: "default.Table_dad5d59ba59b42ba9346f7a42624b6ef" modify_external_catalogs: true
I20260620 07:00:56.478854 1240 raft_consensus.cc:2726] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.479189 683 leader_election.cc:302] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:00:56.481459 1240 raft_consensus.cc:2781] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:56.481619 1240 raft_consensus.cc:686] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:00:56.482089 1240 consensus_queue.cc:237] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.482700 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1f5cbdecd4974d17961520344743336f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.483323 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f5cbdecd4974d17961520344743336f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.485316 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_89396513fc244d759a11c57d9cfa893e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.485893 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89396513fc244d759a11c57d9cfa893e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.486418 1167 tablet_bootstrap.cc:492] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.478538 1169 tablet_replica.cc:330] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:56.486581 1167 ts_tablet_manager.cc:1397] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.002s
I20260620 07:00:56.487466 1167 raft_consensus.cc:348] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.487715 1167 raft_consensus.cc:374] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.487787 1167 raft_consensus.cc:729] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.488059 1167 consensus_queue.cc:260] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.488680 1167 ts_tablet_manager.cc:1428] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260620 07:00:56.489003 1167 tablet_bootstrap.cc:492] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.490882 1167 tablet_bootstrap.cc:654] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.493171 1169 raft_consensus.cc:2229] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.494171 1169 raft_consensus.cc:2258] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.494661 1165 ts_tablet_manager.cc:1939] T aaba6014285c4db4b8127d26df1e0625 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:56.495221 1169 ts_tablet_manager.cc:1905] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.495697 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fcc92630252b40a6a306c3a578fa3e59
I20260620 07:00:56.496170 420 catalog_manager.cc:6565] ReplaceTablet: tablet fcc92630252b40a6a306c3a578fa3e59 deleted and replaced by tablet 04d5d361a5404dcf99a89e93ac1f7dd8
I20260620 07:00:56.497382 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet fcc92630252b40a6a306c3a578fa3e59 with delete_type TABLET_DATA_DELETED (replaced by tablet 04d5d361a5404dcf99a89e93ac1f7dd8) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.497393 728 tablet_service.cc:1514] Processing DeleteTablet for tablet fcc92630252b40a6a306c3a578fa3e59 with delete_type TABLET_DATA_DELETED (replaced by tablet 04d5d361a5404dcf99a89e93ac1f7dd8) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:56.498955 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fcc92630252b40a6a306c3a578fa3e59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcc92630252b40a6a306c3a578fa3e59 already in progress: creating tablet
I20260620 07:00:56.493947 1170 tablet_bootstrap.cc:492] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.501792 1167 tablet_bootstrap.cc:492] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.501823 1170 tablet_bootstrap.cc:654] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.501929 1167 ts_tablet_manager.cc:1397] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.001s
I20260620 07:00:56.502672 1167 raft_consensus.cc:348] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.502949 1167 raft_consensus.cc:374] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.503058 1167 raft_consensus.cc:729] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.503706 1167 consensus_queue.cc:260] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.504840 1167 ts_tablet_manager.cc:1428] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:00:56.505142 1167 tablet_bootstrap.cc:492] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.506863 1167 tablet_bootstrap.cc:654] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.508365 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_26f927ce5e714da5ae118310d32e42a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:56.508795 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ecf5c1d0fa64004bc4a01e96147167e with delete_type TABLET_DATA_DELETED (replaced by tablet 33517843ce1d4d8786c91fd738d81ab2) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:56.509018 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26f927ce5e714da5ae118310d32e42a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.512550 1167 tablet_bootstrap.cc:492] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.512780 1167 ts_tablet_manager.cc:1397] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260620 07:00:56.498615 876 tablet_service.cc:1514] Processing DeleteTablet for tablet fcc92630252b40a6a306c3a578fa3e59 with delete_type TABLET_DATA_DELETED (replaced by tablet 04d5d361a5404dcf99a89e93ac1f7dd8) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.513646 1167 raft_consensus.cc:348] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.515744 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet aaba6014285c4db4b8127d26df1e0625 (table default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]) successfully deleted
I20260620 07:00:56.516044 1165 tablet_replica.cc:330] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:56.516294 1165 raft_consensus.cc:2229] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.516486 1165 raft_consensus.cc:2258] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.522735 1167 raft_consensus.cc:374] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.522921 1167 raft_consensus.cc:729] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.523234 1167 consensus_queue.cc:260] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:56.523869 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c79a42afd7aa42d38e0fb673aebb3ed4 consensus state has no leader
I20260620 07:00:56.524021 1167 ts_tablet_manager.cc:1428] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260620 07:00:56.524318 1167 tablet_bootstrap.cc:492] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.526804 1165 ts_tablet_manager.cc:1905] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.529245 1168 tablet_bootstrap.cc:492] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.529398 1168 ts_tablet_manager.cc:1397] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.183s user 0.004s sys 0.000s
I20260620 07:00:56.529779 1167 tablet_bootstrap.cc:654] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.530251 1168 raft_consensus.cc:348] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.530504 1168 raft_consensus.cc:374] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.530619 1168 raft_consensus.cc:729] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.530918 1168 consensus_queue.cc:260] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.531507 1168 ts_tablet_manager.cc:1428] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:00:56.531785 1168 tablet_bootstrap.cc:492] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.533310 1168 tablet_bootstrap.cc:654] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.536195 1169 ts_tablet_manager.cc:1918] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.536955 1170 tablet_bootstrap.cc:492] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:00:56.536912 1194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260620 07:00:56.537222 1170 ts_tablet_manager.cc:1397] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.004s
I20260620 07:00:56.538298 1170 raft_consensus.cc:348] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.538651 1170 raft_consensus.cc:374] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.538750 1170 raft_consensus.cc:729] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.539201 1169 log.cc:1196] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/9bd966fa009d44bf94bcd865f6231f78
W20260620 07:00:56.539492 1194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 07:00:56.539647 1194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260620 07:00:56.539121 1170 consensus_queue.cc:260] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.539769 1167 tablet_bootstrap.cc:492] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.539904 1167 ts_tablet_manager.cc:1397] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260620 07:00:56.540627 1167 raft_consensus.cc:348] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.540830 1167 raft_consensus.cc:374] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.540901 1167 raft_consensus.cc:729] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.541131 1167 consensus_queue.cc:260] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.541821 1167 ts_tablet_manager.cc:1428] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:00:56.542138 1167 tablet_bootstrap.cc:492] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.542821 1170 ts_tablet_manager.cc:1428] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:00:56.543937 1167 tablet_bootstrap.cc:654] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.544170 1170 tablet_bootstrap.cc:492] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.545886 1170 tablet_bootstrap.cc:654] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.548161 1168 tablet_bootstrap.cc:492] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.548552 1168 ts_tablet_manager.cc:1397] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260620 07:00:56.546380 1169 ts_tablet_manager.cc:1939] T 9bd966fa009d44bf94bcd865f6231f78 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:00:56.550698 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83451bba9a3c4c209dddf4250fea8806 has no consensus state
I20260620 07:00:56.550990 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 13ea5f7db7b34922ac544b9ff2c76809 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:56.551520 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 9bd966fa009d44bf94bcd865f6231f78 (table default.Table_86fbf15f63ce4fef9eb0af8e7ded9b47 [id=c8fb3e499488487d8d0d5b5a9f0b9eee]) successfully deleted
I20260620 07:00:56.551635 1169 tablet_replica.cc:330] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:00:56.551820 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 329b18cc9b544cddbf0564d7de8a5c36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 329b18cc9b544cddbf0564d7de8a5c36 already in progress: creating tablet
I20260620 07:00:56.551818 1169 raft_consensus.cc:2229] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:56.552101 1167 tablet_bootstrap.cc:492] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.552263 1167 ts_tablet_manager.cc:1397] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20260620 07:00:56.552287 1169 pending_rounds.cc:62] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:00:56.552796 1168 raft_consensus.cc:348] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.553095 1168 raft_consensus.cc:374] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.553195 1168 raft_consensus.cc:729] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.553426 1167 raft_consensus.cc:348] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.553684 1167 raft_consensus.cc:374] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.553599 1169 pending_rounds.cc:68] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821556156039168 op_type: NO_OP noop_request { }
I20260620 07:00:56.553759 1167 raft_consensus.cc:729] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.553854 1169 raft_consensus.cc:2866] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:56.553995 1169 raft_consensus.cc:2258] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.554004 1167 consensus_queue.cc:260] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.553442 1168 consensus_queue.cc:260] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.555595 1167 ts_tablet_manager.cc:1428] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:00:56.556481 1168 ts_tablet_manager.cc:1428] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260620 07:00:56.556762 1167 tablet_bootstrap.cc:492] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.557412 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b2f703e512b443a1a6f0fa0ad1a613cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:56.557663 1168 tablet_bootstrap.cc:492] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:00:56.558048 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2f703e512b443a1a6f0fa0ad1a613cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.558512 1167 tablet_bootstrap.cc:654] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.560242 1168 tablet_bootstrap.cc:654] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.560705 1167 tablet_bootstrap.cc:492] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.560844 1167 ts_tablet_manager.cc:1397] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260620 07:00:56.562342 1170 tablet_bootstrap.cc:492] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.562021 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c649dd8a94d74f428ec6a8c9b77288c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:56.562534 1170 ts_tablet_manager.cc:1397] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
W20260620 07:00:56.562996 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c649dd8a94d74f428ec6a8c9b77288c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.563380 1170 raft_consensus.cc:348] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.563685 1170 raft_consensus.cc:374] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.563761 1170 raft_consensus.cc:729] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.563982 1170 consensus_queue.cc:260] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.565555 1170 ts_tablet_manager.cc:1428] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 07:00:56.565954 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8a02f49391a247dd913a1eee7a6dcd61" } new_table_name: "default.Table_f7d77da45d5248419e216d47e3676655" modify_external_catalogs: true
I20260620 07:00:56.566038 1170 tablet_bootstrap.cc:492] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.569883 1170 tablet_bootstrap.cc:654] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.567762 1167 raft_consensus.cc:348] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.570885 1167 raft_consensus.cc:374] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.571013 1167 raft_consensus.cc:729] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.571254 1167 consensus_queue.cc:260] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.571913 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_460e696ec5ea4e19a45d0da357d29439" } new_table_name: "default.Table_18beb2a49dce4703b96c71c424561ed3" modify_external_catalogs: true
I20260620 07:00:56.572947 1167 ts_tablet_manager.cc:1428] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260620 07:00:56.573787 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e580e9992f4d43f38e5740b9bc550766" } new_table_name: "default.Table_a6499deb17cd47d38f57370dff50f181" modify_external_catalogs: true
I20260620 07:00:56.574141 1167 tablet_bootstrap.cc:492] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.575824 1167 tablet_bootstrap.cc:654] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.575925 1240 raft_consensus.cc:482] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.576081 1240 raft_consensus.cc:504] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.577234 1240 leader_election.cc:288] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:00:56.580188 683 leader_election.cc:341] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 654c6215d7634f8594cae155c436c175
W20260620 07:00:56.581324 681 leader_election.cc:341] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 654c6215d7634f8594cae155c436c175
I20260620 07:00:56.581462 681 leader_election.cc:302] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:00:56.581612 422 catalog_manager.cc:5495] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:00:56.582211 1240 raft_consensus.cc:2726] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.582631 1167 tablet_bootstrap.cc:492] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.582645 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]). Expected version 1 got 0
I20260620 07:00:56.582806 1167 ts_tablet_manager.cc:1397] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260620 07:00:56.583092 1168 tablet_bootstrap.cc:492] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.583248 1168 ts_tablet_manager.cc:1397] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.008s
I20260620 07:00:56.583491 1167 raft_consensus.cc:348] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.583748 1167 raft_consensus.cc:374] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.583817 1167 raft_consensus.cc:729] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.584053 1168 raft_consensus.cc:348] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.584270 1168 raft_consensus.cc:374] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.584049 421 catalog_manager.cc:5495] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } }
I20260620 07:00:56.584355 1168 raft_consensus.cc:729] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.584548 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2906fe0a195149d2844232cc8d83f6dd (table default.Table_07215f09fe3e4b7d9c1b0786ef82d218 [id=f12e60a2a8a341c8b574d0dc90fa315a]). Expected version 2 got 0
I20260620 07:00:56.584607 1168 consensus_queue.cc:260] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.584766 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet c79a42afd7aa42d38e0fb673aebb3ed4 (table default.Table_614fec7417f54a76bcc7d96e1e25ba56 [id=55a13c7617e345339dde6677b11008be]). Expected version 1 got 0
W20260620 07:00:56.585326 1194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 07:00:56.585476 1194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260620 07:00:56.585383 1167 consensus_queue.cc:260] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:56.585562 1194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 07:00:56.585790 1194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 07:00:56.586593 1008 tablet_service.cc:1467] Processing CreateTablet for tablet ad65565caddf4e878292d1178fbf6037 (DEFAULT_TABLE table=default.Table_85568ce0333b42d4958c533a98d966b4 [id=be57b2e7e64a4f669ef82569004d523e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.587117 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad65565caddf4e878292d1178fbf6037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.587632 1167 ts_tablet_manager.cc:1428] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260620 07:00:56.588670 1168 ts_tablet_manager.cc:1428] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:00:56.592195 876 tablet_service.cc:1467] Processing CreateTablet for tablet ad65565caddf4e878292d1178fbf6037 (DEFAULT_TABLE table=default.Table_85568ce0333b42d4958c533a98d966b4 [id=be57b2e7e64a4f669ef82569004d523e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.592634 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad65565caddf4e878292d1178fbf6037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.594398 728 tablet_service.cc:1467] Processing CreateTablet for tablet ad65565caddf4e878292d1178fbf6037 (DEFAULT_TABLE table=default.Table_85568ce0333b42d4958c533a98d966b4 [id=be57b2e7e64a4f669ef82569004d523e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.594811 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad65565caddf4e878292d1178fbf6037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.594873 1012 tablet_service.cc:1467] Processing CreateTablet for tablet fe79bcf487fc4d118a91f4c62628d8a5 (DEFAULT_TABLE table=default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.595067 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 (DEFAULT_TABLE table=default.Table_a77c53a332ef44b584f6cdedaf0fa001 [id=1b7f0b11c53649f29df954f7abcd30f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.595256 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe79bcf487fc4d118a91f4c62628d8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.595443 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.598011 729 tablet_service.cc:1467] Processing CreateTablet for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 (DEFAULT_TABLE table=default.Table_a77c53a332ef44b584f6cdedaf0fa001 [id=1b7f0b11c53649f29df954f7abcd30f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.598428 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.598809 1201 raft_consensus.cc:482] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.598961 1201 raft_consensus.cc:504] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.599452 874 tablet_service.cc:1467] Processing CreateTablet for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 (DEFAULT_TABLE table=default.Table_a77c53a332ef44b584f6cdedaf0fa001 [id=1b7f0b11c53649f29df954f7abcd30f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.599581 1201 leader_election.cc:288] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:56.599905 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.600888 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c79a42afd7aa42d38e0fb673aebb3ed4" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:56.601701 968 leader_election.cc:341] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.602598 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c79a42afd7aa42d38e0fb673aebb3ed4" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:56.603180 895 raft_consensus.cc:2454] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:56.603731 969 leader_election.cc:302] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:56.604166 1201 raft_consensus.cc:2781] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:56.604278 1201 raft_consensus.cc:482] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:56.604357 1201 raft_consensus.cc:3037] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.606364 873 tablet_service.cc:1467] Processing CreateTablet for tablet fe79bcf487fc4d118a91f4c62628d8a5 (DEFAULT_TABLE table=default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.606806 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe79bcf487fc4d118a91f4c62628d8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.608196 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 610a25c729cf41b4bd71372bc36365a8 (DEFAULT_TABLE table=default.Table_e580e9992f4d43f38e5740b9bc550766 [id=2b29e3533ace483db8c5f38a662f63f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.608615 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 610a25c729cf41b4bd71372bc36365a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.611192 1010 tablet_service.cc:1467] Processing CreateTablet for tablet f90f1b2facc0415ab378fb81b60b0202 (DEFAULT_TABLE table=default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.611579 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f90f1b2facc0415ab378fb81b60b0202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.612568 1167 tablet_bootstrap.cc:492] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.612876 1011 tablet_service.cc:1467] Processing CreateTablet for tablet b8799f2a2aed4688aa4e6e590dc83a4e (DEFAULT_TABLE table=default.Table_551c55403131424c87aee4c019ca1466 [id=fc9d4751547b40ae866b1c82804da11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.613692 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8799f2a2aed4688aa4e6e590dc83a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.614029 1170 tablet_bootstrap.cc:492] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.614230 1170 ts_tablet_manager.cc:1397] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.002s
I20260620 07:00:56.614652 1167 tablet_bootstrap.cc:654] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.615669 874 tablet_service.cc:1467] Processing CreateTablet for tablet f90f1b2facc0415ab378fb81b60b0202 (DEFAULT_TABLE table=default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.616091 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f90f1b2facc0415ab378fb81b60b0202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.616318 1170 raft_consensus.cc:348] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.616569 1170 raft_consensus.cc:374] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.616659 1170 raft_consensus.cc:729] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.616917 1170 consensus_queue.cc:260] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.617765 872 tablet_service.cc:1467] Processing CreateTablet for tablet 610a25c729cf41b4bd71372bc36365a8 (DEFAULT_TABLE table=default.Table_e580e9992f4d43f38e5740b9bc550766 [id=2b29e3533ace483db8c5f38a662f63f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.618161 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 610a25c729cf41b4bd71372bc36365a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.618432 1201 raft_consensus.cc:504] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.620790 1170 ts_tablet_manager.cc:1428] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 07:00:56.622880 1201 leader_election.cc:288] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:56.623833 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c79a42afd7aa42d38e0fb673aebb3ed4" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:56.624087 895 raft_consensus.cc:3037] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.625910 1170 tablet_bootstrap.cc:492] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.627398 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c79a42afd7aa42d38e0fb673aebb3ed4" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:56.627688 1170 tablet_bootstrap.cc:654] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:56.627990 968 leader_election.cc:341] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.628671 895 raft_consensus.cc:2454] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:56.629336 969 leader_election.cc:302] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:56.629549 1168 tablet_bootstrap.cc:492] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.631806 1176 raft_consensus.cc:2781] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:56.637722 1201 raft_consensus.cc:482] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.638259 1168 tablet_bootstrap.cc:654] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.638021 1201 raft_consensus.cc:504] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.638298 1194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:46775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=44063
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 06:01:36 UTC on ccycloud.quasar-ouulox.root.comops.site
build id 4457022
ASAN enabled
I20260620 07:00:56.639156 1174 raft_consensus.cc:482] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.639369 1174 raft_consensus.cc:504] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.640174 1174 leader_election.cc:288] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.640887 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a7ae0a9b04fca9da8f441958c3280" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:56.641013 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba907170f2df4bd0b5e42d4c2d29b21e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:56.641588 968 leader_election.cc:341] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.641803 1201 leader_election.cc:288] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:00:56.643848 831 leader_election.cc:341] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.647231 1194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 07:00:56.647289 1176 raft_consensus.cc:686] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:56.647713 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba907170f2df4bd0b5e42d4c2d29b21e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:56.647940 874 tablet_service.cc:1467] Processing CreateTablet for tablet b8799f2a2aed4688aa4e6e590dc83a4e (DEFAULT_TABLE table=default.Table_551c55403131424c87aee4c019ca1466 [id=fc9d4751547b40ae866b1c82804da11a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:56.648433 830 leader_election.cc:341] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.648633 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8799f2a2aed4688aa4e6e590dc83a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.648594 830 leader_election.cc:302] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:00:56.648603 413 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.61:33455, user_credentials={real_user=slave}} blocked reactor thread for 54714.6us
I20260620 07:00:56.649135 1174 raft_consensus.cc:2726] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.649411 729 tablet_service.cc:1467] Processing CreateTablet for tablet fe79bcf487fc4d118a91f4c62628d8a5 (DEFAULT_TABLE table=default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.647709 1176 consensus_queue.cc:237] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.649886 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe79bcf487fc4d118a91f4c62628d8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.650010 734 tablet_service.cc:1467] Processing CreateTablet for tablet 610a25c729cf41b4bd71372bc36365a8 (DEFAULT_TABLE table=default.Table_e580e9992f4d43f38e5740b9bc550766 [id=2b29e3533ace483db8c5f38a662f63f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.650542 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 610a25c729cf41b4bd71372bc36365a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.650928 728 tablet_service.cc:1467] Processing CreateTablet for tablet f90f1b2facc0415ab378fb81b60b0202 (DEFAULT_TABLE table=default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.651283 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f90f1b2facc0415ab378fb81b60b0202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.656195 727 tablet_service.cc:1467] Processing CreateTablet for tablet b8799f2a2aed4688aa4e6e590dc83a4e (DEFAULT_TABLE table=default.Table_551c55403131424c87aee4c019ca1466 [id=fc9d4751547b40ae866b1c82804da11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.656725 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8799f2a2aed4688aa4e6e590dc83a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.657249 1168 tablet_bootstrap.cc:492] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.657414 1168 ts_tablet_manager.cc:1397] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.000s
I20260620 07:00:56.658211 1168 raft_consensus.cc:348] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.658447 1168 raft_consensus.cc:374] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.658516 1168 raft_consensus.cc:729] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.658751 1168 consensus_queue.cc:260] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.659634 1167 tablet_bootstrap.cc:492] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.659791 1167 ts_tablet_manager.cc:1397] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.002s
I20260620 07:00:56.660593 1167 raft_consensus.cc:348] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.660815 1167 raft_consensus.cc:374] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.661684 1167 raft_consensus.cc:729] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.662001 1167 consensus_queue.cc:260] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.662647 1167 ts_tablet_manager.cc:1428] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:00:56.664083 1167 tablet_bootstrap.cc:492] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.665143 1168 ts_tablet_manager.cc:1428] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260620 07:00:56.669823 1194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 07:00:56.669878 1168 tablet_bootstrap.cc:492] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.671733 1170 tablet_bootstrap.cc:492] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.671917 1170 ts_tablet_manager.cc:1397] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.046s user 0.006s sys 0.005s
I20260620 07:00:56.672252 1167 tablet_bootstrap.cc:654] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.672732 1170 raft_consensus.cc:348] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.673027 1170 raft_consensus.cc:374] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.673108 1170 raft_consensus.cc:729] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.673789 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a7ae0a9b04fca9da8f441958c3280" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:56.673774 1170 consensus_queue.cc:260] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.674449 1168 tablet_bootstrap.cc:654] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:56.674743 969 leader_election.cc:341] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.674989 969 leader_election.cc:302] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:00:56.675307 1263 raft_consensus.cc:2726] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.676064 1167 tablet_bootstrap.cc:492] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.676196 1170 ts_tablet_manager.cc:1428] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260620 07:00:56.676226 1167 ts_tablet_manager.cc:1397] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20260620 07:00:56.676939 1167 raft_consensus.cc:348] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.677276 1167 raft_consensus.cc:374] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.677369 1167 raft_consensus.cc:729] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.677606 1167 consensus_queue.cc:260] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.678144 1170 tablet_bootstrap.cc:492] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.678165 1167 ts_tablet_manager.cc:1428] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:00:56.679948 1170 tablet_bootstrap.cc:654] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.682317 1167 tablet_bootstrap.cc:492] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.684374 1167 tablet_bootstrap.cc:654] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.690855 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_551c55403131424c87aee4c019ca1466" } modify_external_catalogs: true
I20260620 07:00:56.691169 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_551c55403131424c87aee4c019ca1466" } modify_external_catalogs: true
I20260620 07:00:56.692862 1170 tablet_bootstrap.cc:492] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.693010 1170 ts_tablet_manager.cc:1397] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.007s
I20260620 07:00:56.693796 1170 raft_consensus.cc:348] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.694012 1170 raft_consensus.cc:374] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.694083 1170 raft_consensus.cc:729] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.694330 1170 consensus_queue.cc:260] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.696534 1170 ts_tablet_manager.cc:1428] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 07:00:56.698391 1170 tablet_bootstrap.cc:492] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.700587 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_614fec7417f54a76bcc7d96e1e25ba56" } modify_external_catalogs: true
I20260620 07:00:56.700959 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_614fec7417f54a76bcc7d96e1e25ba56" } modify_external_catalogs: true
I20260620 07:00:56.701926 1170 tablet_bootstrap.cc:654] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.703805 1169 ts_tablet_manager.cc:1905] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.703856 1174 raft_consensus.cc:482] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.704025 1174 raft_consensus.cc:504] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.688936 734 tablet_service.cc:1467] Processing CreateTablet for tablet 63dfade71c254d7e908e00acada93638 (DEFAULT_TABLE table=default.Table_8150c6274659447da7ba165c9ca49a19 [id=7230178ddc264a3faaa90ddc66afffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.704792 1174 leader_election.cc:288] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.705173 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_61741807e243431395868ee24844d1aa" } modify_external_catalogs: true
I20260620 07:00:56.705358 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_61741807e243431395868ee24844d1aa" } modify_external_catalogs: true
I20260620 07:00:56.705508 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61f53616121e4a52835b8b7da1fa5372" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:56.705902 1263 raft_consensus.cc:482] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.706099 1263 raft_consensus.cc:504] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:56.707278 831 leader_election.cc:341] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.707952 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61f53616121e4a52835b8b7da1fa5372" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:56.708387 1263 leader_election.cc:288] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:56.708647 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63dfade71c254d7e908e00acada93638. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:56.709071 830 leader_election.cc:341] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.709221 830 leader_election.cc:302] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:56.709590 1174 raft_consensus.cc:2726] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.710379 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "329b18cc9b544cddbf0564d7de8a5c36" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:56.710949 968 leader_election.cc:341] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:00:56.711817 969 leader_election.cc:341] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 329b18cc9b544cddbf0564d7de8a5c36
I20260620 07:00:56.711814 874 tablet_service.cc:1467] Processing CreateTablet for tablet 63dfade71c254d7e908e00acada93638 (DEFAULT_TABLE table=default.Table_8150c6274659447da7ba165c9ca49a19 [id=7230178ddc264a3faaa90ddc66afffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.711962 969 leader_election.cc:302] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:00:56.712242 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63dfade71c254d7e908e00acada93638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:56.712357 1263 raft_consensus.cc:2726] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.713631 1168 tablet_bootstrap.cc:492] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.713864 1168 ts_tablet_manager.cc:1397] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.044s user 0.012s sys 0.000s
I20260620 07:00:56.714442 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_11cde52aaf3944eeb72cef8645b01d6a" } modify_external_catalogs: true
I20260620 07:00:56.714704 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_11cde52aaf3944eeb72cef8645b01d6a" } modify_external_catalogs: true
I20260620 07:00:56.714851 1168 raft_consensus.cc:348] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.715061 1168 raft_consensus.cc:374] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.715166 1168 raft_consensus.cc:729] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.715415 1168 consensus_queue.cc:260] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.716044 1170 tablet_bootstrap.cc:492] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.716218 1170 ts_tablet_manager.cc:1397] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.001s
I20260620 07:00:56.717015 1170 raft_consensus.cc:348] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.717275 1170 raft_consensus.cc:374] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.717371 1170 raft_consensus.cc:729] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.717631 1170 consensus_queue.cc:260] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.718575 1168 ts_tablet_manager.cc:1428] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:00:56.719775 1169 ts_tablet_manager.cc:1918] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:56.719925 1169 log.cc:1196] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/1accffd74f1a42b4bb2dc4f7110fddab
I20260620 07:00:56.719949 1168 tablet_bootstrap.cc:492] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.720367 1169 ts_tablet_manager.cc:1939] T 1accffd74f1a42b4bb2dc4f7110fddab P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:56.721414 1167 tablet_bootstrap.cc:492] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.721710 1167 ts_tablet_manager.cc:1397] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20260620 07:00:56.722470 1168 tablet_bootstrap.cc:654] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.722923 1167 raft_consensus.cc:348] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.723304 1167 raft_consensus.cc:374] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.723479 1167 raft_consensus.cc:729] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.723881 1167 consensus_queue.cc:260] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.724650 1167 ts_tablet_manager.cc:1428] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:00:56.725044 1167 tablet_bootstrap.cc:492] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:00:56.727147 1272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:00:56.728623 1167 tablet_bootstrap.cc:654] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.720399 1170 ts_tablet_manager.cc:1428] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:00:56.730587 1170 tablet_bootstrap.cc:492] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.731621 1174 raft_consensus.cc:482] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.731776 1174 raft_consensus.cc:504] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.732064 1246 raft_consensus.cc:482] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.732270 1246 raft_consensus.cc:504] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.732501 1170 tablet_bootstrap.cc:654] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.732506 1174 leader_election.cc:288] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.733016 1246 leader_election.cc:288] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:00:56.733757 830 leader_election.cc:341] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 156b65f0b108434aba73e11b9785034b
I20260620 07:00:56.734058 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "156b65f0b108434aba73e11b9785034b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:56.734321 752 raft_consensus.cc:2454] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:56.734676 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52b0ef4797324c82832c11a1c98e2b42" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:56.734949 1033 raft_consensus.cc:2454] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
W20260620 07:00:56.735323 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 537ab1626d4e44c38d8cca8c51921424 consensus state has no leader
I20260620 07:00:56.735373 830 leader_election.cc:302] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.735626 1246 raft_consensus.cc:2781] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:56.735756 1246 raft_consensus.cc:482] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:56.735858 1246 raft_consensus.cc:3037] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.735882 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52b0ef4797324c82832c11a1c98e2b42" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:56.735886 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2a842ef988174540bb18300a4788c4cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:56.736092 753 raft_consensus.cc:2454] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
W20260620 07:00:56.736502 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a842ef988174540bb18300a4788c4cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.736625 831 leader_election.cc:302] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:00:56.737231 1174 raft_consensus.cc:2781] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:56.737356 1174 raft_consensus.cc:482] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:56.737469 1174 raft_consensus.cc:3037] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.739737 1246 raft_consensus.cc:504] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.740307 1174 raft_consensus.cc:504] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.740453 1246 leader_election.cc:288] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.740911 1174 leader_election.cc:288] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.742595 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52b0ef4797324c82832c11a1c98e2b42" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:56.742743 1169 tablet_replica.cc:330] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:56.742871 1033 raft_consensus.cc:3037] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.743027 1169 raft_consensus.cc:2229] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.743036 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 63dfade71c254d7e908e00acada93638 (DEFAULT_TABLE table=default.Table_8150c6274659447da7ba165c9ca49a19 [id=7230178ddc264a3faaa90ddc66afffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:56.743247 1169 raft_consensus.cc:2258] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.743808 1169 ts_tablet_manager.cc:1905] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.744292 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63dfade71c254d7e908e00acada93638. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:56.745805 1274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:00:56.746300 1033 raft_consensus.cc:2454] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
W20260620 07:00:56.746910 830 leader_election.cc:341] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 156b65f0b108434aba73e11b9785034b
I20260620 07:00:56.747153 830 leader_election.cc:302] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.748148 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "156b65f0b108434aba73e11b9785034b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:56.748389 752 raft_consensus.cc:3037] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.748935 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 1accffd74f1a42b4bb2dc4f7110fddab (table default.Table_0c5e7592b74d47cd8e103fc05680d1f0 [id=d93e37b7b9b8436389982f544808fc14]) successfully deleted
I20260620 07:00:56.751003 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52b0ef4797324c82832c11a1c98e2b42" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:56.751281 753 raft_consensus.cc:3037] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:00:56.752735 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7200877be18c4eaca57df88c25d30c01 has no consensus state
I20260620 07:00:56.753047 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 6fcb42f643c24e869fb0d7e2893ffa57 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:56.753535 752 raft_consensus.cc:2454] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:56.753657 419 master_service.cc:946] ReplaceTablet: received request to replace tablet f90f1b2facc0415ab378fb81b60b0202 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:56.754060 831 leader_election.cc:302] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:00:56.754498 1246 raft_consensus.cc:2781] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:56.755360 1167 tablet_bootstrap.cc:492] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.755597 1167 ts_tablet_manager.cc:1397] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.001s
I20260620 07:00:56.758075 1167 raft_consensus.cc:348] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.758445 1167 raft_consensus.cc:374] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.758527 1167 raft_consensus.cc:729] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.758987 753 raft_consensus.cc:2454] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:56.758852 1167 consensus_queue.cc:260] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.759449 1174 raft_consensus.cc:2781] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:56.759696 1167 ts_tablet_manager.cc:1428] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:00:56.767195 1174 raft_consensus.cc:686] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:56.767743 1174 consensus_queue.cc:237] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:56.771672 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 610a25c729cf41b4bd71372bc36365a8 consensus state has no leader
I20260620 07:00:56.772186 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9a3e71613faa4670b104d7f0b524034e" } modify_external_catalogs: true
I20260620 07:00:56.772389 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9a3e71613faa4670b104d7f0b524034e" } modify_external_catalogs: true
I20260620 07:00:56.777220 1170 tablet_bootstrap.cc:492] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.777437 1170 ts_tablet_manager.cc:1397] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.004s
I20260620 07:00:56.778566 1170 raft_consensus.cc:348] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.778828 1263 raft_consensus.cc:482] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.778947 1170 raft_consensus.cc:374] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.779045 1170 raft_consensus.cc:729] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.779009 1263 raft_consensus.cc:504] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.779330 1170 consensus_queue.cc:260] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.779670 1263 leader_election.cc:288] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:56.779901 1170 ts_tablet_manager.cc:1428] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:00:56.780179 1170 tablet_bootstrap.cc:492] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.780407 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33517843ce1d4d8786c91fd738d81ab2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:00:56.781405 969 leader_election.cc:341] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.781483 1167 tablet_bootstrap.cc:492] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.781890 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33517843ce1d4d8786c91fd738d81ab2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:56.782485 968 leader_election.cc:341] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.782613 968 leader_election.cc:302] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:00:56.783097 1263 raft_consensus.cc:2726] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.785109 1170 tablet_bootstrap.cc:654] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.790144 422 master_service.cc:946] ReplaceTablet: received request to replace tablet ba760b5fe1204df2932edd15bdcbaadf from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:56.790239 1167 tablet_bootstrap.cc:654] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.793180 1170 tablet_bootstrap.cc:492] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.793514 1170 ts_tablet_manager.cc:1397] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260620 07:00:56.793697 1169 ts_tablet_manager.cc:1918] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.796506 1165 ts_tablet_manager.cc:1918] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.796741 1165 log.cc:1196] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/1accffd74f1a42b4bb2dc4f7110fddab
I20260620 07:00:56.796828 1169 log.cc:1196] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/14975b8743c14594ad2dcf82027e1658
I20260620 07:00:56.797390 1165 ts_tablet_manager.cc:1939] T 1accffd74f1a42b4bb2dc4f7110fddab P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:56.797447 1169 ts_tablet_manager.cc:1939] T 14975b8743c14594ad2dcf82027e1658 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:56.794286 1170 raft_consensus.cc:348] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.797724 1170 raft_consensus.cc:374] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.797874 1170 raft_consensus.cc:729] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.798321 1165 tablet_replica.cc:330] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:56.798323 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 1accffd74f1a42b4bb2dc4f7110fddab (table default.Table_0c5e7592b74d47cd8e103fc05680d1f0 [id=d93e37b7b9b8436389982f544808fc14]) successfully deleted
I20260620 07:00:56.798264 1170 consensus_queue.cc:260] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:56.798906 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 329b18cc9b544cddbf0564d7de8a5c36 because the tablet was not found. No further retry: Not found: Tablet not found: 329b18cc9b544cddbf0564d7de8a5c36
I20260620 07:00:56.799065 1170 ts_tablet_manager.cc:1428] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:00:56.799610 1170 tablet_bootstrap.cc:492] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.801847 1170 tablet_bootstrap.cc:654] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.803872 1167 tablet_bootstrap.cc:492] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.804080 1167 ts_tablet_manager.cc:1397] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260620 07:00:56.805099 1167 raft_consensus.cc:348] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.805426 1167 raft_consensus.cc:374] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.805547 1167 raft_consensus.cc:729] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.805840 1167 consensus_queue.cc:260] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.806736 1167 ts_tablet_manager.cc:1428] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:00:56.807164 1167 tablet_bootstrap.cc:492] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.810154 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 14975b8743c14594ad2dcf82027e1658 (table default.Table_62b64e3064814fd98928a194b9bc93e2 [id=8395cc24724942e9b6eeefe1ae52f0db]) successfully deleted
I20260620 07:00:56.810635 1246 raft_consensus.cc:686] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:56.812213 1246 consensus_queue.cc:237] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.813606 1165 raft_consensus.cc:2229] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:56.814307 1165 pending_rounds.cc:62] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:00:56.814560 1165 pending_rounds.cc:68] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821557323550720 op_type: NO_OP noop_request { }
I20260620 07:00:56.814883 1165 raft_consensus.cc:2866] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:56.815765 1169 tablet_replica.cc:330] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:56.816200 1169 raft_consensus.cc:2229] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.817811 1169 raft_consensus.cc:2258] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.819031 1167 tablet_bootstrap.cc:654] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.820120 1165 raft_consensus.cc:2258] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.820376 1169 ts_tablet_manager.cc:1905] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.821555 1165 ts_tablet_manager.cc:1905] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:00:56.825090 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16a7e62b5af141ca8b5054ce8f46c2b6 already in progress: creating tablet
W20260620 07:00:56.825381 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6fcb42f643c24e869fb0d7e2893ffa57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fcb42f643c24e869fb0d7e2893ffa57 already in progress: creating tablet
I20260620 07:00:56.828320 1170 tablet_bootstrap.cc:492] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.828543 1170 ts_tablet_manager.cc:1397] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.003s
I20260620 07:00:56.829435 1170 raft_consensus.cc:348] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.829757 1170 raft_consensus.cc:374] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.829890 1170 raft_consensus.cc:729] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.830189 1170 consensus_queue.cc:260] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.832219 1170 ts_tablet_manager.cc:1428] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:00:56.832556 1170 tablet_bootstrap.cc:492] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.839594 1170 tablet_bootstrap.cc:654] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.843351 1165 ts_tablet_manager.cc:1918] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:56.843703 1165 log.cc:1196] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/156b65f0b108434aba73e11b9785034b
I20260620 07:00:56.844069 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 2906fe0a195149d2844232cc8d83f6dd (table default.Table_07215f09fe3e4b7d9c1b0786ef82d218 [id=f12e60a2a8a341c8b574d0dc90fa315a]). Expected version 2 got 0
I20260620 07:00:56.844581 1165 ts_tablet_manager.cc:1939] T 156b65f0b108434aba73e11b9785034b P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:56.845880 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 156b65f0b108434aba73e11b9785034b (table default.Table_5b650174e77b47b4a6283f9b22fb701d [id=b9587405857f4c8fbfcd41538fd20960]) successfully deleted
W20260620 07:00:56.846706 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2060ea1520d8404daa6b862b8945226e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2060ea1520d8404daa6b862b8945226e already in progress: creating tablet
W20260620 07:00:56.847406 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fcc92630252b40a6a306c3a578fa3e59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcc92630252b40a6a306c3a578fa3e59 already in progress: creating tablet
I20260620 07:00:56.847808 1240 raft_consensus.cc:482] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.847967 1240 raft_consensus.cc:504] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:00:56.825584 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2060ea1520d8404daa6b862b8945226e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2060ea1520d8404daa6b862b8945226e already in progress: creating tablet
W20260620 07:00:56.848639 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet fcc92630252b40a6a306c3a578fa3e59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcc92630252b40a6a306c3a578fa3e59 already in progress: creating tablet
I20260620 07:00:56.848694 1240 leader_election.cc:288] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:56.849841 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a56f30ca69e45e3a9ddd41f117f61e2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:56.852998 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a56f30ca69e45e3a9ddd41f117f61e2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:56.853320 895 raft_consensus.cc:2379] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 06a32ef63b2b495a9ade1de48c024ae9 in this term.
I20260620 07:00:56.854740 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b8799f2a2aed4688aa4e6e590dc83a4e
I20260620 07:00:56.857048 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 61f53616121e4a52835b8b7da1fa5372
I20260620 07:00:56.857112 425 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 88635d3b7d83435f8fc8e89dc8de173b (table default.Table_b623e145e58e4cb9b1d75359c4d1cf8e [id=f28fed67d2244a1694c6688535cc5213]). Expected version 1 got 0
I20260620 07:00:56.857295 425 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]). Expected version 1 got 0
I20260620 07:00:56.857473 425 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 52b0ef4797324c82832c11a1c98e2b42 (table default.Table_36a1a1d73652453dbde01677f41a650a [id=9fbfb3ec7f5348d3907734224702c69e]). Expected version 1 got 0
I20260620 07:00:56.857529 1167 tablet_bootstrap.cc:492] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.857579 427 master_service.cc:946] ReplaceTablet: received request to replace tablet ba3862ba4ebf410baebcc1246b08ddc9 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:56.857757 1167 ts_tablet_manager.cc:1397] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.004s
I20260620 07:00:56.858827 1167 raft_consensus.cc:348] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.859171 1167 raft_consensus.cc:374] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.859282 1167 raft_consensus.cc:729] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.859723 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 61f53616121e4a52835b8b7da1fa5372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.859566 1167 consensus_queue.cc:260] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.859988 1166 tablet_replica.cc:330] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:56.860200 1166 raft_consensus.cc:2229] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.860392 1166 raft_consensus.cc:2258] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.860448 683 leader_election.cc:302] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:00:56.861415 1166 ts_tablet_manager.cc:1905] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.863358 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 61f53616121e4a52835b8b7da1fa5372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.864962 1240 raft_consensus.cc:3037] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.865046 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 61f53616121e4a52835b8b7da1fa5372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.866113 874 tablet_service.cc:1514] Processing DeleteTablet for tablet b8799f2a2aed4688aa4e6e590dc83a4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.866899 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 156b65f0b108434aba73e11b9785034b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.867268 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 329b18cc9b544cddbf0564d7de8a5c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.867847 1240 raft_consensus.cc:2726] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:56.868253 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet b8799f2a2aed4688aa4e6e590dc83a4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.869534 734 tablet_service.cc:1514] Processing DeleteTablet for tablet b8799f2a2aed4688aa4e6e590dc83a4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.870328 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1502cae21371444ca45ba8693a352a84" } new_table_name: "default.Table_c6f6140b587a47069d1123f1ff4eef8b" modify_external_catalogs: true
I20260620 07:00:56.870673 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f90f1b2facc0415ab378fb81b60b0202
I20260620 07:00:56.870652 1246 raft_consensus.cc:482] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.870880 1246 raft_consensus.cc:504] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.871088 419 catalog_manager.cc:6565] ReplaceTablet: tablet f90f1b2facc0415ab378fb81b60b0202 deleted and replaced by tablet ea6102e0da4e42cd9f1d6e294bb372b2
I20260620 07:00:56.871497 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f655e04dd3f446debfb3219c289dcadb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:56.871935 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3b8e7056bd14418820032aa533be266" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:56.872087 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f655e04dd3f446debfb3219c289dcadb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.872300 753 raft_consensus.cc:2454] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:56.872866 831 leader_election.cc:302] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.874049 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet f90f1b2facc0415ab378fb81b60b0202 with delete_type TABLET_DATA_DELETED (replaced by tablet ea6102e0da4e42cd9f1d6e294bb372b2) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.874365 1246 leader_election.cc:288] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.874395 1166 ts_tablet_manager.cc:1918] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.874572 1166 log.cc:1196] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/61f53616121e4a52835b8b7da1fa5372
I20260620 07:00:56.874608 1246 raft_consensus.cc:2781] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:56.874702 1246 raft_consensus.cc:482] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:56.874866 1246 raft_consensus.cc:3037] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.860404 1167 ts_tablet_manager.cc:1428] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 07:00:56.874873 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7f1949591089439195b4cd9d39fbd264"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:56.875309 1167 tablet_bootstrap.cc:492] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:00:56.875445 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f1949591089439195b4cd9d39fbd264 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.876837 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3b8e7056bd14418820032aa533be266" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:56.877121 1033 raft_consensus.cc:2454] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:56.877588 1167 tablet_bootstrap.cc:654] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.879703 874 tablet_service.cc:1514] Processing DeleteTablet for tablet f90f1b2facc0415ab378fb81b60b0202 with delete_type TABLET_DATA_DELETED (replaced by tablet ea6102e0da4e42cd9f1d6e294bb372b2) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.881285 734 tablet_service.cc:1514] Processing DeleteTablet for tablet aaba6014285c4db4b8127d26df1e0625 with delete_type TABLET_DATA_DELETED (replaced by tablet 2060ea1520d8404daa6b862b8945226e) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.881933 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 654c6215d7634f8594cae155c436c175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.882241 1168 tablet_bootstrap.cc:492] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:56.882426 1168 ts_tablet_manager.cc:1397] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.163s user 0.002s sys 0.003s
I20260620 07:00:56.882614 734 tablet_service.cc:1514] Processing DeleteTablet for tablet f90f1b2facc0415ab378fb81b60b0202 with delete_type TABLET_DATA_DELETED (replaced by tablet ea6102e0da4e42cd9f1d6e294bb372b2) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.883490 1169 ts_tablet_manager.cc:1918] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.883772 1169 log.cc:1196] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/3ecf5c1d0fa64004bc4a01e96147167e
I20260620 07:00:56.884523 1169 ts_tablet_manager.cc:1939] T 3ecf5c1d0fa64004bc4a01e96147167e P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:56.886617 1168 raft_consensus.cc:348] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.886914 1168 raft_consensus.cc:374] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.886759 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 3ecf5c1d0fa64004bc4a01e96147167e (table default.Table_1502cae21371444ca45ba8693a352a84 [id=5c8493166f2448dea6f711457ba8c1bc]) successfully deleted
I20260620 07:00:56.886983 1168 raft_consensus.cc:729] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.886063 1246 raft_consensus.cc:504] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:00:56.887817 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 61f53616121e4a52835b8b7da1fa5372 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61f53616121e4a52835b8b7da1fa5372 already in progress: creating tablet
I20260620 07:00:56.888756 1166 ts_tablet_manager.cc:1939] T 61f53616121e4a52835b8b7da1fa5372 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:56.889067 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3b8e7056bd14418820032aa533be266" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:56.889287 753 raft_consensus.cc:3037] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.890214 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 61f53616121e4a52835b8b7da1fa5372 (table default.Table_11cde52aaf3944eeb72cef8645b01d6a [id=425c83c87160456590a08a72244d2065]) successfully deleted
W20260620 07:00:56.891047 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b8799f2a2aed4688aa4e6e590dc83a4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8799f2a2aed4688aa4e6e590dc83a4e already in progress: creating tablet
I20260620 07:00:56.892062 753 raft_consensus.cc:2454] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
W20260620 07:00:56.892166 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f90f1b2facc0415ab378fb81b60b0202 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f90f1b2facc0415ab378fb81b60b0202 already in progress: creating tablet
I20260620 07:00:56.892962 831 leader_election.cc:302] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.893326 1279 raft_consensus.cc:2781] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:56.893546 1279 raft_consensus.cc:686] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:56.894356 1194 server_base.cc:1034] running on GCE node
I20260620 07:00:56.894474 1279 consensus_queue.cc:237] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:56.895448 1169 tablet_replica.cc:330] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:56.896184 424 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 3e5e572076894b09b62bcafacd0982e3
W20260620 07:00:56.896786 1289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:00:56.896723 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_90ae8d7513c948f8b7840964f5601249"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.897534 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90ae8d7513c948f8b7840964f5601249 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.897781 1169 raft_consensus.cc:2229] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.897814 1246 leader_election.cc:288] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.897974 1169 raft_consensus.cc:2258] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.898331 1168 consensus_queue.cc:260] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.898904 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ba760b5fe1204df2932edd15bdcbaadf
I20260620 07:00:56.898981 1168 ts_tablet_manager.cc:1428] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260620 07:00:56.899289 1168 tablet_bootstrap.cc:492] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:56.899341 422 catalog_manager.cc:6565] ReplaceTablet: tablet ba760b5fe1204df2932edd15bdcbaadf deleted and replaced by tablet 360880717af145628606b5b9fb26e350
I20260620 07:00:56.899421 1194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 07:00:56.900177 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b14d69a316844dd88f863bb1b3aa52f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.900776 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b14d69a316844dd88f863bb1b3aa52f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:56.896148 1167 tablet_bootstrap.cc:492] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.901337 1167 ts_tablet_manager.cc:1397] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.002s
I20260620 07:00:56.901472 1165 tablet_replica.cc:330] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:56.901657 1165 raft_consensus.cc:2229] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.901831 1165 raft_consensus.cc:2258] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.902148 1167 raft_consensus.cc:348] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.902357 1167 raft_consensus.cc:374] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.902426 1167 raft_consensus.cc:729] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.902747 1170 tablet_bootstrap.cc:492] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.902954 1170 ts_tablet_manager.cc:1397] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.000s
I20260620 07:00:56.903151 874 tablet_service.cc:1514] Processing DeleteTablet for tablet ba760b5fe1204df2932edd15bdcbaadf with delete_type TABLET_DATA_DELETED (replaced by tablet 360880717af145628606b5b9fb26e350) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.903265 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet ba760b5fe1204df2932edd15bdcbaadf with delete_type TABLET_DATA_DELETED (replaced by tablet 360880717af145628606b5b9fb26e350) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.903626 1170 raft_consensus.cc:348] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.903937 1170 raft_consensus.cc:374] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.904021 1170 raft_consensus.cc:729] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.904312 1246 raft_consensus.cc:482] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.904462 1246 raft_consensus.cc:504] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.904654 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3b8e7056bd14418820032aa533be266" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:56.904309 1170 consensus_queue.cc:260] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.904749 1169 ts_tablet_manager.cc:1905] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.904860 1033 raft_consensus.cc:3037] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.905149 1170 ts_tablet_manager.cc:1428] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:00:56.905231 1167 consensus_queue.cc:260] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.905489 1170 tablet_bootstrap.cc:492] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.907055 1167 ts_tablet_manager.cc:1428] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260620 07:00:56.907253 1170 tablet_bootstrap.cc:654] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.907359 1167 tablet_bootstrap.cc:492] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.910953 1033 raft_consensus.cc:2454] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
W20260620 07:00:56.913614 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ba760b5fe1204df2932edd15bdcbaadf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba760b5fe1204df2932edd15bdcbaadf already in progress: creating tablet
I20260620 07:00:56.915838 734 tablet_service.cc:1514] Processing DeleteTablet for tablet ba760b5fe1204df2932edd15bdcbaadf with delete_type TABLET_DATA_DELETED (replaced by tablet 360880717af145628606b5b9fb26e350) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.916518 1167 tablet_bootstrap.cc:654] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.917850 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88635d3b7d83435f8fc8e89dc8de173b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:56.918184 753 raft_consensus.cc:2454] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:56.918685 831 leader_election.cc:302] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.919070 1174 raft_consensus.cc:2781] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:56.919196 1174 raft_consensus.cc:482] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:56.919283 1174 raft_consensus.cc:3037] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.922077 1174 raft_consensus.cc:504] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.923188 1174 leader_election.cc:288] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.923379 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88635d3b7d83435f8fc8e89dc8de173b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:56.923590 1033 raft_consensus.cc:3037] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.923581 1169 ts_tablet_manager.cc:1918] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.923767 1169 log.cc:1196] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/156b65f0b108434aba73e11b9785034b
I20260620 07:00:56.924252 1169 ts_tablet_manager.cc:1939] T 156b65f0b108434aba73e11b9785034b P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:56.924443 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88635d3b7d83435f8fc8e89dc8de173b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:56.924705 753 raft_consensus.cc:3037] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.925688 1169 tablet_replica.cc:330] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:56.926383 1169 raft_consensus.cc:2229] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.926764 1169 raft_consensus.cc:2258] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.926929 1033 raft_consensus.cc:2454] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:56.927407 830 leader_election.cc:302] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.927759 1174 raft_consensus.cc:2781] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:56.928027 1174 raft_consensus.cc:686] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:56.928182 1169 ts_tablet_manager.cc:1905] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.928354 753 raft_consensus.cc:2454] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:56.928948 1174 consensus_queue.cc:237] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.930014 1194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 07:00:56.930838 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 156b65f0b108434aba73e11b9785034b (table default.Table_5b650174e77b47b4a6283f9b22fb701d [id=b9587405857f4c8fbfcd41538fd20960]) successfully deleted
I20260620 07:00:56.931038 1246 leader_election.cc:288] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:56.931521 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88635d3b7d83435f8fc8e89dc8de173b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:56.931792 1033 raft_consensus.cc:2362] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1. Re-sending same reply.
I20260620 07:00:56.935276 1194 hybrid_clock.cc:648] HybridClock initialized: now 1781938856935149 us; error 97 us; skew 500 ppm
I20260620 07:00:56.935740 1194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 07:00:56.936707 1165 ts_tablet_manager.cc:1905] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:00:56.943867 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7200877be18c4eaca57df88c25d30c01 (table default.Table_18beb2a49dce4703b96c71c424561ed3 [id=8f652552eba04d87aad349983184c524], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7200877be18c4eaca57df88c25d30c01 has no consensus state
I20260620 07:00:56.946118 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ba3862ba4ebf410baebcc1246b08ddc9
I20260620 07:00:56.946679 427 catalog_manager.cc:6565] ReplaceTablet: tablet ba3862ba4ebf410baebcc1246b08ddc9 deleted and replaced by tablet e2b0faf91f2f469f9b06e17caa4709e4
I20260620 07:00:56.947050 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a77c53a332ef44b584f6cdedaf0fa001" } new_table_name: "default.Table_aab952ce8c964d5c8fe8f19901567383" modify_external_catalogs: true
I20260620 07:00:56.948887 872 tablet_service.cc:1514] Processing DeleteTablet for tablet ba3862ba4ebf410baebcc1246b08ddc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b0faf91f2f469f9b06e17caa4709e4) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:56.948940 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet ba3862ba4ebf410baebcc1246b08ddc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b0faf91f2f469f9b06e17caa4709e4) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:56.951121 1169 ts_tablet_manager.cc:1918] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.952004 1167 tablet_bootstrap.cc:492] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:56.952196 1167 ts_tablet_manager.cc:1397] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.006s
I20260620 07:00:56.953081 1167 raft_consensus.cc:348] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.953341 1167 raft_consensus.cc:374] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.953637 1168 tablet_bootstrap.cc:654] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.953976 1176 raft_consensus.cc:482] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:56.954227 1176 raft_consensus.cc:504] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.953431 1167 raft_consensus.cc:729] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.954990 1167 consensus_queue.cc:260] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.955514 1176 leader_election.cc:288] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:56.956780 1167 ts_tablet_manager.cc:1428] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 07:00:56.957472 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae5ccd8edf6b4f50a1c9b1d2353e7678" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:56.957787 895 raft_consensus.cc:2454] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:56.958932 1167 tablet_bootstrap.cc:492] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:56.959098 969 leader_election.cc:302] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.959860 1033 raft_consensus.cc:1261] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Refusing update from remote peer 978f112862c64141b1009856bef3d624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:00:56.960072 1176 raft_consensus.cc:2781] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:56.959992 1166 tablet_replica.cc:330] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:56.960171 1176 raft_consensus.cc:482] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:56.960305 1176 raft_consensus.cc:3037] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.962056 1167 tablet_bootstrap.cc:654] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.959501 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae5ccd8edf6b4f50a1c9b1d2353e7678" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:56.962867 752 raft_consensus.cc:3037] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.967272 1169 log.cc:1196] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/329b18cc9b544cddbf0564d7de8a5c36
W20260620 07:00:56.967435 968 leader_election.cc:341] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:56.967695 1169 ts_tablet_manager.cc:1939] T 329b18cc9b544cddbf0564d7de8a5c36 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:56.968601 752 raft_consensus.cc:1261] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Refusing update from remote peer 978f112862c64141b1009856bef3d624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:00:56.968914 1170 tablet_bootstrap.cc:492] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:56.969062 1170 ts_tablet_manager.cc:1397] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.064s user 0.025s sys 0.028s
I20260620 07:00:56.969753 1174 consensus_queue.cc:1035] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:56.969877 1170 raft_consensus.cc:348] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.970082 1170 raft_consensus.cc:374] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:56.970185 1170 raft_consensus.cc:729] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:56.970412 1170 consensus_queue.cc:260] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.971019 1170 ts_tablet_manager.cc:1428] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 07:00:56.971482 1176 raft_consensus.cc:504] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.972386 1176 leader_election.cc:288] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:56.972712 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae5ccd8edf6b4f50a1c9b1d2353e7678" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:56.972867 1165 ts_tablet_manager.cc:1918] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:56.972927 895 raft_consensus.cc:3037] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.973002 1165 log.cc:1196] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/61f53616121e4a52835b8b7da1fa5372
I20260620 07:00:56.973475 1165 ts_tablet_manager.cc:1939] T 61f53616121e4a52835b8b7da1fa5372 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:56.974084 1166 raft_consensus.cc:2229] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:56.974298 1166 raft_consensus.cc:2258] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:56.975090 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 61f53616121e4a52835b8b7da1fa5372 (table default.Table_11cde52aaf3944eeb72cef8645b01d6a [id=425c83c87160456590a08a72244d2065]) successfully deleted
W20260620 07:00:56.975457 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b8799f2a2aed4688aa4e6e590dc83a4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8799f2a2aed4688aa4e6e590dc83a4e already in progress: creating tablet
W20260620 07:00:56.975694 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f90f1b2facc0415ab378fb81b60b0202 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f90f1b2facc0415ab378fb81b60b0202 already in progress: creating tablet
W20260620 07:00:56.975872 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ba760b5fe1204df2932edd15bdcbaadf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba760b5fe1204df2932edd15bdcbaadf already in progress: creating tablet
I20260620 07:00:56.976027 1170 tablet_bootstrap.cc:492] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:56.975998 1194 webserver.cc:460] Webserver started at http://127.0.97.60:44063/ using document root <none> and password file <none>
W20260620 07:00:56.976104 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ba3862ba4ebf410baebcc1246b08ddc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba3862ba4ebf410baebcc1246b08ddc9 already in progress: creating tablet
I20260620 07:00:56.976472 1166 ts_tablet_manager.cc:1905] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:56.977128 1194 fs_manager.cc:359] Metadata directory not provided
I20260620 07:00:56.977279 1194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 07:00:56.977944 1170 tablet_bootstrap.cc:654] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:56.978061 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae5ccd8edf6b4f50a1c9b1d2353e7678" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:56.978286 753 raft_consensus.cc:3037] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:56.981441 1246 consensus_queue.cc:1035] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:56.984815 734 tablet_service.cc:1514] Processing DeleteTablet for tablet ba3862ba4ebf410baebcc1246b08ddc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b0faf91f2f469f9b06e17caa4709e4) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:56.985481 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 329b18cc9b544cddbf0564d7de8a5c36 (table default.Table_2f6560957a4c40c186a1ebb5e88f7123 [id=a7b18d380f2a4a1b86f4c767c6a93221]) successfully deleted
I20260620 07:00:56.986521 753 raft_consensus.cc:2454] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:56.988489 895 raft_consensus.cc:2454] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:56.989203 969 leader_election.cc:302] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:56.989741 1263 raft_consensus.cc:2781] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:56.989931 1263 raft_consensus.cc:686] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:56.990255 1263 consensus_queue.cc:237] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:56.998534 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b7ac5938b8c54806a785eaac99c70caa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:56.999277 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7ac5938b8c54806a785eaac99c70caa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.002496 1169 tablet_replica.cc:330] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.002718 1169 raft_consensus.cc:2229] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.002974 1169 raft_consensus.cc:2258] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.004020 1169 ts_tablet_manager.cc:1905] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.009060 1166 ts_tablet_manager.cc:1918] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:00:57.009559 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b8799f2a2aed4688aa4e6e590dc83a4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8799f2a2aed4688aa4e6e590dc83a4e already in progress: creating tablet
I20260620 07:00:57.011756 1169 ts_tablet_manager.cc:1918] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.011922 1169 log.cc:1196] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/aaba6014285c4db4b8127d26df1e0625
I20260620 07:00:57.012650 1169 ts_tablet_manager.cc:1939] T aaba6014285c4db4b8127d26df1e0625 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.013935 1169 tablet_replica.cc:330] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.014236 1169 raft_consensus.cc:2229] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.014410 1169 raft_consensus.cc:2258] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.015281 1169 ts_tablet_manager.cc:1905] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.016538 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_53d54ae0843e43bbaa814c4fdd23d530"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.017570 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53d54ae0843e43bbaa814c4fdd23d530 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.029243 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet aaba6014285c4db4b8127d26df1e0625 (table default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]) successfully deleted
I20260620 07:00:57.031421 1168 tablet_bootstrap.cc:492] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.031736 1168 ts_tablet_manager.cc:1397] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.133s user 0.003s sys 0.022s
I20260620 07:00:57.032610 1168 raft_consensus.cc:348] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.032845 1168 raft_consensus.cc:374] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.032935 1168 raft_consensus.cc:729] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.032914 1169 ts_tablet_manager.cc:1918] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.033305 1169 log.cc:1196] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/654c6215d7634f8594cae155c436c175
I20260620 07:00:57.033223 1168 consensus_queue.cc:260] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.034976 1169 ts_tablet_manager.cc:1939] T 654c6215d7634f8594cae155c436c175 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.036164 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 654c6215d7634f8594cae155c436c175 (table default.Table_2d526dc5dfb440378c303bf409947c65 [id=b2c123464ea94601b142edcd222945ca]) successfully deleted
I20260620 07:00:57.036432 1166 log.cc:1196] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ba3862ba4ebf410baebcc1246b08ddc9
I20260620 07:00:57.036985 1166 ts_tablet_manager.cc:1939] T ba3862ba4ebf410baebcc1246b08ddc9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:57.037358 1168 ts_tablet_manager.cc:1428] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260620 07:00:57.037194 1167 tablet_bootstrap.cc:492] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:57.037878 1167 ts_tablet_manager.cc:1397] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.079s user 0.010s sys 0.011s
W20260620 07:00:57.038023 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f90f1b2facc0415ab378fb81b60b0202 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f90f1b2facc0415ab378fb81b60b0202 already in progress: creating tablet
W20260620 07:00:57.038854 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ba760b5fe1204df2932edd15bdcbaadf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba760b5fe1204df2932edd15bdcbaadf already in progress: creating tablet
W20260620 07:00:57.039527 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ba3862ba4ebf410baebcc1246b08ddc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba3862ba4ebf410baebcc1246b08ddc9 already in progress: creating tablet
I20260620 07:00:57.040467 1298 mvcc.cc:205] Tried to move back new op lower bound from 7298821558065037312 to 7298821556134309888. Current Snapshot: MvccSnapshot[applied={T|T < 7298821558065037312}]
I20260620 07:00:57.041265 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 537ab1626d4e44c38d8cca8c51921424 from {username='slave'} at 127.0.0.1:42866
W20260620 07:00:57.041769 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 consensus state has no leader
I20260620 07:00:57.042219 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d9dd80723d604b80901a94c9e9fe0246"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.043071 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9dd80723d604b80901a94c9e9fe0246 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.043097 1307 mvcc.cc:205] Tried to move back new op lower bound from 7298821558065037312 to 7298821556134309888. Current Snapshot: MvccSnapshot[applied={T|T < 7298821558065037312}]
I20260620 07:00:57.047542 734 tablet_service.cc:1467] Processing CreateTablet for tablet 3f53f0302d1a4fb3a0fe3e1d98583550 (DEFAULT_TABLE table=default.Table_b2f703e512b443a1a6f0fa0ad1a613cd [id=bce36d2915e7478ebbfcf02633f64563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.048197 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f53f0302d1a4fb3a0fe3e1d98583550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.049055 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 88635d3b7d83435f8fc8e89dc8de173b (table default.Table_b623e145e58e4cb9b1d75359c4d1cf8e [id=f28fed67d2244a1694c6688535cc5213]). Expected version 1 got 0
I20260620 07:00:57.049418 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 33517843ce1d4d8786c91fd738d81ab2 (table default.Table_1502cae21371444ca45ba8693a352a84 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 1 got 0
I20260620 07:00:57.039213 1167 raft_consensus.cc:348] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.050930 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1f763b0e91544700bd672c2ef751b4d2
I20260620 07:00:57.050951 1167 raft_consensus.cc:374] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.051060 1167 raft_consensus.cc:729] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.051307 872 tablet_service.cc:1467] Processing CreateTablet for tablet 3f53f0302d1a4fb3a0fe3e1d98583550 (DEFAULT_TABLE table=default.Table_b2f703e512b443a1a6f0fa0ad1a613cd [id=bce36d2915e7478ebbfcf02633f64563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.051326 1167 consensus_queue.cc:260] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.051820 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f53f0302d1a4fb3a0fe3e1d98583550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.051661 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.052358 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.052529 1311 tablet.cc:1722] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:00:57.053443 874 tablet_service.cc:1467] Processing CreateTablet for tablet 8b8d90f8d63e45ce990aead6166bcfb6 (DEFAULT_TABLE table=default.Table_26f927ce5e714da5ae118310d32e42a3 [id=2c972f7177414e16be4a7133dc2dac9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.053715 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c79a42afd7aa42d38e0fb673aebb3ed4
I20260620 07:00:57.053835 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b8d90f8d63e45ce990aead6166bcfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.053956 1167 ts_tablet_manager.cc:1428] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260620 07:00:57.054427 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7b6efec6450d4ae6a6518c7c13d94482"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.055008 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33517843ce1d4d8786c91fd738d81ab2 consensus state has no leader
I20260620 07:00:57.055373 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0820a2498d5941f396ff09b10011c330" } new_table_name: "default.Table_31c2839acbe6481b9a678fbc6dadb416" modify_external_catalogs: true
I20260620 07:00:57.057071 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dad5d59ba59b42ba9346f7a42624b6ef" } new_table_name: "default.Table_306943077846415ea552992291e5b67f" modify_external_catalogs: true
I20260620 07:00:57.058400 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 9d05d17792e54877b29431754676dcad from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:57.061656 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 3f53f0302d1a4fb3a0fe3e1d98583550 (DEFAULT_TABLE table=default.Table_b2f703e512b443a1a6f0fa0ad1a613cd [id=bce36d2915e7478ebbfcf02633f64563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.062003 729 tablet_service.cc:1467] Processing CreateTablet for tablet 8b8d90f8d63e45ce990aead6166bcfb6 (DEFAULT_TABLE table=default.Table_26f927ce5e714da5ae118310d32e42a3 [id=2c972f7177414e16be4a7133dc2dac9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.062166 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 8b8d90f8d63e45ce990aead6166bcfb6 (DEFAULT_TABLE table=default.Table_26f927ce5e714da5ae118310d32e42a3 [id=2c972f7177414e16be4a7133dc2dac9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.062386 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b8d90f8d63e45ce990aead6166bcfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.062455 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.062703 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet c79a42afd7aa42d38e0fb673aebb3ed4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.065737 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.066285 728 tablet_service.cc:1514] Processing DeleteTablet for tablet c79a42afd7aa42d38e0fb673aebb3ed4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:57.067130 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b6efec6450d4ae6a6518c7c13d94482 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.068192 727 tablet_service.cc:1467] Processing CreateTablet for tablet 9e643fb0890042ae891ea17f0bc03740 (DEFAULT_TABLE table=default.Table_89396513fc244d759a11c57d9cfa893e [id=65b5bbb9004b4c28b8233868e05c293a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.068547 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e643fb0890042ae891ea17f0bc03740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.071647 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 13ea5f7db7b34922ac544b9ff2c76809 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.071956 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 with delete_type TABLET_DATA_DELETED (replaced by tablet 98385b3c486146a08b63a9507b060d80) from {username='slave'} at 127.0.0.1:41218
W20260620 07:00:57.071974 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1f763b0e91544700bd672c2ef751b4d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f763b0e91544700bd672c2ef751b4d2 already in progress: creating tablet
I20260620 07:00:57.072147 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 329b18cc9b544cddbf0564d7de8a5c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.072752 1169 tablet_replica.cc:330] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.072973 1169 raft_consensus.cc:2229] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.073184 1169 raft_consensus.cc:2258] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.073783 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f763b0e91544700bd672c2ef751b4d2) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.073946 1169 ts_tablet_manager.cc:1905] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.074049 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f0a3c36ff864f0083383103effe0ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.074334 1246 raft_consensus.cc:482] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.074537 1246 raft_consensus.cc:504] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.075416 1246 leader_election.cc:288] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.078962 1168 tablet_bootstrap.cc:492] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.080753 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d97c42bcac24188bbc322f9d4ef2600" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:57.081600 1170 tablet_bootstrap.cc:492] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.081779 1170 ts_tablet_manager.cc:1397] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.106s user 0.017s sys 0.024s
I20260620 07:00:57.082295 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 9e643fb0890042ae891ea17f0bc03740 (DEFAULT_TABLE table=default.Table_89396513fc244d759a11c57d9cfa893e [id=65b5bbb9004b4c28b8233868e05c293a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.083457 727 tablet_service.cc:1467] Processing CreateTablet for tablet 69113a64960d4aee9a2a4fcb28570bf2 (DEFAULT_TABLE table=default.Table_1f5cbdecd4974d17961520344743336f [id=fc671ac815da4c76b050f11dfcaee2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.083985 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69113a64960d4aee9a2a4fcb28570bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.085047 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 69113a64960d4aee9a2a4fcb28570bf2 (DEFAULT_TABLE table=default.Table_1f5cbdecd4974d17961520344743336f [id=fc671ac815da4c76b050f11dfcaee2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.086139 729 tablet_service.cc:1467] Processing CreateTablet for tablet 17590c6a1a96414f84632a8b0e0a795b (DEFAULT_TABLE table=default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.086591 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 17590c6a1a96414f84632a8b0e0a795b (DEFAULT_TABLE table=default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.087131 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17590c6a1a96414f84632a8b0e0a795b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.088217 1010 tablet_service.cc:1467] Processing CreateTablet for tablet e275d82068074370ba1e32b7ca5fdcc3 (DEFAULT_TABLE table=default.Table_89bf00306e9c44a0a0de2e0a7235f436 [id=24b0b6eb9f944dbb971530ee8f603c0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.082720 1170 raft_consensus.cc:348] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.089102 1170 raft_consensus.cc:374] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.089125 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 21f51aeb329e42359cfaf7de2a039d13 (DEFAULT_TABLE table=default.Table_066c84335e324028aaab00d42e0e5aec [id=bbf8c2959d834ddc8bb8b9790c6fcd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.089206 1170 raft_consensus.cc:729] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.089178 728 tablet_service.cc:1467] Processing CreateTablet for tablet 21f51aeb329e42359cfaf7de2a039d13 (DEFAULT_TABLE table=default.Table_066c84335e324028aaab00d42e0e5aec [id=bbf8c2959d834ddc8bb8b9790c6fcd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.089536 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21f51aeb329e42359cfaf7de2a039d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.089433 1170 consensus_queue.cc:260] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.090559 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 7200877be18c4eaca57df88c25d30c01 (DEFAULT_TABLE table=default.Table_18beb2a49dce4703b96c71c424561ed3 [id=8f652552eba04d87aad349983184c524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.092006 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 83451bba9a3c4c209dddf4250fea8806 (DEFAULT_TABLE table=default.Table_dad5d59ba59b42ba9346f7a42624b6ef [id=04c170b69f3b43eb88b51e1654ec86df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.092662 1170 ts_tablet_manager.cc:1428] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
I20260620 07:00:57.092976 1170 tablet_bootstrap.cc:492] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.096267 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 (DEFAULT_TABLE table=default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.096904 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 (DEFAULT_TABLE table=default.Table_c649dd8a94d74f428ec6a8c9b77288c2 [id=82c73c656d3148df95ac377dfe7f38fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.097290 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 978f99d2a7d6448aba8dcd2611b75af3 (DEFAULT_TABLE table=default.Table_5c7875d7e8b1438ca620be079ce992c9 [id=c6b286f7e44a496aa9f070c73a885062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.097925 731 tablet_service.cc:1467] Processing CreateTablet for tablet 7200877be18c4eaca57df88c25d30c01 (DEFAULT_TABLE table=default.Table_18beb2a49dce4703b96c71c424561ed3 [id=8f652552eba04d87aad349983184c524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.098291 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7200877be18c4eaca57df88c25d30c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.099053 726 tablet_service.cc:1467] Processing CreateTablet for tablet 978f99d2a7d6448aba8dcd2611b75af3 (DEFAULT_TABLE table=default.Table_5c7875d7e8b1438ca620be079ce992c9 [id=c6b286f7e44a496aa9f070c73a885062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.099100 1304 mvcc.cc:205] Tried to move back new op lower bound from 7298821558065037312 to 7298821556134309888. Current Snapshot: MvccSnapshot[applied={T|T < 7298821558065037312}]
I20260620 07:00:57.099524 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 978f99d2a7d6448aba8dcd2611b75af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.099733 1170 tablet_bootstrap.cc:654] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.100792 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d97c42bcac24188bbc322f9d4ef2600" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:57.101032 1033 raft_consensus.cc:2454] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:57.101470 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7200877be18c4eaca57df88c25d30c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.103235 1167 tablet_bootstrap.cc:492] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:57.103276 733 tablet_service.cc:1467] Processing CreateTablet for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 (DEFAULT_TABLE table=default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.103683 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04d5d361a5404dcf99a89e93ac1f7dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.105324 1167 tablet_bootstrap.cc:654] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.106299 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21f51aeb329e42359cfaf7de2a039d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.107270 730 tablet_service.cc:1467] Processing CreateTablet for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 (DEFAULT_TABLE table=default.Table_c649dd8a94d74f428ec6a8c9b77288c2 [id=82c73c656d3148df95ac377dfe7f38fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.107811 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cb04a2e17f3417aaf0f89f0c7f78159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.111168 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83451bba9a3c4c209dddf4250fea8806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.111806 732 tablet_service.cc:1467] Processing CreateTablet for tablet 83451bba9a3c4c209dddf4250fea8806 (DEFAULT_TABLE table=default.Table_dad5d59ba59b42ba9346f7a42624b6ef [id=04c170b69f3b43eb88b51e1654ec86df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.112605 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83451bba9a3c4c209dddf4250fea8806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.115255 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b8d90f8d63e45ce990aead6166bcfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.118687 1312 tablet.cc:1722] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:00:57.119310 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f53f0302d1a4fb3a0fe3e1d98583550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.123739 1167 tablet_bootstrap.cc:492] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:57.124004 1167 ts_tablet_manager.cc:1397] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.002s
I20260620 07:00:57.124903 1167 raft_consensus.cc:348] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.125258 1167 raft_consensus.cc:374] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.125418 1167 raft_consensus.cc:729] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.125699 1167 consensus_queue.cc:260] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.127418 876 tablet_service.cc:1467] Processing CreateTablet for tablet 9e643fb0890042ae891ea17f0bc03740 (DEFAULT_TABLE table=default.Table_89396513fc244d759a11c57d9cfa893e [id=65b5bbb9004b4c28b8233868e05c293a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.128957 1167 ts_tablet_manager.cc:1428] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:00:57.132838 872 tablet_service.cc:1514] Processing DeleteTablet for tablet c79a42afd7aa42d38e0fb673aebb3ed4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.133149 1165 tablet_replica.cc:330] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:57.133447 1165 raft_consensus.cc:2229] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.133673 1165 raft_consensus.cc:2258] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.134433 1165 ts_tablet_manager.cc:1905] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:00:57.134845 831 leader_election.cc:341] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:00:57.135074 831 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 51839.1us
I20260620 07:00:57.136373 873 tablet_service.cc:1467] Processing CreateTablet for tablet 17590c6a1a96414f84632a8b0e0a795b (DEFAULT_TABLE table=default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.136464 869 tablet_service.cc:1467] Processing CreateTablet for tablet 21f51aeb329e42359cfaf7de2a039d13 (DEFAULT_TABLE table=default.Table_066c84335e324028aaab00d42e0e5aec [id=bbf8c2959d834ddc8bb8b9790c6fcd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.137054 875 tablet_service.cc:1467] Processing CreateTablet for tablet 7200877be18c4eaca57df88c25d30c01 (DEFAULT_TABLE table=default.Table_18beb2a49dce4703b96c71c424561ed3 [id=8f652552eba04d87aad349983184c524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.137357 866 tablet_service.cc:1467] Processing CreateTablet for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 (DEFAULT_TABLE table=default.Table_c649dd8a94d74f428ec6a8c9b77288c2 [id=82c73c656d3148df95ac377dfe7f38fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.137429 830 leader_election.cc:302] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:57.137672 871 tablet_service.cc:1467] Processing CreateTablet for tablet 83451bba9a3c4c209dddf4250fea8806 (DEFAULT_TABLE table=default.Table_dad5d59ba59b42ba9346f7a42624b6ef [id=04c170b69f3b43eb88b51e1654ec86df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.138185 870 tablet_service.cc:1467] Processing CreateTablet for tablet 978f99d2a7d6448aba8dcd2611b75af3 (DEFAULT_TABLE table=default.Table_5c7875d7e8b1438ca620be079ce992c9 [id=c6b286f7e44a496aa9f070c73a885062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.138662 1246 raft_consensus.cc:482] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.138882 868 tablet_service.cc:1467] Processing CreateTablet for tablet e275d82068074370ba1e32b7ca5fdcc3 (DEFAULT_TABLE table=default.Table_89bf00306e9c44a0a0de2e0a7235f436 [id=24b0b6eb9f944dbb971530ee8f603c0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.139658 1246 raft_consensus.cc:504] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.139789 1280 raft_consensus.cc:2781] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.139956 1280 raft_consensus.cc:482] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.140089 1280 raft_consensus.cc:3037] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.140362 1246 leader_election.cc:288] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.139654 867 tablet_service.cc:1467] Processing CreateTablet for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 (DEFAULT_TABLE table=default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.143162 872 tablet_service.cc:1467] Processing CreateTablet for tablet 69113a64960d4aee9a2a4fcb28570bf2 (DEFAULT_TABLE table=default.Table_1f5cbdecd4974d17961520344743336f [id=fc671ac815da4c76b050f11dfcaee2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.143573 1310 tablet.cc:1722] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:00:57.144950 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e643fb0890042ae891ea17f0bc03740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.145205 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cb04a2e17f3417aaf0f89f0c7f78159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.145516 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83451bba9a3c4c209dddf4250fea8806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.148840 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e275d82068074370ba1e32b7ca5fdcc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.151077 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04d5d361a5404dcf99a89e93ac1f7dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.151409 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69113a64960d4aee9a2a4fcb28570bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.151854 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17590c6a1a96414f84632a8b0e0a795b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.159276 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7200877be18c4eaca57df88c25d30c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.163130 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21f51aeb329e42359cfaf7de2a039d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.167152 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 978f99d2a7d6448aba8dcd2611b75af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.168716 1280 raft_consensus.cc:504] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.169795 1280 leader_election.cc:288] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.187856 1168 tablet_bootstrap.cc:654] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.192080 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.194052 734 tablet_service.cc:1467] Processing CreateTablet for tablet e275d82068074370ba1e32b7ca5fdcc3 (DEFAULT_TABLE table=default.Table_89bf00306e9c44a0a0de2e0a7235f436 [id=24b0b6eb9f944dbb971530ee8f603c0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.099545 1169 ts_tablet_manager.cc:1918] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.197706 1169 log.cc:1196] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/c79a42afd7aa42d38e0fb673aebb3ed4
I20260620 07:00:57.224814 1194 fs_manager.cc:709] Time spent opening directory manager: real 0.241s user 0.004s sys 0.021s
I20260620 07:00:57.230147 1263 consensus_queue.cc:1035] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 07:00:57.230904 1167 tablet_bootstrap.cc:492] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:57.232208 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e275d82068074370ba1e32b7ca5fdcc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.235092 1166 tablet_replica.cc:330] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:57.235558 1176 raft_consensus.cc:482] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.235731 1176 raft_consensus.cc:504] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.237897 1176 leader_election.cc:288] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:57.199811 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d97c42bcac24188bbc322f9d4ef2600" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:57.201603 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba3862ba4ebf410baebcc1246b08ddc9" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:57.243469 1166 raft_consensus.cc:2229] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:57.243517 753 raft_consensus.cc:2454] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:57.243765 1166 pending_rounds.cc:62] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:00:57.237099 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f0a3c36ff864f0083383103effe0ee8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:57.244442 831 leader_election.cc:341] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.244814 831 leader_election.cc:302] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:57.245193 1279 raft_consensus.cc:2781] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.245397 1279 raft_consensus.cc:482] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.245585 1279 raft_consensus.cc:3037] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.251327 1169 ts_tablet_manager.cc:1939] T c79a42afd7aa42d38e0fb673aebb3ed4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.253090 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet c79a42afd7aa42d38e0fb673aebb3ed4 (table default.Table_614fec7417f54a76bcc7d96e1e25ba56 [id=55a13c7617e345339dde6677b11008be]) successfully deleted
I20260620 07:00:57.197559 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e275d82068074370ba1e32b7ca5fdcc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.253368 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ba3862ba4ebf410baebcc1246b08ddc9 (table default.Table_c7ad555de0774a6e9ecf9af82802275d [id=cfbc4dc349434379b3eaabd5dc948327]) successfully deleted
W20260620 07:00:57.253676 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1f763b0e91544700bd672c2ef751b4d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f763b0e91544700bd672c2ef751b4d2 already in progress: creating tablet
I20260620 07:00:57.247602 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69113a64960d4aee9a2a4fcb28570bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.254844 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d97c42bcac24188bbc322f9d4ef2600" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:57.247731 1166 pending_rounds.cc:68] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821556838936576 op_type: NO_OP noop_request { }
I20260620 07:00:57.255275 1032 raft_consensus.cc:3037] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:00:57.251622 968 leader_election.cc:341] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.251752 1176 consensus_queue.cc:1035] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260620 07:00:57.255297 1166 raft_consensus.cc:2866] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:57.257718 1166 raft_consensus.cc:2258] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.259027 1166 ts_tablet_manager.cc:1905] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.261040 1032 raft_consensus.cc:2454] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:57.261518 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e643fb0890042ae891ea17f0bc03740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.262051 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04d5d361a5404dcf99a89e93ac1f7dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.262971 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17590c6a1a96414f84632a8b0e0a795b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.267585 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 978f99d2a7d6448aba8dcd2611b75af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.250511 1279 raft_consensus.cc:504] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:57.259509 830 leader_election.cc:341] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: ba3862ba4ebf410baebcc1246b08ddc9
I20260620 07:00:57.268322 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f0a3c36ff864f0083383103effe0ee8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:57.268988 830 leader_election.cc:302] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:57.269961 1280 raft_consensus.cc:2781] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:57.270525 1280 raft_consensus.cc:686] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:57.270967 1280 consensus_queue.cc:237] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:57.272854 969 leader_election.cc:341] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.273528 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cb04a2e17f3417aaf0f89f0c7f78159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.274416 1168 tablet_bootstrap.cc:492] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.274698 1168 ts_tablet_manager.cc:1397] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.214s user 0.004s sys 0.001s
I20260620 07:00:57.275734 1168 raft_consensus.cc:348] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.276154 1168 raft_consensus.cc:374] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.276185 1167 tablet_bootstrap.cc:654] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.276310 1168 raft_consensus.cc:729] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.276665 969 leader_election.cc:302] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:00:57.276698 1168 consensus_queue.cc:260] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.281433 1176 raft_consensus.cc:2726] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:57.284543 1279 leader_election.cc:288] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.267481 1165 ts_tablet_manager.cc:1918] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.285106 1165 log.cc:1196] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/c79a42afd7aa42d38e0fb673aebb3ed4
I20260620 07:00:57.285835 1165 ts_tablet_manager.cc:1939] T c79a42afd7aa42d38e0fb673aebb3ed4 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:00:57.286422 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 289405cbf0784916b971b038279309d8 consensus state has no leader
I20260620 07:00:57.287111 1170 tablet_bootstrap.cc:492] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.287133 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba3862ba4ebf410baebcc1246b08ddc9" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:57.287335 1170 ts_tablet_manager.cc:1397] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.194s user 0.075s sys 0.091s
I20260620 07:00:57.287422 753 raft_consensus.cc:3037] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.288182 1170 raft_consensus.cc:348] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.288409 1170 raft_consensus.cc:374] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.288499 1170 raft_consensus.cc:729] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.289480 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9d05d17792e54877b29431754676dcad
I20260620 07:00:57.289921 419 catalog_manager.cc:6565] ReplaceTablet: tablet 9d05d17792e54877b29431754676dcad deleted and replaced by tablet e14db4e3394046e49ecc69c9ca4dc840
I20260620 07:00:57.290632 753 raft_consensus.cc:2454] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:57.291337 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d05d17792e54877b29431754676dcad with delete_type TABLET_DATA_DELETED (replaced by tablet e14db4e3394046e49ecc69c9ca4dc840) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.291261 1170 consensus_queue.cc:260] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.292212 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d05d17792e54877b29431754676dcad with delete_type TABLET_DATA_DELETED (replaced by tablet e14db4e3394046e49ecc69c9ca4dc840) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.291160 831 leader_election.cc:302] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:57.292699 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 537ab1626d4e44c38d8cca8c51921424
I20260620 07:00:57.293351 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 537ab1626d4e44c38d8cca8c51921424 with delete_type TABLET_DATA_DELETED (replaced by tablet add9e860802d4edebcfbc9fa3c4a6b24) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.293597 422 catalog_manager.cc:6565] ReplaceTablet: tablet 537ab1626d4e44c38d8cca8c51921424 deleted and replaced by tablet add9e860802d4edebcfbc9fa3c4a6b24
I20260620 07:00:57.294543 1170 ts_tablet_manager.cc:1428] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 07:00:57.294610 1279 raft_consensus.cc:2781] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:57.295199 1279 raft_consensus.cc:686] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:57.295444 1279 consensus_queue.cc:237] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.296481 1170 tablet_bootstrap.cc:492] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.296694 1168 ts_tablet_manager.cc:1428] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260620 07:00:57.297003 1168 tablet_bootstrap.cc:492] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.298638 1168 tablet_bootstrap.cc:654] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.299078 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet c79a42afd7aa42d38e0fb673aebb3ed4 (table default.Table_614fec7417f54a76bcc7d96e1e25ba56 [id=55a13c7617e345339dde6677b11008be]) successfully deleted
W20260620 07:00:57.299302 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1f763b0e91544700bd672c2ef751b4d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f763b0e91544700bd672c2ef751b4d2 already in progress: creating tablet
I20260620 07:00:57.299333 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 537ab1626d4e44c38d8cca8c51921424 with delete_type TABLET_DATA_DELETED (replaced by tablet add9e860802d4edebcfbc9fa3c4a6b24) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.299871 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d05d17792e54877b29431754676dcad with delete_type TABLET_DATA_DELETED (replaced by tablet e14db4e3394046e49ecc69c9ca4dc840) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:57.300062 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 537ab1626d4e44c38d8cca8c51921424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 537ab1626d4e44c38d8cca8c51921424 already in progress: creating tablet
W20260620 07:00:57.300429 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9d05d17792e54877b29431754676dcad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d05d17792e54877b29431754676dcad already in progress: creating tablet
I20260620 07:00:57.301376 1176 raft_consensus.cc:482] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.301558 1176 raft_consensus.cc:504] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.302230 1176 leader_election.cc:288] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:00:57.311952 830 leader_election.cc:341] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: ba3862ba4ebf410baebcc1246b08ddc9
W20260620 07:00:57.314450 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 9d05d17792e54877b29431754676dcad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d05d17792e54877b29431754676dcad already in progress: creating tablet
W20260620 07:00:57.315209 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 537ab1626d4e44c38d8cca8c51921424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 537ab1626d4e44c38d8cca8c51921424 already in progress: creating tablet
I20260620 07:00:57.316591 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a7e62b5af141ca8b5054ce8f46c2b6" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:57.319736 1170 tablet_bootstrap.cc:654] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.320744 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a7e62b5af141ca8b5054ce8f46c2b6" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:57.321568 968 leader_election.cc:341] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.322062 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 537ab1626d4e44c38d8cca8c51921424 with delete_type TABLET_DATA_DELETED (replaced by tablet add9e860802d4edebcfbc9fa3c4a6b24) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.322502 1168 tablet_bootstrap.cc:492] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.322695 1168 ts_tablet_manager.cc:1397] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
W20260620 07:00:57.323482 969 leader_election.cc:341] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.323477 1168 raft_consensus.cc:348] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.323724 969 leader_election.cc:302] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:00:57.323804 1168 raft_consensus.cc:374] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.324052 1263 raft_consensus.cc:2726] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:57.323928 1168 raft_consensus.cc:729] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.324566 1168 consensus_queue.cc:260] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.325529 1168 ts_tablet_manager.cc:1428] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:00:57.325830 1168 tablet_bootstrap.cc:492] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.328578 1319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 07:00:57.329427 1166 ts_tablet_manager.cc:1918] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:57.329873 1168 tablet_bootstrap.cc:654] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.331911 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 88635d3b7d83435f8fc8e89dc8de173b from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:57.332990 1170 tablet_bootstrap.cc:492] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.332966 1166 log.cc:1196] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/c79a42afd7aa42d38e0fb673aebb3ed4
I20260620 07:00:57.333029 1194 fs_manager.cc:725] Time spent opening block manager: real 0.074s user 0.004s sys 0.000s
I20260620 07:00:57.333314 1170 ts_tablet_manager.cc:1397] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.002s
I20260620 07:00:57.333491 1166 ts_tablet_manager.cc:1939] T c79a42afd7aa42d38e0fb673aebb3ed4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:57.334154 1170 raft_consensus.cc:348] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.334453 1170 raft_consensus.cc:374] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.333281 1194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data,/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
uuid: "f32c3995c70946c38ce1a3094aaaffb1"
format_stamp: "Formatted at 2026-06-20 07:00:51 on dist-test-slave-jd6w"
I20260620 07:00:57.334570 1170 raft_consensus.cc:729] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.334681 1194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 07:00:57.335162 1170 consensus_queue.cc:260] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.335579 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_85568ce0333b42d4958c533a98d966b4" } new_table_name: "default.Table_9fead9e2caec405da4386b1c600ea7b1" modify_external_catalogs: true
I20260620 07:00:57.337293 1170 ts_tablet_manager.cc:1428] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:00:57.337855 1170 tablet_bootstrap.cc:492] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.341228 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_90ae8d7513c948f8b7840964f5601249" } modify_external_catalogs: true
I20260620 07:00:57.341470 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_90ae8d7513c948f8b7840964f5601249" } modify_external_catalogs: true
I20260620 07:00:57.342191 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_829da258d7c446d3b8e8c95466a42a88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.342758 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_829da258d7c446d3b8e8c95466a42a88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.344975 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c564f427e36645eaa41eb09a08173e96" } modify_external_catalogs: true
I20260620 07:00:57.345418 1170 tablet_bootstrap.cc:654] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.345512 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c564f427e36645eaa41eb09a08173e96" } modify_external_catalogs: true
I20260620 07:00:57.346114 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6114f9a7dc6143338db6a4d5e2d30761" } modify_external_catalogs: true
I20260620 07:00:57.346277 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6114f9a7dc6143338db6a4d5e2d30761" } modify_external_catalogs: true
I20260620 07:00:57.348922 1168 tablet_bootstrap.cc:492] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.349138 1168 ts_tablet_manager.cc:1397] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.006s
I20260620 07:00:57.350065 1168 raft_consensus.cc:348] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.350355 1168 raft_consensus.cc:374] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.350469 1168 raft_consensus.cc:729] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.350757 1168 consensus_queue.cc:260] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.351716 1168 ts_tablet_manager.cc:1428] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:00:57.352057 1168 tablet_bootstrap.cc:492] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.354017 1168 tablet_bootstrap.cc:654] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.356770 1170 tablet_bootstrap.cc:492] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.357035 1170 ts_tablet_manager.cc:1397] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.003s
I20260620 07:00:57.358036 1170 raft_consensus.cc:348] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.358392 1170 raft_consensus.cc:374] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.358541 1170 raft_consensus.cc:729] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.358873 1170 consensus_queue.cc:260] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.360291 426 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 2906fe0a195149d2844232cc8d83f6dd (table default.Table_07215f09fe3e4b7d9c1b0786ef82d218 [id=f12e60a2a8a341c8b574d0dc90fa315a]). Expected version 2 got 0
I20260620 07:00:57.360520 426 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 (table default.Table_c3a21b866a364f0e97c74a240faf1dff [id=a53fbb10c3c84cb698f8973d0e23bce0]). Expected version 2 got 0
I20260620 07:00:57.361020 1170 ts_tablet_manager.cc:1428] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
W20260620 07:00:57.361068 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83451bba9a3c4c209dddf4250fea8806 consensus state has no leader
I20260620 07:00:57.361410 421 master_service.cc:946] ReplaceTablet: received request to replace tablet c79a42afd7aa42d38e0fb673aebb3ed4 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:57.361456 1170 tablet_bootstrap.cc:492] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.364938 1170 tablet_bootstrap.cc:654] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.366439 875 tablet_service.cc:1467] Processing CreateTablet for tablet e7d1e4719cd441dd8054b24861cbd8a2 (DEFAULT_TABLE table=default.Table_7f1949591089439195b4cd9d39fbd264 [id=b9301ede677241efa94753841070351a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.366952 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7d1e4719cd441dd8054b24861cbd8a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.365815 734 tablet_service.cc:1467] Processing CreateTablet for tablet e7d1e4719cd441dd8054b24861cbd8a2 (DEFAULT_TABLE table=default.Table_7f1949591089439195b4cd9d39fbd264 [id=b9301ede677241efa94753841070351a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.367348 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7d1e4719cd441dd8054b24861cbd8a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.368536 732 tablet_service.cc:1467] Processing CreateTablet for tablet e2b0faf91f2f469f9b06e17caa4709e4 (DEFAULT_TABLE table=default.Table_c7ad555de0774a6e9ecf9af82802275d [id=cfbc4dc349434379b3eaabd5dc948327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.369267 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2b0faf91f2f469f9b06e17caa4709e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.366892 729 tablet_service.cc:1467] Processing CreateTablet for tablet ea6102e0da4e42cd9f1d6e294bb372b2 (DEFAULT_TABLE table=default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.371236 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6102e0da4e42cd9f1d6e294bb372b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.371513 872 tablet_service.cc:1467] Processing CreateTablet for tablet ea6102e0da4e42cd9f1d6e294bb372b2 (DEFAULT_TABLE table=default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.371852 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6102e0da4e42cd9f1d6e294bb372b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.374971 870 tablet_service.cc:1467] Processing CreateTablet for tablet e2b0faf91f2f469f9b06e17caa4709e4 (DEFAULT_TABLE table=default.Table_c7ad555de0774a6e9ecf9af82802275d [id=cfbc4dc349434379b3eaabd5dc948327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.375324 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2b0faf91f2f469f9b06e17caa4709e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.378539 730 tablet_service.cc:1467] Processing CreateTablet for tablet 81704d3a3cf648d987d4b40a270f7508 (DEFAULT_TABLE table=default.Table_90ae8d7513c948f8b7840964f5601249 [id=e7c8a5a3411f485abeddf596a8584e99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.378998 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81704d3a3cf648d987d4b40a270f7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.379463 731 tablet_service.cc:1467] Processing CreateTablet for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (DEFAULT_TABLE table=default.Table_b14d69a316844dd88f863bb1b3aa52f6 [id=2abd0f99a3034a0e8824bcb0002c91bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.380173 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e54f1185cd4c5c8e5d2ed289b61650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.383545 871 tablet_service.cc:1467] Processing CreateTablet for tablet 360880717af145628606b5b9fb26e350 (DEFAULT_TABLE table=default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.383939 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360880717af145628606b5b9fb26e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.387122 869 tablet_service.cc:1467] Processing CreateTablet for tablet 81704d3a3cf648d987d4b40a270f7508 (DEFAULT_TABLE table=default.Table_90ae8d7513c948f8b7840964f5601249 [id=e7c8a5a3411f485abeddf596a8584e99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.387351 732 tablet_service.cc:1467] Processing CreateTablet for tablet 360880717af145628606b5b9fb26e350 (DEFAULT_TABLE table=default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.387514 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81704d3a3cf648d987d4b40a270f7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.389309 876 tablet_service.cc:1467] Processing CreateTablet for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (DEFAULT_TABLE table=default.Table_b14d69a316844dd88f863bb1b3aa52f6 [id=2abd0f99a3034a0e8824bcb0002c91bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.389745 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e54f1185cd4c5c8e5d2ed289b61650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.391261 731 tablet_service.cc:1467] Processing CreateTablet for tablet 169b93c38e59435db218152f2d25bdfa (DEFAULT_TABLE table=default.Table_2a842ef988174540bb18300a4788c4cc [id=4e394c13e3214375a63a155d3a95d20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.395303 874 tablet_service.cc:1467] Processing CreateTablet for tablet 169b93c38e59435db218152f2d25bdfa (DEFAULT_TABLE table=default.Table_2a842ef988174540bb18300a4788c4cc [id=4e394c13e3214375a63a155d3a95d20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.334138 1167 tablet_bootstrap.cc:492] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:57.395665 1167 ts_tablet_manager.cc:1397] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.266s user 0.001s sys 0.009s
I20260620 07:00:57.395709 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 169b93c38e59435db218152f2d25bdfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.396580 1167 raft_consensus.cc:348] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.396853 1167 raft_consensus.cc:374] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.396950 1167 raft_consensus.cc:729] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.397164 1167 consensus_queue.cc:260] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.397527 729 tablet_service.cc:1467] Processing CreateTablet for tablet 369c205d7f7841598cb99f661b25736f (DEFAULT_TABLE table=default.Table_f655e04dd3f446debfb3219c289dcadb [id=6654082b40084682b5bf224e82c955df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.397758 1167 ts_tablet_manager.cc:1428] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:00:57.398041 1167 tablet_bootstrap.cc:492] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:57.398149 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369c205d7f7841598cb99f661b25736f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.398612 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 169b93c38e59435db218152f2d25bdfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.367678 1003 tablet_service.cc:1467] Processing CreateTablet for tablet ea6102e0da4e42cd9f1d6e294bb372b2 (DEFAULT_TABLE table=default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.399101 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6102e0da4e42cd9f1d6e294bb372b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.372097 1002 tablet_service.cc:1467] Processing CreateTablet for tablet e7d1e4719cd441dd8054b24861cbd8a2 (DEFAULT_TABLE table=default.Table_7f1949591089439195b4cd9d39fbd264 [id=b9301ede677241efa94753841070351a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.402398 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7d1e4719cd441dd8054b24861cbd8a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.404711 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360880717af145628606b5b9fb26e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.404971 1166 tablet_replica.cc:330] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:57.410085 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet c79a42afd7aa42d38e0fb673aebb3ed4 (table default.Table_614fec7417f54a76bcc7d96e1e25ba56 [id=55a13c7617e345339dde6677b11008be]) successfully deleted
I20260620 07:00:57.411041 868 tablet_service.cc:1467] Processing CreateTablet for tablet 369c205d7f7841598cb99f661b25736f (DEFAULT_TABLE table=default.Table_f655e04dd3f446debfb3219c289dcadb [id=6654082b40084682b5bf224e82c955df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.411468 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369c205d7f7841598cb99f661b25736f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.411851 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cd78dd998663465682443de81e772aad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.412449 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd78dd998663465682443de81e772aad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:57.415339 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad65565caddf4e878292d1178fbf6037 consensus state has no leader
I20260620 07:00:57.416033 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 13ea5f7db7b34922ac544b9ff2c76809 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:57.426688 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3dc4c1ec06e74b1ba496fb7896bea7da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.427502 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dc4c1ec06e74b1ba496fb7896bea7da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.428431 1168 tablet_bootstrap.cc:492] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.428565 1168 ts_tablet_manager.cc:1397] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.003s
I20260620 07:00:57.429275 1168 raft_consensus.cc:348] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.429486 1168 raft_consensus.cc:374] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.429562 1168 raft_consensus.cc:729] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.429751 1168 consensus_queue.cc:260] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.430521 1168 ts_tablet_manager.cc:1428] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:00:57.430804 1168 tablet_bootstrap.cc:492] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.437412 1168 tablet_bootstrap.cc:654] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.439428 1240 raft_consensus.cc:482] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.439658 1240 raft_consensus.cc:504] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.440496 1240 leader_election.cc:288] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:00:57.442096 683 leader_election.cc:341] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 61f53616121e4a52835b8b7da1fa5372
W20260620 07:00:57.442556 681 leader_election.cc:341] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 61f53616121e4a52835b8b7da1fa5372
I20260620 07:00:57.442698 681 leader_election.cc:302] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:00:57.443167 1240 raft_consensus.cc:2726] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:57.444458 1170 tablet_bootstrap.cc:492] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.444444 1168 tablet_bootstrap.cc:492] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.444624 1168 ts_tablet_manager.cc:1397] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260620 07:00:57.444629 1170 ts_tablet_manager.cc:1397] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.083s user 0.000s sys 0.016s
I20260620 07:00:57.445271 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 81704d3a3cf648d987d4b40a270f7508
I20260620 07:00:57.445358 1168 raft_consensus.cc:348] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.445621 1168 raft_consensus.cc:374] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.445700 1168 raft_consensus.cc:729] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.445957 1168 consensus_queue.cc:260] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.446265 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1e123882f2a44ed28dbe6198a0ac7098"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:57.446403 1170 raft_consensus.cc:348] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.446663 1170 raft_consensus.cc:374] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.446748 1170 raft_consensus.cc:729] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
W20260620 07:00:57.446820 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e123882f2a44ed28dbe6198a0ac7098 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.446966 1168 ts_tablet_manager.cc:1428] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 07:00:57.447458 1170 consensus_queue.cc:260] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.448942 1168 tablet_bootstrap.cc:492] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.449591 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 81704d3a3cf648d987d4b40a270f7508 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.450562 1170 ts_tablet_manager.cc:1428] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
W20260620 07:00:57.451318 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 81704d3a3cf648d987d4b40a270f7508 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81704d3a3cf648d987d4b40a270f7508 already in progress: creating tablet
I20260620 07:00:57.451903 1170 tablet_bootstrap.cc:492] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.453547 1170 tablet_bootstrap.cc:654] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.455300 1168 tablet_bootstrap.cc:654] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.458137 1279 raft_consensus.cc:482] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.458292 1279 raft_consensus.cc:504] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.387936 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 81704d3a3cf648d987d4b40a270f7508 (DEFAULT_TABLE table=default.Table_90ae8d7513c948f8b7840964f5601249 [id=e7c8a5a3411f485abeddf596a8584e99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.391121 1008 tablet_service.cc:1467] Processing CreateTablet for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (DEFAULT_TABLE table=default.Table_b14d69a316844dd88f863bb1b3aa52f6 [id=2abd0f99a3034a0e8824bcb0002c91bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.459215 1279 leader_election.cc:288] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.459456 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e54f1185cd4c5c8e5d2ed289b61650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.392588 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 169b93c38e59435db218152f2d25bdfa (DEFAULT_TABLE table=default.Table_2a842ef988174540bb18300a4788c4cc [id=4e394c13e3214375a63a155d3a95d20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.459843 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 169b93c38e59435db218152f2d25bdfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.462298 1168 tablet_bootstrap.cc:492] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.462430 1168 ts_tablet_manager.cc:1397] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260620 07:00:57.463047 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 81704d3a3cf648d987d4b40a270f7508 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.464010 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a7e62b5af141ca8b5054ce8f46c2b6" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:00:57.464195 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 81704d3a3cf648d987d4b40a270f7508 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81704d3a3cf648d987d4b40a270f7508 already in progress: creating tablet
I20260620 07:00:57.464386 1032 raft_consensus.cc:2454] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:57.465584 1170 tablet_bootstrap.cc:492] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.465664 830 leader_election.cc:302] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:57.465763 1170 ts_tablet_manager.cc:1397] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260620 07:00:57.466004 1279 raft_consensus.cc:2781] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.466109 1279 raft_consensus.cc:482] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.466223 1279 raft_consensus.cc:3037] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.466270 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81704d3a3cf648d987d4b40a270f7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.466183 1168 raft_consensus.cc:348] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.466419 1168 raft_consensus.cc:374] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.466523 1168 raft_consensus.cc:729] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.466657 1170 raft_consensus.cc:348] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.466946 1170 raft_consensus.cc:374] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.467051 1170 raft_consensus.cc:729] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.467450 1170 consensus_queue.cc:260] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.467585 1168 consensus_queue.cc:260] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.468160 1168 ts_tablet_manager.cc:1428] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 07:00:57.468432 1168 tablet_bootstrap.cc:492] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.469074 1279 raft_consensus.cc:504] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.470124 1168 tablet_bootstrap.cc:654] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.470199 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a7e62b5af141ca8b5054ce8f46c2b6" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:57.471575 1170 ts_tablet_manager.cc:1428] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260620 07:00:57.470871 831 leader_election.cc:341] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.473448 1170 tablet_bootstrap.cc:492] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.475131 1280 raft_consensus.cc:482] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.475265 1280 raft_consensus.cc:504] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.475822 1280 leader_election.cc:288] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.476585 1170 tablet_bootstrap.cc:654] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.476794 1279 leader_election.cc:288] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.478586 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 88635d3b7d83435f8fc8e89dc8de173b
I20260620 07:00:57.479099 420 catalog_manager.cc:6565] ReplaceTablet: tablet 88635d3b7d83435f8fc8e89dc8de173b deleted and replaced by tablet d17c49eecec741cdbd592c94b7f84c67
I20260620 07:00:57.480563 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a7ae0a9b04fca9da8f441958c3280" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:57.480878 754 raft_consensus.cc:2454] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:57.481706 831 leader_election.cc:302] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:57.485150 1168 tablet_bootstrap.cc:492] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.485169 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2906fe0a195149d2844232cc8d83f6dd (table default.Table_07215f09fe3e4b7d9c1b0786ef82d218 [id=f12e60a2a8a341c8b574d0dc90fa315a]). Expected version 2 got 0
I20260620 07:00:57.486018 1168 ts_tablet_manager.cc:1397] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.004s
I20260620 07:00:57.485636 424 catalog_manager.cc:5495] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } }
I20260620 07:00:57.487320 1168 raft_consensus.cc:348] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.487689 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ea6102e0da4e42cd9f1d6e294bb372b2
I20260620 07:00:57.488823 1168 raft_consensus.cc:374] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.489053 1168 raft_consensus.cc:729] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.489384 1168 consensus_queue.cc:260] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.489549 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6102e0da4e42cd9f1d6e294bb372b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.489770 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 88635d3b7d83435f8fc8e89dc8de173b with delete_type TABLET_DATA_DELETED (replaced by tablet d17c49eecec741cdbd592c94b7f84c67) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.489835 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a7ae0a9b04fca9da8f441958c3280" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:57.490165 1280 raft_consensus.cc:2781] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.490144 1032 raft_consensus.cc:2454] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:57.490264 1280 raft_consensus.cc:482] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.490347 1280 raft_consensus.cc:3037] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.491562 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 88635d3b7d83435f8fc8e89dc8de173b with delete_type TABLET_DATA_DELETED (replaced by tablet d17c49eecec741cdbd592c94b7f84c67) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.492842 1170 tablet_bootstrap.cc:492] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.493009 1170 ts_tablet_manager.cc:1397] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.005s
I20260620 07:00:57.493772 1280 raft_consensus.cc:504] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.494598 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a7e62b5af141ca8b5054ce8f46c2b6" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:57.494844 1032 raft_consensus.cc:3037] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.494977 730 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6102e0da4e42cd9f1d6e294bb372b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.495206 1169 tablet_replica.cc:330] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.495404 1169 raft_consensus.cc:2229] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.495569 1169 raft_consensus.cc:2258] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.496105 1169 ts_tablet_manager.cc:1905] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.486493 424 catalog_manager.cc:5495] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } }
I20260620 07:00:57.497583 1032 raft_consensus.cc:2454] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:57.497576 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 52b0ef4797324c82832c11a1c98e2b42 (table default.Table_36a1a1d73652453dbde01677f41a650a [id=9fbfb3ec7f5348d3907734224702c69e]). Expected version 1 got 0
I20260620 07:00:57.498286 1170 raft_consensus.cc:348] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.498556 1170 raft_consensus.cc:374] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.498646 1170 raft_consensus.cc:729] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.498944 1170 consensus_queue.cc:260] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.499356 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 88635d3b7d83435f8fc8e89dc8de173b with delete_type TABLET_DATA_DELETED (replaced by tablet d17c49eecec741cdbd592c94b7f84c67) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.499625 868 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6102e0da4e42cd9f1d6e294bb372b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.500067 830 leader_election.cc:302] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:57.500402 1165 tablet_replica.cc:330] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:57.500568 1279 raft_consensus.cc:2781] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:57.500608 1165 raft_consensus.cc:2229] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:57.500663 1170 ts_tablet_manager.cc:1428] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260620 07:00:57.500756 1279 raft_consensus.cc:686] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:57.500870 1165 pending_rounds.cc:62] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:00:57.500943 1165 pending_rounds.cc:68] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821557983956992 op_type: NO_OP noop_request { }
I20260620 07:00:57.501096 1279 consensus_queue.cc:237] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.501834 1170 tablet_bootstrap.cc:492] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.501103 1165 raft_consensus.cc:2866] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:57.502877 1165 raft_consensus.cc:2258] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.503572 1280 leader_election.cc:288] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.503818 1165 ts_tablet_manager.cc:1905] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.506263 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a7ae0a9b04fca9da8f441958c3280" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:57.506538 754 raft_consensus.cc:3037] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.509951 1169 ts_tablet_manager.cc:1918] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.510058 1165 ts_tablet_manager.cc:1918] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:57.510108 754 raft_consensus.cc:2454] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:57.510210 1165 log.cc:1196] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/88635d3b7d83435f8fc8e89dc8de173b
I20260620 07:00:57.510649 1165 ts_tablet_manager.cc:1939] T 88635d3b7d83435f8fc8e89dc8de173b P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:57.511013 1168 ts_tablet_manager.cc:1428] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260620 07:00:57.511497 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 88635d3b7d83435f8fc8e89dc8de173b (table default.Table_b623e145e58e4cb9b1d75359c4d1cf8e [id=f28fed67d2244a1694c6688535cc5213]) successfully deleted
W20260620 07:00:57.511878 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ea6102e0da4e42cd9f1d6e294bb372b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea6102e0da4e42cd9f1d6e294bb372b2 already in progress: creating tablet
I20260620 07:00:57.513093 1168 tablet_bootstrap.cc:492] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.514319 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a7ae0a9b04fca9da8f441958c3280" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:57.514562 1032 raft_consensus.cc:3037] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.515693 1280 raft_consensus.cc:482] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.518857 1032 raft_consensus.cc:2454] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:57.516281 1168 tablet_bootstrap.cc:654] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.520545 1280 raft_consensus.cc:504] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.522384 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1d97c42bcac24188bbc322f9d4ef2600
I20260620 07:00:57.523901 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d97c42bcac24188bbc322f9d4ef2600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.524770 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d97c42bcac24188bbc322f9d4ef2600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.524955 423 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_07215f09fe3e4b7d9c1b0786ef82d218 [id=f12e60a2a8a341c8b574d0dc90fa315a] alter complete (version 2)
I20260620 07:00:57.525082 1165 tablet_replica.cc:330] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:57.525352 1165 raft_consensus.cc:2229] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:57.525645 1165 pending_rounds.cc:62] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:00:57.525764 1165 pending_rounds.cc:68] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821559385612288 op_type: NO_OP noop_request { }
I20260620 07:00:57.525974 1165 raft_consensus.cc:2866] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:57.526150 1165 raft_consensus.cc:2258] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.527303 1165 ts_tablet_manager.cc:1905] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.533033 1168 tablet_bootstrap.cc:492] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.533077 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 2060ea1520d8404daa6b862b8945226e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.533205 1168 ts_tablet_manager.cc:1397] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.004s
I20260620 07:00:57.533569 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fcb42f643c24e869fb0d7e2893ffa57 with delete_type TABLET_DATA_DELETED (replaced by tablet 83451bba9a3c4c209dddf4250fea8806) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.533792 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 978f99d2a7d6448aba8dcd2611b75af3) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.534036 1168 raft_consensus.cc:348] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.534283 1168 raft_consensus.cc:374] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.534376 1168 raft_consensus.cc:729] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.534607 1168 consensus_queue.cc:260] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.537031 1168 ts_tablet_manager.cc:1428] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 07:00:57.537345 1168 tablet_bootstrap.cc:492] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.538774 1168 tablet_bootstrap.cc:654] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.535250 830 leader_election.cc:302] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:57.536455 1165 ts_tablet_manager.cc:1918] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:57.541254 1165 log.cc:1196] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/1d97c42bcac24188bbc322f9d4ef2600
I20260620 07:00:57.541914 1279 raft_consensus.cc:2781] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:57.542629 1279 raft_consensus.cc:686] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:57.543555 1279 consensus_queue.cc:237] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.545229 1280 leader_election.cc:288] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.549063 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33517843ce1d4d8786c91fd738d81ab2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:57.549355 1032 raft_consensus.cc:2454] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:57.510244 1169 log.cc:1196] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/88635d3b7d83435f8fc8e89dc8de173b
I20260620 07:00:57.512413 1170 tablet_bootstrap.cc:654] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.550738 1169 ts_tablet_manager.cc:1939] T 88635d3b7d83435f8fc8e89dc8de173b P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.521973 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33517843ce1d4d8786c91fd738d81ab2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:57.551285 752 raft_consensus.cc:2454] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:57.523828 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d97c42bcac24188bbc322f9d4ef2600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.526041 729 tablet_service.cc:1514] Processing DeleteTablet for tablet c79a42afd7aa42d38e0fb673aebb3ed4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.526229 731 tablet_service.cc:1514] Processing DeleteTablet for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 with delete_type TABLET_DATA_DELETED (replaced by tablet 98385b3c486146a08b63a9507b060d80) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.553099 1169 tablet_replica.cc:330] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.553380 1169 raft_consensus.cc:2229] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.553591 1169 raft_consensus.cc:2258] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.555866 830 leader_election.cc:302] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:57.556262 1280 raft_consensus.cc:2781] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.556391 1280 raft_consensus.cc:482] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.556490 1280 raft_consensus.cc:3037] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.554692 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 88635d3b7d83435f8fc8e89dc8de173b (table default.Table_b623e145e58e4cb9b1d75359c4d1cf8e [id=f28fed67d2244a1694c6688535cc5213]) successfully deleted
W20260620 07:00:57.559904 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ea6102e0da4e42cd9f1d6e294bb372b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea6102e0da4e42cd9f1d6e294bb372b2 already in progress: creating tablet
I20260620 07:00:57.562122 1169 ts_tablet_manager.cc:1905] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.392724 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 360880717af145628606b5b9fb26e350 (DEFAULT_TABLE table=default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.376755 1013 tablet_service.cc:1467] Processing CreateTablet for tablet e2b0faf91f2f469f9b06e17caa4709e4 (DEFAULT_TABLE table=default.Table_c7ad555de0774a6e9ecf9af82802275d [id=cfbc4dc349434379b3eaabd5dc948327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.411639 1167 tablet_bootstrap.cc:654] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.566952 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360880717af145628606b5b9fb26e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.417340 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 369c205d7f7841598cb99f661b25736f (DEFAULT_TABLE table=default.Table_f655e04dd3f446debfb3219c289dcadb [id=6654082b40084682b5bf224e82c955df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.567945 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369c205d7f7841598cb99f661b25736f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.543879 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a7e62b5af141ca8b5054ce8f46c2b6" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:57.569124 831 leader_election.cc:341] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.569380 1280 raft_consensus.cc:504] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.419642 1263 raft_consensus.cc:482] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.570983 1263 raft_consensus.cc:504] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.571374 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33517843ce1d4d8786c91fd738d81ab2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:57.571650 753 raft_consensus.cc:3037] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.571650 1263 leader_election.cc:288] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:57.571949 1166 raft_consensus.cc:2229] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.572549 1166 raft_consensus.cc:2258] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.573208 1166 ts_tablet_manager.cc:1905] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.575423 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2b0faf91f2f469f9b06e17caa4709e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.541909 1165 ts_tablet_manager.cc:1939] T 1d97c42bcac24188bbc322f9d4ef2600 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:57.578459 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 1d97c42bcac24188bbc322f9d4ef2600 (table default.Table_c564f427e36645eaa41eb09a08173e96 [id=bfd61df271fe448da18b4aae768f19e5]) successfully deleted
I20260620 07:00:57.578656 1169 ts_tablet_manager.cc:1918] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.447417 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 81704d3a3cf648d987d4b40a270f7508 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.578817 1169 log.cc:1196] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/1d97c42bcac24188bbc322f9d4ef2600
I20260620 07:00:57.579252 1169 ts_tablet_manager.cc:1939] T 1d97c42bcac24188bbc322f9d4ef2600 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.579423 1280 leader_election.cc:288] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.580098 1280 raft_consensus.cc:482] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.580247 1280 raft_consensus.cc:504] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.583314 1280 leader_election.cc:288] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.580355 753 raft_consensus.cc:2454] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:57.581360 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fcb42f643c24e869fb0d7e2893ffa57" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:57.584533 831 leader_election.cc:341] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.585140 831 leader_election.cc:302] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:57.585623 1246 raft_consensus.cc:2781] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:57.585857 1246 raft_consensus.cc:686] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:57.586189 1246 consensus_queue.cc:237] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.590875 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 1d97c42bcac24188bbc322f9d4ef2600 (table default.Table_c564f427e36645eaa41eb09a08173e96 [id=bfd61df271fe448da18b4aae768f19e5]) successfully deleted
I20260620 07:00:57.591169 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13ea5f7db7b34922ac544b9ff2c76809" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:57.591878 896 raft_consensus.cc:2454] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
W20260620 07:00:57.592212 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c79a42afd7aa42d38e0fb673aebb3ed4 because the tablet was not found. No further retry: Not found: Tablet not found: c79a42afd7aa42d38e0fb673aebb3ed4
I20260620 07:00:57.592269 1263 raft_consensus.cc:482] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.592468 1263 raft_consensus.cc:504] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.592609 1169 tablet_replica.cc:330] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.592818 1169 raft_consensus.cc:2229] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.592960 1169 raft_consensus.cc:2258] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.593171 1263 leader_election.cc:288] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:57.593487 1169 ts_tablet_manager.cc:1905] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.594656 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33517843ce1d4d8786c91fd738d81ab2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:57.594801 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fcb42f643c24e869fb0d7e2893ffa57" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:57.594883 969 leader_election.cc:302] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:57.594980 1032 raft_consensus.cc:3037] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.595024 1033 raft_consensus.cc:2454] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:57.595510 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7f1949591089439195b4cd9d39fbd264" } new_table_name: "default.Table_705dc245b225442eb3ba5fc4731c8e12" modify_external_catalogs: true
I20260620 07:00:57.597078 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_622b45b592db43659f3fb16e236d0fb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.597659 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_622b45b592db43659f3fb16e236d0fb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.598071 1032 raft_consensus.cc:2454] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:57.598995 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_09dc5f70574848c78709d12aff4618f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.599687 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09dc5f70574848c78709d12aff4618f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:57.595055 969 raft_consensus.cc:2670] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:00:57.600399 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13ea5f7db7b34922ac544b9ff2c76809" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:57.600975 968 leader_election.cc:341] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.601078 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_066c84335e324028aaab00d42e0e5aec" } modify_external_catalogs: true
I20260620 07:00:57.601233 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_066c84335e324028aaab00d42e0e5aec" } modify_external_catalogs: true
I20260620 07:00:57.603521 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_90ac8c8b385b4d52a9c4a817223fd870" } modify_external_catalogs: true
I20260620 07:00:57.603809 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_90ac8c8b385b4d52a9c4a817223fd870" } modify_external_catalogs: true
I20260620 07:00:57.605372 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6bd66e9c6f5d4e348b7345db1c1175d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:57.605847 1170 tablet_bootstrap.cc:492] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:00:57.605875 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bd66e9c6f5d4e348b7345db1c1175d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.606019 1170 ts_tablet_manager.cc:1397] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.104s user 0.011s sys 0.012s
I20260620 07:00:57.602351 1169 ts_tablet_manager.cc:1918] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.606760 1169 log.cc:1196] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ae5ccd8edf6b4f50a1c9b1d2353e7678
I20260620 07:00:57.606932 1170 raft_consensus.cc:348] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.609115 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8150c6274659447da7ba165c9ca49a19" } new_table_name: "default.Table_c1da229c30624077a49d8112967940c7" modify_external_catalogs: true
I20260620 07:00:57.607193 1169 ts_tablet_manager.cc:1939] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.610877 1170 raft_consensus.cc:374] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.611070 1170 raft_consensus.cc:729] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.611428 1170 consensus_queue.cc:260] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.611951 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 (table default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9 [id=7b71c48967844bf59fbd632ce967b1dc]) successfully deleted
I20260620 07:00:57.612576 830 leader_election.cc:302] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:57.613240 1279 raft_consensus.cc:2781] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.613276 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc3bc9ec1334f1bb3d9f653b2472bc7" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:57.613808 1279 raft_consensus.cc:482] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.613938 1279 raft_consensus.cc:3037] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.613824 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc3bc9ec1334f1bb3d9f653b2472bc7" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:57.614413 1170 ts_tablet_manager.cc:1428] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
W20260620 07:00:57.614920 968 leader_election.cc:341] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.615676 1170 tablet_bootstrap.cc:492] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.616684 1279 raft_consensus.cc:504] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.617249 1279 leader_election.cc:288] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.617717 1170 tablet_bootstrap.cc:654] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.618582 1166 ts_tablet_manager.cc:1918] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.618752 1166 log.cc:1196] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/13ea5f7db7b34922ac544b9ff2c76809
I20260620 07:00:57.619202 1166 ts_tablet_manager.cc:1939] T 13ea5f7db7b34922ac544b9ff2c76809 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:57.620268 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 13ea5f7db7b34922ac544b9ff2c76809 (table default.Table_f7c2c9f418cd448a8905994508501609 [id=1a7d8ddec9f247bfb0bc83027e152304]) successfully deleted
I20260620 07:00:57.623579 868 tablet_service.cc:1514] Processing DeleteTablet for tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 with delete_type TABLET_DATA_DELETED (replaced by tablet 98385b3c486146a08b63a9507b060d80) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.624287 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 88635d3b7d83435f8fc8e89dc8de173b with delete_type TABLET_DATA_DELETED (replaced by tablet d17c49eecec741cdbd592c94b7f84c67) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.624788 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d97c42bcac24188bbc322f9d4ef2600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.625164 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 13ea5f7db7b34922ac544b9ff2c76809 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.625483 868 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f763b0e91544700bd672c2ef751b4d2) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.625841 868 tablet_service.cc:1514] Processing DeleteTablet for tablet ba3862ba4ebf410baebcc1246b08ddc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b0faf91f2f469f9b06e17caa4709e4) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.626947 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fcb42f643c24e869fb0d7e2893ffa57" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:57.627357 1168 tablet_bootstrap.cc:492] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.627594 1168 ts_tablet_manager.cc:1397] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.090s user 0.001s sys 0.027s
I20260620 07:00:57.627828 1165 tablet_replica.cc:330] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:00:57.627561 831 leader_election.cc:341] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.627861 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f867b8b18e344c358ef4e7924b074edd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:57.628481 1165 raft_consensus.cc:2229] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.628718 1165 raft_consensus.cc:2258] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:57.628587 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f867b8b18e344c358ef4e7924b074edd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.629127 1168 raft_consensus.cc:348] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.629436 1168 raft_consensus.cc:374] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.629575 1168 raft_consensus.cc:729] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.629869 1168 consensus_queue.cc:260] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.630036 1165 ts_tablet_manager.cc:1905] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.630565 1168 ts_tablet_manager.cc:1428] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260620 07:00:57.630929 1168 tablet_bootstrap.cc:492] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.632829 1168 tablet_bootstrap.cc:654] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:57.634119 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e7d1e4719cd441dd8054b24861cbd8a2 consensus state has no leader
I20260620 07:00:57.636924 1168 tablet_bootstrap.cc:492] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.636865 426 master_service.cc:946] ReplaceTablet: received request to replace tablet 1d97c42bcac24188bbc322f9d4ef2600 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:57.637297 1168 ts_tablet_manager.cc:1397] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
W20260620 07:00:57.637787 969 leader_election.cc:341] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.637965 969 leader_election.cc:302] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:00:57.638664 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fcb42f643c24e869fb0d7e2893ffa57" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:57.638897 1032 raft_consensus.cc:3037] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.639039 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1f5cbdecd4974d17961520344743336f" } new_table_name: "default.Table_815bd5183e254243bbd89ce69522aafb" modify_external_catalogs: true
I20260620 07:00:57.639159 1201 raft_consensus.cc:2726] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:57.640991 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c5b10800d2e343da82faaf876f4651ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.641579 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5b10800d2e343da82faaf876f4651ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.641858 1032 raft_consensus.cc:2454] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:57.643373 1168 raft_consensus.cc:348] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.643733 1168 raft_consensus.cc:374] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.643844 1168 raft_consensus.cc:729] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.644099 1168 consensus_queue.cc:260] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.644714 1168 ts_tablet_manager.cc:1428] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260620 07:00:57.644676 1201 raft_consensus.cc:482] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.644961 1168 tablet_bootstrap.cc:492] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.646410 1201 raft_consensus.cc:504] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.647879 1165 ts_tablet_manager.cc:1918] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.648221 1165 log.cc:1196] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ae5ccd8edf6b4f50a1c9b1d2353e7678
I20260620 07:00:57.648455 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba907170f2df4bd0b5e42d4c2d29b21e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:57.648705 753 raft_consensus.cc:2454] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:57.649196 968 leader_election.cc:302] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:57.649509 1263 raft_consensus.cc:2781] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.649597 1263 raft_consensus.cc:482] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.649701 1263 raft_consensus.cc:3037] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.652336 1263 raft_consensus.cc:504] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.653820 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba907170f2df4bd0b5e42d4c2d29b21e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:57.654048 753 raft_consensus.cc:3037] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.654088 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b697ccd03f014152b6a0f571ecb24083"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.654647 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b697ccd03f014152b6a0f571ecb24083 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.655706 1170 tablet_bootstrap.cc:492] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.655920 1170 ts_tablet_manager.cc:1397] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.002s
I20260620 07:00:57.656929 1170 raft_consensus.cc:348] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.657284 1170 raft_consensus.cc:374] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.657404 1170 raft_consensus.cc:729] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.657757 1170 consensus_queue.cc:260] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:57.658694 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63dfade71c254d7e908e00acada93638 consensus state has no leader
I20260620 07:00:57.659090 419 master_service.cc:946] ReplaceTablet: received request to replace tablet d3b8e7056bd14418820032aa533be266 from {username='slave'} at 127.0.0.1:42866
W20260620 07:00:57.659617 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69113a64960d4aee9a2a4fcb28570bf2 consensus state has no leader
I20260620 07:00:57.660036 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_aab952ce8c964d5c8fe8f19901567383" } new_table_name: "default.Table_a8832b6e92294c9c9e051bc22e13b5e4" modify_external_catalogs: true
I20260620 07:00:57.661356 1170 ts_tablet_manager.cc:1428] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260620 07:00:57.663595 1170 tablet_bootstrap.cc:492] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.665033 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1f7b560e0967428b810645d2b7d664cf" } new_table_name: "default.Table_6f3b64370ac34819971c81edfb087f5f" modify_external_catalogs: true
I20260620 07:00:57.666172 1170 tablet_bootstrap.cc:654] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.666677 1168 tablet_bootstrap.cc:654] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.666708 1165 ts_tablet_manager.cc:1939] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:57.667131 1263 leader_election.cc:288] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:57.667639 1165 tablet_replica.cc:330] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:57.667879 1165 raft_consensus.cc:2229] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.668068 1165 raft_consensus.cc:2258] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.668642 1165 ts_tablet_manager.cc:1905] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.669673 753 raft_consensus.cc:2454] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:57.671836 968 leader_election.cc:302] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:57.672200 1263 raft_consensus.cc:2781] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:57.672686 1263 raft_consensus.cc:686] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:57.672973 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 (table default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9 [id=7b71c48967844bf59fbd632ce967b1dc]) successfully deleted
I20260620 07:00:57.672972 1263 consensus_queue.cc:237] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.675267 1201 leader_election.cc:288] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:57.675746 731 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff06bc5fc684b9195c719cbf39d34a6 (DEFAULT_TABLE table=default.Table_829da258d7c446d3b8e8c95466a42a88 [id=74f991adb273483bb626c5939a2cc63c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.676236 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff06bc5fc684b9195c719cbf39d34a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.677493 1165 ts_tablet_manager.cc:1918] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.677644 1165 log.cc:1196] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/13ea5f7db7b34922ac544b9ff2c76809
I20260620 07:00:57.677981 1165 ts_tablet_manager.cc:1939] T 13ea5f7db7b34922ac544b9ff2c76809 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:00:57.678933 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 88635d3b7d83435f8fc8e89dc8de173b because the tablet was not found. No further retry: Not found: Tablet not found: 88635d3b7d83435f8fc8e89dc8de173b
W20260620 07:00:57.679397 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1d97c42bcac24188bbc322f9d4ef2600 because the tablet was not found. No further retry: Not found: Tablet not found: 1d97c42bcac24188bbc322f9d4ef2600
I20260620 07:00:57.679708 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 13ea5f7db7b34922ac544b9ff2c76809 (table default.Table_f7c2c9f418cd448a8905994508501609 [id=1a7d8ddec9f247bfb0bc83027e152304]) successfully deleted
I20260620 07:00:57.680138 1165 tablet_replica.cc:330] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:57.680522 1165 raft_consensus.cc:2229] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:57.680932 1165 pending_rounds.cc:62] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:00:57.681078 1165 pending_rounds.cc:68] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821560502870016 op_type: NO_OP noop_request { }
I20260620 07:00:57.681335 1165 raft_consensus.cc:2866] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:57.681540 1165 raft_consensus.cc:2258] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.682762 1165 ts_tablet_manager.cc:1905] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.691923 1170 tablet_bootstrap.cc:492] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.692209 1170 ts_tablet_manager.cc:1397] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.008s
I20260620 07:00:57.692611 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 33517843ce1d4d8786c91fd738d81ab2 (table default.Table_c6f6140b587a47069d1123f1ff4eef8b [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 2 got 0
I20260620 07:00:57.693077 1170 raft_consensus.cc:348] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.693197 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]). Expected version 1 got 0
I20260620 07:00:57.693470 1170 raft_consensus.cc:374] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.693717 1170 raft_consensus.cc:729] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.694376 1170 consensus_queue.cc:260] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.696173 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f0a3c36ff864f0083383103effe0ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.696404 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d97c42bcac24188bbc322f9d4ef2600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:57.696489 412 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc -> Peer f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775): Couldn't send request to peer f32c3995c70946c38ce1a3094aaaffb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 07:00:57.696589 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 61f53616121e4a52835b8b7da1fa5372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.696825 733 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f763b0e91544700bd672c2ef751b4d2) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.697064 1169 tablet_replica.cc:330] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.696884 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d590d1639a8b436980ba1655ca8ddbf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:57.697247 1169 raft_consensus.cc:2229] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.697417 1169 raft_consensus.cc:2258] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:57.697525 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d590d1639a8b436980ba1655ca8ddbf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.695999 729 tablet_service.cc:1514] Processing DeleteTablet for tablet ba3862ba4ebf410baebcc1246b08ddc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b0faf91f2f469f9b06e17caa4709e4) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.699486 1169 ts_tablet_manager.cc:1905] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.700547 418 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 (table default.Table_c3a21b866a364f0e97c74a240faf1dff [id=a53fbb10c3c84cb698f8973d0e23bce0]). Expected version 2 got 0
I20260620 07:00:57.700915 418 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]). Expected version 1 got 0
I20260620 07:00:57.701143 418 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 289405cbf0784916b971b038279309d8 (table default.Table_31c2839acbe6481b9a678fbc6dadb416 [id=ca68189e4cd34f43a8fbdb53a834be16]). Expected version 1 got 0
I20260620 07:00:57.701694 1165 ts_tablet_manager.cc:1918] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:57.701875 1165 log.cc:1196] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/bb1a7ae0a9b04fca9da8f441958c3280
I20260620 07:00:57.702169 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e5e2d0beac44480daaa7c2757ac7b178
I20260620 07:00:57.702272 1165 ts_tablet_manager.cc:1939] T bb1a7ae0a9b04fca9da8f441958c3280 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:57.702943 729 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e2d0beac44480daaa7c2757ac7b178 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.703049 868 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e2d0beac44480daaa7c2757ac7b178 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.703392 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet bb1a7ae0a9b04fca9da8f441958c3280 (table default.Table_61741807e243431395868ee24844d1aa [id=31b071f3fa7547fb8a222ac6b8bffd6a]) successfully deleted
I20260620 07:00:57.704667 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e2d0beac44480daaa7c2757ac7b178 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.705699 1165 tablet_replica.cc:330] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:57.706419 1165 raft_consensus.cc:2229] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:57.706748 1165 pending_rounds.cc:62] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:00:57.707078 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_09dc5f70574848c78709d12aff4618f1" } modify_external_catalogs: true
I20260620 07:00:57.707142 1165 pending_rounds.cc:68] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821559570804736 op_type: NO_OP noop_request { }
I20260620 07:00:57.707300 1165 raft_consensus.cc:2866] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:57.707296 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 13ea5f7db7b34922ac544b9ff2c76809 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.707497 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 978f99d2a7d6448aba8dcd2611b75af3) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.707536 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_09dc5f70574848c78709d12aff4618f1" } modify_external_catalogs: true
I20260620 07:00:57.707751 1165 raft_consensus.cc:2258] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.708312 1169 ts_tablet_manager.cc:1918] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.708442 1169 log.cc:1196] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/1f0a3c36ff864f0083383103effe0ee8
I20260620 07:00:57.708827 1169 ts_tablet_manager.cc:1939] T 1f0a3c36ff864f0083383103effe0ee8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.709195 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_705dc245b225442eb3ba5fc4731c8e12" } modify_external_catalogs: true
I20260620 07:00:57.709439 1165 ts_tablet_manager.cc:1905] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.709679 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_705dc245b225442eb3ba5fc4731c8e12" } modify_external_catalogs: true
I20260620 07:00:57.709964 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 1f0a3c36ff864f0083383103effe0ee8 (table default.Table_0d16742deb1e45ee86c610022bd3e4b9 [id=3da7a85c122648408588dea7ebe1fa5c]) successfully deleted
I20260620 07:00:57.710546 1168 tablet_bootstrap.cc:492] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.710716 1168 ts_tablet_manager.cc:1397] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.066s user 0.005s sys 0.005s
I20260620 07:00:57.711541 1168 raft_consensus.cc:348] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.711726 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_196313208d3a49659e5f18d921894e9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:57.712081 1168 raft_consensus.cc:374] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.712240 1168 raft_consensus.cc:729] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:00:57.712528 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_196313208d3a49659e5f18d921894e9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.712544 1168 consensus_queue.cc:260] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.713419 1168 ts_tablet_manager.cc:1428] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:00:57.714986 868 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff06bc5fc684b9195c719cbf39d34a6 (DEFAULT_TABLE table=default.Table_829da258d7c446d3b8e8c95466a42a88 [id=74f991adb273483bb626c5939a2cc63c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.715656 1168 tablet_bootstrap.cc:492] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.716481 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff06bc5fc684b9195c719cbf39d34a6 (DEFAULT_TABLE table=default.Table_829da258d7c446d3b8e8c95466a42a88 [id=74f991adb273483bb626c5939a2cc63c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.716516 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff06bc5fc684b9195c719cbf39d34a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.716941 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff06bc5fc684b9195c719cbf39d34a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.716957 1170 ts_tablet_manager.cc:1428] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.024s user 0.003s sys 0.000s
I20260620 07:00:57.719173 733 tablet_service.cc:1467] Processing CreateTablet for tablet 203ba3933d3a4fb2a4978b29cad614e6 (DEFAULT_TABLE table=default.Table_7b6efec6450d4ae6a6518c7c13d94482 [id=72036a5a731244a4a1f797ec8663aef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.719449 874 tablet_service.cc:1467] Processing CreateTablet for tablet 203ba3933d3a4fb2a4978b29cad614e6 (DEFAULT_TABLE table=default.Table_7b6efec6450d4ae6a6518c7c13d94482 [id=72036a5a731244a4a1f797ec8663aef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.719548 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 203ba3933d3a4fb2a4978b29cad614e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.719966 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 203ba3933d3a4fb2a4978b29cad614e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.723830 871 tablet_service.cc:1467] Processing CreateTablet for tablet b6e36ffd69974ef897390a257f63a509 (DEFAULT_TABLE table=default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.725220 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e36ffd69974ef897390a257f63a509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.725977 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 203ba3933d3a4fb2a4978b29cad614e6 (DEFAULT_TABLE table=default.Table_7b6efec6450d4ae6a6518c7c13d94482 [id=72036a5a731244a4a1f797ec8663aef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.726397 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 203ba3933d3a4fb2a4978b29cad614e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.727092 1002 tablet_service.cc:1467] Processing CreateTablet for tablet b6e36ffd69974ef897390a257f63a509 (DEFAULT_TABLE table=default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.726905 418 catalog_manager.cc:5495] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260620 07:00:57.727412 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e36ffd69974ef897390a257f63a509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.734958 1170 tablet_bootstrap.cc:492] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:00:57.735710 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 62ef9a12e3684d27b6696f631c68a5af consensus state has no leader
W20260620 07:00:57.737661 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1d97c42bcac24188bbc322f9d4ef2600 because the tablet was not found. No further retry: Not found: Tablet not found: 1d97c42bcac24188bbc322f9d4ef2600
I20260620 07:00:57.737987 1240 raft_consensus.cc:482] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.737989 729 tablet_service.cc:1467] Processing CreateTablet for tablet b6e36ffd69974ef897390a257f63a509 (DEFAULT_TABLE table=default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.738631 1240 raft_consensus.cc:504] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.739326 1240 leader_election.cc:288] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.739872 876 tablet_service.cc:1467] Processing CreateTablet for tablet add9e860802d4edebcfbc9fa3c4a6b24 (DEFAULT_TABLE table=default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.740083 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e2d0beac44480daaa7c2757ac7b178" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:57.740350 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add9e860802d4edebcfbc9fa3c4a6b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.740360 1032 raft_consensus.cc:2454] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:00:57.741353 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e2d0beac44480daaa7c2757ac7b178" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:57.741511 1006 tablet_service.cc:1467] Processing CreateTablet for tablet e14db4e3394046e49ecc69c9ca4dc840 (DEFAULT_TABLE table=default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.741590 896 raft_consensus.cc:2454] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:00:57.741953 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14db4e3394046e49ecc69c9ca4dc840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.743574 875 tablet_service.cc:1467] Processing CreateTablet for tablet e14db4e3394046e49ecc69c9ca4dc840 (DEFAULT_TABLE table=default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.744081 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14db4e3394046e49ecc69c9ca4dc840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.754855 1169 tablet_replica.cc:330] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.755481 681 leader_election.cc:302] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:57.755532 1010 tablet_service.cc:1467] Processing CreateTablet for tablet add9e860802d4edebcfbc9fa3c4a6b24 (DEFAULT_TABLE table=default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.755496 1169 raft_consensus.cc:2229] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.756278 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add9e860802d4edebcfbc9fa3c4a6b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.756709 1240 raft_consensus.cc:2781] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.756845 1240 raft_consensus.cc:482] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.757337 1240 raft_consensus.cc:3037] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:00:57.759374 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 consensus state has no leader
I20260620 07:00:57.760789 1240 raft_consensus.cc:504] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.761451 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_36a1a1d73652453dbde01677f41a650a" } modify_external_catalogs: true
I20260620 07:00:57.761650 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_36a1a1d73652453dbde01677f41a650a" } modify_external_catalogs: true
I20260620 07:00:57.762015 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e2d0beac44480daaa7c2757ac7b178" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:57.762240 1032 raft_consensus.cc:3037] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.762288 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e2d0beac44480daaa7c2757ac7b178" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:57.762517 896 raft_consensus.cc:3037] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.762708 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0d2790345adb48f6b1c2e10d634207e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:57.763305 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d2790345adb48f6b1c2e10d634207e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.765196 1032 raft_consensus.cc:2454] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:00:57.765235 896 raft_consensus.cc:2454] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:00:57.765391 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba907170f2df4bd0b5e42d4c2d29b21e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:57.765599 893 raft_consensus.cc:3037] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.765826 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba907170f2df4bd0b5e42d4c2d29b21e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:57.766120 1168 tablet_bootstrap.cc:654] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.767226 732 tablet_service.cc:1467] Processing CreateTablet for tablet e14db4e3394046e49ecc69c9ca4dc840 (DEFAULT_TABLE table=default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.767680 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14db4e3394046e49ecc69c9ca4dc840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.769147 893 raft_consensus.cc:2454] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:57.773298 734 tablet_service.cc:1467] Processing CreateTablet for tablet add9e860802d4edebcfbc9fa3c4a6b24 (DEFAULT_TABLE table=default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.773824 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add9e860802d4edebcfbc9fa3c4a6b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.774466 1169 raft_consensus.cc:2258] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.774971 830 leader_election.cc:302] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:57.775352 1279 raft_consensus.cc:2781] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:57.775480 1279 raft_consensus.cc:686] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:57.775744 1279 consensus_queue.cc:237] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.776006 868 tablet_service.cc:1467] Processing CreateTablet for tablet f9df1d52393e47ce991b5295d03624e8 (DEFAULT_TABLE table=default.Table_b7ac5938b8c54806a785eaac99c70caa [id=a7902aafbaad4905a6b5b03ad669eeae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.775640 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad (DEFAULT_TABLE table=default.Table_d9dd80723d604b80901a94c9e9fe0246 [id=1aa84262b2da494d8f47bd49a6348733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.776219 730 tablet_service.cc:1467] Processing CreateTablet for tablet bea895c735c847f59794ab8c3282447d (DEFAULT_TABLE table=default.Table_53d54ae0843e43bbaa814c4fdd23d530 [id=42744b614d6e4bd7900ea2fc51d30fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.776569 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bea895c735c847f59794ab8c3282447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.778262 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.778927 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e36ffd69974ef897390a257f63a509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.779130 875 tablet_service.cc:1467] Processing CreateTablet for tablet bea895c735c847f59794ab8c3282447d (DEFAULT_TABLE table=default.Table_53d54ae0843e43bbaa814c4fdd23d530 [id=42744b614d6e4bd7900ea2fc51d30fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.779628 681 leader_election.cc:302] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:57.779704 876 tablet_service.cc:1467] Processing CreateTablet for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad (DEFAULT_TABLE table=default.Table_d9dd80723d604b80901a94c9e9fe0246 [id=1aa84262b2da494d8f47bd49a6348733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.780381 1168 tablet_bootstrap.cc:492] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.780550 1168 ts_tablet_manager.cc:1397] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.004s
I20260620 07:00:57.779222 1013 tablet_service.cc:1467] Processing CreateTablet for tablet bea895c735c847f59794ab8c3282447d (DEFAULT_TABLE table=default.Table_53d54ae0843e43bbaa814c4fdd23d530 [id=42744b614d6e4bd7900ea2fc51d30fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.786456 1166 tablet_replica.cc:330] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:57.786746 1168 raft_consensus.cc:348] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.787092 1168 raft_consensus.cc:374] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.787220 1168 raft_consensus.cc:729] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.787557 1168 consensus_queue.cc:260] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.788897 1166 raft_consensus.cc:2229] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:57.791960 1166 pending_rounds.cc:62] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:00:57.795396 1168 ts_tablet_manager.cc:1428] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260620 07:00:57.795805 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9df1d52393e47ce991b5295d03624e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.794283 1280 raft_consensus.cc:482] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.800372 1280 raft_consensus.cc:504] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.800799 1169 ts_tablet_manager.cc:1905] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.800734 1166 pending_rounds.cc:68] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821558235529216 op_type: NO_OP noop_request { }
I20260620 07:00:57.800966 1166 raft_consensus.cc:2866] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:57.801098 1166 raft_consensus.cc:2258] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.801530 726 tablet_service.cc:1467] Processing CreateTablet for tablet f9df1d52393e47ce991b5295d03624e8 (DEFAULT_TABLE table=default.Table_b7ac5938b8c54806a785eaac99c70caa [id=a7902aafbaad4905a6b5b03ad669eeae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.801944 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9df1d52393e47ce991b5295d03624e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.803083 1170 tablet_bootstrap.cc:654] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.803531 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 21f51aeb329e42359cfaf7de2a039d13
I20260620 07:00:57.804133 1240 leader_election.cc:288] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.804363 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 21f51aeb329e42359cfaf7de2a039d13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.804363 1240 raft_consensus.cc:2781] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:57.804518 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 21f51aeb329e42359cfaf7de2a039d13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.804979 1240 raft_consensus.cc:686] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:00:57.807057 421 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 5037eaed54694cb692ac73207a4abbe5
I20260620 07:00:57.802937 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bea895c735c847f59794ab8c3282447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.803015 1165 ts_tablet_manager.cc:1918] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:57.803403 1168 tablet_bootstrap.cc:492] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.811935 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.813752 1166 ts_tablet_manager.cc:1905] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.813505 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc3bc9ec1334f1bb3d9f653b2472bc7" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:57.814357 831 leader_election.cc:341] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.814915 1003 tablet_service.cc:1467] Processing CreateTablet for tablet f9df1d52393e47ce991b5295d03624e8 (DEFAULT_TABLE table=default.Table_b7ac5938b8c54806a785eaac99c70caa [id=a7902aafbaad4905a6b5b03ad669eeae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.815162 1170 tablet_bootstrap.cc:492] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.805891 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 21f51aeb329e42359cfaf7de2a039d13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.815270 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bea895c735c847f59794ab8c3282447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.815454 731 tablet_service.cc:1467] Processing CreateTablet for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad (DEFAULT_TABLE table=default.Table_d9dd80723d604b80901a94c9e9fe0246 [id=1aa84262b2da494d8f47bd49a6348733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:57.816789 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9df1d52393e47ce991b5295d03624e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.816694 1240 consensus_queue.cc:237] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.822094 1170 ts_tablet_manager.cc:1397] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.095s user 0.003s sys 0.002s
I20260620 07:00:57.830993 1362 tablet.cc:1722] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:00:57.833698 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:57.838270 1201 raft_consensus.cc:482] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.838467 1201 raft_consensus.cc:504] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.839493 1201 leader_election.cc:288] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:57.841631 1167 tablet_bootstrap.cc:492] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:57.841882 1167 ts_tablet_manager.cc:1397] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.444s user 0.022s sys 0.019s
I20260620 07:00:57.842916 1167 raft_consensus.cc:348] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.843235 1167 raft_consensus.cc:374] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.843345 1167 raft_consensus.cc:729] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.843647 1167 consensus_queue.cc:260] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.844596 1167 ts_tablet_manager.cc:1428] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:00:57.844511 1170 raft_consensus.cc:348] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.845484 1170 raft_consensus.cc:374] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.845679 1170 raft_consensus.cc:729] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.843536 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2060ea1520d8404daa6b862b8945226e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:57.847054 968 leader_election.cc:341] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.847088 1170 consensus_queue.cc:260] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.848347 1170 ts_tablet_manager.cc:1428] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.026s user 0.001s sys 0.002s
I20260620 07:00:57.849475 1170 tablet_bootstrap.cc:492] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.855144 1167 tablet_bootstrap.cc:492] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:57.855532 1165 log.cc:1196] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ba3862ba4ebf410baebcc1246b08ddc9
I20260620 07:00:57.860342 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e7d1e4719cd441dd8054b24861cbd8a2
I20260620 07:00:57.861892 868 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d1e4719cd441dd8054b24861cbd8a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.862038 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d48c7f04b672408686515f6713e117c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:57.862247 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c8cc4f7a40724cbdb83345a1c7df93df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:57.862677 1165 ts_tablet_manager.cc:1939] T ba3862ba4ebf410baebcc1246b08ddc9 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:00:57.862877 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8cc4f7a40724cbdb83345a1c7df93df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.863407 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_31c2839acbe6481b9a678fbc6dadb416" } new_table_name: "default.Table_dc7b02e7defe4ddc8c4305ecb34bb7ab" modify_external_catalogs: true
I20260620 07:00:57.864431 1165 tablet_replica.cc:330] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:57.864454 734 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d1e4719cd441dd8054b24861cbd8a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.864648 1165 raft_consensus.cc:2229] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.865561 1165 raft_consensus.cc:2258] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.866082 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ba3862ba4ebf410baebcc1246b08ddc9 (table default.Table_c7ad555de0774a6e9ecf9af82802275d [id=cfbc4dc349434379b3eaabd5dc948327]) successfully deleted
I20260620 07:00:57.866673 1168 tablet_bootstrap.cc:654] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.869515 396 master_runner.cc:186] Error getting master registration for 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111),
I20260620 07:00:57.869702 396 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 07:00:57.862898 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d48c7f04b672408686515f6713e117c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.876447 1165 ts_tablet_manager.cc:1905] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.880133 1166 ts_tablet_manager.cc:1918] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:57.880868 1170 tablet_bootstrap.cc:654] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.882010 1169 ts_tablet_manager.cc:1918] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.883440 1363 tablet.cc:1722] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:00:57.884892 1169 log.cc:1196] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/61f53616121e4a52835b8b7da1fa5372
I20260620 07:00:57.888105 1166 log.cc:1196] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ae5ccd8edf6b4f50a1c9b1d2353e7678
I20260620 07:00:57.890363 1166 ts_tablet_manager.cc:1939] T ae5ccd8edf6b4f50a1c9b1d2353e7678 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:57.885879 1169 ts_tablet_manager.cc:1939] T 61f53616121e4a52835b8b7da1fa5372 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.891642 1166 tablet_replica.cc:330] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:57.891527 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_136e581f613845f79105f13229d93e06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:57.892272 1240 raft_consensus.cc:482] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:00:57.892416 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_136e581f613845f79105f13229d93e06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.892602 1240 raft_consensus.cc:504] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.893391 1169 tablet_replica.cc:330] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.893651 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a7e62b5af141ca8b5054ce8f46c2b6" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:57.894089 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 61f53616121e4a52835b8b7da1fa5372 (table default.Table_11cde52aaf3944eeb72cef8645b01d6a [id=425c83c87160456590a08a72244d2065]) successfully deleted
I20260620 07:00:57.895414 1169 raft_consensus.cc:2229] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.895659 1169 raft_consensus.cc:2258] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.896545 1169 ts_tablet_manager.cc:1905] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.899578 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a7e62b5af141ca8b5054ce8f46c2b6" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:57.899904 1032 raft_consensus.cc:2379] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:00:57.900472 681 leader_election.cc:302] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:00:57.900992 1361 raft_consensus.cc:3037] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.903736 1170 tablet_bootstrap.cc:492] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.903952 1361 raft_consensus.cc:2726] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:57.904243 1170 ts_tablet_manager.cc:1397] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.004s
I20260620 07:00:57.905179 1170 raft_consensus.cc:348] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.905515 1170 raft_consensus.cc:374] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.905650 1170 raft_consensus.cc:729] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.905886 1165 ts_tablet_manager.cc:1918] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.905419 1240 leader_election.cc:288] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.905921 1170 consensus_queue.cc:260] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.908344 1165 log.cc:1196] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/e5e2d0beac44480daaa7c2757ac7b178
I20260620 07:00:57.909260 1170 ts_tablet_manager.cc:1428] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260620 07:00:57.909279 1165 ts_tablet_manager.cc:1939] T e5e2d0beac44480daaa7c2757ac7b178 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:57.909773 1170 tablet_bootstrap.cc:492] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.906985 1246 consensus_queue.cc:1035] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:57.911278 1280 leader_election.cc:288] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.912292 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet e5e2d0beac44480daaa7c2757ac7b178 (table default.Table_90ac8c8b385b4d52a9c4a817223fd870 [id=24931029acfd4661a09a5bf4656596f3]) successfully deleted
W20260620 07:00:57.913132 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 21f51aeb329e42359cfaf7de2a039d13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21f51aeb329e42359cfaf7de2a039d13 already in progress: creating tablet
I20260620 07:00:57.916247 1170 tablet_bootstrap.cc:654] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.917784 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d3b8e7056bd14418820032aa533be266
I20260620 07:00:57.917814 1169 ts_tablet_manager.cc:1918] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.917932 1169 log.cc:1196] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/bb1a7ae0a9b04fca9da8f441958c3280
I20260620 07:00:57.918267 419 catalog_manager.cc:6565] ReplaceTablet: tablet d3b8e7056bd14418820032aa533be266 deleted and replaced by tablet d15ea9529afe40b6b4a702035479aef3
I20260620 07:00:57.918542 1169 ts_tablet_manager.cc:1939] T bb1a7ae0a9b04fca9da8f441958c3280 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.920347 1169 tablet_replica.cc:330] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.920547 1169 raft_consensus.cc:2229] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.921129 1169 raft_consensus.cc:2258] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:57.921366 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e7d1e4719cd441dd8054b24861cbd8a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e7d1e4719cd441dd8054b24861cbd8a2 already in progress: creating tablet
I20260620 07:00:57.921366 875 tablet_service.cc:1514] Processing DeleteTablet for tablet d3b8e7056bd14418820032aa533be266 with delete_type TABLET_DATA_DELETED (replaced by tablet d15ea9529afe40b6b4a702035479aef3) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.922125 1165 tablet_replica.cc:330] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:57.922664 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet bb1a7ae0a9b04fca9da8f441958c3280 (table default.Table_61741807e243431395868ee24844d1aa [id=31b071f3fa7547fb8a222ac6b8bffd6a]) successfully deleted
I20260620 07:00:57.922078 731 tablet_service.cc:1514] Processing DeleteTablet for tablet d3b8e7056bd14418820032aa533be266 with delete_type TABLET_DATA_DELETED (replaced by tablet d15ea9529afe40b6b4a702035479aef3) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.921965 1169 ts_tablet_manager.cc:1905] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.923473 1165 raft_consensus.cc:2229] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:57.924374 1168 tablet_bootstrap.cc:492] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.925618 1168 ts_tablet_manager.cc:1397] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.122s user 0.000s sys 0.010s
I20260620 07:00:57.928229 1168 raft_consensus.cc:348] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.928606 1168 raft_consensus.cc:374] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.928738 1168 raft_consensus.cc:729] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.929057 1168 consensus_queue.cc:260] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.929905 1168 ts_tablet_manager.cc:1428] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:00:57.931198 1168 tablet_bootstrap.cc:492] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.933259 1170 tablet_bootstrap.cc:492] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.933494 1170 ts_tablet_manager.cc:1397] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.003s
I20260620 07:00:57.929409 1280 consensus_queue.cc:1035] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:57.936254 1165 pending_rounds.cc:62] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:00:57.936463 1165 pending_rounds.cc:68] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821557844987904 op_type: NO_OP noop_request { }
I20260620 07:00:57.936746 1170 raft_consensus.cc:348] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.937171 1165 raft_consensus.cc:2866] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:57.937918 1170 raft_consensus.cc:374] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.938069 1170 raft_consensus.cc:729] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.938529 1170 consensus_queue.cc:260] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.939159 1170 ts_tablet_manager.cc:1428] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260620 07:00:57.939764 1170 tablet_bootstrap.cc:492] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.939787 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ae5ccd8edf6b4f50a1c9b1d2353e7678 (table default.Table_c6419748536e4ba1a12f2b1fbdfb4dd9 [id=7b71c48967844bf59fbd632ce967b1dc]) successfully deleted
I20260620 07:00:57.939869 1166 raft_consensus.cc:2229] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.940033 1165 raft_consensus.cc:2258] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.938488 1168 tablet_bootstrap.cc:654] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.942329 1170 tablet_bootstrap.cc:654] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.942345 1165 ts_tablet_manager.cc:1905] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.940598 1167 tablet_bootstrap.cc:654] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.942595 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2aa5bfb35aed447f8788be438410abc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:57.943246 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet d3b8e7056bd14418820032aa533be266 with delete_type TABLET_DATA_DELETED (replaced by tablet d15ea9529afe40b6b4a702035479aef3) from {username='slave'} at 127.0.0.1:41218
W20260620 07:00:57.943325 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2aa5bfb35aed447f8788be438410abc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:57.943462 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d1e4719cd441dd8054b24861cbd8a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.943619 1166 raft_consensus.cc:2258] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.944156 1166 ts_tablet_manager.cc:1905] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.944352 1169 ts_tablet_manager.cc:1918] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:57.944470 1169 log.cc:1196] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ba3862ba4ebf410baebcc1246b08ddc9
I20260620 07:00:57.944808 1169 ts_tablet_manager.cc:1939] T ba3862ba4ebf410baebcc1246b08ddc9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.945691 1169 tablet_replica.cc:330] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.946908 1169 raft_consensus.cc:2229] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:57.947870 1169 pending_rounds.cc:62] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:00:57.948410 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ba3862ba4ebf410baebcc1246b08ddc9 (table default.Table_c7ad555de0774a6e9ecf9af82802275d [id=cfbc4dc349434379b3eaabd5dc948327]) successfully deleted
I20260620 07:00:57.948412 1169 pending_rounds.cc:68] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821561637003264 op_type: NO_OP noop_request { }
I20260620 07:00:57.949173 1170 tablet_bootstrap.cc:492] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:57.949352 1170 ts_tablet_manager.cc:1397] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260620 07:00:57.950064 1170 raft_consensus.cc:348] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.950354 1170 raft_consensus.cc:374] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.950467 1170 raft_consensus.cc:729] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.950711 1170 consensus_queue.cc:260] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.951328 1170 ts_tablet_manager.cc:1428] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:00:57.952056 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b697ccd03f014152b6a0f571ecb24083" } new_table_name: "default.Table_2411c7dd68274c07a75cd0b3ae3e2d32" modify_external_catalogs: true
I20260620 07:00:57.951825 1170 tablet_bootstrap.cc:492] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:57.954612 1170 tablet_bootstrap.cc:654] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.896066 466 master_runner.cc:186] Error getting master registration for 127.0.97.60:46775: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111),
I20260620 07:00:57.954869 466 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 07:00:57.954843 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet fcc92630252b40a6a306c3a578fa3e59 with delete_type TABLET_DATA_DELETED (replaced by tablet 04d5d361a5404dcf99a89e93ac1f7dd8) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.954733 1169 raft_consensus.cc:2866] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:57.955013 1169 raft_consensus.cc:2258] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.955870 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc3bc9ec1334f1bb3d9f653b2472bc7" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:57.956106 1169 ts_tablet_manager.cc:1905] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:57.956095 1032 raft_consensus.cc:2454] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:57.959533 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2060ea1520d8404daa6b862b8945226e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:57.959787 895 raft_consensus.cc:2454] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
W20260620 07:00:57.962030 414 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 537ab1626d4e44c38d8cca8c51921424 (table default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 537ab1626d4e44c38d8cca8c51921424 consensus state has no leader
I20260620 07:00:57.962205 1169 ts_tablet_manager.cc:1918] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:57.962729 969 leader_election.cc:302] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:57.963358 1201 raft_consensus.cc:2781] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.963640 1168 tablet_bootstrap.cc:492] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:57.963835 1168 ts_tablet_manager.cc:1397] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.002s
I20260620 07:00:57.963471 1201 raft_consensus.cc:482] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.965924 1201 raft_consensus.cc:3037] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.967679 1168 raft_consensus.cc:348] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.968004 1168 raft_consensus.cc:374] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:57.968153 1168 raft_consensus.cc:729] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:57.968437 1168 consensus_queue.cc:260] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.968747 1201 raft_consensus.cc:504] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.969106 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c5b10800d2e343da82faaf876f4651ab" } new_table_name: "default.Table_51a5ad47a8104b21839dba3fcd13be8e" modify_external_catalogs: true
I20260620 07:00:57.969949 1201 leader_election.cc:288] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:57.970408 830 leader_election.cc:302] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:57.972039 1168 ts_tablet_manager.cc:1428] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260620 07:00:57.973590 1279 raft_consensus.cc:2781] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:57.973812 1279 raft_consensus.cc:482] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:57.973994 1279 raft_consensus.cc:3037] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.975443 1169 log.cc:1196] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/e5e2d0beac44480daaa7c2757ac7b178
I20260620 07:00:57.975519 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2060ea1520d8404daa6b862b8945226e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:57.975806 753 raft_consensus.cc:3037] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.977144 1165 ts_tablet_manager.cc:1918] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:57.977281 1165 log.cc:1196] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/d3b8e7056bd14418820032aa533be266
I20260620 07:00:57.977706 1165 ts_tablet_manager.cc:1939] T d3b8e7056bd14418820032aa533be266 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:57.979943 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet d3b8e7056bd14418820032aa533be266 (table default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]) successfully deleted
I20260620 07:00:57.980135 1279 raft_consensus.cc:504] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.981235 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc3bc9ec1334f1bb3d9f653b2472bc7" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
W20260620 07:00:57.982235 831 leader_election.cc:341] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.982537 753 raft_consensus.cc:2454] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:57.982620 1279 leader_election.cc:288] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:57.983294 1280 consensus_queue.cc:1035] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:57.984448 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc3bc9ec1334f1bb3d9f653b2472bc7" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:57.984665 1032 raft_consensus.cc:3037] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:57.985198 968 leader_election.cc:302] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:57.985234 1376 tablet.cc:1722] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:00:57.986037 1169 ts_tablet_manager.cc:1939] T e5e2d0beac44480daaa7c2757ac7b178 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:57.986097 1201 raft_consensus.cc:2781] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:57.986258 1201 raft_consensus.cc:686] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:57.986505 1201 consensus_queue.cc:237] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.987067 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 52b0ef4797324c82832c11a1c98e2b42
I20260620 07:00:57.987534 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet e5e2d0beac44480daaa7c2757ac7b178 (table default.Table_90ac8c8b385b4d52a9c4a817223fd870 [id=24931029acfd4661a09a5bf4656596f3]) successfully deleted
I20260620 07:00:57.987807 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 52b0ef4797324c82832c11a1c98e2b42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:57.990052 1169 tablet_replica.cc:330] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:57.990279 1169 raft_consensus.cc:2229] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:57.990477 1169 raft_consensus.cc:2258] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:57.991549 1194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 07:00:57.991848 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 52b0ef4797324c82832c11a1c98e2b42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:57.992727 1032 raft_consensus.cc:2454] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:57.992835 1194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 07:00:57.993014 1168 tablet_bootstrap.cc:492] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:57.993202 1194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 07:00:57.993356 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 52b0ef4797324c82832c11a1c98e2b42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:57.993774 1280 raft_consensus.cc:482] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:57.993919 1280 raft_consensus.cc:504] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:57.994331 1165 tablet_replica.cc:330] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:57.995185 1168 tablet_bootstrap.cc:654] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:57.995812 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d05d17792e54877b29431754676dcad" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:57.995563 1280 leader_election.cc:288] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:00:57.996380 831 leader_election.cc:341] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:57.996819 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2060ea1520d8404daa6b862b8945226e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:58.000267 893 raft_consensus.cc:3037] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.002163 1169 ts_tablet_manager.cc:1905] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.004362 1167 tablet_bootstrap.cc:492] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.004612 1167 ts_tablet_manager.cc:1397] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.150s user 0.000s sys 0.007s
I20260620 07:00:58.008188 893 raft_consensus.cc:2454] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.008963 1167 raft_consensus.cc:348] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.011116 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_49629c65f95a46ff815a7d39c7143227"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.011750 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49629c65f95a46ff815a7d39c7143227 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.013713 1170 tablet_bootstrap.cc:492] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:58.013947 1170 ts_tablet_manager.cc:1397] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.005s
I20260620 07:00:58.014894 1170 raft_consensus.cc:348] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.015229 1170 raft_consensus.cc:374] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.015381 1170 raft_consensus.cc:729] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.015856 1168 tablet_bootstrap.cc:492] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:58.016068 1168 ts_tablet_manager.cc:1397] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.003s
I20260620 07:00:58.016906 1168 raft_consensus.cc:348] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.017442 1170 consensus_queue.cc:260] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.009747 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d05d17792e54877b29431754676dcad" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.017997 1168 raft_consensus.cc:374] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.018116 1170 ts_tablet_manager.cc:1428] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260620 07:00:58.017573 830 leader_election.cc:302] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:58.018411 1170 tablet_bootstrap.cc:492] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:58.019003 1280 raft_consensus.cc:2781] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.019044 1167 raft_consensus.cc:374] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.019174 1167 raft_consensus.cc:729] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.019186 1280 raft_consensus.cc:686] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:58.019506 1280 consensus_queue.cc:237] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.021422 1167 consensus_queue.cc:260] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.022135 1167 ts_tablet_manager.cc:1428] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260620 07:00:58.024964 1165 raft_consensus.cc:2229] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:58.025902 1165 raft_consensus.cc:2258] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:58.026729 830 leader_election.cc:341] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.027451 830 leader_election.cc:302] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:58.028440 1167 tablet_bootstrap.cc:492] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.028488 1364 raft_consensus.cc:2726] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:58.030617 1166 ts_tablet_manager.cc:1918] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.030870 1166 log.cc:1196] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/329b18cc9b544cddbf0564d7de8a5c36
I20260620 07:00:58.032769 1165 ts_tablet_manager.cc:1905] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.034811 1167 tablet_bootstrap.cc:654] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.035915 1166 ts_tablet_manager.cc:1939] T 329b18cc9b544cddbf0564d7de8a5c36 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.036437 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6bd66e9c6f5d4e348b7345db1c1175d8" } modify_external_catalogs: true
I20260620 07:00:58.036675 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6bd66e9c6f5d4e348b7345db1c1175d8" } modify_external_catalogs: true
I20260620 07:00:58.037410 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 329b18cc9b544cddbf0564d7de8a5c36 (table default.Table_2f6560957a4c40c186a1ebb5e88f7123 [id=a7b18d380f2a4a1b86f4c767c6a93221]) successfully deleted
I20260620 07:00:58.037799 1166 tablet_replica.cc:330] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.038174 1170 tablet_bootstrap.cc:654] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.038172 1166 raft_consensus.cc:2229] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.038488 1166 raft_consensus.cc:2258] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.038620 1169 ts_tablet_manager.cc:1918] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.038774 1169 log.cc:1196] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/13ea5f7db7b34922ac544b9ff2c76809
I20260620 07:00:58.039225 1169 ts_tablet_manager.cc:1939] T 13ea5f7db7b34922ac544b9ff2c76809 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:58.039673 1166 ts_tablet_manager.cc:1905] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.040539 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 13ea5f7db7b34922ac544b9ff2c76809 (table default.Table_f7c2c9f418cd448a8905994508501609 [id=1a7d8ddec9f247bfb0bc83027e152304]) successfully deleted
I20260620 07:00:58.041276 1169 tablet_replica.cc:330] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:58.041487 1169 raft_consensus.cc:2229] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.041652 1169 raft_consensus.cc:2258] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.042161 1165 ts_tablet_manager.cc:1918] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:58.042317 1165 log.cc:1196] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/52b0ef4797324c82832c11a1c98e2b42
I20260620 07:00:58.042409 1169 ts_tablet_manager.cc:1905] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.042778 1165 ts_tablet_manager.cc:1939] T 52b0ef4797324c82832c11a1c98e2b42 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:58.043944 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 52b0ef4797324c82832c11a1c98e2b42 (table default.Table_36a1a1d73652453dbde01677f41a650a [id=9fbfb3ec7f5348d3907734224702c69e]) successfully deleted
I20260620 07:00:58.018132 1168 raft_consensus.cc:729] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.044392 1168 consensus_queue.cc:260] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.045193 1168 ts_tablet_manager.cc:1428] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20260620 07:00:58.047248 1168 tablet_bootstrap.cc:492] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:58.051134 1168 tablet_bootstrap.cc:654] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.051739 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a31b6fbb7c36401aae31f37d6bcb978e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.052364 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a31b6fbb7c36401aae31f37d6bcb978e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.055415 1167 tablet_bootstrap.cc:492] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.055730 1167 ts_tablet_manager.cc:1397] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.005s
I20260620 07:00:58.056892 1167 raft_consensus.cc:348] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.057322 1167 raft_consensus.cc:374] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.057449 1167 raft_consensus.cc:729] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.057775 1167 consensus_queue.cc:260] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.059638 1167 ts_tablet_manager.cc:1428] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 07:00:58.060881 1167 tablet_bootstrap.cc:492] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.062350 1169 ts_tablet_manager.cc:1918] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.062539 1169 log.cc:1196] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/16a7e62b5af141ca8b5054ce8f46c2b6
I20260620 07:00:58.062981 1169 ts_tablet_manager.cc:1939] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:58.065678 1280 raft_consensus.cc:482] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.065852 1280 raft_consensus.cc:504] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.066380 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 289405cbf0784916b971b038279309d8 (table default.Table_31c2839acbe6481b9a678fbc6dadb416 [id=ca68189e4cd34f43a8fbdb53a834be16]). Expected version 1 got 0
I20260620 07:00:58.066628 1280 leader_election.cc:288] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:58.066663 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]). Expected version 1 got 0
I20260620 07:00:58.067019 1166 ts_tablet_manager.cc:1918] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.066933 421 catalog_manager.cc:5495] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:00:58.067397 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 33517843ce1d4d8786c91fd738d81ab2 (table default.Table_c6f6140b587a47069d1123f1ff4eef8b [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 2 got 0
W20260620 07:00:58.068017 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 289405cbf0784916b971b038279309d8 consensus state has no leader
I20260620 07:00:58.067994 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad65565caddf4e878292d1178fbf6037" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.068327 427 master_service.cc:946] ReplaceTablet: received request to replace tablet f90f1b2facc0415ab378fb81b60b0202 from {username='slave'} at 127.0.0.1:42866
W20260620 07:00:58.069240 831 leader_election.cc:341] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.069442 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 169b93c38e59435db218152f2d25bdfa from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.069059 419 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec] alter complete (version 1)
I20260620 07:00:58.070040 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 537ab1626d4e44c38d8cca8c51921424 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.070303 875 tablet_service.cc:1467] Processing CreateTablet for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 (DEFAULT_TABLE table=default.Table_d590d1639a8b436980ba1655ca8ddbf0 [id=08b49e7b2cb8468e97d459fb1ab36211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.070758 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95f9a6b2f2cb41e6b74715b2618d8a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.067638 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad65565caddf4e878292d1178fbf6037" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.070648 1167 tablet_bootstrap.cc:654] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.074079 1166 log.cc:1196] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/bb1a7ae0a9b04fca9da8f441958c3280
I20260620 07:00:58.074156 1169 tablet_replica.cc:330] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:58.074358 1169 raft_consensus.cc:2229] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.074447 1166 ts_tablet_manager.cc:1939] T bb1a7ae0a9b04fca9da8f441958c3280 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.074539 1169 pending_rounds.cc:62] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:00:58.074591 1169 pending_rounds.cc:68] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821557844987904 op_type: NO_OP noop_request { }
I20260620 07:00:58.074735 1169 raft_consensus.cc:2866] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:58.074883 1169 raft_consensus.cc:2258] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.075153 876 tablet_service.cc:1467] Processing CreateTablet for tablet 076926f7dffe4a7b80c25ea3c18e9958 (DEFAULT_TABLE table=default.Table_b697ccd03f014152b6a0f571ecb24083 [id=804a023058a643b189246bf7c6a98af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.075419 731 tablet_service.cc:1467] Processing CreateTablet for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 (DEFAULT_TABLE table=default.Table_d590d1639a8b436980ba1655ca8ddbf0 [id=08b49e7b2cb8468e97d459fb1ab36211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.075520 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 076926f7dffe4a7b80c25ea3c18e9958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.075803 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95f9a6b2f2cb41e6b74715b2618d8a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.078132 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 16a7e62b5af141ca8b5054ce8f46c2b6 (table default.Table_5c7875d7e8b1438ca620be079ce992c9 [id=c6b286f7e44a496aa9f070c73a885062]) successfully deleted
W20260620 07:00:58.078362 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 21f51aeb329e42359cfaf7de2a039d13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21f51aeb329e42359cfaf7de2a039d13 already in progress: creating tablet
I20260620 07:00:58.078365 725 tablet_service.cc:1467] Processing CreateTablet for tablet f8b961698fe54e7f9c16f41b90058093 (DEFAULT_TABLE table=default.Table_1e123882f2a44ed28dbe6198a0ac7098 [id=681c188b41234255b290334fb43f58f1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:58.078553 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet e7d1e4719cd441dd8054b24861cbd8a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e7d1e4719cd441dd8054b24861cbd8a2 already in progress: creating tablet
I20260620 07:00:58.078805 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8b961698fe54e7f9c16f41b90058093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.079062 733 tablet_service.cc:1467] Processing CreateTablet for tablet 076926f7dffe4a7b80c25ea3c18e9958 (DEFAULT_TABLE table=default.Table_b697ccd03f014152b6a0f571ecb24083 [id=804a023058a643b189246bf7c6a98af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.079425 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 076926f7dffe4a7b80c25ea3c18e9958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.078737 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 97) took 1005 ms. Trace:
I20260620 07:00:58.080649 1166 rpcz_store.cc:276] 0620 07:00:57.073649 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:57.073703 (+ 54us) service_pool.cc:227] Handling call
0620 07:00:58.037737 (+964034us) ts_tablet_manager.cc:1145] Deleting tablet bb1a7ae0a9b04fca9da8f441958c3280
0620 07:00:58.037747 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:58.047588 (+ 9841us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:58.066894 (+ 19306us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:58.078678 (+ 11784us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":963797}
I20260620 07:00:58.081735 1166 tablet_replica.cc:330] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.082020 1166 raft_consensus.cc:2229] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.083089 732 tablet_service.cc:1467] Processing CreateTablet for tablet 7fc63351f767447c99b819fe7848d381 (DEFAULT_TABLE table=default.Table_c5b10800d2e343da82faaf876f4651ab [id=38f5978d6a7945c9aec7b78d789241ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.083451 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fc63351f767447c99b819fe7848d381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.083379 868 tablet_service.cc:1467] Processing CreateTablet for tablet 7fc63351f767447c99b819fe7848d381 (DEFAULT_TABLE table=default.Table_c5b10800d2e343da82faaf876f4651ab [id=38f5978d6a7945c9aec7b78d789241ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.083770 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fc63351f767447c99b819fe7848d381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.084077 1166 raft_consensus.cc:2258] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.087111 871 tablet_service.cc:1467] Processing CreateTablet for tablet ca380134173e42f6b562b56375f2ccad (DEFAULT_TABLE table=default.Table_6bd66e9c6f5d4e348b7345db1c1175d8 [id=82989da82c6244a7b6f52db6807af15f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.087477 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca380134173e42f6b562b56375f2ccad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.087512 1166 ts_tablet_manager.cc:1905] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.087690 734 tablet_service.cc:1467] Processing CreateTablet for tablet ca380134173e42f6b562b56375f2ccad (DEFAULT_TABLE table=default.Table_6bd66e9c6f5d4e348b7345db1c1175d8 [id=82989da82c6244a7b6f52db6807af15f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.087786 427 master_service.cc:946] ReplaceTablet: received request to replace tablet add9e860802d4edebcfbc9fa3c4a6b24 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.088650 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca380134173e42f6b562b56375f2ccad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.089797 727 tablet_service.cc:1467] Processing CreateTablet for tablet d066c73ae0104cb3be792790b1dfb93d (DEFAULT_TABLE table=default.Table_3dc4c1ec06e74b1ba496fb7896bea7da [id=c8fa0544c10a479ba4496d1482c535f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.090106 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d066c73ae0104cb3be792790b1dfb93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.092432 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fcb42f643c24e869fb0d7e2893ffa57 with delete_type TABLET_DATA_DELETED (replaced by tablet 83451bba9a3c4c209dddf4250fea8806) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.094903 728 tablet_service.cc:1467] Processing CreateTablet for tablet d17c49eecec741cdbd592c94b7f84c67 (DEFAULT_TABLE table=default.Table_b623e145e58e4cb9b1d75359c4d1cf8e [id=f28fed67d2244a1694c6688535cc5213]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.095033 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 (DEFAULT_TABLE table=default.Table_d590d1639a8b436980ba1655ca8ddbf0 [id=08b49e7b2cb8468e97d459fb1ab36211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.095366 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d17c49eecec741cdbd592c94b7f84c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.095413 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95f9a6b2f2cb41e6b74715b2618d8a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.095542 1167 tablet_bootstrap.cc:492] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.095676 1167 ts_tablet_manager.cc:1397] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.005s
I20260620 07:00:58.096498 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 076926f7dffe4a7b80c25ea3c18e9958 (DEFAULT_TABLE table=default.Table_b697ccd03f014152b6a0f571ecb24083 [id=804a023058a643b189246bf7c6a98af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.096896 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 076926f7dffe4a7b80c25ea3c18e9958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.099088 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 7fc63351f767447c99b819fe7848d381 (DEFAULT_TABLE table=default.Table_c5b10800d2e343da82faaf876f4651ab [id=38f5978d6a7945c9aec7b78d789241ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.099488 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fc63351f767447c99b819fe7848d381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.102944 726 tablet_service.cc:1467] Processing CreateTablet for tablet cb26f1d10f9a4978b41afbd8894f1102 (DEFAULT_TABLE table=default.Table_622b45b592db43659f3fb16e236d0fb3 [id=b1edb1d369d341b4bd7aa4a9b1fcdea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.103073 1167 raft_consensus.cc:348] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.103196 1004 tablet_service.cc:1467] Processing CreateTablet for tablet ca380134173e42f6b562b56375f2ccad (DEFAULT_TABLE table=default.Table_6bd66e9c6f5d4e348b7345db1c1175d8 [id=82989da82c6244a7b6f52db6807af15f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.103313 1167 raft_consensus.cc:374] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.103400 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb26f1d10f9a4978b41afbd8894f1102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.103406 1167 raft_consensus.cc:729] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.103670 1003 tablet_service.cc:1467] Processing CreateTablet for tablet cb26f1d10f9a4978b41afbd8894f1102 (DEFAULT_TABLE table=default.Table_622b45b592db43659f3fb16e236d0fb3 [id=b1edb1d369d341b4bd7aa4a9b1fcdea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.103744 1167 consensus_queue.cc:260] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.104074 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 1b98711dfb114a2985c5153e9b44147a (DEFAULT_TABLE table=default.Table_cd78dd998663465682443de81e772aad [id=fd979c937e3048858b59d596663abdc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.104489 1008 tablet_service.cc:1467] Processing CreateTablet for tablet d17c49eecec741cdbd592c94b7f84c67 (DEFAULT_TABLE table=default.Table_b623e145e58e4cb9b1d75359c4d1cf8e [id=f28fed67d2244a1694c6688535cc5213]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.104969 1011 tablet_service.cc:1467] Processing CreateTablet for tablet d066c73ae0104cb3be792790b1dfb93d (DEFAULT_TABLE table=default.Table_3dc4c1ec06e74b1ba496fb7896bea7da [id=c8fa0544c10a479ba4496d1482c535f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.105365 1005 tablet_service.cc:1467] Processing CreateTablet for tablet f8b961698fe54e7f9c16f41b90058093 (DEFAULT_TABLE table=default.Table_1e123882f2a44ed28dbe6198a0ac7098 [id=681c188b41234255b290334fb43f58f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.105744 1167 ts_tablet_manager.cc:1428] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
W20260620 07:00:58.105775 830 leader_election.cc:341] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.105928 830 leader_election.cc:302] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:58.106532 729 tablet_service.cc:1467] Processing CreateTablet for tablet 1b98711dfb114a2985c5153e9b44147a (DEFAULT_TABLE table=default.Table_cd78dd998663465682443de81e772aad [id=fd979c937e3048858b59d596663abdc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.106976 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b98711dfb114a2985c5153e9b44147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.108532 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet bb1a7ae0a9b04fca9da8f441958c3280 (table default.Table_61741807e243431395868ee24844d1aa [id=31b071f3fa7547fb8a222ac6b8bffd6a]) successfully deleted
I20260620 07:00:58.108610 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca380134173e42f6b562b56375f2ccad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.108738 1169 ts_tablet_manager.cc:1905] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.108908 1280 raft_consensus.cc:2726] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:58.110219 874 tablet_service.cc:1467] Processing CreateTablet for tablet cb26f1d10f9a4978b41afbd8894f1102 (DEFAULT_TABLE table=default.Table_622b45b592db43659f3fb16e236d0fb3 [id=b1edb1d369d341b4bd7aa4a9b1fcdea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.110742 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb26f1d10f9a4978b41afbd8894f1102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.112815 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_829da258d7c446d3b8e8c95466a42a88" } new_table_name: "default.Table_009386cbc364471099079c21ecb6c8e0" modify_external_catalogs: true
I20260620 07:00:58.114952 872 tablet_service.cc:1467] Processing CreateTablet for tablet 1b98711dfb114a2985c5153e9b44147a (DEFAULT_TABLE table=default.Table_cd78dd998663465682443de81e772aad [id=fd979c937e3048858b59d596663abdc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.115306 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b98711dfb114a2985c5153e9b44147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.115567 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8b961698fe54e7f9c16f41b90058093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.118726 870 tablet_service.cc:1467] Processing CreateTablet for tablet d17c49eecec741cdbd592c94b7f84c67 (DEFAULT_TABLE table=default.Table_b623e145e58e4cb9b1d75359c4d1cf8e [id=f28fed67d2244a1694c6688535cc5213]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.119024 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b98711dfb114a2985c5153e9b44147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.119170 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d17c49eecec741cdbd592c94b7f84c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.122592 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d17c49eecec741cdbd592c94b7f84c67. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:58.123003 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 076926f7dffe4a7b80c25ea3c18e9958 consensus state has no leader
I20260620 07:00:58.123967 869 tablet_service.cc:1467] Processing CreateTablet for tablet d066c73ae0104cb3be792790b1dfb93d (DEFAULT_TABLE table=default.Table_3dc4c1ec06e74b1ba496fb7896bea7da [id=c8fa0544c10a479ba4496d1482c535f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.124435 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d066c73ae0104cb3be792790b1dfb93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.125213 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_196313208d3a49659e5f18d921894e9c" } new_table_name: "default.Table_a0fe99e70d5f44b99137fcf3cd3c75de" modify_external_catalogs: true
I20260620 07:00:58.127624 1201 raft_consensus.cc:482] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.127760 1201 raft_consensus.cc:504] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.128420 1201 leader_election.cc:288] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.129205 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d066c73ae0104cb3be792790b1dfb93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.110219 867 tablet_service.cc:1467] Processing CreateTablet for tablet f8b961698fe54e7f9c16f41b90058093 (DEFAULT_TABLE table=default.Table_1e123882f2a44ed28dbe6198a0ac7098 [id=681c188b41234255b290334fb43f58f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.133402 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8b961698fe54e7f9c16f41b90058093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.134829 1170 tablet_bootstrap.cc:492] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:58.135070 1170 ts_tablet_manager.cc:1397] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.117s user 0.005s sys 0.000s
I20260620 07:00:58.135022 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289405cbf0784916b971b038279309d8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.135296 753 raft_consensus.cc:2454] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.135406 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb26f1d10f9a4978b41afbd8894f1102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.136507 1170 raft_consensus.cc:348] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.136833 1170 raft_consensus.cc:374] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.136960 1170 raft_consensus.cc:729] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.137527 1280 raft_consensus.cc:482] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.137255 1170 consensus_queue.cc:260] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.137723 1280 raft_consensus.cc:504] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.138451 1280 leader_election.cc:288] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:58.140038 1170 ts_tablet_manager.cc:1428] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:00:58.140465 1170 tablet_bootstrap.cc:492] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:58.140441 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289405cbf0784916b971b038279309d8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:58.140707 893 raft_consensus.cc:2454] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.140798 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f0a3c36ff864f0083383103effe0ee8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.141597 968 leader_election.cc:302] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
W20260620 07:00:58.142560 830 leader_election.cc:341] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: Tablet not RUNNING: STOPPED
I20260620 07:00:58.143904 1364 raft_consensus.cc:482] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.144117 1364 raft_consensus.cc:504] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.144721 1201 raft_consensus.cc:2781] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.144825 1201 raft_consensus.cc:482] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.144898 1201 raft_consensus.cc:3037] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.144996 1364 leader_election.cc:288] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:58.146075 1364 raft_consensus.cc:482] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.146234 1364 raft_consensus.cc:504] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.146981 1364 leader_election.cc:288] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:58.148725 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62ef9a12e3684d27b6696f631c68a5af" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.148939 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f763b0e91544700bd672c2ef751b4d2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.149091 1032 raft_consensus.cc:2454] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
W20260620 07:00:58.149937 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fc63351f767447c99b819fe7848d381 consensus state has no leader
I20260620 07:00:58.150054 1201 raft_consensus.cc:504] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.150803 1201 leader_election.cc:288] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.151173 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_53d54ae0843e43bbaa814c4fdd23d530" } modify_external_catalogs: true
I20260620 07:00:58.151386 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_53d54ae0843e43bbaa814c4fdd23d530" } modify_external_catalogs: true
W20260620 07:00:58.151559 830 leader_election.cc:341] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.152666 830 leader_election.cc:302] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.152721 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289405cbf0784916b971b038279309d8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:58.152897 893 raft_consensus.cc:3037] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.153009 1280 raft_consensus.cc:2781] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.153115 1280 raft_consensus.cc:482] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.153221 1280 raft_consensus.cc:3037] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.156453 893 raft_consensus.cc:2454] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.162038 1167 tablet_bootstrap.cc:492] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.162010 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d37e4e9b4260490d8205e9ce30762f3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.162654 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d37e4e9b4260490d8205e9ce30762f3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.164229 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c3a21b866a364f0e97c74a240faf1dff" } modify_external_catalogs: true
I20260620 07:00:58.164435 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c3a21b866a364f0e97c74a240faf1dff" } modify_external_catalogs: true
I20260620 07:00:58.166064 1167 tablet_bootstrap.cc:654] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.166450 1280 raft_consensus.cc:504] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.168418 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_04030fe8e5944650b8eb6f7dd65772a8" } modify_external_catalogs: true
I20260620 07:00:58.168646 1166 ts_tablet_manager.cc:1918] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.168643 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_04030fe8e5944650b8eb6f7dd65772a8" } modify_external_catalogs: true
I20260620 07:00:58.168769 1166 log.cc:1196] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/1f0a3c36ff864f0083383103effe0ee8
I20260620 07:00:58.169191 1166 ts_tablet_manager.cc:1939] T 1f0a3c36ff864f0083383103effe0ee8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.169977 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 96) took 1096 ms. Trace:
I20260620 07:00:58.170064 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ca380134173e42f6b562b56375f2ccad
I20260620 07:00:58.170650 969 leader_election.cc:302] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.170888 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_afc28b2f3ee848e9873f0f1f373eb2cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.171128 1201 raft_consensus.cc:2781] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.171259 1201 raft_consensus.cc:686] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
W20260620 07:00:58.171577 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afc28b2f3ee848e9873f0f1f373eb2cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.171504 1201 consensus_queue.cc:237] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.173375 419 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 62ef9a12e3684d27b6696f631c68a5af (table default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]). Expected version 1 got 0
I20260620 07:00:58.174582 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 203ba3933d3a4fb2a4978b29cad614e6 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.179257 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f0a3c36ff864f0083383103effe0ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:55 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.179621 1165 tablet_replica.cc:330] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:58.179656 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet ba760b5fe1204df2932edd15bdcbaadf with delete_type TABLET_DATA_DELETED (replaced by tablet 360880717af145628606b5b9fb26e350) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.179908 1165 raft_consensus.cc:2229] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.179912 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet ca380134173e42f6b562b56375f2ccad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.180147 1165 raft_consensus.cc:2258] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.180886 1165 ts_tablet_manager.cc:1905] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.183391 866 tablet_service.cc:1514] Processing DeleteTablet for tablet 2060ea1520d8404daa6b862b8945226e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.183557 865 tablet_service.cc:1514] Processing DeleteTablet for tablet ba3862ba4ebf410baebcc1246b08ddc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b0faf91f2f469f9b06e17caa4709e4) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.183740 864 tablet_service.cc:1514] Processing DeleteTablet for tablet fcc92630252b40a6a306c3a578fa3e59 with delete_type TABLET_DATA_DELETED (replaced by tablet 04d5d361a5404dcf99a89e93ac1f7dd8) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.184015 866 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e2d0beac44480daaa7c2757ac7b178 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.184027 873 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a7ae0a9b04fca9da8f441958c3280 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f763b0e91544700bd672c2ef751b4d2) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.184501 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 16a7e62b5af141ca8b5054ce8f46c2b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 978f99d2a7d6448aba8dcd2611b75af3) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.184731 866 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fcb42f643c24e869fb0d7e2893ffa57 with delete_type TABLET_DATA_DELETED (replaced by tablet 83451bba9a3c4c209dddf4250fea8806) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.184937 873 tablet_service.cc:1514] Processing DeleteTablet for tablet ca380134173e42f6b562b56375f2ccad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.187413 1166 rpcz_store.cc:276] 0620 07:00:57.073499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:57.073973 (+ 474us) service_pool.cc:227] Handling call
0620 07:00:58.081177 (+1007204us) ts_tablet_manager.cc:1145] Deleting tablet 1f0a3c36ff864f0083383103effe0ee8
0620 07:00:58.081658 (+ 481us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:58.091752 (+ 10094us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:58.168499 (+ 76747us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:58.169937 (+ 1438us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1006997}
I20260620 07:00:58.190730 1166 tablet_replica.cc:330] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.191079 1166 raft_consensus.cc:2229] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.191289 1166 raft_consensus.cc:2258] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.191757 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 1f0a3c36ff864f0083383103effe0ee8 (table default.Table_0d16742deb1e45ee86c610022bd3e4b9 [id=3da7a85c122648408588dea7ebe1fa5c]) successfully deleted
I20260620 07:00:58.192119 1166 ts_tablet_manager.cc:1905] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.198122 1166 ts_tablet_manager.cc:1918] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.198285 1166 log.cc:1196] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/9d05d17792e54877b29431754676dcad
I20260620 07:00:58.198448 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 169b93c38e59435db218152f2d25bdfa
I20260620 07:00:58.198706 1166 ts_tablet_manager.cc:1939] T 9d05d17792e54877b29431754676dcad P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.199003 422 catalog_manager.cc:6565] ReplaceTablet: tablet 169b93c38e59435db218152f2d25bdfa deleted and replaced by tablet 5a4390225af348f89c934f0f179ddab5
I20260620 07:00:58.199874 1167 tablet_bootstrap.cc:492] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.200474 1167 ts_tablet_manager.cc:1397] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.004s
I20260620 07:00:58.201437 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 169b93c38e59435db218152f2d25bdfa with delete_type TABLET_DATA_DELETED (replaced by tablet 5a4390225af348f89c934f0f179ddab5) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.201751 1167 raft_consensus.cc:348] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.202096 1167 raft_consensus.cc:374] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.202226 1167 raft_consensus.cc:729] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.202556 1167 consensus_queue.cc:260] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.206987 1167 ts_tablet_manager.cc:1428] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260620 07:00:58.209751 1201 raft_consensus.cc:482] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.209949 1201 raft_consensus.cc:504] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.211289 1201 leader_election.cc:288] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.211669 1167 tablet_bootstrap.cc:492] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.212402 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet add9e860802d4edebcfbc9fa3c4a6b24
I20260620 07:00:58.212845 427 catalog_manager.cc:6565] ReplaceTablet: tablet add9e860802d4edebcfbc9fa3c4a6b24 deleted and replaced by tablet 9a46df2909bf43f297b412c33f18a329
I20260620 07:00:58.213354 1167 tablet_bootstrap.cc:654] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.213498 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 169b93c38e59435db218152f2d25bdfa with delete_type TABLET_DATA_DELETED (replaced by tablet 5a4390225af348f89c934f0f179ddab5) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.214442 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba760b5fe1204df2932edd15bdcbaadf" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:58.214812 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet add9e860802d4edebcfbc9fa3c4a6b24 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a46df2909bf43f297b412c33f18a329) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.215245 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 9d05d17792e54877b29431754676dcad (table default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]) successfully deleted
I20260620 07:00:58.215256 893 raft_consensus.cc:2454] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.216189 969 leader_election.cc:302] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.216539 1201 raft_consensus.cc:2781] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.216643 1201 raft_consensus.cc:482] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.216754 1201 raft_consensus.cc:3037] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:00:58.216831 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 537ab1626d4e44c38d8cca8c51921424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 537ab1626d4e44c38d8cca8c51921424 already in progress: creating tablet
I20260620 07:00:58.219830 1201 raft_consensus.cc:504] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.220182 427 catalog_manager.cc:5495] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260620 07:00:58.220669 427 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 289405cbf0784916b971b038279309d8 (table default.Table_dc7b02e7defe4ddc8c4305ecb34bb7ab [id=ca68189e4cd34f43a8fbdb53a834be16]). Expected version 2 got 0
I20260620 07:00:58.220989 873 tablet_service.cc:1514] Processing DeleteTablet for tablet add9e860802d4edebcfbc9fa3c4a6b24 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a46df2909bf43f297b412c33f18a329) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.220939 1201 leader_election.cc:288] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.221436 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba760b5fe1204df2932edd15bdcbaadf" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
W20260620 07:00:58.221540 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ea6102e0da4e42cd9f1d6e294bb372b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea6102e0da4e42cd9f1d6e294bb372b2 already in progress: creating tablet
I20260620 07:00:58.221894 1166 tablet_replica.cc:330] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.221906 893 raft_consensus.cc:3037] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.222187 1166 raft_consensus.cc:2229] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.222364 1166 raft_consensus.cc:2258] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.222908 1166 ts_tablet_manager.cc:1905] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.223187 1167 tablet_bootstrap.cc:492] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.223342 1167 ts_tablet_manager.cc:1397] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260620 07:00:58.224218 1167 raft_consensus.cc:348] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.224432 1167 raft_consensus.cc:374] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.224536 1167 raft_consensus.cc:729] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.224761 1167 consensus_queue.cc:260] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.225318 1167 ts_tablet_manager.cc:1428] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:00:58.225589 1167 tablet_bootstrap.cc:492] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:00:58.226094 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ff06bc5fc684b9195c719cbf39d34a6 consensus state has no leader
I20260620 07:00:58.227275 1167 tablet_bootstrap.cc:654] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.230849 728 tablet_service.cc:1514] Processing DeleteTablet for tablet ca380134173e42f6b562b56375f2ccad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.231600 1201 raft_consensus.cc:482] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.232018 1201 raft_consensus.cc:504] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.232609 1201 leader_election.cc:288] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:00:58.235399 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5757e05e9a2403a86ca98f455e11754 has no consensus state
I20260620 07:00:58.237479 893 raft_consensus.cc:2454] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.238219 969 leader_election.cc:302] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.238523 1201 raft_consensus.cc:2781] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.238654 1201 raft_consensus.cc:686] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:58.239025 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "537ab1626d4e44c38d8cca8c51921424" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:58.238956 1201 consensus_queue.cc:237] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.239277 893 raft_consensus.cc:2454] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.239302 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0ae107b34dfc4243ac376ddf1ad50774"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.239746 969 leader_election.cc:302] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
W20260620 07:00:58.239912 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ae107b34dfc4243ac376ddf1ad50774 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.240110 1333 raft_consensus.cc:2781] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.240231 1333 raft_consensus.cc:482] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.240332 1333 raft_consensus.cc:3037] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.248903 1165 ts_tablet_manager.cc:1918] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.249089 1165 log.cc:1196] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/1f0a3c36ff864f0083383103effe0ee8
I20260620 07:00:58.249509 1165 ts_tablet_manager.cc:1939] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:58.249451 1333 raft_consensus.cc:504] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.250487 1333 leader_election.cc:288] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.251833 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet bea895c735c847f59794ab8c3282447d
I20260620 07:00:58.251835 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "537ab1626d4e44c38d8cca8c51921424" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:58.252051 893 raft_consensus.cc:3037] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.254824 873 tablet_service.cc:1514] Processing DeleteTablet for tablet bea895c735c847f59794ab8c3282447d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.255306 893 raft_consensus.cc:2454] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.255782 969 leader_election.cc:302] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.256250 1333 raft_consensus.cc:2781] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.256448 1333 raft_consensus.cc:686] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:58.257478 1333 consensus_queue.cc:237] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.258347 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9c3075f87cd749e78ca23499c09b7b87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.259029 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c3075f87cd749e78ca23499c09b7b87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:58.262036 831 leader_election.cc:341] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 1f0a3c36ff864f0083383103effe0ee8
I20260620 07:00:58.262297 831 leader_election.cc:302] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:00:58.262599 831 raft_consensus.cc:2670] T 1f0a3c36ff864f0083383103effe0ee8 P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:00:58.261116 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289405cbf0784916b971b038279309d8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:58.264750 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba760b5fe1204df2932edd15bdcbaadf" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.265008 752 raft_consensus.cc:2454] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.265401 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba760b5fe1204df2932edd15bdcbaadf" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:58.265625 751 raft_consensus.cc:3037] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.267092 724 tablet_service.cc:1514] Processing DeleteTablet for tablet bea895c735c847f59794ab8c3282447d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.267513 750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "537ab1626d4e44c38d8cca8c51921424" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.267760 750 raft_consensus.cc:2454] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.268890 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 169b93c38e59435db218152f2d25bdfa with delete_type TABLET_DATA_DELETED (replaced by tablet 5a4390225af348f89c934f0f179ddab5) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.270596 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f763b0e91544700bd672c2ef751b4d2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.271633 753 raft_consensus.cc:3037] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.272044 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dc7b02e7defe4ddc8c4305ecb34bb7ab" } modify_external_catalogs: true
I20260620 07:00:58.272241 1364 raft_consensus.cc:482] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.272337 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dc7b02e7defe4ddc8c4305ecb34bb7ab" } modify_external_catalogs: true
I20260620 07:00:58.272454 1364 raft_consensus.cc:504] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.273386 1166 ts_tablet_manager.cc:1918] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.274130 1364 leader_election.cc:288] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:58.274396 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62ef9a12e3684d27b6696f631c68a5af" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:58.274699 748 raft_consensus.cc:3037] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.270532 730 tablet_service.cc:1514] Processing DeleteTablet for tablet add9e860802d4edebcfbc9fa3c4a6b24 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a46df2909bf43f297b412c33f18a329) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.276482 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "537ab1626d4e44c38d8cca8c51921424" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:58.277143 747 raft_consensus.cc:3037] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.273911 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcc92630252b40a6a306c3a578fa3e59" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.280580 1032 raft_consensus.cc:2454] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:58.281250 830 leader_election.cc:302] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.281704 1364 raft_consensus.cc:2781] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.281875 1364 raft_consensus.cc:482] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.282032 1364 raft_consensus.cc:3037] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.285034 1364 raft_consensus.cc:504] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.286343 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcc92630252b40a6a306c3a578fa3e59" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:58.286599 1032 raft_consensus.cc:3037] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.282919 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62ef9a12e3684d27b6696f631c68a5af" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.289403 1032 raft_consensus.cc:2454] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:58.290324 830 leader_election.cc:302] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.290769 1364 leader_election.cc:288] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:58.290963 1279 raft_consensus.cc:2781] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.291052 1166 log.cc:1196] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/88635d3b7d83435f8fc8e89dc8de173b
I20260620 07:00:58.291131 1279 raft_consensus.cc:686] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:58.291457 1166 ts_tablet_manager.cc:1939] T 88635d3b7d83435f8fc8e89dc8de173b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.291445 1279 consensus_queue.cc:237] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.293187 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 88635d3b7d83435f8fc8e89dc8de173b (table default.Table_b623e145e58e4cb9b1d75359c4d1cf8e [id=f28fed67d2244a1694c6688535cc5213]) successfully deleted
I20260620 07:00:58.293272 1166 tablet_replica.cc:330] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.293416 1167 tablet_bootstrap.cc:492] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.293504 1166 raft_consensus.cc:2229] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.293573 1167 ts_tablet_manager.cc:1397] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.025s
I20260620 07:00:58.293689 1166 raft_consensus.cc:2258] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.294266 1166 ts_tablet_manager.cc:1905] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.294356 1167 raft_consensus.cc:348] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.295104 1167 raft_consensus.cc:374] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.295328 1167 raft_consensus.cc:729] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.295615 1167 consensus_queue.cc:260] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.297911 1167 ts_tablet_manager.cc:1428] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260620 07:00:58.298259 1167 tablet_bootstrap.cc:492] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.300028 1167 tablet_bootstrap.cc:654] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.302665 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_625f2cf95ae74282910b8556035bc856"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.303452 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_625f2cf95ae74282910b8556035bc856 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.308600 747 raft_consensus.cc:2454] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.309270 751 raft_consensus.cc:2454] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.309526 1166 ts_tablet_manager.cc:1918] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.310019 1166 log.cc:1196] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/1d97c42bcac24188bbc322f9d4ef2600
I20260620 07:00:58.310019 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 203ba3933d3a4fb2a4978b29cad614e6
I20260620 07:00:58.310457 1166 ts_tablet_manager.cc:1939] T 1d97c42bcac24188bbc322f9d4ef2600 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.310546 419 catalog_manager.cc:6565] ReplaceTablet: tablet 203ba3933d3a4fb2a4978b29cad614e6 deleted and replaced by tablet f690e150839a4d23860932712f61e7c8
I20260620 07:00:58.311656 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 203ba3933d3a4fb2a4978b29cad614e6 with delete_type TABLET_DATA_DELETED (replaced by tablet f690e150839a4d23860932712f61e7c8) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.312269 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 1d97c42bcac24188bbc322f9d4ef2600 (table default.Table_c564f427e36645eaa41eb09a08173e96 [id=bfd61df271fe448da18b4aae768f19e5]) successfully deleted
I20260620 07:00:58.312728 1166 tablet_replica.cc:330] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.312968 1166 raft_consensus.cc:2229] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:58.313194 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 203ba3933d3a4fb2a4978b29cad614e6 with delete_type TABLET_DATA_DELETED (replaced by tablet f690e150839a4d23860932712f61e7c8) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.313324 1166 pending_rounds.cc:62] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:00:58.313423 1166 pending_rounds.cc:68] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821562327941120 op_type: NO_OP noop_request { }
I20260620 07:00:58.313673 1166 raft_consensus.cc:2866] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:58.313865 1166 raft_consensus.cc:2258] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.314778 1166 ts_tablet_manager.cc:1905] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.315757 753 raft_consensus.cc:2454] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.316983 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1ee056973abb41d18f9fb63fff39b8b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.317631 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ee056973abb41d18f9fb63fff39b8b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.319793 1167 tablet_bootstrap.cc:492] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.319973 1167 ts_tablet_manager.cc:1397] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.003s
I20260620 07:00:58.320879 1167 raft_consensus.cc:348] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.321111 1167 raft_consensus.cc:374] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.321211 1167 raft_consensus.cc:729] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.321440 1167 consensus_queue.cc:260] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.321625 1166 ts_tablet_manager.cc:1918] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:58.322098 1167 ts_tablet_manager.cc:1428] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:00:58.322388 1167 tablet_bootstrap.cc:492] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.323843 1169 ts_tablet_manager.cc:1918] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:58.330097 1166 log.cc:1196] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/2060ea1520d8404daa6b862b8945226e
I20260620 07:00:58.330709 1166 ts_tablet_manager.cc:1939] T 2060ea1520d8404daa6b862b8945226e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.331878 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 2060ea1520d8404daa6b862b8945226e (table default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]) successfully deleted
I20260620 07:00:58.332320 1166 tablet_replica.cc:330] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.332559 1166 raft_consensus.cc:2229] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.332804 1166 raft_consensus.cc:2258] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.333436 1166 ts_tablet_manager.cc:1905] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.333954 1167 tablet_bootstrap.cc:654] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.339031 1167 tablet_bootstrap.cc:492] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.343843 1280 leader_election.cc:288] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:58.345623 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 203ba3933d3a4fb2a4978b29cad614e6 with delete_type TABLET_DATA_DELETED (replaced by tablet f690e150839a4d23860932712f61e7c8) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:58.346642 831 leader_election.cc:341] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.346904 1167 ts_tablet_manager.cc:1397] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260620 07:00:58.347185 831 leader_election.cc:302] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:58.349261 1033 raft_consensus.cc:1261] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Refusing update from remote peer 978f112862c64141b1009856bef3d624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:00:58.349905 1246 raft_consensus.cc:2726] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:58.350333 1246 consensus_queue.cc:1035] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:58.351608 1167 raft_consensus.cc:348] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.351912 1167 raft_consensus.cc:374] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.352007 1167 raft_consensus.cc:729] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.352252 1167 consensus_queue.cc:260] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.352872 1167 ts_tablet_manager.cc:1428] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260620 07:00:58.339656 748 raft_consensus.cc:2454] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:58.344105 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcc92630252b40a6a306c3a578fa3e59" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.344844 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcc92630252b40a6a306c3a578fa3e59" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:58.349570 747 raft_consensus.cc:1261] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Refusing update from remote peer 978f112862c64141b1009856bef3d624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:00:58.352012 1240 raft_consensus.cc:482] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.354825 1240 raft_consensus.cc:504] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.355453 1240 leader_election.cc:288] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:58.356182 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fcb42f643c24e869fb0d7e2893ffa57" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.356649 1167 tablet_bootstrap.cc:492] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:00:58.356786 681 leader_election.cc:341] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: Tablet not RUNNING: STOPPED
I20260620 07:00:58.356508 1169 log.cc:1196] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/d3b8e7056bd14418820032aa533be266
I20260620 07:00:58.357539 1169 ts_tablet_manager.cc:1939] T d3b8e7056bd14418820032aa533be266 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:58.360571 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet d3b8e7056bd14418820032aa533be266 (table default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]) successfully deleted
I20260620 07:00:58.361639 1167 tablet_bootstrap.cc:654] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.361847 1170 tablet_bootstrap.cc:654] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.363603 831 leader_election.cc:302] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
W20260620 07:00:58.363935 831 leader_election.cc:341] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:00:58.364260 831 leader_election.cc:341] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.365315 1364 raft_consensus.cc:2781] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.365837 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet bea895c735c847f59794ab8c3282447d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.365477 1364 raft_consensus.cc:686] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:58.368933 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 289405cbf0784916b971b038279309d8 (table default.Table_dc7b02e7defe4ddc8c4305ecb34bb7ab [id=ca68189e4cd34f43a8fbdb53a834be16]). Expected version 2 got 0
I20260620 07:00:58.370823 1376 tablet.cc:1722] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:00:58.371946 1169 tablet_replica.cc:330] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:58.372172 1169 raft_consensus.cc:2229] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.372368 1169 raft_consensus.cc:2258] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.372272 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62ef9a12e3684d27b6696f631c68a5af" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:58.372530 1032 raft_consensus.cc:3037] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.366498 1364 consensus_queue.cc:237] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.376443 1362 tablet.cc:1722] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:00:58.377070 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fcb42f643c24e869fb0d7e2893ffa57" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:58.377739 1032 raft_consensus.cc:2454] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:58.379439 1246 consensus_queue.cc:1035] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:58.382952 1167 tablet_bootstrap.cc:492] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.383111 1167 ts_tablet_manager.cc:1397] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.002s
I20260620 07:00:58.383893 1167 raft_consensus.cc:348] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.384128 1167 raft_consensus.cc:374] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.384235 1167 raft_consensus.cc:729] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.384462 1167 consensus_queue.cc:260] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.384467 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9201e532fd5c4a5da602ce54ccfd3d68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.385049 1167 ts_tablet_manager.cc:1428] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260620 07:00:58.385064 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9201e532fd5c4a5da602ce54ccfd3d68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.385339 1167 tablet_bootstrap.cc:492] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.386597 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d48c7f04b672408686515f6713e117c0" } new_table_name: "default.Table_52bddb4b77954070ad4efafc2734ea40" modify_external_catalogs: true
I20260620 07:00:58.388199 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_89b9acd5b1b34e06a9040bd30c2b7f3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.388697 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89b9acd5b1b34e06a9040bd30c2b7f3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.389942 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a6499deb17cd47d38f57370dff50f181" } new_table_name: "default.Table_b700a15c3ddb49248d638c0c8ea908bd" modify_external_catalogs: true
I20260620 07:00:58.393131 1166 ts_tablet_manager.cc:1918] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.393381 1166 log.cc:1196] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/6fcb42f643c24e869fb0d7e2893ffa57
I20260620 07:00:58.393903 1166 ts_tablet_manager.cc:1939] T 6fcb42f643c24e869fb0d7e2893ffa57 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.394991 1167 tablet_bootstrap.cc:654] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.395421 683 leader_election.cc:302] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:00:58.396135 1240 raft_consensus.cc:2726] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:58.397501 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 6fcb42f643c24e869fb0d7e2893ffa57 (table default.Table_306943077846415ea552992291e5b67f [id=04c170b69f3b43eb88b51e1654ec86df]) successfully deleted
I20260620 07:00:58.397884 1168 tablet_bootstrap.cc:492] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:58.398128 1168 ts_tablet_manager.cc:1397] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.351s user 0.005s sys 0.013s
I20260620 07:00:58.399857 1168 raft_consensus.cc:348] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.400231 1168 raft_consensus.cc:374] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.400379 1168 raft_consensus.cc:729] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.400681 1168 consensus_queue.cc:260] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.401300 1169 ts_tablet_manager.cc:1905] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.402721 1166 tablet_replica.cc:330] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.404166 1168 ts_tablet_manager.cc:1428] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260620 07:00:58.404619 1168 tablet_bootstrap.cc:492] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:00:58.401841 831 consensus_peers.cc:487] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16a7e62b5af141ca8b5054ce8f46c2b6. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:00:58.407227 1168 tablet_bootstrap.cc:654] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.403317 1167 tablet_bootstrap.cc:492] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.408558 1170 tablet_bootstrap.cc:492] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:58.408684 1167 ts_tablet_manager.cc:1397] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.002s
I20260620 07:00:58.408732 1170 ts_tablet_manager.cc:1397] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.268s user 0.002s sys 0.002s
I20260620 07:00:58.409523 1170 raft_consensus.cc:348] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.409791 1170 raft_consensus.cc:374] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.409866 1170 raft_consensus.cc:729] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.409945 1167 raft_consensus.cc:348] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.410319 1167 raft_consensus.cc:374] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.410597 1167 raft_consensus.cc:729] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.410976 1167 consensus_queue.cc:260] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.413982 1166 raft_consensus.cc:2229] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.414304 1166 raft_consensus.cc:2258] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.414961 1166 ts_tablet_manager.cc:1905] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.419186 893 raft_consensus.cc:1261] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Refusing update from remote peer 06a32ef63b2b495a9ade1de48c024ae9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:00:58.419854 1201 consensus_queue.cc:1035] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:58.421489 751 raft_consensus.cc:1261] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Refusing update from remote peer 06a32ef63b2b495a9ade1de48c024ae9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:00:58.423005 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 289405cbf0784916b971b038279309d8
I20260620 07:00:58.422899 1201 consensus_queue.cc:1035] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:58.423938 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 289405cbf0784916b971b038279309d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.423851 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a0fe99e70d5f44b99137fcf3cd3c75de" } new_table_name: "default.Table_6fc42e4c813c4e8db990bffc476328b2" modify_external_catalogs: true
I20260620 07:00:58.426523 1168 tablet_bootstrap.cc:492] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:58.426865 1168 ts_tablet_manager.cc:1397] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.002s
I20260620 07:00:58.415086 1167 ts_tablet_manager.cc:1428] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:00:58.429042 1167 tablet_bootstrap.cc:492] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.431191 1167 tablet_bootstrap.cc:654] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.431680 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f88d0de1570d449abac5073822dea297"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.431821 1168 raft_consensus.cc:348] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.432060 1168 raft_consensus.cc:374] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.432138 1168 raft_consensus.cc:729] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.432382 1168 consensus_queue.cc:260] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.432961 1168 ts_tablet_manager.cc:1428] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.000s sys 0.000s
I20260620 07:00:58.432933 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d05d17792e54877b29431754676dcad with delete_type TABLET_DATA_DELETED (replaced by tablet e14db4e3394046e49ecc69c9ca4dc840) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.433508 1168 tablet_bootstrap.cc:492] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:58.434334 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_45f4253095cd4fd8a48faf559ccb7385" } modify_external_catalogs: true
I20260620 07:00:58.434561 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_45f4253095cd4fd8a48faf559ccb7385" } modify_external_catalogs: true
I20260620 07:00:58.435292 1168 tablet_bootstrap.cc:654] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:58.435663 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 610a25c729cf41b4bd71372bc36365a8 consensus state has no leader
I20260620 07:00:58.436396 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_43fba6bd19564f6d998a9d73c9b5448a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.438272 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 581573cafab14ac79ff7ad19da0580b4 has no consensus state
W20260620 07:00:58.441166 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f88d0de1570d449abac5073822dea297 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.441535 1362 tablet.cc:1722] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260620 07:00:58.443899 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43fba6bd19564f6d998a9d73c9b5448a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.446337 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 289405cbf0784916b971b038279309d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.447721 1263 raft_consensus.cc:482] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.447767 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 1f0a3c36ff864f0083383103effe0ee8 (table default.Table_0d16742deb1e45ee86c610022bd3e4b9 [id=3da7a85c122648408588dea7ebe1fa5c]) successfully deleted
I20260620 07:00:58.447881 1263 raft_consensus.cc:504] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.448619 1263 leader_election.cc:288] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.450130 1376 tablet.cc:1722] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:00:58.451813 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe79bcf487fc4d118a91f4c62628d8a5" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:58.452622 968 leader_election.cc:341] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.456564 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe79bcf487fc4d118a91f4c62628d8a5" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:58.456611 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 289405cbf0784916b971b038279309d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.456856 893 raft_consensus.cc:2454] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.457301 969 leader_election.cc:302] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:58.457947 726 tablet_service.cc:1514] Processing DeleteTablet for tablet d3b8e7056bd14418820032aa533be266 with delete_type TABLET_DATA_DELETED (replaced by tablet d15ea9529afe40b6b4a702035479aef3) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.460716 1165 tablet_replica.cc:330] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:58.461472 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 2060ea1520d8404daa6b862b8945226e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.462060 1165 raft_consensus.cc:2229] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.462769 1263 raft_consensus.cc:2781] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.462944 1263 raft_consensus.cc:482] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.463042 1263 raft_consensus.cc:3037] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.466948 1417 tablet.cc:1722] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:00:58.475898 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 537ab1626d4e44c38d8cca8c51921424 with delete_type TABLET_DATA_DELETED (replaced by tablet add9e860802d4edebcfbc9fa3c4a6b24) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.477981 1170 consensus_queue.cc:260] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.478133 1263 raft_consensus.cc:504] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.479564 1263 leader_election.cc:288] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.483237 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe79bcf487fc4d118a91f4c62628d8a5" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:58.483484 893 raft_consensus.cc:3037] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.485991 1165 raft_consensus.cc:2258] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.486469 893 raft_consensus.cc:2454] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.489246 1168 tablet_bootstrap.cc:492] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:58.489368 969 leader_election.cc:302] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.489423 1168 ts_tablet_manager.cc:1397] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.056s user 0.029s sys 0.018s
I20260620 07:00:58.489662 1201 raft_consensus.cc:2781] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.489812 1201 raft_consensus.cc:686] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:58.490056 1201 consensus_queue.cc:237] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.490199 1168 raft_consensus.cc:348] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.490399 1168 raft_consensus.cc:374] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.490482 1168 raft_consensus.cc:729] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.490741 1168 consensus_queue.cc:260] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.491340 1168 ts_tablet_manager.cc:1428] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:00:58.492074 1168 tablet_bootstrap.cc:492] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:58.495721 1168 tablet_bootstrap.cc:654] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.499156 1165 ts_tablet_manager.cc:1905] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.502609 1167 tablet_bootstrap.cc:492] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.502763 1167 ts_tablet_manager.cc:1397] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.003s
I20260620 07:00:58.479311 726 tablet_service.cc:1514] Processing DeleteTablet for tablet ba760b5fe1204df2932edd15bdcbaadf with delete_type TABLET_DATA_DELETED (replaced by tablet 360880717af145628606b5b9fb26e350) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.481959 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe79bcf487fc4d118a91f4c62628d8a5" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
W20260620 07:00:58.504355 968 leader_election.cc:341] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.505869 1167 raft_consensus.cc:348] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.506107 1167 raft_consensus.cc:374] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.506208 1167 raft_consensus.cc:729] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.506449 1167 consensus_queue.cc:260] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.506726 1170 ts_tablet_manager.cc:1428] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.098s user 0.000s sys 0.003s
I20260620 07:00:58.507078 1170 tablet_bootstrap.cc:492] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:58.507903 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d9dd80723d604b80901a94c9e9fe0246" } new_table_name: "default.Table_ff4515912eae481fbffd1f927fa46455" modify_external_catalogs: true
W20260620 07:00:58.500272 830 consensus_peers.cc:487] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:00:58.509023 1166 ts_tablet_manager.cc:1918] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.509420 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cd78dd998663465682443de81e772aad" } new_table_name: "default.Table_2acb7e56cf474a28b1cfe9bfeedcc02d" modify_external_catalogs: true
I20260620 07:00:58.511034 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a8832b6e92294c9c9e051bc22e13b5e4" } modify_external_catalogs: true
I20260620 07:00:58.511250 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a8832b6e92294c9c9e051bc22e13b5e4" } modify_external_catalogs: true
I20260620 07:00:58.512598 1166 log.cc:1196] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/16a7e62b5af141ca8b5054ce8f46c2b6
I20260620 07:00:58.514176 1166 ts_tablet_manager.cc:1939] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.503938 1168 tablet_bootstrap.cc:492] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:58.515069 1168 ts_tablet_manager.cc:1397] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.008s
I20260620 07:00:58.512238 1167 ts_tablet_manager.cc:1428] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260620 07:00:58.515938 1168 raft_consensus.cc:348] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.516220 1168 raft_consensus.cc:374] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.516302 1168 raft_consensus.cc:729] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.516543 1168 consensus_queue.cc:260] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.516685 1167 tablet_bootstrap.cc:492] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.517234 1168 ts_tablet_manager.cc:1428] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:00:58.519311 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 16a7e62b5af141ca8b5054ce8f46c2b6 (table default.Table_5c7875d7e8b1438ca620be079ce992c9 [id=c6b286f7e44a496aa9f070c73a885062]) successfully deleted
I20260620 07:00:58.521557 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 118) took 1073 ms. Trace:
I20260620 07:00:58.522467 1166 rpcz_store.cc:276] 0620 07:00:57.447274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:57.447327 (+ 53us) service_pool.cc:227] Handling call
0620 07:00:58.520971 (+1073644us) ts_tablet_manager.cc:1145] Deleting tablet 81704d3a3cf648d987d4b40a270f7508
0620 07:00:58.520982 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:58.521086 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":942103}
W20260620 07:00:58.523398 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 81704d3a3cf648d987d4b40a270f7508 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81704d3a3cf648d987d4b40a270f7508 already in progress: creating tablet
I20260620 07:00:58.523818 1166 tablet_replica.cc:330] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.524035 1166 raft_consensus.cc:2229] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.524291 1166 raft_consensus.cc:2258] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.524557 1170 tablet_bootstrap.cc:654] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.524892 1166 ts_tablet_manager.cc:1905] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.522349 1167 tablet_bootstrap.cc:654] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.498710 1169 ts_tablet_manager.cc:1918] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:58.501017 1420 tablet.cc:1722] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:00:58.526837 1169 log.cc:1196] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/52b0ef4797324c82832c11a1c98e2b42
I20260620 07:00:58.527382 1169 ts_tablet_manager.cc:1939] T 52b0ef4797324c82832c11a1c98e2b42 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:58.528646 1169 tablet_replica.cc:330] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:58.528966 1169 raft_consensus.cc:2229] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.529167 1169 raft_consensus.cc:2258] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.529860 1169 ts_tablet_manager.cc:1905] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.534228 1240 raft_consensus.cc:482] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.534842 1240 raft_consensus.cc:504] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:58.535215 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5757e05e9a2403a86ca98f455e11754 has no consensus state
I20260620 07:00:58.535528 1240 leader_election.cc:288] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:00:58.539096 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad consensus state has no leader
I20260620 07:00:58.539391 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 076926f7dffe4a7b80c25ea3c18e9958 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.540032 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc3bc9ec1334f1bb3d9f653b2472bc7" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.540470 1167 tablet_bootstrap.cc:492] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:00:58.540750 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b98711dfb114a2985c5153e9b44147a consensus state has no leader
I20260620 07:00:58.540778 1167 ts_tablet_manager.cc:1397] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.007s
I20260620 07:00:58.540992 426 master_service.cc:946] ReplaceTablet: received request to replace tablet 360880717af145628606b5b9fb26e350 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.541496 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e5288a8179334813988c13c09263d3fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.541574 1167 raft_consensus.cc:348] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.541813 1167 raft_consensus.cc:374] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.541896 1167 raft_consensus.cc:729] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
W20260620 07:00:58.542153 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5288a8179334813988c13c09263d3fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.542127 1167 consensus_queue.cc:260] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.542856 1169 ts_tablet_manager.cc:1918] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.543084 1169 log.cc:1196] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/6fcb42f643c24e869fb0d7e2893ffa57
I20260620 07:00:58.543438 1169 ts_tablet_manager.cc:1939] T 6fcb42f643c24e869fb0d7e2893ffa57 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:58.540470 1032 raft_consensus.cc:2379] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:00:58.545513 1170 tablet_bootstrap.cc:492] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:58.545679 1170 ts_tablet_manager.cc:1397] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.003s
I20260620 07:00:58.545977 1169 tablet_replica.cc:330] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:58.546172 1169 raft_consensus.cc:2229] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.546334 1168 tablet_bootstrap.cc:492] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:58.547467 1167 ts_tablet_manager.cc:1428] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 07:00:58.547672 1169 raft_consensus.cc:2258] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.547652 1170 raft_consensus.cc:348] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.547914 1170 raft_consensus.cc:374] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.548005 1170 raft_consensus.cc:729] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.548274 425 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 62ef9a12e3684d27b6696f631c68a5af (table default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]). Expected version 1 got 0
I20260620 07:00:58.548357 1170 consensus_queue.cc:260] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.548677 1169 ts_tablet_manager.cc:1905] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.550619 1170 ts_tablet_manager.cc:1428] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260620 07:00:58.552116 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc3bc9ec1334f1bb3d9f653b2472bc7" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:58.552606 1167 tablet_bootstrap.cc:492] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.553227 1170 tablet_bootstrap.cc:492] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:58.553403 683 leader_election.cc:302] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:00:58.553769 1240 raft_consensus.cc:3037] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.554378 1167 tablet_bootstrap.cc:654] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.555011 1170 tablet_bootstrap.cc:654] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.557016 1240 raft_consensus.cc:2726] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:58.559031 869 tablet_service.cc:1467] Processing CreateTablet for tablet 82020156f3e44a1e84a9435d1f994124 (DEFAULT_TABLE table=default.Table_136e581f613845f79105f13229d93e06 [id=e3117c7c078044e9872c3c7e880aed79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.560725 1168 tablet_bootstrap.cc:654] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.563105 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82020156f3e44a1e84a9435d1f994124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.564127 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 82020156f3e44a1e84a9435d1f994124 (DEFAULT_TABLE table=default.Table_136e581f613845f79105f13229d93e06 [id=e3117c7c078044e9872c3c7e880aed79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.564653 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82020156f3e44a1e84a9435d1f994124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.564884 1005 tablet_service.cc:1467] Processing CreateTablet for tablet d15ea9529afe40b6b4a702035479aef3 (DEFAULT_TABLE table=default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.565148 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 581573cafab14ac79ff7ad19da0580b4 (DEFAULT_TABLE table=default.Table_52bddb4b77954070ad4efafc2734ea40 [id=8f88c270fabb4c93a3b154ed158ab22b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.565266 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d15ea9529afe40b6b4a702035479aef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.565526 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581573cafab14ac79ff7ad19da0580b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.568439 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 46689d13712842bf9145ad2bc3fc2acf (DEFAULT_TABLE table=default.Table_f867b8b18e344c358ef4e7924b074edd [id=00c840fc683c4a4491fe102554b4bc2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.568810 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46689d13712842bf9145ad2bc3fc2acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.571187 1008 tablet_service.cc:1467] Processing CreateTablet for tablet a5757e05e9a2403a86ca98f455e11754 (DEFAULT_TABLE table=default.Table_6fc42e4c813c4e8db990bffc476328b2 [id=7abc3167416745d0871a33a335f880c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.571556 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5757e05e9a2403a86ca98f455e11754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.574106 1201 consensus_queue.cc:1035] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:58.575206 1003 tablet_service.cc:1467] Processing CreateTablet for tablet da1e30385ed44c7f8b7db868f2e2bc29 (DEFAULT_TABLE table=default.Table_0d2790345adb48f6b1c2e10d634207e3 [id=640b0fb8da40454d94a90d23f41b06ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.564890 1013 tablet_service.cc:1467] Processing CreateTablet for tablet c5919c99f3324f7ba52c72e91b35afaf (DEFAULT_TABLE table=default.Table_c8cc4f7a40724cbdb83345a1c7df93df [id=f5b48af418374488b10044125de5d0c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.577176 874 tablet_service.cc:1467] Processing CreateTablet for tablet 46689d13712842bf9145ad2bc3fc2acf (DEFAULT_TABLE table=default.Table_f867b8b18e344c358ef4e7924b074edd [id=00c840fc683c4a4491fe102554b4bc2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.577350 875 tablet_service.cc:1467] Processing CreateTablet for tablet 581573cafab14ac79ff7ad19da0580b4 (DEFAULT_TABLE table=default.Table_52bddb4b77954070ad4efafc2734ea40 [id=8f88c270fabb4c93a3b154ed158ab22b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.577459 868 tablet_service.cc:1467] Processing CreateTablet for tablet d15ea9529afe40b6b4a702035479aef3 (DEFAULT_TABLE table=default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.577622 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46689d13712842bf9145ad2bc3fc2acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.577857 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581573cafab14ac79ff7ad19da0580b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.578047 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d15ea9529afe40b6b4a702035479aef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.578145 867 tablet_service.cc:1467] Processing CreateTablet for tablet a5757e05e9a2403a86ca98f455e11754 (DEFAULT_TABLE table=default.Table_6fc42e4c813c4e8db990bffc476328b2 [id=7abc3167416745d0871a33a335f880c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.578881 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5757e05e9a2403a86ca98f455e11754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.581367 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da1e30385ed44c7f8b7db868f2e2bc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.581622 870 tablet_service.cc:1467] Processing CreateTablet for tablet da1e30385ed44c7f8b7db868f2e2bc29 (DEFAULT_TABLE table=default.Table_0d2790345adb48f6b1c2e10d634207e3 [id=640b0fb8da40454d94a90d23f41b06ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.581848 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5919c99f3324f7ba52c72e91b35afaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.581970 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da1e30385ed44c7f8b7db868f2e2bc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.584965 1279 raft_consensus.cc:482] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.585137 1279 raft_consensus.cc:504] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.585775 1279 leader_election.cc:288] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:58.586571 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f90f1b2facc0415ab378fb81b60b0202" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:00:58.587594 831 leader_election.cc:341] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.587546 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f90f1b2facc0415ab378fb81b60b0202" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.587795 1032 raft_consensus.cc:2454] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:58.588182 830 leader_election.cc:302] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:58.588372 869 tablet_service.cc:1467] Processing CreateTablet for tablet c5919c99f3324f7ba52c72e91b35afaf (DEFAULT_TABLE table=default.Table_c8cc4f7a40724cbdb83345a1c7df93df [id=f5b48af418374488b10044125de5d0c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.588567 1279 raft_consensus.cc:2781] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.589812 1279 raft_consensus.cc:482] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.590657 1279 raft_consensus.cc:3037] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.592144 1165 ts_tablet_manager.cc:1918] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.593875 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5919c99f3324f7ba52c72e91b35afaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.612268 1170 tablet_bootstrap.cc:492] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:58.613030 1170 ts_tablet_manager.cc:1397] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.012s
I20260620 07:00:58.614621 1170 raft_consensus.cc:348] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.617197 1170 raft_consensus.cc:374] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.617487 1170 raft_consensus.cc:729] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.617893 1170 consensus_queue.cc:260] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.620539 1170 ts_tablet_manager.cc:1428] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260620 07:00:58.623093 1170 tablet_bootstrap.cc:492] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:00:58.623865 413 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.61:33455, user_credentials={real_user=slave}} blocked reactor thread for 90854.9us
I20260620 07:00:58.624051 1169 ts_tablet_manager.cc:1918] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:00:58.624177 1169 log.cc:1196] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/289405cbf0784916b971b038279309d8
I20260620 07:00:58.624176 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 52b0ef4797324c82832c11a1c98e2b42 (table default.Table_36a1a1d73652453dbde01677f41a650a [id=9fbfb3ec7f5348d3907734224702c69e]) successfully deleted
I20260620 07:00:58.624413 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 6fcb42f643c24e869fb0d7e2893ffa57 (table default.Table_306943077846415ea552992291e5b67f [id=04c170b69f3b43eb88b51e1654ec86df]) successfully deleted
I20260620 07:00:58.624634 1169 ts_tablet_manager.cc:1939] T 289405cbf0784916b971b038279309d8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:00:58.624634 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ca380134173e42f6b562b56375f2ccad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca380134173e42f6b562b56375f2ccad already in progress: creating tablet
I20260620 07:00:58.626036 1263 consensus_queue.cc:1035] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:00:58.624861 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet bea895c735c847f59794ab8c3282447d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bea895c735c847f59794ab8c3282447d already in progress: creating tablet
W20260620 07:00:58.627883 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 169b93c38e59435db218152f2d25bdfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 169b93c38e59435db218152f2d25bdfa already in progress: creating tablet
W20260620 07:00:58.628218 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet add9e860802d4edebcfbc9fa3c4a6b24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet add9e860802d4edebcfbc9fa3c4a6b24 already in progress: creating tablet
W20260620 07:00:58.628436 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 203ba3933d3a4fb2a4978b29cad614e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 203ba3933d3a4fb2a4978b29cad614e6 already in progress: creating tablet
I20260620 07:00:58.628460 1169 tablet_replica.cc:330] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:58.628662 1169 raft_consensus.cc:2229] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.628850 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 289405cbf0784916b971b038279309d8 (table default.Table_dc7b02e7defe4ddc8c4305ecb34bb7ab [id=ca68189e4cd34f43a8fbdb53a834be16]) successfully deleted
W20260620 07:00:58.629076 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d3b8e7056bd14418820032aa533be266 because the tablet was not found. No further retry: Not found: Tablet not found: d3b8e7056bd14418820032aa533be266
I20260620 07:00:58.629307 1169 raft_consensus.cc:2258] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.629910 1165 log.cc:1196] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/2060ea1520d8404daa6b862b8945226e
I20260620 07:00:58.630556 1169 ts_tablet_manager.cc:1905] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.633931 1170 tablet_bootstrap.cc:654] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.633895 1279 raft_consensus.cc:504] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.635739 726 tablet_service.cc:1467] Processing CreateTablet for tablet 82020156f3e44a1e84a9435d1f994124 (DEFAULT_TABLE table=default.Table_136e581f613845f79105f13229d93e06 [id=e3117c7c078044e9872c3c7e880aed79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.636081 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f90f1b2facc0415ab378fb81b60b0202" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:58.636354 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82020156f3e44a1e84a9435d1f994124. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:58.636680 831 leader_election.cc:341] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.636929 1279 leader_election.cc:288] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:58.639452 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f90f1b2facc0415ab378fb81b60b0202" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:58.643040 1170 tablet_bootstrap.cc:492] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:58.643782 1170 ts_tablet_manager.cc:1397] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.001s
I20260620 07:00:58.644905 1170 raft_consensus.cc:348] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.647207 1170 raft_consensus.cc:374] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.647563 1165 ts_tablet_manager.cc:1939] T 2060ea1520d8404daa6b862b8945226e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:58.647621 1170 raft_consensus.cc:729] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.649106 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 2060ea1520d8404daa6b862b8945226e (table default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]) successfully deleted
I20260620 07:00:58.649300 1170 consensus_queue.cc:260] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:58.649569 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ba3862ba4ebf410baebcc1246b08ddc9 because the tablet was not found. No further retry: Not found: Tablet not found: ba3862ba4ebf410baebcc1246b08ddc9
I20260620 07:00:58.649700 1165 tablet_replica.cc:330] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:58.650393 726 tablet_service.cc:1467] Processing CreateTablet for tablet c5919c99f3324f7ba52c72e91b35afaf (DEFAULT_TABLE table=default.Table_c8cc4f7a40724cbdb83345a1c7df93df [id=f5b48af418374488b10044125de5d0c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.649994 1165 raft_consensus.cc:2229] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:58.650961 1165 pending_rounds.cc:62] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:00:58.651122 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5919c99f3324f7ba52c72e91b35afaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.651398 1165 pending_rounds.cc:68] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821563564777472 op_type: NO_OP noop_request { }
I20260620 07:00:58.651582 1165 raft_consensus.cc:2866] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:58.651690 1165 raft_consensus.cc:2258] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.652793 1165 ts_tablet_manager.cc:1905] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.652752 1170 ts_tablet_manager.cc:1428] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260620 07:00:58.655450 729 tablet_service.cc:1467] Processing CreateTablet for tablet 581573cafab14ac79ff7ad19da0580b4 (DEFAULT_TABLE table=default.Table_52bddb4b77954070ad4efafc2734ea40 [id=8f88c270fabb4c93a3b154ed158ab22b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.655939 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581573cafab14ac79ff7ad19da0580b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.656199 1170 tablet_bootstrap.cc:492] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:58.657888 1170 tablet_bootstrap.cc:654] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.660229 1169 ts_tablet_manager.cc:1918] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.660373 1169 log.cc:1196] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/2060ea1520d8404daa6b862b8945226e
I20260620 07:00:58.660691 1169 ts_tablet_manager.cc:1939] T 2060ea1520d8404daa6b862b8945226e P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:58.661844 1169 tablet_replica.cc:330] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:58.662074 1169 raft_consensus.cc:2229] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.662276 1168 tablet_bootstrap.cc:492] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:58.662334 1169 raft_consensus.cc:2258] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.662431 1168 ts_tablet_manager.cc:1397] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.127s user 0.007s sys 0.018s
I20260620 07:00:58.663221 1168 raft_consensus.cc:348] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.663444 1168 raft_consensus.cc:374] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.663563 1168 raft_consensus.cc:729] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.663870 1168 consensus_queue.cc:260] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.664152 1169 ts_tablet_manager.cc:1905] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.665073 1168 ts_tablet_manager.cc:1428] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 07:00:58.665359 1032 raft_consensus.cc:3037] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.665445 1168 tablet_bootstrap.cc:492] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:58.667646 1168 tablet_bootstrap.cc:654] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.669298 1032 raft_consensus.cc:2454] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:58.670077 830 leader_election.cc:302] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:00:58.670703 1279 raft_consensus.cc:2781] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.671083 1279 raft_consensus.cc:686] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:58.671269 1263 raft_consensus.cc:482] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.671444 1263 raft_consensus.cc:504] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.671491 1279 consensus_queue.cc:237] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.672065 1263 leader_election.cc:288] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.677181 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f763b0e91544700bd672c2ef751b4d2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.677448 751 raft_consensus.cc:2454] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.677979 968 leader_election.cc:302] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:58.678571 1263 raft_consensus.cc:2781] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.678668 1263 raft_consensus.cc:482] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.678768 1263 raft_consensus.cc:3037] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.682180 729 tablet_service.cc:1467] Processing CreateTablet for tablet 46689d13712842bf9145ad2bc3fc2acf (DEFAULT_TABLE table=default.Table_f867b8b18e344c358ef4e7924b074edd [id=00c840fc683c4a4491fe102554b4bc2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.682636 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46689d13712842bf9145ad2bc3fc2acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.682659 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f763b0e91544700bd672c2ef751b4d2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:58.682914 895 raft_consensus.cc:2454] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.688196 726 tablet_service.cc:1467] Processing CreateTablet for tablet a5757e05e9a2403a86ca98f455e11754 (DEFAULT_TABLE table=default.Table_6fc42e4c813c4e8db990bffc476328b2 [id=7abc3167416745d0871a33a335f880c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.688776 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5757e05e9a2403a86ca98f455e11754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.694643 1168 tablet_bootstrap.cc:492] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:58.696339 1168 ts_tablet_manager.cc:1397] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260620 07:00:58.700914 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 2060ea1520d8404daa6b862b8945226e (table default.Table_45bc9d5cae2547f38e9729f15afa1677 [id=21226cda9fcd401c9739960d9154d3d1]) successfully deleted
I20260620 07:00:58.700858 1168 raft_consensus.cc:348] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.704968 1333 raft_consensus.cc:482] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.702869 1168 raft_consensus.cc:374] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.705531 1168 raft_consensus.cc:729] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.705973 1168 consensus_queue.cc:260] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.708735 1168 ts_tablet_manager.cc:1428] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260620 07:00:58.709033 1240 raft_consensus.cc:482] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.709110 1165 ts_tablet_manager.cc:1918] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:58.709209 1240 raft_consensus.cc:504] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.709405 1165 log.cc:1196] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/fcc92630252b40a6a306c3a578fa3e59
I20260620 07:00:58.709908 1240 leader_election.cc:288] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:58.709935 1165 ts_tablet_manager.cc:1939] T fcc92630252b40a6a306c3a578fa3e59 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:58.710891 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d05d17792e54877b29431754676dcad" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:58.711264 893 raft_consensus.cc:2454] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:00:58.711630 1165 tablet_replica.cc:330] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:58.711988 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet fcc92630252b40a6a306c3a578fa3e59 (table default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]) successfully deleted
W20260620 07:00:58.712378 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e5e2d0beac44480daaa7c2757ac7b178 because the tablet was not found. No further retry: Not found: Tablet not found: e5e2d0beac44480daaa7c2757ac7b178
W20260620 07:00:58.712597 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet bb1a7ae0a9b04fca9da8f441958c3280 because the tablet was not found. No further retry: Not found: Tablet not found: bb1a7ae0a9b04fca9da8f441958c3280
I20260620 07:00:58.713029 1168 tablet_bootstrap.cc:492] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:58.713896 727 tablet_service.cc:1467] Processing CreateTablet for tablet d15ea9529afe40b6b4a702035479aef3 (DEFAULT_TABLE table=default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.714347 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d15ea9529afe40b6b4a702035479aef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.714835 1168 tablet_bootstrap.cc:654] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.715080 683 leader_election.cc:302] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.715670 1240 raft_consensus.cc:2781] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.715864 725 tablet_service.cc:1467] Processing CreateTablet for tablet da1e30385ed44c7f8b7db868f2e2bc29 (DEFAULT_TABLE table=default.Table_0d2790345adb48f6b1c2e10d634207e3 [id=640b0fb8da40454d94a90d23f41b06ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.716284 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da1e30385ed44c7f8b7db868f2e2bc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.722826 1165 raft_consensus.cc:2229] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:58.723421 1165 pending_rounds.cc:62] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:00:58.723907 1165 pending_rounds.cc:68] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821560327696384 op_type: NO_OP noop_request { }
I20260620 07:00:58.724817 1167 tablet_bootstrap.cc:492] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.725026 1167 ts_tablet_manager.cc:1397] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.173s user 0.027s sys 0.059s
I20260620 07:00:58.725190 1263 raft_consensus.cc:504] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.725812 1263 leader_election.cc:288] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.726097 1167 raft_consensus.cc:348] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.726313 1167 raft_consensus.cc:374] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.726441 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f763b0e91544700bd672c2ef751b4d2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:58.726402 1167 raft_consensus.cc:729] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.726660 893 raft_consensus.cc:3037] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.726905 1165 raft_consensus.cc:2866] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:58.726846 1333 raft_consensus.cc:504] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.727154 1165 raft_consensus.cc:2258] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.727769 419 master_service.cc:946] ReplaceTablet: received request to replace tablet e275d82068074370ba1e32b7ca5fdcc3 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.729053 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 04d5d361a5404dcf99a89e93ac1f7dd8
I20260620 07:00:58.729633 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 17590c6a1a96414f84632a8b0e0a795b from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.730422 893 raft_consensus.cc:2454] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.731163 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 360880717af145628606b5b9fb26e350
I20260620 07:00:58.731391 969 leader_election.cc:302] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.731513 426 catalog_manager.cc:6565] ReplaceTablet: tablet 360880717af145628606b5b9fb26e350 deleted and replaced by tablet 2910da33bbdb4410a4a90ff9747a7de1
I20260620 07:00:58.731902 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.732467 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.732535 1333 leader_election.cc:288] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:58.732684 1333 raft_consensus.cc:2781] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.732806 1333 raft_consensus.cc:686] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:58.732812 1165 ts_tablet_manager.cc:1905] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.733011 1333 consensus_queue.cc:237] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.733667 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 076926f7dffe4a7b80c25ea3c18e9958
I20260620 07:00:58.733968 420 catalog_manager.cc:6565] ReplaceTablet: tablet 076926f7dffe4a7b80c25ea3c18e9958 deleted and replaced by tablet 9e8cd4ec5619416a8983e1bc1b6b6a09
I20260620 07:00:58.734163 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 33517843ce1d4d8786c91fd738d81ab2 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.734293 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9f7cf9e3a14e28ac20662b5e86dc41" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:58.734611 893 raft_consensus.cc:2454] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:58.734999 969 leader_election.cc:302] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.735284 1263 raft_consensus.cc:2781] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.735816 1263 raft_consensus.cc:482] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.735908 1263 raft_consensus.cc:3037] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.737236 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.737504 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 360880717af145628606b5b9fb26e350 with delete_type TABLET_DATA_DELETED (replaced by tablet 2910da33bbdb4410a4a90ff9747a7de1) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.737556 427 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
I20260620 07:00:58.737722 427 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_9fead9e2caec405da4386b1c600ea7b1 [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 1 got 0
I20260620 07:00:58.737730 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 076926f7dffe4a7b80c25ea3c18e9958 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8cd4ec5619416a8983e1bc1b6b6a09) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.737928 427 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 610a25c729cf41b4bd71372bc36365a8 (table default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3]). Expected version 2 got 0
I20260620 07:00:58.738513 1263 raft_consensus.cc:504] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.739562 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.739771 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 360880717af145628606b5b9fb26e350 with delete_type TABLET_DATA_DELETED (replaced by tablet 2910da33bbdb4410a4a90ff9747a7de1) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.739914 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 076926f7dffe4a7b80c25ea3c18e9958 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8cd4ec5619416a8983e1bc1b6b6a09) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.740123 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_9fead9e2caec405da4386b1c600ea7b1 [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 1 got 0
I20260620 07:00:58.740347 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 62ef9a12e3684d27b6696f631c68a5af (table default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]). Expected version 1 got 0
I20260620 07:00:58.740847 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8a56f30ca69e45e3a9ddd41f117f61e2
I20260620 07:00:58.741670 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ccdfbf066b8640709a0ff65043a63e9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.742233 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccdfbf066b8640709a0ff65043a63e9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.742550 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9f7cf9e3a14e28ac20662b5e86dc41" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:58.742801 893 raft_consensus.cc:3037] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.743393 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7
I20260620 07:00:58.744174 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_48a88b94cfe34d46ab9881c6bcb2cfc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.744621 1263 leader_election.cc:288] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:00:58.744827 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48a88b94cfe34d46ab9881c6bcb2cfc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.746217 425 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_c6f6140b587a47069d1123f1ff4eef8b [id=5c8493166f2448dea6f711457ba8c1bc] alter complete (version 2)
I20260620 07:00:58.746253 893 raft_consensus.cc:2454] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.746814 969 leader_election.cc:302] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.747121 1263 raft_consensus.cc:2781] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.747206 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8245acd5248f4f15891928e4d69a511d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.747692 1263 raft_consensus.cc:686] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
W20260620 07:00:58.747777 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8245acd5248f4f15891928e4d69a511d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.748039 1263 consensus_queue.cc:237] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.748996 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7d9f7cf9e3a14e28ac20662b5e86dc41
I20260620 07:00:58.726732 1167 consensus_queue.cc:260] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.749668 1167 ts_tablet_manager.cc:1428] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260620 07:00:58.749606 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5a07e98698e24414a5ac54521c1b251c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.750083 1167 tablet_bootstrap.cc:492] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:00:58.750190 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a07e98698e24414a5ac54521c1b251c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.752425 1167 tablet_bootstrap.cc:654] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.752772 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.753041 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.753276 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:58.754923 830 consensus_peers.cc:487] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fcb42f643c24e869fb0d7e2893ffa57. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:00:58.756122 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_52bddb4b77954070ad4efafc2734ea40" } modify_external_catalogs: true
I20260620 07:00:58.756313 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_52bddb4b77954070ad4efafc2734ea40" } modify_external_catalogs: true
I20260620 07:00:58.757768 1165 ts_tablet_manager.cc:1918] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:58.758139 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 537ab1626d4e44c38d8cca8c51921424 with delete_type TABLET_DATA_DELETED (replaced by tablet add9e860802d4edebcfbc9fa3c4a6b24) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.754187 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.754385 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.754451 1166 ts_tablet_manager.cc:1918] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.754571 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.761166 1166 log.cc:1196] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/e5e2d0beac44480daaa7c2757ac7b178
I20260620 07:00:58.761617 1166 ts_tablet_manager.cc:1939] T e5e2d0beac44480daaa7c2757ac7b178 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.762380 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 125) took 1057 ms. Trace:
I20260620 07:00:58.762547 1166 rpcz_store.cc:276] 0620 07:00:57.704482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:57.704558 (+ 76us) service_pool.cc:227] Handling call
0620 07:00:58.523753 (+819195us) ts_tablet_manager.cc:1145] Deleting tablet e5e2d0beac44480daaa7c2757ac7b178
0620 07:00:58.523762 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:58.679579 (+155817us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:58.754289 (+ 74710us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:58.762349 (+ 8060us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":818938}
I20260620 07:00:58.763055 1166 tablet_replica.cc:330] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.763149 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet e5e2d0beac44480daaa7c2757ac7b178 (table default.Table_90ac8c8b385b4d52a9c4a817223fd870 [id=24931029acfd4661a09a5bf4656596f3]) successfully deleted
I20260620 07:00:58.763360 1166 raft_consensus.cc:2229] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.763564 1166 raft_consensus.cc:2258] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.763903 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.764122 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d05d17792e54877b29431754676dcad with delete_type TABLET_DATA_DELETED (replaced by tablet e14db4e3394046e49ecc69c9ca4dc840) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.764261 874 tablet_service.cc:1514] Processing DeleteTablet for tablet ba760b5fe1204df2932edd15bdcbaadf with delete_type TABLET_DATA_DELETED (replaced by tablet 360880717af145628606b5b9fb26e350) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.764312 1166 ts_tablet_manager.cc:1905] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.764494 1165 log.cc:1196] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/16a7e62b5af141ca8b5054ce8f46c2b6
I20260620 07:00:58.765100 1165 ts_tablet_manager.cc:1939] T 16a7e62b5af141ca8b5054ce8f46c2b6 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:58.765143 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0ae107b34dfc4243ac376ddf1ad50774" } new_table_name: "default.Table_827793c101e141e5a8bac046d9985a22" modify_external_catalogs: true
I20260620 07:00:58.766923 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 537ab1626d4e44c38d8cca8c51921424 with delete_type TABLET_DATA_DELETED (replaced by tablet add9e860802d4edebcfbc9fa3c4a6b24) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.767207 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.767685 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet f90f1b2facc0415ab378fb81b60b0202 with delete_type TABLET_DATA_DELETED (replaced by tablet ea6102e0da4e42cd9f1d6e294bb372b2) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.774444 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 16a7e62b5af141ca8b5054ce8f46c2b6 (table default.Table_5c7875d7e8b1438ca620be079ce992c9 [id=c6b286f7e44a496aa9f070c73a885062]) successfully deleted
I20260620 07:00:58.775839 1165 tablet_replica.cc:330] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:58.776373 1165 raft_consensus.cc:2229] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:58.777007 1165 pending_rounds.cc:62] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:00:58.778168 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e275d82068074370ba1e32b7ca5fdcc3
I20260620 07:00:58.778281 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 33517843ce1d4d8786c91fd738d81ab2
I20260620 07:00:58.778584 419 catalog_manager.cc:6565] ReplaceTablet: tablet e275d82068074370ba1e32b7ca5fdcc3 deleted and replaced by tablet 89f5e2f055fb469dbbb935bba724dcb5
I20260620 07:00:58.778721 420 catalog_manager.cc:6565] ReplaceTablet: tablet 33517843ce1d4d8786c91fd738d81ab2 deleted and replaced by tablet 134f76587b6147afaf4e94fde5574efc
I20260620 07:00:58.778966 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6fc42e4c813c4e8db990bffc476328b2" } new_table_name: "default.Table_0f52b588d09748288097316c7b3de423" modify_external_catalogs: true
I20260620 07:00:58.779135 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_47155b1e4814476084ad3242145bf731"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.779347 874 tablet_service.cc:1514] Processing DeleteTablet for tablet e275d82068074370ba1e32b7ca5fdcc3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89f5e2f055fb469dbbb935bba724dcb5) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.779577 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 33517843ce1d4d8786c91fd738d81ab2 with delete_type TABLET_DATA_DELETED (replaced by tablet 134f76587b6147afaf4e94fde5574efc) from {username='slave'} at 127.0.0.1:45984
W20260620 07:00:58.779743 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47155b1e4814476084ad3242145bf731 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.778403 1165 pending_rounds.cc:68] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821561452212224 op_type: NO_OP noop_request { }
I20260620 07:00:58.779982 1165 raft_consensus.cc:2866] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:58.780102 1165 raft_consensus.cc:2258] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.780668 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d6954c46581045c4baef6b4145f331a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.781095 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6954c46581045c4baef6b4145f331a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.781565 1165 ts_tablet_manager.cc:1905] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.782115 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 17590c6a1a96414f84632a8b0e0a795b
I20260620 07:00:58.782234 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet e275d82068074370ba1e32b7ca5fdcc3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89f5e2f055fb469dbbb935bba724dcb5) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.782516 418 catalog_manager.cc:6565] ReplaceTablet: tablet 17590c6a1a96414f84632a8b0e0a795b deleted and replaced by tablet 2ee94c1a799a47f997469f96005167dc
I20260620 07:00:58.782482 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 33517843ce1d4d8786c91fd738d81ab2 with delete_type TABLET_DATA_DELETED (replaced by tablet 134f76587b6147afaf4e94fde5574efc) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.783200 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 17590c6a1a96414f84632a8b0e0a795b with delete_type TABLET_DATA_DELETED (replaced by tablet 2ee94c1a799a47f997469f96005167dc) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.784166 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 17590c6a1a96414f84632a8b0e0a795b with delete_type TABLET_DATA_DELETED (replaced by tablet 2ee94c1a799a47f997469f96005167dc) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.785288 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 63dfade71c254d7e908e00acada93638 (table default.Table_c1da229c30624077a49d8112967940c7 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 1 got 0
I20260620 07:00:58.785576 423 catalog_manager.cc:5495] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:00:58.785969 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
I20260620 07:00:58.786255 1364 raft_consensus.cc:482] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:58.786427 1364 raft_consensus.cc:504] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.787173 1364 leader_election.cc:288] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:58.788265 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8799f2a2aed4688aa4e6e590dc83a4e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:58.788537 1032 raft_consensus.cc:2454] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:58.788967 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 581573cafab14ac79ff7ad19da0580b4
I20260620 07:00:58.789006 830 leader_election.cc:302] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.789427 1364 raft_consensus.cc:2781] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:58.789563 1364 raft_consensus.cc:482] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.789671 1364 raft_consensus.cc:3037] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.789960 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 581573cafab14ac79ff7ad19da0580b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.791209 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 581573cafab14ac79ff7ad19da0580b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.793357 1364 raft_consensus.cc:504] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.794730 1364 leader_election.cc:288] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:58.794665 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8799f2a2aed4688aa4e6e590dc83a4e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:58.795135 1032 raft_consensus.cc:3037] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.798602 1032 raft_consensus.cc:2454] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:00:58.799094 830 leader_election.cc:302] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.799569 1364 raft_consensus.cc:2781] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.799787 1364 raft_consensus.cc:686] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:00:58.801081 1364 consensus_queue.cc:237] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.804667 1240 raft_consensus.cc:482] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:58.804860 1240 raft_consensus.cc:3037] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:00:58.805608 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96453f82ff3048beabeb188fb27dee42 has no consensus state
I20260620 07:00:58.808658 1240 raft_consensus.cc:504] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.809491 1240 leader_election.cc:288] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:00:58.811983 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5757e05e9a2403a86ca98f455e11754 consensus state has no leader
I20260620 07:00:58.812800 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8799f2a2aed4688aa4e6e590dc83a4e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:58.813711 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d05d17792e54877b29431754676dcad" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:58.814028 893 raft_consensus.cc:3037] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.814453 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet b8799f2a2aed4688aa4e6e590dc83a4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:58.817925 893 raft_consensus.cc:2454] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:00:58.819682 681 leader_election.cc:341] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 9d05d17792e54877b29431754676dcad
I20260620 07:00:58.821063 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9f7cf9e3a14e28ac20662b5e86dc41" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:58.822454 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f763b0e91544700bd672c2ef751b4d2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
W20260620 07:00:58.823057 968 leader_election.cc:341] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.822441 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9f7cf9e3a14e28ac20662b5e86dc41" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.822420 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:58.824133 968 leader_election.cc:341] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.824764 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.812789 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8799f2a2aed4688aa4e6e590dc83a4e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:58.827172 1166 ts_tablet_manager.cc:1918] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.827322 1166 log.cc:1196] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/21f51aeb329e42359cfaf7de2a039d13
I20260620 07:00:58.827907 1166 ts_tablet_manager.cc:1939] T 21f51aeb329e42359cfaf7de2a039d13 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.827903 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.828424 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 360880717af145628606b5b9fb26e350 with delete_type TABLET_DATA_DELETED (replaced by tablet 2910da33bbdb4410a4a90ff9747a7de1) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.828552 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.828720 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 134) took 1024 ms. Trace:
I20260620 07:00:58.828812 1166 rpcz_store.cc:276] 0620 07:00:57.804351 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:57.804418 (+ 67us) service_pool.cc:227] Handling call
0620 07:00:58.762991 (+958573us) ts_tablet_manager.cc:1145] Deleting tablet 21f51aeb329e42359cfaf7de2a039d13
0620 07:00:58.763000 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:58.801141 (+ 38141us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:58.827054 (+ 25913us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:58.828670 (+ 1616us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":958284}
I20260620 07:00:58.829159 1166 tablet_replica.cc:330] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.829290 683 leader_election.cc:302] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:58.829344 1166 raft_consensus.cc:2229] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.829507 1166 raft_consensus.cc:2258] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:58.829867 831 leader_election.cc:341] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.830014 1166 ts_tablet_manager.cc:1905] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:00:58.830211 831 leader_election.cc:341] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:58.830246 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 21f51aeb329e42359cfaf7de2a039d13 (table default.Table_066c84335e324028aaab00d42e0e5aec [id=bbf8c2959d834ddc8bb8b9790c6fcd89]) successfully deleted
I20260620 07:00:58.831727 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5c7875d7e8b1438ca620be079ce992c9" } new_table_name: "default.Table_407d8f13b4bd41fb8675708922430b28" modify_external_catalogs: true
I20260620 07:00:58.833071 751 raft_consensus.cc:3037] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:58.835635 1279 consensus_queue.cc:1035] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:58.837754 1166 ts_tablet_manager.cc:1918] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.837915 1166 log.cc:1196] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/d3b8e7056bd14418820032aa533be266
I20260620 07:00:58.838341 1166 ts_tablet_manager.cc:1939] T d3b8e7056bd14418820032aa533be266 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.839406 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet d3b8e7056bd14418820032aa533be266 (table default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]) successfully deleted
I20260620 07:00:58.839484 1166 tablet_replica.cc:330] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.839704 1166 raft_consensus.cc:2229] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 07:00:58.839748 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet e7d1e4719cd441dd8054b24861cbd8a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e7d1e4719cd441dd8054b24861cbd8a2 already in progress: creating tablet
I20260620 07:00:58.839864 1166 raft_consensus.cc:2258] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.841135 1166 ts_tablet_manager.cc:1905] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.842756 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_18beb2a49dce4703b96c71c424561ed3" } new_table_name: "default.Table_4b0078a40169404eb33b169cdb5f08df" modify_external_catalogs: true
I20260620 07:00:58.844228 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f88d0de1570d449abac5073822dea297" } new_table_name: "default.Table_55942390786a4cec9d933146948c3a48" modify_external_catalogs: true
I20260620 07:00:58.844861 1165 ts_tablet_manager.cc:1918] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:58.844990 1165 log.cc:1196] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/6fcb42f643c24e869fb0d7e2893ffa57
I20260620 07:00:58.845394 1165 ts_tablet_manager.cc:1939] T 6fcb42f643c24e869fb0d7e2893ffa57 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:58.845620 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_86b6eecd1d144fc298cf3bfc9b315ae5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.846181 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86b6eecd1d144fc298cf3bfc9b315ae5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.847437 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6bb87ba811824e86bea6f3f64db35a6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:58.848294 1166 ts_tablet_manager.cc:1918] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.848460 1166 log.cc:1196] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/fcc92630252b40a6a306c3a578fa3e59
I20260620 07:00:58.848831 1166 ts_tablet_manager.cc:1939] T fcc92630252b40a6a306c3a578fa3e59 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:00:58.849300 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bb87ba811824e86bea6f3f64db35a6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.849792 1166 tablet_replica.cc:330] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.850009 1166 raft_consensus.cc:2229] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.850239 1166 raft_consensus.cc:2258] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.850311 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 33517843ce1d4d8786c91fd738d81ab2 with delete_type TABLET_DATA_DELETED (replaced by tablet 134f76587b6147afaf4e94fde5574efc) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.850176 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 581573cafab14ac79ff7ad19da0580b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.851150 1166 ts_tablet_manager.cc:1905] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.851428 1170 tablet_bootstrap.cc:492] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:58.851717 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 289405cbf0784916b971b038279309d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:58.851953 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 81133.4us
I20260620 07:00:58.852254 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 076926f7dffe4a7b80c25ea3c18e9958 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8cd4ec5619416a8983e1bc1b6b6a09) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.853474 1170 ts_tablet_manager.cc:1397] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.195s user 0.024s sys 0.023s
I20260620 07:00:58.851866 723 tablet_service.cc:1514] Processing DeleteTablet for tablet e275d82068074370ba1e32b7ca5fdcc3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89f5e2f055fb469dbbb935bba724dcb5) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.853636 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 17590c6a1a96414f84632a8b0e0a795b with delete_type TABLET_DATA_DELETED (replaced by tablet 2ee94c1a799a47f997469f96005167dc) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:58.854257 681 leader_election.cc:341] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 9d05d17792e54877b29431754676dcad
I20260620 07:00:58.855374 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
I20260620 07:00:58.855547 1170 raft_consensus.cc:348] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.855638 418 catalog_manager.cc:5495] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:00:58.856096 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 62ef9a12e3684d27b6696f631c68a5af (table default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]). Expected version 1 got 0
I20260620 07:00:58.856240 1170 raft_consensus.cc:374] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.856312 1170 raft_consensus.cc:729] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.856489 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 610a25c729cf41b4bd71372bc36365a8 (table default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3]). Expected version 2 got 0
I20260620 07:00:58.856551 1170 consensus_queue.cc:260] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.856668 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 63dfade71c254d7e908e00acada93638 (table default.Table_c1da229c30624077a49d8112967940c7 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 1 got 0
I20260620 07:00:58.857968 1166 ts_tablet_manager.cc:1918] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:58.858165 1166 log.cc:1196] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/52b0ef4797324c82832c11a1c98e2b42
I20260620 07:00:58.858443 751 raft_consensus.cc:2454] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:58.858659 1166 ts_tablet_manager.cc:1939] T 52b0ef4797324c82832c11a1c98e2b42 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:58.858564 721 tablet_service.cc:1467] Processing CreateTablet for tablet c11f2678559c41d3bc71d4fa04efd0ac (DEFAULT_TABLE table=default.Table_89b9acd5b1b34e06a9040bd30c2b7f3c [id=9b7cbb1400d7413ca5debb997aeade9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.859596 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c11f2678559c41d3bc71d4fa04efd0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.860045 1166 tablet_replica.cc:330] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:58.860268 1166 raft_consensus.cc:2229] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:00:58.860483 1166 pending_rounds.cc:62] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:00:58.860556 1166 pending_rounds.cc:68] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821563349598208 op_type: NO_OP noop_request { }
I20260620 07:00:58.860680 1166 raft_consensus.cc:2866] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:58.860823 1166 raft_consensus.cc:2258] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:58.862702 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 978f99d2a7d6448aba8dcd2611b75af3 consensus state has no leader
I20260620 07:00:58.863950 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 52b0ef4797324c82832c11a1c98e2b42 (table default.Table_36a1a1d73652453dbde01677f41a650a [id=9fbfb3ec7f5348d3907734224702c69e]) successfully deleted
I20260620 07:00:58.866147 1167 tablet_bootstrap.cc:492] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:58.866323 1167 ts_tablet_manager.cc:1397] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.116s user 0.005s sys 0.003s
I20260620 07:00:58.867251 1240 raft_consensus.cc:2781] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:58.867213 1167 raft_consensus.cc:348] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.867468 1167 raft_consensus.cc:374] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.867558 1167 raft_consensus.cc:729] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.867715 1003 tablet_service.cc:1467] Processing CreateTablet for tablet c11f2678559c41d3bc71d4fa04efd0ac (DEFAULT_TABLE table=default.Table_89b9acd5b1b34e06a9040bd30c2b7f3c [id=9b7cbb1400d7413ca5debb997aeade9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.867813 1167 consensus_queue.cc:260] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.868196 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c11f2678559c41d3bc71d4fa04efd0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.868389 1167 ts_tablet_manager.cc:1428] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:00:58.869289 1167 tablet_bootstrap.cc:492] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:58.871125 1011 tablet_service.cc:1467] Processing CreateTablet for tablet f8ec1e179a704e5480f3deaf856156e7 (DEFAULT_TABLE table=default.Table_1ee056973abb41d18f9fb63fff39b8b8 [id=0597dd0aeaa9466b8804375281de13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.871481 1167 tablet_bootstrap.cc:654] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.871552 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8ec1e179a704e5480f3deaf856156e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.873129 1169 ts_tablet_manager.cc:1918] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:58.873373 1169 log.cc:1196] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/537ab1626d4e44c38d8cca8c51921424
I20260620 07:00:58.873872 1169 ts_tablet_manager.cc:1939] T 537ab1626d4e44c38d8cca8c51921424 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:58.877466 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 1c64df83a18a470c98a9c1fd6bb38918 (DEFAULT_TABLE table=default.Table_afc28b2f3ee848e9873f0f1f373eb2cd [id=4896f23e711941b988db4ea9f22ce625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.877812 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 9a46df2909bf43f297b412c33f18a329 (DEFAULT_TABLE table=default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.877919 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c64df83a18a470c98a9c1fd6bb38918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.878196 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 96453f82ff3048beabeb188fb27dee42 (DEFAULT_TABLE table=default.Table_827793c101e141e5a8bac046d9985a22 [id=7c6337d452d64674bd95e1738caa4345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.878513 1013 tablet_service.cc:1467] Processing CreateTablet for tablet f690e150839a4d23860932712f61e7c8 (DEFAULT_TABLE table=default.Table_7b6efec6450d4ae6a6518c7c13d94482 [id=72036a5a731244a4a1f797ec8663aef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.878685 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 261f0d97e1084e828b9562cb30ea422b (DEFAULT_TABLE table=default.Table_49629c65f95a46ff815a7d39c7143227 [id=466c737c0047420081fddb786a8093f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.879202 1002 tablet_service.cc:1467] Processing CreateTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 (DEFAULT_TABLE table=default.Table_a31b6fbb7c36401aae31f37d6bcb978e [id=f178692be04f4e4db4933fb296012ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.879791 1004 tablet_service.cc:1467] Processing CreateTablet for tablet ed69a44c466047d298cf7653b2a2bb23 (DEFAULT_TABLE table=default.Table_d37e4e9b4260490d8205e9ce30762f3b [id=e0814f1fc9264eae8150af51e6ede5f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.880360 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 168fb1666e2c41358213240d34ef9572 (DEFAULT_TABLE table=default.Table_f88d0de1570d449abac5073822dea297 [id=2920611d71ce4939bc2e2201f2e411ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.881502 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a46df2909bf43f297b412c33f18a329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.881755 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f690e150839a4d23860932712f61e7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.883412 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 261f0d97e1084e828b9562cb30ea422b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.887123 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96453f82ff3048beabeb188fb27dee42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.887753 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a292d66ee14a48959c1f6a63e0a0f492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.888595 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 168fb1666e2c41358213240d34ef9572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.889391 731 tablet_service.cc:1467] Processing CreateTablet for tablet f690e150839a4d23860932712f61e7c8 (DEFAULT_TABLE table=default.Table_7b6efec6450d4ae6a6518c7c13d94482 [id=72036a5a731244a4a1f797ec8663aef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.889935 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f690e150839a4d23860932712f61e7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.890928 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed69a44c466047d298cf7653b2a2bb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.894390 723 tablet_service.cc:1467] Processing CreateTablet for tablet 1c64df83a18a470c98a9c1fd6bb38918 (DEFAULT_TABLE table=default.Table_afc28b2f3ee848e9873f0f1f373eb2cd [id=4896f23e711941b988db4ea9f22ce625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.895215 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c64df83a18a470c98a9c1fd6bb38918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.899421 728 tablet_service.cc:1467] Processing CreateTablet for tablet 261f0d97e1084e828b9562cb30ea422b (DEFAULT_TABLE table=default.Table_49629c65f95a46ff815a7d39c7143227 [id=466c737c0047420081fddb786a8093f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.899991 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 261f0d97e1084e828b9562cb30ea422b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.901041 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 8088fadabff64c35aa96a1ede17318c3 (DEFAULT_TABLE table=default.Table_2aa5bfb35aed447f8788be438410abc7 [id=cce39caa12524890aa7c670b5d0aa8af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.901604 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8088fadabff64c35aa96a1ede17318c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.906464 725 tablet_service.cc:1467] Processing CreateTablet for tablet 168fb1666e2c41358213240d34ef9572 (DEFAULT_TABLE table=default.Table_f88d0de1570d449abac5073822dea297 [id=2920611d71ce4939bc2e2201f2e411ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.906775 729 tablet_service.cc:1467] Processing CreateTablet for tablet 96453f82ff3048beabeb188fb27dee42 (DEFAULT_TABLE table=default.Table_827793c101e141e5a8bac046d9985a22 [id=7c6337d452d64674bd95e1738caa4345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.906723 727 tablet_service.cc:1467] Processing CreateTablet for tablet f8ec1e179a704e5480f3deaf856156e7 (DEFAULT_TABLE table=default.Table_1ee056973abb41d18f9fb63fff39b8b8 [id=0597dd0aeaa9466b8804375281de13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.906960 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 168fb1666e2c41358213240d34ef9572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.907114 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96453f82ff3048beabeb188fb27dee42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.907788 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8ec1e179a704e5480f3deaf856156e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.911141 724 tablet_service.cc:1467] Processing CreateTablet for tablet b4ee5c79e2a6419ea3847cbebdeced79 (DEFAULT_TABLE table=default.Table_43fba6bd19564f6d998a9d73c9b5448a [id=5a23c89228964939bd74b5079dd25881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.911326 732 tablet_service.cc:1467] Processing CreateTablet for tablet 8088fadabff64c35aa96a1ede17318c3 (DEFAULT_TABLE table=default.Table_2aa5bfb35aed447f8788be438410abc7 [id=cce39caa12524890aa7c670b5d0aa8af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.911332 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 537ab1626d4e44c38d8cca8c51921424 (table default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]) successfully deleted
I20260620 07:00:58.912135 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4ee5c79e2a6419ea3847cbebdeced79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.912281 730 tablet_service.cc:1467] Processing CreateTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 (DEFAULT_TABLE table=default.Table_9c3075f87cd749e78ca23499c09b7b87 [id=0d5d9534e45441a290f21fca41209793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.912616 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5014cf5cc70466bafb6921c9d46ba72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.914983 726 tablet_service.cc:1467] Processing CreateTablet for tablet 9a46df2909bf43f297b412c33f18a329 (DEFAULT_TABLE table=default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.915401 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a46df2909bf43f297b412c33f18a329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.915720 722 tablet_service.cc:1467] Processing CreateTablet for tablet ed69a44c466047d298cf7653b2a2bb23 (DEFAULT_TABLE table=default.Table_d37e4e9b4260490d8205e9ce30762f3b [id=e0814f1fc9264eae8150af51e6ede5f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.916129 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed69a44c466047d298cf7653b2a2bb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.916494 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 7200877be18c4eaca57df88c25d30c01 (table default.Table_18beb2a49dce4703b96c71c424561ed3 [id=8f652552eba04d87aad349983184c524]). Expected version 1 got 0
I20260620 07:00:58.919116 733 tablet_service.cc:1467] Processing CreateTablet for tablet f4e3145a872348b6a85a19d1678636bc (DEFAULT_TABLE table=default.Table_9201e532fd5c4a5da602ce54ccfd3d68 [id=543dd082f0474b39ae0f0e66dc257ebb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.919479 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4e3145a872348b6a85a19d1678636bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.923275 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8088fadabff64c35aa96a1ede17318c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.932297 734 tablet_service.cc:1467] Processing CreateTablet for tablet cfff2a14b1184d39bd7ac1091ef749c9 (DEFAULT_TABLE table=default.Table_625f2cf95ae74282910b8556035bc856 [id=dfd2898601854be0ba91e18aca844d9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.932835 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfff2a14b1184d39bd7ac1091ef749c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.935514 728 tablet_service.cc:1467] Processing CreateTablet for tablet 5a4390225af348f89c934f0f179ddab5 (DEFAULT_TABLE table=default.Table_2a842ef988174540bb18300a4788c4cc [id=4e394c13e3214375a63a155d3a95d20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.935950 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a4390225af348f89c934f0f179ddab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.945941 999 tablet_service.cc:1467] Processing CreateTablet for tablet 5a4390225af348f89c934f0f179ddab5 (DEFAULT_TABLE table=default.Table_2a842ef988174540bb18300a4788c4cc [id=4e394c13e3214375a63a155d3a95d20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.947986 1169 tablet_replica.cc:330] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:58.948400 1169 raft_consensus.cc:2229] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:58.948732 1169 raft_consensus.cc:2258] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:58.949401 1169 ts_tablet_manager.cc:1905] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.950717 1007 tablet_service.cc:1467] Processing CreateTablet for tablet b4ee5c79e2a6419ea3847cbebdeced79 (DEFAULT_TABLE table=default.Table_43fba6bd19564f6d998a9d73c9b5448a [id=5a23c89228964939bd74b5079dd25881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.954645 721 tablet_service.cc:1467] Processing CreateTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 (DEFAULT_TABLE table=default.Table_a31b6fbb7c36401aae31f37d6bcb978e [id=f178692be04f4e4db4933fb296012ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.955202 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a292d66ee14a48959c1f6a63e0a0f492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.956475 1455 raft_consensus.cc:482] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:00:58.956854 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7200877be18c4eaca57df88c25d30c01 consensus state has no leader
I20260620 07:00:58.956709 1455 raft_consensus.cc:504] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.958031 1455 leader_election.cc:288] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:00:58.958063 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 168fb1666e2c41358213240d34ef9572 consensus state has no leader
I20260620 07:00:58.961279 1240 raft_consensus.cc:686] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:00:58.963084 1170 ts_tablet_manager.cc:1428] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.109s user 0.001s sys 0.008s
I20260620 07:00:58.962621 1240 consensus_queue.cc:237] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.966421 722 tablet_service.cc:1514] Processing DeleteTablet for tablet fcc92630252b40a6a306c3a578fa3e59 with delete_type TABLET_DATA_DELETED (replaced by tablet 04d5d361a5404dcf99a89e93ac1f7dd8) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.966717 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.967468 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d05d17792e54877b29431754676dcad with delete_type TABLET_DATA_DELETED (replaced by tablet e14db4e3394046e49ecc69c9ca4dc840) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:58.967870 1170 tablet_bootstrap.cc:492] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:58.969537 1170 tablet_bootstrap.cc:654] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:58.972599 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_26f927ce5e714da5ae118310d32e42a3" } modify_external_catalogs: true
I20260620 07:00:58.972870 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_26f927ce5e714da5ae118310d32e42a3" } modify_external_catalogs: true
I20260620 07:00:58.973439 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_136e581f613845f79105f13229d93e06" } modify_external_catalogs: true
I20260620 07:00:58.973606 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_136e581f613845f79105f13229d93e06" } modify_external_catalogs: true
I20260620 07:00:58.974138 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_222fe401283741dfbd8316b30e97e70d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.974814 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_222fe401283741dfbd8316b30e97e70d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.976173 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a31b6fbb7c36401aae31f37d6bcb978e" } modify_external_catalogs: true
I20260620 07:00:58.976353 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a31b6fbb7c36401aae31f37d6bcb978e" } modify_external_catalogs: true
I20260620 07:00:58.977618 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6" } modify_external_catalogs: true
I20260620 07:00:58.977805 1166 ts_tablet_manager.cc:1905] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:58.977831 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6" } modify_external_catalogs: true
W20260620 07:00:58.984495 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7200877be18c4eaca57df88c25d30c01 (table default.Table_4b0078a40169404eb33b169cdb5f08df [id=8f652552eba04d87aad349983184c524], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7200877be18c4eaca57df88c25d30c01 consensus state has no leader
I20260620 07:00:58.986733 1170 tablet_bootstrap.cc:492] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:58.987004 1170 ts_tablet_manager.cc:1397] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.001s
I20260620 07:00:58.988090 1170 raft_consensus.cc:348] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.988371 1170 raft_consensus.cc:374] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:58.988502 1170 raft_consensus.cc:729] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:58.989354 1170 consensus_queue.cc:260] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:58.989302 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_659d4f17a45b47f5a065e40e30ab00b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.990552 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_659d4f17a45b47f5a065e40e30ab00b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.990455 1170 ts_tablet_manager.cc:1428] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:00:58.991847 1170 tablet_bootstrap.cc:492] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:58.991937 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_21e2f7c931b949399e8536e32bf83d59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.992493 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21e2f7c931b949399e8536e32bf83d59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.994264 420 master_service.cc:946] ReplaceTablet: received request to replace tablet b6e36ffd69974ef897390a257f63a509 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.995620 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8f58e36dcf944fb2906f6ded391b7ce7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.996193 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f58e36dcf944fb2906f6ded391b7ce7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:58.996229 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3dc4c1ec06e74b1ba496fb7896bea7da" } modify_external_catalogs: true
I20260620 07:00:58.996454 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3dc4c1ec06e74b1ba496fb7896bea7da" } modify_external_catalogs: true
I20260620 07:00:58.997467 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:58.997982 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.001318 1170 tablet_bootstrap.cc:654] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:59.008351 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8e6e4c363d6f44828436c4fca5227174"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.009011 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e6e4c363d6f44828436c4fca5227174 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.012132 426 master_service.cc:946] ReplaceTablet: received request to replace tablet a5757e05e9a2403a86ca98f455e11754 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:59.012065 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_07215f09fe3e4b7d9c1b0786ef82d218" } new_table_name: "default.Table_06b2bcb778eb4444828c3050a4ed47ec" modify_external_catalogs: true
I20260620 07:00:59.013792 998 tablet_service.cc:1467] Processing CreateTablet for tablet cfff2a14b1184d39bd7ac1091ef749c9 (DEFAULT_TABLE table=default.Table_625f2cf95ae74282910b8556035bc856 [id=dfd2898601854be0ba91e18aca844d9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.014560 1000 tablet_service.cc:1467] Processing CreateTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 (DEFAULT_TABLE table=default.Table_9c3075f87cd749e78ca23499c09b7b87 [id=0d5d9534e45441a290f21fca41209793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.019301 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4ee5c79e2a6419ea3847cbebdeced79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.977846 1001 tablet_service.cc:1467] Processing CreateTablet for tablet f4e3145a872348b6a85a19d1678636bc (DEFAULT_TABLE table=default.Table_9201e532fd5c4a5da602ce54ccfd3d68 [id=543dd082f0474b39ae0f0e66dc257ebb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.020673 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9f7cf9e3a14e28ac20662b5e86dc41" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:59.027297 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f867b8b18e344c358ef4e7924b074edd" } new_table_name: "default.Table_eedf4e35718843d2bb59ddbb3c085feb" modify_external_catalogs: true
I20260620 07:00:59.029356 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_14c9ff1d977443ba914900cfb627c5e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.029904 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14c9ff1d977443ba914900cfb627c5e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.030157 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a4390225af348f89c934f0f179ddab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.032541 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d9a5c76430d34f31a928af10dfa284c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.033174 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9a5c76430d34f31a928af10dfa284c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.035969 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5014cf5cc70466bafb6921c9d46ba72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.036841 1167 tablet_bootstrap.cc:492] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:00:59.037041 1167 ts_tablet_manager.cc:1397] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.168s user 0.032s sys 0.037s
I20260620 07:00:59.038116 1167 raft_consensus.cc:348] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.038461 1167 raft_consensus.cc:374] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.038582 1167 raft_consensus.cc:729] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
W20260620 07:00:59.041141 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46689d13712842bf9145ad2bc3fc2acf consensus state has no leader
I20260620 07:00:59.041467 421 master_service.cc:946] ReplaceTablet: received request to replace tablet f9df1d52393e47ce991b5295d03624e8 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:59.044320 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfff2a14b1184d39bd7ac1091ef749c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.847220 1168 tablet_bootstrap.cc:492] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:59.046655 1168 ts_tablet_manager.cc:1397] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.334s user 0.012s sys 0.004s
I20260620 07:00:59.047525 1168 raft_consensus.cc:348] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.047775 1168 raft_consensus.cc:374] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.047866 1168 raft_consensus.cc:729] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:00:59.048002 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 6fcb42f643c24e869fb0d7e2893ffa57 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:59.048126 1168 consensus_queue.cc:260] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:58.865106 868 tablet_service.cc:1467] Processing CreateTablet for tablet c11f2678559c41d3bc71d4fa04efd0ac (DEFAULT_TABLE table=default.Table_89b9acd5b1b34e06a9040bd30c2b7f3c [id=9b7cbb1400d7413ca5debb997aeade9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.048820 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c11f2678559c41d3bc71d4fa04efd0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.048672 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 6fcb42f643c24e869fb0d7e2893ffa57 (table default.Table_306943077846415ea552992291e5b67f [id=04c170b69f3b43eb88b51e1654ec86df]) successfully deleted
I20260620 07:00:59.048548 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 04d5d361a5404dcf99a89e93ac1f7dd8 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:58.866149 874 tablet_service.cc:1467] Processing CreateTablet for tablet f8ec1e179a704e5480f3deaf856156e7 (DEFAULT_TABLE table=default.Table_1ee056973abb41d18f9fb63fff39b8b8 [id=0597dd0aeaa9466b8804375281de13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.051182 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8ec1e179a704e5480f3deaf856156e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:59.054416 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ca380134173e42f6b562b56375f2ccad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca380134173e42f6b562b56375f2ccad already in progress: creating tablet
I20260620 07:00:59.054464 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4e3145a872348b6a85a19d1678636bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.875252 869 tablet_service.cc:1467] Processing CreateTablet for tablet 96453f82ff3048beabeb188fb27dee42 (DEFAULT_TABLE table=default.Table_827793c101e141e5a8bac046d9985a22 [id=7c6337d452d64674bd95e1738caa4345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.875679 867 tablet_service.cc:1467] Processing CreateTablet for tablet 1c64df83a18a470c98a9c1fd6bb38918 (DEFAULT_TABLE table=default.Table_afc28b2f3ee848e9873f0f1f373eb2cd [id=4896f23e711941b988db4ea9f22ce625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.876056 870 tablet_service.cc:1467] Processing CreateTablet for tablet f690e150839a4d23860932712f61e7c8 (DEFAULT_TABLE table=default.Table_7b6efec6450d4ae6a6518c7c13d94482 [id=72036a5a731244a4a1f797ec8663aef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.878382 876 tablet_service.cc:1467] Processing CreateTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 (DEFAULT_TABLE table=default.Table_a31b6fbb7c36401aae31f37d6bcb978e [id=f178692be04f4e4db4933fb296012ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.879258 875 tablet_service.cc:1467] Processing CreateTablet for tablet 261f0d97e1084e828b9562cb30ea422b (DEFAULT_TABLE table=default.Table_49629c65f95a46ff815a7d39c7143227 [id=466c737c0047420081fddb786a8093f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.879675 871 tablet_service.cc:1467] Processing CreateTablet for tablet 9a46df2909bf43f297b412c33f18a329 (DEFAULT_TABLE table=default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.880060 872 tablet_service.cc:1467] Processing CreateTablet for tablet ed69a44c466047d298cf7653b2a2bb23 (DEFAULT_TABLE table=default.Table_d37e4e9b4260490d8205e9ce30762f3b [id=e0814f1fc9264eae8150af51e6ede5f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.880409 873 tablet_service.cc:1467] Processing CreateTablet for tablet 168fb1666e2c41358213240d34ef9572 (DEFAULT_TABLE table=default.Table_f88d0de1570d449abac5073822dea297 [id=2920611d71ce4939bc2e2201f2e411ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.881682 866 tablet_service.cc:1467] Processing CreateTablet for tablet b4ee5c79e2a6419ea3847cbebdeced79 (DEFAULT_TABLE table=default.Table_43fba6bd19564f6d998a9d73c9b5448a [id=5a23c89228964939bd74b5079dd25881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.884399 864 tablet_service.cc:1467] Processing CreateTablet for tablet 8088fadabff64c35aa96a1ede17318c3 (DEFAULT_TABLE table=default.Table_2aa5bfb35aed447f8788be438410abc7 [id=cce39caa12524890aa7c670b5d0aa8af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.055477 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96453f82ff3048beabeb188fb27dee42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.051374 1167 consensus_queue.cc:260] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.056353 1169 ts_tablet_manager.cc:1918] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:59.056517 1169 log.cc:1196] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ba760b5fe1204df2932edd15bdcbaadf
I20260620 07:00:58.887128 865 tablet_service.cc:1467] Processing CreateTablet for tablet f4e3145a872348b6a85a19d1678636bc (DEFAULT_TABLE table=default.Table_9201e532fd5c4a5da602ce54ccfd3d68 [id=543dd082f0474b39ae0f0e66dc257ebb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.887643 863 tablet_service.cc:1467] Processing CreateTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 (DEFAULT_TABLE table=default.Table_9c3075f87cd749e78ca23499c09b7b87 [id=0d5d9534e45441a290f21fca41209793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.887676 862 tablet_service.cc:1467] Processing CreateTablet for tablet 5a4390225af348f89c934f0f179ddab5 (DEFAULT_TABLE table=default.Table_2a842ef988174540bb18300a4788c4cc [id=4e394c13e3214375a63a155d3a95d20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.889402 861 tablet_service.cc:1467] Processing CreateTablet for tablet cfff2a14b1184d39bd7ac1091ef749c9 (DEFAULT_TABLE table=default.Table_625f2cf95ae74282910b8556035bc856 [id=dfd2898601854be0ba91e18aca844d9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:58.958815 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9f7cf9e3a14e28ac20662b5e86dc41" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:59.059062 893 raft_consensus.cc:2379] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 06a32ef63b2b495a9ade1de48c024ae9 in this term.
I20260620 07:00:59.059031 425 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_9fead9e2caec405da4386b1c600ea7b1 [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 1 got 0
I20260620 07:00:59.059584 683 leader_election.cc:302] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:00:59.060047 1240 raft_consensus.cc:3037] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.063140 1169 ts_tablet_manager.cc:1939] T ba760b5fe1204df2932edd15bdcbaadf P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:59.065573 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 168fb1666e2c41358213240d34ef9572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:58.966325 859 tablet_service.cc:1514] Processing DeleteTablet for tablet f90f1b2facc0415ab378fb81b60b0202 with delete_type TABLET_DATA_DELETED (replaced by tablet ea6102e0da4e42cd9f1d6e294bb372b2) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:58.971787 860 tablet_service.cc:1514] Processing DeleteTablet for tablet b8799f2a2aed4688aa4e6e590dc83a4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:59.029450 1279 consensus_queue.cc:1035] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:00:59.071089 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a292d66ee14a48959c1f6a63e0a0f492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.072203 1240 raft_consensus.cc:2726] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:00:59.075039 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4ee5c79e2a6419ea3847cbebdeced79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.079088 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8088fadabff64c35aa96a1ede17318c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.083768 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c64df83a18a470c98a9c1fd6bb38918. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:59.085103 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 169b93c38e59435db218152f2d25bdfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 169b93c38e59435db218152f2d25bdfa already in progress: creating tablet
W20260620 07:00:59.085417 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet add9e860802d4edebcfbc9fa3c4a6b24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet add9e860802d4edebcfbc9fa3c4a6b24 already in progress: creating tablet
W20260620 07:00:59.085649 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet bea895c735c847f59794ab8c3282447d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bea895c735c847f59794ab8c3282447d already in progress: creating tablet
W20260620 07:00:59.085840 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 203ba3933d3a4fb2a4978b29cad614e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 203ba3933d3a4fb2a4978b29cad614e6 already in progress: creating tablet
I20260620 07:00:59.086297 1165 tablet_replica.cc:330] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:00:59.086586 1165 raft_consensus.cc:2229] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:59.089144 1165 raft_consensus.cc:2258] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:59.091763 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f690e150839a4d23860932712f61e7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.092245 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2acb7e56cf474a28b1cfe9bfeedcc02d" } new_table_name: "default.Table_97d5316440584dd08daee78c90a8eb10" modify_external_catalogs: true
I20260620 07:00:59.098032 1167 ts_tablet_manager.cc:1428] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260620 07:00:59.100760 1263 raft_consensus.cc:482] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.102545 721 tablet_service.cc:1467] Processing CreateTablet for tablet a9d4ef3ba51e432f889fb927a6af8b49 (DEFAULT_TABLE table=default.Table_d6954c46581045c4baef6b4145f331a3 [id=705e29f50b13486ea45548ea2cccb107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.103027 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9d4ef3ba51e432f889fb927a6af8b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.104799 1167 tablet_bootstrap.cc:492] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:59.107283 728 tablet_service.cc:1467] Processing CreateTablet for tablet 34dc2af503684aaba8388a4611fab48e (DEFAULT_TABLE table=default.Table_8245acd5248f4f15891928e4d69a511d [id=10e4dd185dca4e42ad74dfc50e7db3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.107695 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34dc2af503684aaba8388a4611fab48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.108930 1165 ts_tablet_manager.cc:1905] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:59.110890 1263 raft_consensus.cc:504] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.113868 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a4390225af348f89c934f0f179ddab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.114326 1012 tablet_service.cc:1467] Processing CreateTablet for tablet a9d4ef3ba51e432f889fb927a6af8b49 (DEFAULT_TABLE table=default.Table_d6954c46581045c4baef6b4145f331a3 [id=705e29f50b13486ea45548ea2cccb107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.115326 1263 leader_election.cc:288] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.117846 726 tablet_service.cc:1467] Processing CreateTablet for tablet b5e08a38c42d4e3da20292343bf085b9 (DEFAULT_TABLE table=default.Table_ccdfbf066b8640709a0ff65043a63e9a [id=7ce4d1b95a984ccabd629f933ccaff8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.118498 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e08a38c42d4e3da20292343bf085b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.118693 1169 tablet_replica.cc:330] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:59.119081 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet eea1525b54cc42b78180ba6867957f76
I20260620 07:00:59.119856 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad65565caddf4e878292d1178fbf6037" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:59.120107 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a5757e05e9a2403a86ca98f455e11754
I20260620 07:00:59.120102 747 raft_consensus.cc:2454] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:59.120545 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8b8d90f8d63e45ce990aead6166bcfb6
I20260620 07:00:59.121243 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a292d66ee14a48959c1f6a63e0a0f492
I20260620 07:00:59.121945 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d066c73ae0104cb3be792790b1dfb93d
I20260620 07:00:59.123389 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 82020156f3e44a1e84a9435d1f994124
I20260620 07:00:59.120546 426 catalog_manager.cc:6565] ReplaceTablet: tablet a5757e05e9a2403a86ca98f455e11754 deleted and replaced by tablet a2d6f7f2b5b3473aa010b8982a03aa5e
I20260620 07:00:59.127592 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f9df1d52393e47ce991b5295d03624e8
I20260620 07:00:59.128002 421 catalog_manager.cc:6565] ReplaceTablet: tablet f9df1d52393e47ce991b5295d03624e8 deleted and replaced by tablet b39e682e71ed4776a786f7d30158e7e0
I20260620 07:00:59.119451 1169 raft_consensus.cc:2229] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:59.129082 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b6e36ffd69974ef897390a257f63a509
I20260620 07:00:59.129436 420 catalog_manager.cc:6565] ReplaceTablet: tablet b6e36ffd69974ef897390a257f63a509 deleted and replaced by tablet 54bb495eea4c49b7ad7bf2300ad0e60a
I20260620 07:00:59.129619 1169 raft_consensus.cc:2258] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:00:59.132016 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b98711dfb114a2985c5153e9b44147a consensus state has no leader
I20260620 07:00:59.136652 968 leader_election.cc:302] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:59.136853 1263 raft_consensus.cc:482] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.137382 721 tablet_service.cc:1514] Processing DeleteTablet for tablet eea1525b54cc42b78180ba6867957f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.138234 721 tablet_service.cc:1514] Processing DeleteTablet for tablet a5757e05e9a2403a86ca98f455e11754 with delete_type TABLET_DATA_DELETED (replaced by tablet a2d6f7f2b5b3473aa010b8982a03aa5e) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.137140 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 34dc2af503684aaba8388a4611fab48e (DEFAULT_TABLE table=default.Table_8245acd5248f4f15891928e4d69a511d [id=10e4dd185dca4e42ad74dfc50e7db3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.139272 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8d90f8d63e45ce990aead6166bcfb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.139644 1263 raft_consensus.cc:504] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.140960 726 tablet_service.cc:1514] Processing DeleteTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.141125 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7200877be18c4eaca57df88c25d30c01" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:59.142760 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9d4ef3ba51e432f889fb927a6af8b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.142755 726 tablet_service.cc:1514] Processing DeleteTablet for tablet d066c73ae0104cb3be792790b1dfb93d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.143406 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed69a44c466047d298cf7653b2a2bb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.146768 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfff2a14b1184d39bd7ac1091ef749c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.148515 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4e3145a872348b6a85a19d1678636bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.148753 859 tablet_service.cc:1514] Processing DeleteTablet for tablet a5757e05e9a2403a86ca98f455e11754 with delete_type TABLET_DATA_DELETED (replaced by tablet a2d6f7f2b5b3473aa010b8982a03aa5e) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:59.145728 860 tablet_service.cc:1467] Processing CreateTablet for tablet a9d4ef3ba51e432f889fb927a6af8b49 (DEFAULT_TABLE table=default.Table_d6954c46581045c4baef6b4145f331a3 [id=705e29f50b13486ea45548ea2cccb107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.150074 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet eea1525b54cc42b78180ba6867957f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.151597 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 82020156f3e44a1e84a9435d1f994124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.154852 869 tablet_service.cc:1514] Processing DeleteTablet for tablet d066c73ae0104cb3be792790b1dfb93d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:59.158004 721 tablet_service.cc:1514] Processing DeleteTablet for tablet b6e36ffd69974ef897390a257f63a509 with delete_type TABLET_DATA_DELETED (replaced by tablet 54bb495eea4c49b7ad7bf2300ad0e60a) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.153389 1169 ts_tablet_manager.cc:1905] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:59.156225 726 tablet_service.cc:1514] Processing DeleteTablet for tablet f9df1d52393e47ce991b5295d03624e8 with delete_type TABLET_DATA_DELETED (replaced by tablet b39e682e71ed4776a786f7d30158e7e0) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.161206 726 tablet_service.cc:1467] Processing CreateTablet for tablet 5208f3136bcd45579de49b8b10745122 (DEFAULT_TABLE table=default.Table_48a88b94cfe34d46ab9881c6bcb2cfc3 [id=47d63992f58d45c3aef24a7a606ce4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.162086 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5208f3136bcd45579de49b8b10745122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.157289 1008 tablet_service.cc:1467] Processing CreateTablet for tablet b5e08a38c42d4e3da20292343bf085b9 (DEFAULT_TABLE table=default.Table_ccdfbf066b8640709a0ff65043a63e9a [id=7ce4d1b95a984ccabd629f933ccaff8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.157303 1333 raft_consensus.cc:2781] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:59.159116 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8d90f8d63e45ce990aead6166bcfb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.165881 1333 raft_consensus.cc:482] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:59.166215 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ba760b5fe1204df2932edd15bdcbaadf (table default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]) successfully deleted
W20260620 07:00:59.162185 968 leader_election.cc:341] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:59.162199 997 tablet_service.cc:1514] Processing DeleteTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.167728 1170 tablet_bootstrap.cc:492] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:00:59.167886 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04d5d361a5404dcf99a89e93ac1f7dd8 already in progress: creating tablet
I20260620 07:00:59.167340 997 tablet_service.cc:1467] Processing CreateTablet for tablet eea1525b54cc42b78180ba6867957f76 (DEFAULT_TABLE table=default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6 [id=9ccc7eaea2334670b3c18570de5dcb3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.171788 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 5208f3136bcd45579de49b8b10745122 (DEFAULT_TABLE table=default.Table_48a88b94cfe34d46ab9881c6bcb2cfc3 [id=47d63992f58d45c3aef24a7a606ce4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.172317 1263 leader_election.cc:288] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.172158 1170 ts_tablet_manager.cc:1397] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.178s user 0.011s sys 0.009s
I20260620 07:00:59.173224 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34dc2af503684aaba8388a4611fab48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.175024 721 tablet_service.cc:1467] Processing CreateTablet for tablet eea1525b54cc42b78180ba6867957f76 (DEFAULT_TABLE table=default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6 [id=9ccc7eaea2334670b3c18570de5dcb3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.175540 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eea1525b54cc42b78180ba6867957f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.179627 1170 raft_consensus.cc:348] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.179894 1170 raft_consensus.cc:374] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.179984 1170 raft_consensus.cc:729] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:59.180253 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e08a38c42d4e3da20292343bf085b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.180295 1170 consensus_queue.cc:260] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.183203 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 82020156f3e44a1e84a9435d1f994124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.184043 994 tablet_service.cc:1514] Processing DeleteTablet for tablet f9df1d52393e47ce991b5295d03624e8 with delete_type TABLET_DATA_DELETED (replaced by tablet b39e682e71ed4776a786f7d30158e7e0) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.184695 996 tablet_service.cc:1514] Processing DeleteTablet for tablet d066c73ae0104cb3be792790b1dfb93d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.184903 729 tablet_service.cc:1467] Processing CreateTablet for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 (DEFAULT_TABLE table=default.Table_2411c7dd68274c07a75cd0b3ae3e2d32 [id=804a023058a643b189246bf7c6a98af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.185132 725 tablet_service.cc:1467] Processing CreateTablet for tablet 2e0891d6911d4bf8887f7e88a605aed5 (DEFAULT_TABLE table=default.Table_47155b1e4814476084ad3242145bf731 [id=e8f54af0bb3645dfbf1f7032451ec119]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.185386 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.185392 1333 raft_consensus.cc:3037] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.185698 722 tablet_service.cc:1467] Processing CreateTablet for tablet 134f76587b6147afaf4e94fde5574efc (DEFAULT_TABLE table=default.Table_c6f6140b587a47069d1123f1ff4eef8b [id=5c8493166f2448dea6f711457ba8c1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.186062 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 134f76587b6147afaf4e94fde5574efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.187070 727 tablet_service.cc:1467] Processing CreateTablet for tablet 2910da33bbdb4410a4a90ff9747a7de1 (DEFAULT_TABLE table=default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.187386 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2910da33bbdb4410a4a90ff9747a7de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.188308 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e0891d6911d4bf8887f7e88a605aed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.188262 728 tablet_service.cc:1467] Processing CreateTablet for tablet 8cca283f4d2645c0b59f750949b7e263 (DEFAULT_TABLE table=default.Table_e5288a8179334813988c13c09263d3fb [id=c1fc89d0749e49239f909c0b75349ec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.188616 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cca283f4d2645c0b59f750949b7e263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.190583 1170 ts_tablet_manager.cc:1428] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260620 07:00:59.192870 1170 tablet_bootstrap.cc:492] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:59.154485 1166 ts_tablet_manager.cc:1918] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:59.195783 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet a5757e05e9a2403a86ca98f455e11754 with delete_type TABLET_DATA_DELETED (replaced by tablet a2d6f7f2b5b3473aa010b8982a03aa5e) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.196321 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet b6e36ffd69974ef897390a257f63a509 with delete_type TABLET_DATA_DELETED (replaced by tablet 54bb495eea4c49b7ad7bf2300ad0e60a) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.184501 994 tablet_service.cc:1467] Processing CreateTablet for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 (DEFAULT_TABLE table=default.Table_2411c7dd68274c07a75cd0b3ae3e2d32 [id=804a023058a643b189246bf7c6a98af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.185086 996 tablet_service.cc:1467] Processing CreateTablet for tablet 134f76587b6147afaf4e94fde5574efc (DEFAULT_TABLE table=default.Table_c6f6140b587a47069d1123f1ff4eef8b [id=5c8493166f2448dea6f711457ba8c1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.183864 995 tablet_service.cc:1467] Processing CreateTablet for tablet 2e0891d6911d4bf8887f7e88a605aed5 (DEFAULT_TABLE table=default.Table_47155b1e4814476084ad3242145bf731 [id=e8f54af0bb3645dfbf1f7032451ec119]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.203821 1166 log.cc:1196] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ba760b5fe1204df2932edd15bdcbaadf
I20260620 07:00:59.205719 1013 tablet_service.cc:1467] Processing CreateTablet for tablet c38c628514c44c6fa5aff64928e515d9 (DEFAULT_TABLE table=default.Table_5a07e98698e24414a5ac54521c1b251c [id=a6be77da33394794ac37a31806294616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.211650 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d590d1639a8b436980ba1655ca8ddbf0" } new_table_name: "default.Table_6641e445a3014a60a287541bee6f57e2" modify_external_catalogs: true
I20260620 07:00:59.214962 722 tablet_service.cc:1467] Processing CreateTablet for tablet c38c628514c44c6fa5aff64928e515d9 (DEFAULT_TABLE table=default.Table_5a07e98698e24414a5ac54521c1b251c [id=a6be77da33394794ac37a31806294616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.215402 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c38c628514c44c6fa5aff64928e515d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.215337 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 89f5e2f055fb469dbbb935bba724dcb5 (DEFAULT_TABLE table=default.Table_89bf00306e9c44a0a0de2e0a7235f436 [id=24b0b6eb9f944dbb971530ee8f603c0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.215621 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_306943077846415ea552992291e5b67f" } new_table_name: "default.Table_82f52a84b6a04edea83f64b1e1ac450f" modify_external_catalogs: true
I20260620 07:00:59.215817 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 2910da33bbdb4410a4a90ff9747a7de1 (DEFAULT_TABLE table=default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.216382 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eea1525b54cc42b78180ba6867957f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.216094 729 tablet_service.cc:1467] Processing CreateTablet for tablet 89f5e2f055fb469dbbb935bba724dcb5 (DEFAULT_TABLE table=default.Table_89bf00306e9c44a0a0de2e0a7235f436 [id=24b0b6eb9f944dbb971530ee8f603c0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.218021 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1e0b2a9ca560420992035cf675a19d7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.218571 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e0b2a9ca560420992035cf675a19d7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.219103 727 tablet_service.cc:1467] Processing CreateTablet for tablet 2ee94c1a799a47f997469f96005167dc (DEFAULT_TABLE table=default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.219544 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f5e2f055fb469dbbb935bba724dcb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.220731 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_22154b88a133429f981e2e3a4d1fd4aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.221257 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22154b88a133429f981e2e3a4d1fd4aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.221511 1167 tablet_bootstrap.cc:654] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:59.222914 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ee94c1a799a47f997469f96005167dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.223022 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 134f76587b6147afaf4e94fde5574efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.223445 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a3dece319ace4b3c8341417bad1846e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.223955 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3dece319ace4b3c8341417bad1846e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.224225 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2910da33bbdb4410a4a90ff9747a7de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.225282 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.226125 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_95a1a4e2127e468a819635950d7f6b5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:59.226352 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_642c62b94c31483480661843e4bcbe5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.226584 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95a1a4e2127e468a819635950d7f6b5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:59.226733 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_642c62b94c31483480661843e4bcbe5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.227588 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5208f3136bcd45579de49b8b10745122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.227746 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_68b350ce02ec4ae8bedc85e7b6258775"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.228209 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68b350ce02ec4ae8bedc85e7b6258775 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.228430 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c38c628514c44c6fa5aff64928e515d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.229056 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 2ee94c1a799a47f997469f96005167dc (DEFAULT_TABLE table=default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.229120 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a40bbf24d40c42a693a3c8694f7dac84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:59.229234 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e596c68125a748248683d7d3edcacf20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:59.229466 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ee94c1a799a47f997469f96005167dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:59.229604 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a40bbf24d40c42a693a3c8694f7dac84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.229990 1170 tablet_bootstrap.cc:654] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:59.229605 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e596c68125a748248683d7d3edcacf20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.232311 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 8cca283f4d2645c0b59f750949b7e263 (DEFAULT_TABLE table=default.Table_e5288a8179334813988c13c09263d3fb [id=c1fc89d0749e49239f909c0b75349ec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.245167 424 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
W20260620 07:00:59.245795 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95f9a6b2f2cb41e6b74715b2618d8a70 consensus state has no leader
I20260620 07:00:59.245972 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_86b6eecd1d144fc298cf3bfc9b315ae5" } new_table_name: "default.Table_e398e5c359f8400eac47c32d10c9a432" modify_external_catalogs: true
W20260620 07:00:59.246227 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83451bba9a3c4c209dddf4250fea8806 consensus state has no leader
I20260620 07:00:59.246568 873 tablet_service.cc:1467] Processing CreateTablet for tablet 34dc2af503684aaba8388a4611fab48e (DEFAULT_TABLE table=default.Table_8245acd5248f4f15891928e4d69a511d [id=10e4dd185dca4e42ad74dfc50e7db3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.249588 859 tablet_service.cc:1514] Processing DeleteTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:59.253258 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e0891d6911d4bf8887f7e88a605aed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.253824 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7200877be18c4eaca57df88c25d30c01" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:59.254256 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8d90f8d63e45ce990aead6166bcfb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:59.254541 857 tablet_service.cc:1514] Processing DeleteTablet for tablet b6e36ffd69974ef897390a257f63a509 with delete_type TABLET_DATA_DELETED (replaced by tablet 54bb495eea4c49b7ad7bf2300ad0e60a) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:59.254839 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad65565caddf4e878292d1178fbf6037" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:59.255055 893 raft_consensus.cc:2454] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:59.255833 859 tablet_service.cc:1514] Processing DeleteTablet for tablet f9df1d52393e47ce991b5295d03624e8 with delete_type TABLET_DATA_DELETED (replaced by tablet b39e682e71ed4776a786f7d30158e7e0) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:59.261768 728 tablet_service.cc:1467] Processing CreateTablet for tablet e5b6c578055d4f95b44c85eba8e92ac8 (DEFAULT_TABLE table=default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a [id=b64b98af489b40d3a363f9101d971f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.262321 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5b6c578055d4f95b44c85eba8e92ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.264652 726 tablet_service.cc:1467] Processing CreateTablet for tablet 27da98f96a2245c5b4210b7cf084886d (DEFAULT_TABLE table=default.Table_8f58e36dcf944fb2906f6ded391b7ce7 [id=6d5b03179de540539513cab6cd39da39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.265043 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27da98f96a2245c5b4210b7cf084886d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.266021 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 261f0d97e1084e828b9562cb30ea422b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.266162 734 tablet_service.cc:1467] Processing CreateTablet for tablet 39504144a623423c873ded7d6839367a (DEFAULT_TABLE table=default.Table_d9a5c76430d34f31a928af10dfa284c6 [id=07dc49586074421fa6e3b6ee862b8216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.266546 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39504144a623423c873ded7d6839367a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.271103 725 tablet_service.cc:1467] Processing CreateTablet for tablet 04db48e910514d46bb4deb9acf54f7c0 (DEFAULT_TABLE table=default.Table_86b6eecd1d144fc298cf3bfc9b315ae5 [id=41c90959790840acbf26b2339272e8ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.271549 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04db48e910514d46bb4deb9acf54f7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.274106 734 tablet_service.cc:1467] Processing CreateTablet for tablet 54bb495eea4c49b7ad7bf2300ad0e60a (DEFAULT_TABLE table=default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.274456 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54bb495eea4c49b7ad7bf2300ad0e60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.276388 1169 ts_tablet_manager.cc:1918] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:00:59.276522 1169 log.cc:1196] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/1dc3bc9ec1334f1bb3d9f653b2472bc7
I20260620 07:00:59.277063 1169 ts_tablet_manager.cc:1939] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:59.278276 1169 tablet_replica.cc:330] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:59.278513 1169 raft_consensus.cc:2229] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:59.278729 1169 raft_consensus.cc:2258] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:59.279341 1169 ts_tablet_manager.cc:1905] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:59.283005 721 tablet_service.cc:1467] Processing CreateTablet for tablet a2d6f7f2b5b3473aa010b8982a03aa5e (DEFAULT_TABLE table=default.Table_0f52b588d09748288097316c7b3de423 [id=7abc3167416745d0871a33a335f880c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.283490 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d6f7f2b5b3473aa010b8982a03aa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.284891 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_877047b74134494489f2e58811a97682"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.285490 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_877047b74134494489f2e58811a97682 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.286917 857 tablet_service.cc:1467] Processing CreateTablet for tablet 5208f3136bcd45579de49b8b10745122 (DEFAULT_TABLE table=default.Table_48a88b94cfe34d46ab9881c6bcb2cfc3 [id=47d63992f58d45c3aef24a7a606ce4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.253945 1333 raft_consensus.cc:504] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.289194 722 tablet_service.cc:1467] Processing CreateTablet for tablet 9b2f0c28057b4534a8a400d1ca7f3991 (DEFAULT_TABLE table=default.Table_8e6e4c363d6f44828436c4fca5227174 [id=e2675f19e2dd4de2b88dca72b4b16a97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.289564 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b2f0c28057b4534a8a400d1ca7f3991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.289964 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad65565caddf4e878292d1178fbf6037" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:59.290191 747 raft_consensus.cc:3037] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.292568 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6bb87ba811824e86bea6f3f64db35a6c" } new_table_name: "default.Table_8bb5c7631c6145c49b7b09fcda4e4554" modify_external_catalogs: true
I20260620 07:00:59.292908 747 raft_consensus.cc:2454] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:59.294412 1166 ts_tablet_manager.cc:1939] T ba760b5fe1204df2932edd15bdcbaadf P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:00:59.294476 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3af42fa4c4614dab89c7853707b243cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.295017 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3af42fa4c4614dab89c7853707b243cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.296861 874 tablet_service.cc:1514] Processing DeleteTablet for tablet eea1525b54cc42b78180ba6867957f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:59.297277 968 leader_election.cc:302] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:59.297513 725 tablet_service.cc:1467] Processing CreateTablet for tablet ba93e22c4720417c99d471b9c8b49b86 (DEFAULT_TABLE table=default.Table_222fe401283741dfbd8316b30e97e70d [id=f974e84fd3e44839bf7da901087aa984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.297569 1263 raft_consensus.cc:2781] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:59.297667 730 tablet_service.cc:1467] Processing CreateTablet for tablet a9daee42d5c748ceaed7dc94f551c0d1 (DEFAULT_TABLE table=default.Table_659d4f17a45b47f5a065e40e30ab00b7 [id=88c48077ab69456c9d5241e3cd750089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.297892 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba93e22c4720417c99d471b9c8b49b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.298080 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9daee42d5c748ceaed7dc94f551c0d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.298625 859 tablet_service.cc:1467] Processing CreateTablet for tablet b5e08a38c42d4e3da20292343bf085b9 (DEFAULT_TABLE table=default.Table_ccdfbf066b8640709a0ff65043a63e9a [id=7ce4d1b95a984ccabd629f933ccaff8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.299419 1263 raft_consensus.cc:686] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:59.299695 1263 consensus_queue.cc:237] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.301566 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cca283f4d2645c0b59f750949b7e263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.302250 723 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9d7421b549468e8a7782f467473bdb (DEFAULT_TABLE table=default.Table_14c9ff1d977443ba914900cfb627c5e7 [id=471f2077c52c4990a4c8b7eb8879d92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.302642 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f9d7421b549468e8a7782f467473bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.302626 1333 leader_election.cc:288] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.302846 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 (table default.Table_c3a21b866a364f0e97c74a240faf1dff [id=a53fbb10c3c84cb698f8973d0e23bce0]) successfully deleted
I20260620 07:00:59.303066 732 tablet_service.cc:1467] Processing CreateTablet for tablet b39e682e71ed4776a786f7d30158e7e0 (DEFAULT_TABLE table=default.Table_b7ac5938b8c54806a785eaac99c70caa [id=a7902aafbaad4905a6b5b03ad669eeae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.303421 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39e682e71ed4776a786f7d30158e7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.303714 726 tablet_service.cc:1467] Processing CreateTablet for tablet d51c7488711b4db697b48025a5ba6e9d (DEFAULT_TABLE table=default.Table_6bb87ba811824e86bea6f3f64db35a6c [id=ca832808e4a449deab0a9c100d5ead0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.304035 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51c7488711b4db697b48025a5ba6e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.305146 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
W20260620 07:00:59.306318 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04db48e910514d46bb4deb9acf54f7c0 consensus state has no leader
I20260620 07:00:59.317829 727 tablet_service.cc:1467] Processing CreateTablet for tablet b6dca84adc5940e5a5505378e7276731 (DEFAULT_TABLE table=default.Table_21e2f7c931b949399e8536e32bf83d59 [id=71fe166d837d4d07a832d5e50bb59f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.318230 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6dca84adc5940e5a5505378e7276731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.318583 1000 tablet_service.cc:1467] Processing CreateTablet for tablet b6dca84adc5940e5a5505378e7276731 (DEFAULT_TABLE table=default.Table_21e2f7c931b949399e8536e32bf83d59 [id=71fe166d837d4d07a832d5e50bb59f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.323932 999 tablet_service.cc:1467] Processing CreateTablet for tablet 9b2f0c28057b4534a8a400d1ca7f3991 (DEFAULT_TABLE table=default.Table_8e6e4c363d6f44828436c4fca5227174 [id=e2675f19e2dd4de2b88dca72b4b16a97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.329088 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 04db48e910514d46bb4deb9acf54f7c0 (DEFAULT_TABLE table=default.Table_86b6eecd1d144fc298cf3bfc9b315ae5 [id=41c90959790840acbf26b2339272e8ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.329965 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9d4ef3ba51e432f889fb927a6af8b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.330891 1002 tablet_service.cc:1467] Processing CreateTablet for tablet e5b6c578055d4f95b44c85eba8e92ac8 (DEFAULT_TABLE table=default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a [id=b64b98af489b40d3a363f9101d971f53]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:59.335963 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d51c7488711b4db697b48025a5ba6e9d consensus state has no leader
I20260620 07:00:59.338148 1168 ts_tablet_manager.cc:1428] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.280s user 0.015s sys 0.011s
I20260620 07:00:59.339577 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_09cf5a5a891a4f53be1f8c6f66b3759f" } modify_external_catalogs: true
I20260620 07:00:59.339787 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_09cf5a5a891a4f53be1f8c6f66b3759f" } modify_external_catalogs: true
I20260620 07:00:59.341209 1168 tablet_bootstrap.cc:492] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:00:59.341629 866 tablet_service.cc:1467] Processing CreateTablet for tablet 2e0891d6911d4bf8887f7e88a605aed5 (DEFAULT_TABLE table=default.Table_47155b1e4814476084ad3242145bf731 [id=e8f54af0bb3645dfbf1f7032451ec119]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.344357 858 tablet_service.cc:1467] Processing CreateTablet for tablet 8cca283f4d2645c0b59f750949b7e263 (DEFAULT_TABLE table=default.Table_e5288a8179334813988c13c09263d3fb [id=c1fc89d0749e49239f909c0b75349ec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.344763 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_eedf4e35718843d2bb59ddbb3c085feb" } modify_external_catalogs: true
I20260620 07:00:59.344942 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_eedf4e35718843d2bb59ddbb3c085feb" } modify_external_catalogs: true
I20260620 07:00:59.344993 867 tablet_service.cc:1467] Processing CreateTablet for tablet eea1525b54cc42b78180ba6867957f76 (DEFAULT_TABLE table=default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6 [id=9ccc7eaea2334670b3c18570de5dcb3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.345782 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f7d77da45d5248419e216d47e3676655" } modify_external_catalogs: true
I20260620 07:00:59.345837 874 tablet_service.cc:1467] Processing CreateTablet for tablet 134f76587b6147afaf4e94fde5574efc (DEFAULT_TABLE table=default.Table_c6f6140b587a47069d1123f1ff4eef8b [id=5c8493166f2448dea6f711457ba8c1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.345950 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f7d77da45d5248419e216d47e3676655" } modify_external_catalogs: true
I20260620 07:00:59.349012 864 tablet_service.cc:1467] Processing CreateTablet for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 (DEFAULT_TABLE table=default.Table_2411c7dd68274c07a75cd0b3ae3e2d32 [id=804a023058a643b189246bf7c6a98af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.352414 876 tablet_service.cc:1467] Processing CreateTablet for tablet c38c628514c44c6fa5aff64928e515d9 (DEFAULT_TABLE table=default.Table_5a07e98698e24414a5ac54521c1b251c [id=a6be77da33394794ac37a31806294616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.353626 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5014cf5cc70466bafb6921c9d46ba72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.353924 868 tablet_service.cc:1467] Processing CreateTablet for tablet 2910da33bbdb4410a4a90ff9747a7de1 (DEFAULT_TABLE table=default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.362947 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cca283f4d2645c0b59f750949b7e263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.367527 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 82020156f3e44a1e84a9435d1f994124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:00:59.370009 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eea1525b54cc42b78180ba6867957f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.374307 1333 raft_consensus.cc:482] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.362999 1470 raft_consensus.cc:482] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.376221 1333 raft_consensus.cc:504] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.377384 1333 leader_election.cc:288] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.378000 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f5e2f055fb469dbbb935bba724dcb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.378245 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 27da98f96a2245c5b4210b7cf084886d (DEFAULT_TABLE table=default.Table_8f58e36dcf944fb2906f6ded391b7ce7 [id=6d5b03179de540539513cab6cd39da39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.378307 1470 raft_consensus.cc:504] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.380497 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27da98f96a2245c5b4210b7cf084886d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.380766 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6dca84adc5940e5a5505378e7276731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.369395 872 tablet_service.cc:1467] Processing CreateTablet for tablet 89f5e2f055fb469dbbb935bba724dcb5 (DEFAULT_TABLE table=default.Table_89bf00306e9c44a0a0de2e0a7235f436 [id=24b0b6eb9f944dbb971530ee8f603c0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.392335 1470 leader_election.cc:288] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:59.400123 1170 tablet_bootstrap.cc:492] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:59.400359 1170 ts_tablet_manager.cc:1397] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.208s user 0.004s sys 0.000s
I20260620 07:00:59.401376 1170 raft_consensus.cc:348] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.401670 1170 raft_consensus.cc:374] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.401780 1170 raft_consensus.cc:729] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:59.402077 1170 consensus_queue.cc:260] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.407153 870 tablet_service.cc:1467] Processing CreateTablet for tablet 9b2f0c28057b4534a8a400d1ca7f3991 (DEFAULT_TABLE table=default.Table_8e6e4c363d6f44828436c4fca5227174 [id=e2675f19e2dd4de2b88dca72b4b16a97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.407647 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c38c628514c44c6fa5aff64928e515d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.409909 861 tablet_service.cc:1467] Processing CreateTablet for tablet b6dca84adc5940e5a5505378e7276731 (DEFAULT_TABLE table=default.Table_21e2f7c931b949399e8536e32bf83d59 [id=71fe166d837d4d07a832d5e50bb59f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.413753 1170 ts_tablet_manager.cc:1428] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:00:59.415992 753 raft_consensus.cc:1261] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Refusing update from remote peer 978f112862c64141b1009856bef3d624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 07:00:59.414376 413 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.61:33455, user_credentials={real_user=slave}} blocked reactor thread for 57559.9us
I20260620 07:00:59.418458 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63dfade71c254d7e908e00acada93638" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:59.422971 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e596c68125a748248683d7d3edcacf20" } modify_external_catalogs: true
I20260620 07:00:59.423208 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e596c68125a748248683d7d3edcacf20" } modify_external_catalogs: true
I20260620 07:00:59.410702 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:59.427153 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a40bbf24d40c42a693a3c8694f7dac84" } modify_external_catalogs: true
I20260620 07:00:59.427342 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a40bbf24d40c42a693a3c8694f7dac84" } modify_external_catalogs: true
I20260620 07:00:59.428608 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b623e145e58e4cb9b1d75359c4d1cf8e" } new_table_name: "default.Table_e21acc07ea2349cc9a821839ff680062" modify_external_catalogs: true
I20260620 07:00:59.450711 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2ee94c1a799a47f997469f96005167dc
I20260620 07:00:59.451679 732 tablet_service.cc:1514] Processing DeleteTablet for tablet f90f1b2facc0415ab378fb81b60b0202 with delete_type TABLET_DATA_DELETED (replaced by tablet ea6102e0da4e42cd9f1d6e294bb372b2) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.452855 1170 tablet_bootstrap.cc:492] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:59.454612 722 tablet_service.cc:1467] Processing CreateTablet for tablet c8f81fa4e88945f1a392fbacfd031392 (DEFAULT_TABLE table=default.Table_a3dece319ace4b3c8341417bad1846e4 [id=0828a7e1651a4a46926570ca443cf647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.455178 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8f81fa4e88945f1a392fbacfd031392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.464455 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ee94c1a799a47f997469f96005167dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.475174 1240 raft_consensus.cc:482] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.476015 1240 raft_consensus.cc:504] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.476711 1240 leader_election.cc:288] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:59.477792 730 tablet_service.cc:1467] Processing CreateTablet for tablet eeb082e189304f13909d115f7197c5a1 (DEFAULT_TABLE table=default.Table_a40bbf24d40c42a693a3c8694f7dac84 [id=6bf90216e3494e01b7d8c51f68a83db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.478427 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb082e189304f13909d115f7197c5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.479558 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 46689d13712842bf9145ad2bc3fc2acf
I20260620 07:00:59.480296 423 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet a45c213de99c465799939f0f5e416489
I20260620 07:00:59.480618 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9a46df2909bf43f297b412c33f18a329
W20260620 07:00:59.481176 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d17c49eecec741cdbd592c94b7f84c67 consensus state has no leader
I20260620 07:00:59.482996 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cad45c9dbce34e7a98ad913944183256"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.483752 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cad45c9dbce34e7a98ad913944183256 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.485085 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet eeb082e189304f13909d115f7197c5a1
I20260620 07:00:59.487190 865 tablet_service.cc:1467] Processing CreateTablet for tablet 04db48e910514d46bb4deb9acf54f7c0 (DEFAULT_TABLE table=default.Table_86b6eecd1d144fc298cf3bfc9b315ae5 [id=41c90959790840acbf26b2339272e8ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.487190 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9fead9e2caec405da4386b1c600ea7b1" } new_table_name: "default.Table_dc7f658802694547b6670d0c962fe652" modify_external_catalogs: true
I20260620 07:00:59.487389 1470 raft_consensus.cc:482] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.498313 1170 tablet_bootstrap.cc:654] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:59.504110 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1ee056973abb41d18f9fb63fff39b8b8" } new_table_name: "default.Table_a252a334ff554e9686916014b6d8d87c" modify_external_catalogs: true
I20260620 07:00:59.505852 1170 tablet_bootstrap.cc:492] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:59.506090 1170 ts_tablet_manager.cc:1397] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.092s user 0.005s sys 0.000s
I20260620 07:00:59.507526 1170 raft_consensus.cc:348] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.507875 1170 raft_consensus.cc:374] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.508008 1170 raft_consensus.cc:729] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:59.508353 1170 consensus_queue.cc:260] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.509022 1170 ts_tablet_manager.cc:1428] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:00:59.509420 1170 tablet_bootstrap.cc:492] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:59.511401 1170 tablet_bootstrap.cc:654] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:59.508589 1169 ts_tablet_manager.cc:1918] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:00:59.518517 1169 log.cc:1196] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/8a56f30ca69e45e3a9ddd41f117f61e2
I20260620 07:00:59.520013 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5345217f0b8545a29bddb73746b3d846"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:59.484079 869 tablet_service.cc:1467] Processing CreateTablet for tablet 2ee94c1a799a47f997469f96005167dc (DEFAULT_TABLE table=default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:59.520622 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5345217f0b8545a29bddb73746b3d846 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.520710 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5208f3136bcd45579de49b8b10745122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.520303 862 tablet_service.cc:1467] Processing CreateTablet for tablet e5b6c578055d4f95b44c85eba8e92ac8 (DEFAULT_TABLE table=default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a [id=b64b98af489b40d3a363f9101d971f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.525708 1470 raft_consensus.cc:504] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.526371 1470 leader_election.cc:288] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:00:59.526624 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b2f0c28057b4534a8a400d1ca7f3991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.529312 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5b6c578055d4f95b44c85eba8e92ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.529942 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34dc2af503684aaba8388a4611fab48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.538959 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6dca84adc5940e5a5505378e7276731. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:59.542958 968 consensus_peers.cc:487] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 289405cbf0784916b971b038279309d8. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:00:59.543777 968 leader_election.cc:341] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:59.544103 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04db48e910514d46bb4deb9acf54f7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.547145 1169 ts_tablet_manager.cc:1939] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:59.528589 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 151) took 1207 ms. Trace:
I20260620 07:00:59.549644 1005 tablet_service.cc:1467] Processing CreateTablet for tablet a2d6f7f2b5b3473aa010b8982a03aa5e (DEFAULT_TABLE table=default.Table_0f52b588d09748288097316c7b3de423 [id=7abc3167416745d0871a33a335f880c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.550974 1168 tablet_bootstrap.cc:654] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:00:59.551709 681 leader_election.cc:341] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: fcc92630252b40a6a306c3a578fa3e59
I20260620 07:00:59.553145 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 134f76587b6147afaf4e94fde5574efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.554909 998 tablet_service.cc:1467] Processing CreateTablet for tablet 39504144a623423c873ded7d6839367a (DEFAULT_TABLE table=default.Table_d9a5c76430d34f31a928af10dfa284c6 [id=07dc49586074421fa6e3b6ee862b8216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.555320 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04db48e910514d46bb4deb9acf54f7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.555661 1169 tablet_replica.cc:330] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:59.555918 1169 raft_consensus.cc:2229] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:59.556133 1169 raft_consensus.cc:2258] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:59.556793 1169 ts_tablet_manager.cc:1905] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:59.557296 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_064fe848c6a04392901aeeb0168f99b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.557924 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_064fe848c6a04392901aeeb0168f99b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.560905 875 tablet_service.cc:1467] Processing CreateTablet for tablet a2d6f7f2b5b3473aa010b8982a03aa5e (DEFAULT_TABLE table=default.Table_0f52b588d09748288097316c7b3de423 [id=7abc3167416745d0871a33a335f880c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.564318 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7d53dfa17a784fa08192e52f450ee287"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.564889 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d53dfa17a784fa08192e52f450ee287 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.565477 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cd9d406b4ab84e899550e53fce092e5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.566015 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd9d406b4ab84e899550e53fce092e5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.569063 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4d3d2172df004ee39d7e56f81179364f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.569603 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d3d2172df004ee39d7e56f81179364f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.570976 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6f694d1dc105473b93ba18dc487d0d55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.571547 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f694d1dc105473b93ba18dc487d0d55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.572949 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b12d35c7af0b4279880ff02a830fcdd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.573925 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b12d35c7af0b4279880ff02a830fcdd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.576510 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]) successfully deleted
I20260620 07:00:59.577653 1167 tablet_bootstrap.cc:492] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:00:59.579070 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 360880717af145628606b5b9fb26e350 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 360880717af145628606b5b9fb26e350 already in progress: creating tablet
I20260620 07:00:59.581267 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 46689d13712842bf9145ad2bc3fc2acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.581528 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ee94c1a799a47f997469f96005167dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.584209 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e08a38c42d4e3da20292343bf085b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.585603 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e0891d6911d4bf8887f7e88a605aed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.585847 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a46df2909bf43f297b412c33f18a329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.590909 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d6f7f2b5b3473aa010b8982a03aa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.598582 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39504144a623423c873ded7d6839367a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.598629 730 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 (DEFAULT_TABLE table=default.Table_642c62b94c31483480661843e4bcbe5c [id=aec61ada90ac43b6b4ca3d6c297c8bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.600538 726 tablet_service.cc:1467] Processing CreateTablet for tablet f8be5f41f1d64d918b727e3eef18738e (DEFAULT_TABLE table=default.Table_68b350ce02ec4ae8bedc85e7b6258775 [id=d55d6c70a1b34227b4820944e280fde8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.600153 727 tablet_service.cc:1467] Processing CreateTablet for tablet ab60101b34144f85b0afd2e8c4846e48 (DEFAULT_TABLE table=default.Table_22154b88a133429f981e2e3a4d1fd4aa [id=76b0e45d4d264794a80b3293898b6064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.601522 723 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 (DEFAULT_TABLE table=default.Table_95a1a4e2127e468a819635950d7f6b5f [id=441ab9871f3141a28fb5f7c8c26e41bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.602296 734 tablet_service.cc:1467] Processing CreateTablet for tablet c2e38178b9244152915d4c0a9dcf59dc (DEFAULT_TABLE table=default.Table_1e0b2a9ca560420992035cf675a19d7a [id=202a9df145344ba48e0563ba13f1849f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.599565 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.603379 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8be5f41f1d64d918b727e3eef18738e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.604182 1166 rpcz_store.cc:276] 0620 07:00:58.179512 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.179562 (+ 50us) service_pool.cc:227] Handling call
0620 07:00:58.859613 (+680051us) ts_tablet_manager.cc:1145] Deleting tablet ba760b5fe1204df2932edd15bdcbaadf
0620 07:00:58.859977 (+ 364us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.096687 (+236710us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:59.133732 (+ 37045us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:59.386455 (+252723us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":679823}
I20260620 07:00:59.607344 1170 tablet_bootstrap.cc:492] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:59.607506 1170 ts_tablet_manager.cc:1397] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.098s user 0.013s sys 0.020s
I20260620 07:00:59.607753 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.608101 1011 tablet_service.cc:1467] Processing CreateTablet for tablet ba93e22c4720417c99d471b9c8b49b86 (DEFAULT_TABLE table=default.Table_222fe401283741dfbd8316b30e97e70d [id=f974e84fd3e44839bf7da901087aa984]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:59.608431 968 consensus_peers.cc:487] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 537ab1626d4e44c38d8cca8c51921424. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:00:59.610948 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab60101b34144f85b0afd2e8c4846e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.614938 1263 raft_consensus.cc:482] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.615105 1263 raft_consensus.cc:504] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.616793 996 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9d7421b549468e8a7782f467473bdb (DEFAULT_TABLE table=default.Table_14c9ff1d977443ba914900cfb627c5e7 [id=471f2077c52c4990a4c8b7eb8879d92e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:59.620029 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 57937.6us
I20260620 07:00:59.620774 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8245acd5248f4f15891928e4d69a511d" } new_table_name: "default.Table_d65dd044d2b645638bc5ed4451380807" modify_external_catalogs: true
I20260620 07:00:59.621037 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7ff3385435e3457aa03dba26530f9f0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:59.621377 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 150) took 1430 ms. Trace:
W20260620 07:00:59.621552 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ff3385435e3457aa03dba26530f9f0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:59.622175 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad65565caddf4e878292d1178fbf6037 consensus state has no leader
I20260620 07:00:59.622547 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_afc28b2f3ee848e9873f0f1f373eb2cd" } new_table_name: "default.Table_79f82cf183f64103a58283b6793b810f" modify_external_catalogs: true
W20260620 07:00:59.623008 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8ec1e179a704e5480f3deaf856156e7 consensus state has no leader
I20260620 07:00:59.623241 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e032d39a4bb74ed18c922fb3ba622d07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:59.623689 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 9d05d17792e54877b29431754676dcad from {username='slave'} at 127.0.0.1:42866
W20260620 07:00:59.623895 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e032d39a4bb74ed18c922fb3ba622d07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.623240 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 63dfade71c254d7e908e00acada93638 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:59.625979 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:59.626581 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2e38178b9244152915d4c0a9dcf59dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.626981 1240 raft_consensus.cc:482] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.627137 1240 raft_consensus.cc:504] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.627875 1240 leader_election.cc:288] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.628247 1170 raft_consensus.cc:348] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.628471 1170 raft_consensus.cc:374] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.628598 1170 raft_consensus.cc:729] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:59.628810 1170 consensus_queue.cc:260] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.629382 1170 ts_tablet_manager.cc:1428] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.021s user 0.001s sys 0.000s
I20260620 07:00:59.629432 1263 leader_election.cc:288] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.630138 1170 tablet_bootstrap.cc:492] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:59.624272 997 tablet_service.cc:1467] Processing CreateTablet for tablet 54bb495eea4c49b7ad7bf2300ad0e60a (DEFAULT_TABLE table=default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.630844 1012 tablet_service.cc:1467] Processing CreateTablet for tablet a9daee42d5c748ceaed7dc94f551c0d1 (DEFAULT_TABLE table=default.Table_659d4f17a45b47f5a065e40e30ab00b7 [id=88c48077ab69456c9d5241e3cd750089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.631215 1001 tablet_service.cc:1467] Processing CreateTablet for tablet d51c7488711b4db697b48025a5ba6e9d (DEFAULT_TABLE table=default.Table_6bb87ba811824e86bea6f3f64db35a6c [id=ca832808e4a449deab0a9c100d5ead0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.631560 1166 rpcz_store.cc:276] 0620 07:00:58.179400 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.179829 (+ 429us) service_pool.cc:227] Handling call
0620 07:00:59.605759 (+1425930us) ts_tablet_manager.cc:1145] Deleting tablet ca380134173e42f6b562b56375f2ccad
0620 07:00:59.605772 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.609698 (+ 3926us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1425733}
I20260620 07:00:59.632031 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 152) took 1430 ms. Trace:
I20260620 07:00:59.632151 1166 rpcz_store.cc:276] 0620 07:00:58.201286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.201333 (+ 47us) service_pool.cc:227] Handling call
0620 07:00:59.631836 (+1430503us) ts_tablet_manager.cc:1145] Deleting tablet 169b93c38e59435db218152f2d25bdfa
0620 07:00:59.631848 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.631978 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1430252}
I20260620 07:00:59.632513 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ba760b5fe1204df2932edd15bdcbaadf (table default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]) successfully deleted
I20260620 07:00:59.632514 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 153) took 1417 ms. Trace:
I20260620 07:00:59.632678 1166 rpcz_store.cc:276] 0620 07:00:58.214630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.214681 (+ 51us) service_pool.cc:227] Handling call
0620 07:00:59.632367 (+1417686us) ts_tablet_manager.cc:1145] Deleting tablet add9e860802d4edebcfbc9fa3c4a6b24
0620 07:00:59.632377 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.632464 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1417431}
I20260620 07:00:59.633025 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 155) took 1321 ms. Trace:
I20260620 07:00:59.633136 1166 rpcz_store.cc:276] 0620 07:00:58.311481 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.311548 (+ 67us) service_pool.cc:227] Handling call
0620 07:00:59.632884 (+1321336us) ts_tablet_manager.cc:1145] Deleting tablet 203ba3933d3a4fb2a4978b29cad614e6
0620 07:00:59.632914 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.632983 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321080}
I20260620 07:00:59.633466 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 154) took 1380 ms. Trace:
I20260620 07:00:59.633646 1201 raft_consensus.cc:482] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.633826 1201 raft_consensus.cc:504] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.634473 1201 leader_election.cc:288] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.634871 1031 raft_consensus.cc:1261] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Refusing update from remote peer 978f112862c64141b1009856bef3d624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:00:59.633598 1166 rpcz_store.cc:276] 0620 07:00:58.253261 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.365656 (+112395us) service_pool.cc:227] Handling call
0620 07:00:59.633329 (+1267673us) ts_tablet_manager.cc:1145] Deleting tablet bea895c735c847f59794ab8c3282447d
0620 07:00:59.633339 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.633420 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1267346}
I20260620 07:00:59.635763 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 158) took 1203 ms. Trace:
I20260620 07:00:59.635888 1166 rpcz_store.cc:276] 0620 07:00:58.432730 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.432831 (+ 101us) service_pool.cc:227] Handling call
0620 07:00:59.635629 (+1202798us) ts_tablet_manager.cc:1145] Deleting tablet 9d05d17792e54877b29431754676dcad
0620 07:00:59.635638 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.635728 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1202506}
I20260620 07:00:59.636243 1166 tablet_replica.cc:330] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:00:59.636472 1166 raft_consensus.cc:2229] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
W20260620 07:00:59.636579 969 leader_election.cc:341] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:59.636744 969 leader_election.cc:302] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:00:59.636838 1166 raft_consensus.cc:2258] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:59.636961 1170 tablet_bootstrap.cc:654] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:59.637320 1333 raft_consensus.cc:2726] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:00:59.637578 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ca380134173e42f6b562b56375f2ccad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca380134173e42f6b562b56375f2ccad already in progress: creating tablet
I20260620 07:00:59.637650 1333 consensus_queue.cc:1035] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:00:59.637876 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 169b93c38e59435db218152f2d25bdfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 169b93c38e59435db218152f2d25bdfa already in progress: creating tablet
W20260620 07:00:59.638198 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 203ba3933d3a4fb2a4978b29cad614e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 203ba3933d3a4fb2a4978b29cad614e6 already in progress: creating tablet
W20260620 07:00:59.638381 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet bea895c735c847f59794ab8c3282447d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bea895c735c847f59794ab8c3282447d already in progress: creating tablet
W20260620 07:00:59.638610 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9d05d17792e54877b29431754676dcad because the tablet was not found. No further retry: Not found: Tablet not found: 9d05d17792e54877b29431754676dcad
I20260620 07:00:59.638630 1166 ts_tablet_manager.cc:1905] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:59.638923 1009 tablet_service.cc:1467] Processing CreateTablet for tablet b39e682e71ed4776a786f7d30158e7e0 (DEFAULT_TABLE table=default.Table_b7ac5938b8c54806a785eaac99c70caa [id=a7902aafbaad4905a6b5b03ad669eeae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.639487 1167 ts_tablet_manager.cc:1397] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.480s user 0.007s sys 0.011s
I20260620 07:00:59.643419 1167 raft_consensus.cc:348] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.644599 1167 raft_consensus.cc:374] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.644888 1167 raft_consensus.cc:729] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
W20260620 07:00:59.647120 968 leader_election.cc:341] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:00:59.597503 722 tablet_service.cc:1514] Processing DeleteTablet for tablet eeb082e189304f13909d115f7197c5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.646921 1167 consensus_queue.cc:260] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.644922 1170 tablet_bootstrap.cc:492] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:59.653338 1170 ts_tablet_manager.cc:1397] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260620 07:00:59.648770 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63dfade71c254d7e908e00acada93638" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:00:59.635816 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63dfade71c254d7e908e00acada93638" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:59.655395 1030 raft_consensus.cc:2454] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:59.639402 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:59.655889 1029 raft_consensus.cc:2454] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:00:59.660218 1170 raft_consensus.cc:348] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.661397 1170 raft_consensus.cc:374] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.661691 1170 raft_consensus.cc:729] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:59.662132 1170 consensus_queue.cc:260] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.662930 747 raft_consensus.cc:2454] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:59.664017 751 raft_consensus.cc:3037] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.664324 1170 ts_tablet_manager.cc:1428] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260620 07:00:59.665341 1170 tablet_bootstrap.cc:492] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:59.667819 1170 tablet_bootstrap.cc:654] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:59.674219 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f5e2f055fb469dbbb935bba724dcb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.689142 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6641e445a3014a60a287541bee6f57e2" } modify_external_catalogs: true
I20260620 07:00:59.689417 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6641e445a3014a60a287541bee6f57e2" } modify_external_catalogs: true
I20260620 07:00:59.686069 1364 consensus_queue.cc:1035] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260620 07:00:59.692186 1470 raft_consensus.cc:482] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.694222 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b2f0c28057b4534a8a400d1ca7f3991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.697597 866 tablet_service.cc:1467] Processing CreateTablet for tablet 27da98f96a2245c5b4210b7cf084886d (DEFAULT_TABLE table=default.Table_8f58e36dcf944fb2906f6ded391b7ce7 [id=6d5b03179de540539513cab6cd39da39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.700889 1170 tablet_bootstrap.cc:492] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:59.701138 1170 ts_tablet_manager.cc:1397] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.005s
I20260620 07:00:59.703380 1170 raft_consensus.cc:348] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.704941 1170 raft_consensus.cc:374] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.705351 1170 raft_consensus.cc:729] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:59.706143 1170 consensus_queue.cc:260] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.707130 1169 ts_tablet_manager.cc:1918] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:59.708760 1279 consensus_queue.cc:1035] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.062s
I20260620 07:00:59.709340 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:59.710680 1170 ts_tablet_manager.cc:1428] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260620 07:00:59.711227 1170 tablet_bootstrap.cc:492] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:59.713032 1170 tablet_bootstrap.cc:654] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:59.713042 968 leader_election.cc:302] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:59.714898 1169 log.cc:1196] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/7d9f7cf9e3a14e28ac20662b5e86dc41
I20260620 07:00:59.715214 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2910da33bbdb4410a4a90ff9747a7de1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:59.716346 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 49628.1us
I20260620 07:00:59.717095 1167 ts_tablet_manager.cc:1428] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.077s user 0.003s sys 0.002s
I20260620 07:00:59.718461 1167 tablet_bootstrap.cc:492] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:00:59.718622 994 tablet_service.cc:1467] Processing CreateTablet for tablet eeb082e189304f13909d115f7197c5a1 (DEFAULT_TABLE table=default.Table_a40bbf24d40c42a693a3c8694f7dac84 [id=6bf90216e3494e01b7d8c51f68a83db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.720752 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d6f7f2b5b3473aa010b8982a03aa5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:59.721081 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34dc2af503684aaba8388a4611fab48e consensus state has no leader
I20260620 07:00:59.721742 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 (DEFAULT_TABLE table=default.Table_642c62b94c31483480661843e4bcbe5c [id=aec61ada90ac43b6b4ca3d6c297c8bd3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:59.721884 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1c64df83a18a470c98a9c1fd6bb38918 consensus state has no leader
I20260620 07:00:59.723325 1169 ts_tablet_manager.cc:1939] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:59.724555 1169 tablet_replica.cc:330] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:59.724836 1169 raft_consensus.cc:2229] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:59.725106 1169 raft_consensus.cc:2258] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:59.725838 1169 ts_tablet_manager.cc:1905] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:59.726756 1201 raft_consensus.cc:2781] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:59.726907 1201 raft_consensus.cc:482] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:59.727169 1263 consensus_queue.cc:1035] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260620 07:00:59.726986 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 (table default.Table_a8832b6e92294c9c9e051bc22e13b5e4 [id=1b7f0b11c53649f29df954f7abcd30f1]) successfully deleted
I20260620 07:00:59.728698 1201 raft_consensus.cc:3037] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.730337 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 7200877be18c4eaca57df88c25d30c01 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:59.733733 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 8a56f30ca69e45e3a9ddd41f117f61e2 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:59.648949 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe79bcf487fc4d118a91f4c62628d8a5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:59.738809 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ee94c1a799a47f997469f96005167dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.747609 995 tablet_service.cc:1514] Processing DeleteTablet for tablet eeb082e189304f13909d115f7197c5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.752509 1169 ts_tablet_manager.cc:1918] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:00:59.752688 1169 log.cc:1196] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/33517843ce1d4d8786c91fd738d81ab2
I20260620 07:00:59.753093 1169 ts_tablet_manager.cc:1939] T 33517843ce1d4d8786c91fd738d81ab2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:59.757121 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 610a25c729cf41b4bd71372bc36365a8 (table default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3]). Expected version 2 got 0
I20260620 07:00:59.758441 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f9d7421b549468e8a7782f467473bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.758348 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 33517843ce1d4d8786c91fd738d81ab2 (table default.Table_c6f6140b587a47069d1123f1ff4eef8b [id=5c8493166f2448dea6f711457ba8c1bc]) successfully deleted
I20260620 07:00:59.761329 730 tablet_service.cc:1514] Processing DeleteTablet for tablet b8799f2a2aed4688aa4e6e590dc83a4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.762589 1240 raft_consensus.cc:482] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.762760 1240 raft_consensus.cc:504] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.763432 1240 leader_election.cc:288] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.764279 730 tablet_service.cc:1467] Processing CreateTablet for tablet 864c95b908674e4f8425d765444c281b (DEFAULT_TABLE table=default.Table_3af42fa4c4614dab89c7853707b243cb [id=f3a3145cdeb841329b0b4af9d9aa4235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.764827 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864c95b908674e4f8425d765444c281b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.766294 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9daee42d5c748ceaed7dc94f551c0d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.768342 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7200877be18c4eaca57df88c25d30c01
I20260620 07:00:59.768711 427 catalog_manager.cc:6565] ReplaceTablet: tablet 7200877be18c4eaca57df88c25d30c01 deleted and replaced by tablet 4655d289c94c4bce9707be375fc4b850
I20260620 07:00:59.769266 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 63dfade71c254d7e908e00acada93638
I20260620 07:00:59.769626 419 catalog_manager.cc:6565] ReplaceTablet: tablet 63dfade71c254d7e908e00acada93638 deleted and replaced by tablet dac4a1434751433488eb2913b1ddfd23
I20260620 07:00:59.770614 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 7200877be18c4eaca57df88c25d30c01 with delete_type TABLET_DATA_DELETED (replaced by tablet 4655d289c94c4bce9707be375fc4b850) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.771389 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 63dfade71c254d7e908e00acada93638 with delete_type TABLET_DATA_DELETED (replaced by tablet dac4a1434751433488eb2913b1ddfd23) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.773788 734 tablet_service.cc:1467] Processing CreateTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 (DEFAULT_TABLE table=default.Table_877047b74134494489f2e58811a97682 [id=55c4c9a5f69b4cf7bb05ce4157f8a5e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.774156 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3b70b1674e43768b29dea84b09a1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.777196 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39e682e71ed4776a786f7d30158e7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.777184 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:59.778858 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
I20260620 07:00:59.785835 1167 tablet_bootstrap.cc:654] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:59.786423 1201 raft_consensus.cc:504] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.787559 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e398e5c359f8400eac47c32d10c9a432" } modify_external_catalogs: true
I20260620 07:00:59.787822 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e398e5c359f8400eac47c32d10c9a432" } modify_external_catalogs: true
I20260620 07:00:59.788764 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63dfade71c254d7e908e00acada93638" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:00:59.789157 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_642c62b94c31483480661843e4bcbe5c" } modify_external_catalogs: true
I20260620 07:00:59.789379 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_642c62b94c31483480661843e4bcbe5c" } modify_external_catalogs: true
I20260620 07:00:59.794889 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 95f9a6b2f2cb41e6b74715b2618d8a70
I20260620 07:00:59.796442 747 raft_consensus.cc:3037] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.797340 1263 consensus_queue.cc:1035] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260620 07:00:59.800494 747 raft_consensus.cc:2454] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:59.801110 1165 ts_tablet_manager.cc:1918] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:00:59.801142 895 raft_consensus.cc:2454] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:59.801326 1165 log.cc:1196] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/289405cbf0784916b971b038279309d8
I20260620 07:00:59.801502 1169 tablet_replica.cc:330] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:59.801827 1165 ts_tablet_manager.cc:1939] T 289405cbf0784916b971b038279309d8 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:00:59.802186 1169 raft_consensus.cc:2229] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:59.803851 1169 raft_consensus.cc:2258] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:59.804180 1201 leader_election.cc:288] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.804275 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.804417 968 leader_election.cc:302] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:59.804777 1201 raft_consensus.cc:2781] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:59.805452 1201 raft_consensus.cc:686] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:00:59.806473 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
I20260620 07:00:59.807288 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 04db48e910514d46bb4deb9acf54f7c0
I20260620 07:00:59.806716 1169 ts_tablet_manager.cc:1905] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:00:59.807336 998 tablet_service.cc:1467] Processing CreateTablet for tablet ab60101b34144f85b0afd2e8c4846e48 (DEFAULT_TABLE table=default.Table_22154b88a133429f981e2e3a4d1fd4aa [id=76b0e45d4d264794a80b3293898b6064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.807888 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2
I20260620 07:00:59.811751 1170 tablet_bootstrap.cc:492] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:00:59.812027 1170 ts_tablet_manager.cc:1397] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.101s user 0.001s sys 0.018s
I20260620 07:00:59.710084 1470 raft_consensus.cc:504] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.813006 1170 raft_consensus.cc:348] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:00:59.811937 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 581573cafab14ac79ff7ad19da0580b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 581573cafab14ac79ff7ad19da0580b4 already in progress: creating tablet
I20260620 07:00:59.814114 1170 raft_consensus.cc:374] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:00:59.814414 1170 raft_consensus.cc:729] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:00:59.814916 1170 consensus_queue.cc:260] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:00:59.816097 1170 ts_tablet_manager.cc:1428] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260620 07:00:59.815725 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 289405cbf0784916b971b038279309d8 because the tablet was not found. No further retry: Not found: Tablet not found: 289405cbf0784916b971b038279309d8
W20260620 07:00:59.818037 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 076926f7dffe4a7b80c25ea3c18e9958 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 076926f7dffe4a7b80c25ea3c18e9958 already in progress: creating tablet
W20260620 07:00:59.820228 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet e275d82068074370ba1e32b7ca5fdcc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e275d82068074370ba1e32b7ca5fdcc3 already in progress: creating tablet
I20260620 07:00:59.822083 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:59.822585 1169 ts_tablet_manager.cc:1918] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:00:59.814605 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad65565caddf4e878292d1178fbf6037" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:00:59.824054 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5a07e98698e24414a5ac54521c1b251c" } modify_external_catalogs: true
I20260620 07:00:59.824306 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5a07e98698e24414a5ac54521c1b251c" } modify_external_catalogs: true
I20260620 07:00:59.811041 1201 consensus_queue.cc:237] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.826678 893 raft_consensus.cc:3037] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.829569 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_89396513fc244d759a11c57d9cfa893e" } new_table_name: "default.Table_ddfa02b01d2248a188748eda117387da" modify_external_catalogs: true
I20260620 07:00:59.829998 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 170) took 1401 ms. Trace:
I20260620 07:00:59.831015 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e032d39a4bb74ed18c922fb3ba622d07" } modify_external_catalogs: true
I20260620 07:00:59.831214 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e032d39a4bb74ed18c922fb3ba622d07" } modify_external_catalogs: true
I20260620 07:00:59.831807 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27da98f96a2245c5b4210b7cf084886d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.832273 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 04db48e910514d46bb4deb9acf54f7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.830613 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63dfade71c254d7e908e00acada93638" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:00:59.833366 865 tablet_service.cc:1467] Processing CreateTablet for tablet ba93e22c4720417c99d471b9c8b49b86 (DEFAULT_TABLE table=default.Table_222fe401283741dfbd8316b30e97e70d [id=f974e84fd3e44839bf7da901087aa984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.833731 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:00:59.834075 995 tablet_service.cc:1467] Processing CreateTablet for tablet c2e38178b9244152915d4c0a9dcf59dc (DEFAULT_TABLE table=default.Table_1e0b2a9ca560420992035cf675a19d7a [id=202a9df145344ba48e0563ba13f1849f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.836372 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ebd139afc6aa4a2aa7084a1f41685bce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.836936 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebd139afc6aa4a2aa7084a1f41685bce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.837661 1470 leader_election.cc:288] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:00:59.839598 857 tablet_service.cc:1467] Processing CreateTablet for tablet 39504144a623423c873ded7d6839367a (DEFAULT_TABLE table=default.Table_d9a5c76430d34f31a928af10dfa284c6 [id=07dc49586074421fa6e3b6ee862b8216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.841454 893 raft_consensus.cc:2454] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:00:59.847944 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c38c628514c44c6fa5aff64928e515d9
I20260620 07:00:59.848800 734 tablet_service.cc:1514] Processing DeleteTablet for tablet c38c628514c44c6fa5aff64928e515d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:00:59.849153 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e643fb0890042ae891ea17f0bc03740 consensus state has no leader
I20260620 07:00:59.850530 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ebd139afc6aa4a2aa7084a1f41685bce" } new_table_name: "default.Table_b829d1b373034423ae5025caa27ff52f" modify_external_catalogs: true
I20260620 07:00:59.852113 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c11d0890ced54dabb9c71dfbe7d94d2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.852669 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c11d0890ced54dabb9c71dfbe7d94d2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.850924 873 tablet_service.cc:1467] Processing CreateTablet for tablet 54bb495eea4c49b7ad7bf2300ad0e60a (DEFAULT_TABLE table=default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.853371 1240 raft_consensus.cc:482] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.853530 1240 raft_consensus.cc:504] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.854244 1240 leader_election.cc:288] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.854233 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_323e0a217ebf4aad8ef0137a7599dd92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.854763 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_323e0a217ebf4aad8ef0137a7599dd92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.854959 1240 raft_consensus.cc:482] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:00:59.855105 1240 raft_consensus.cc:504] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.855621 1240 leader_election.cc:288] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.856252 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7b6efec6450d4ae6a6518c7c13d94482" } new_table_name: "default.Table_228578e017344fbfb4d357cfbeaf6ea8" modify_external_catalogs: true
I20260620 07:00:59.857618 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1aeab74931f24831bafc5e0ba0dd2a6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.858135 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1aeab74931f24831bafc5e0ba0dd2a6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.862990 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7b68309da41f4767a4a2ac0898fa91c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.863657 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b68309da41f4767a4a2ac0898fa91c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.865273 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a14863df3baa41daa0a80ae9da10cf0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.865798 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a14863df3baa41daa0a80ae9da10cf0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:59.868651 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9e70b585def4a4a9081a0938af8ce5b has no consensus state
I20260620 07:00:59.871953 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 864c95b908674e4f8425d765444c281b (DEFAULT_TABLE table=default.Table_3af42fa4c4614dab89c7853707b243cb [id=f3a3145cdeb841329b0b4af9d9aa4235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.871568 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.872709 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.876323 1006 tablet_service.cc:1467] Processing CreateTablet for tablet c8f81fa4e88945f1a392fbacfd031392 (DEFAULT_TABLE table=default.Table_a3dece319ace4b3c8341417bad1846e4 [id=0828a7e1651a4a46926570ca443cf647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.876464 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d980ceff63f447adbc0aaf600b24f40e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:00:59.877138 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d980ceff63f447adbc0aaf600b24f40e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.822746 1169 log.cc:1196] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/fcc92630252b40a6a306c3a578fa3e59
I20260620 07:00:59.881047 1169 ts_tablet_manager.cc:1939] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:00:59.837613 894 raft_consensus.cc:2454] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:59.883286 1169 tablet_replica.cc:330] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:00:59.884274 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet fcc92630252b40a6a306c3a578fa3e59 (table default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]) successfully deleted
I20260620 07:00:59.886839 1028 raft_consensus.cc:2454] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
W20260620 07:00:59.887285 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f690e150839a4d23860932712f61e7c8 consensus state has no leader
I20260620 07:00:59.890985 681 leader_election.cc:302] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:59.891650 1240 raft_consensus.cc:2781] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:59.891753 1240 raft_consensus.cc:482] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:59.891856 1240 raft_consensus.cc:3037] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.894577 1240 raft_consensus.cc:504] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:00:59.896356 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 (DEFAULT_TABLE table=default.Table_95a1a4e2127e468a819635950d7f6b5f [id=441ab9871f3141a28fb5f7c8c26e41bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.899392 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f90f1b2facc0415ab378fb81b60b0202" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:59.899989 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb082e189304f13909d115f7197c5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.905689 1170 tablet_bootstrap.cc:492] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:00:59.907511 1168 tablet_bootstrap.cc:492] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:00:59.912667 830 leader_election.cc:302] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:00:59.913945 896 raft_consensus.cc:2454] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:00:59.914155 1470 raft_consensus.cc:2781] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:00:59.914419 1470 raft_consensus.cc:482] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:00:59.914376 861 tablet_service.cc:1467] Processing CreateTablet for tablet d51c7488711b4db697b48025a5ba6e9d (DEFAULT_TABLE table=default.Table_6bb87ba811824e86bea6f3f64db35a6c [id=ca832808e4a449deab0a9c100d5ead0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.914515 1470 raft_consensus.cc:3037] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.914796 867 tablet_service.cc:1467] Processing CreateTablet for tablet a9daee42d5c748ceaed7dc94f551c0d1 (DEFAULT_TABLE table=default.Table_659d4f17a45b47f5a065e40e30ab00b7 [id=88c48077ab69456c9d5241e3cd750089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.915184 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.915608 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9daee42d5c748ceaed7dc94f551c0d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.916729 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51c7488711b4db697b48025a5ba6e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.918444 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54bb495eea4c49b7ad7bf2300ad0e60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.920418 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba93e22c4720417c99d471b9c8b49b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.921394 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39504144a623423c873ded7d6839367a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:59.926594 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 84493.1us
I20260620 07:00:59.925654 876 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9d7421b549468e8a7782f467473bdb (DEFAULT_TABLE table=default.Table_14c9ff1d977443ba914900cfb627c5e7 [id=471f2077c52c4990a4c8b7eb8879d92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.929946 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 7200877be18c4eaca57df88c25d30c01 from {username='slave'} at 127.0.0.1:42866
I20260620 07:00:59.926349 1165 rpcz_store.cc:276] 0620 07:00:58.423758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.423813 (+ 55us) service_pool.cc:227] Handling call
0620 07:00:59.084545 (+660732us) ts_tablet_manager.cc:1145] Deleting tablet 289405cbf0784916b971b038279309d8
0620 07:00:59.084554 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.376125 (+291571us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:59.673554 (+297429us) tablet_metadata.cc:641] Metadata flushed
0620 07:00:59.824907 (+151353us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22078,"tablet-delete.queue_time_us":660482}
I20260620 07:00:59.935557 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 178) took 1198 ms. Trace:
I20260620 07:00:59.935714 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_55942390786a4cec9d933146948c3a48" } new_table_name: "default.Table_d33f4bd9d2ad4555b2a76128e5d3f234" modify_external_catalogs: true
I20260620 07:00:59.938606 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b0ba90ad7d404eefaffdd72e2bbd6645"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:59.938755 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_49352a35a6414ff4b6f4a0e417cc7a48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:00:59.938558 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a46df2909bf43f297b412c33f18a329. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:00:59.939208 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0ba90ad7d404eefaffdd72e2bbd6645 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:00:59.939215 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49352a35a6414ff4b6f4a0e417cc7a48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:00:59.940615 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b14d69a316844dd88f863bb1b3aa52f6" } new_table_name: "default.Table_5716ccac487c4d4296da6cdd2d2ceeb0" modify_external_catalogs: true
I20260620 07:00:59.940666 1240 leader_election.cc:288] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:00:59.955479 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 7200877be18c4eaca57df88c25d30c01 with delete_type TABLET_DATA_DELETED (replaced by tablet 4655d289c94c4bce9707be375fc4b850) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.957930 1169 raft_consensus.cc:2229] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:00:59.958617 1169 pending_rounds.cc:62] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:00:59.958705 1169 pending_rounds.cc:68] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821565372551168 op_type: NO_OP noop_request { }
I20260620 07:00:59.958882 1169 raft_consensus.cc:2866] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:00:59.959013 1169 raft_consensus.cc:2258] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:00:59.964303 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51c7488711b4db697b48025a5ba6e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.964322 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 46689d13712842bf9145ad2bc3fc2acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.965878 1007 tablet_service.cc:1467] Processing CreateTablet for tablet f8be5f41f1d64d918b727e3eef18738e (DEFAULT_TABLE table=default.Table_68b350ce02ec4ae8bedc85e7b6258775 [id=d55d6c70a1b34227b4820944e280fde8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:00:59.966444 968 consensus_peers.cc:487] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d9f7cf9e3a14e28ac20662b5e86dc41. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:00:59.966588 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 75793.8us
I20260620 07:00:59.967238 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:00:59.967476 1030 raft_consensus.cc:3037] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:00:59.971602 1028 raft_consensus.cc:2379] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:00:59.972177 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8799f2a2aed4688aa4e6e590dc83a4e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:00:59.972500 1032 raft_consensus.cc:2379] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:00:59.972913 1009 tablet_service.cc:1467] Processing CreateTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 (DEFAULT_TABLE table=default.Table_877047b74134494489f2e58811a97682 [id=55c4c9a5f69b4cf7bb05ce4157f8a5e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:00:59.972826 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 63dfade71c254d7e908e00acada93638 with delete_type TABLET_DATA_DELETED (replaced by tablet dac4a1434751433488eb2913b1ddfd23) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.973412 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 04db48e910514d46bb4deb9acf54f7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.973616 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.973799 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet c38c628514c44c6fa5aff64928e515d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.974247 1030 raft_consensus.cc:2454] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:00:59.974679 681 leader_election.cc:302] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:00:59.975286 1240 raft_consensus.cc:2781] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:00:59.976835 1240 raft_consensus.cc:686] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:00:59.978933 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a46df2909bf43f297b412c33f18a329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.979712 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:00:59.981735 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2e38178b9244152915d4c0a9dcf59dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.983011 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3b70b1674e43768b29dea84b09a1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:00:59.984372 969 leader_election.cc:302] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:00:59.987744 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet a9e70b585def4a4a9081a0938af8ce5b (table default.Table_b829d1b373034423ae5025caa27ff52f [id=a876d134592d456ea2e7b8336037020f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a9e70b585def4a4a9081a0938af8ce5b has no consensus state
I20260620 07:00:59.989415 1168 ts_tablet_manager.cc:1397] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.569s user 0.007s sys 0.010s
I20260620 07:00:59.993634 1263 consensus_queue.cc:1035] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260620 07:00:59.997632 1170 tablet_bootstrap.cc:654] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:00:59.998387 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba93e22c4720417c99d471b9c8b49b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.011363 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 9e643fb0890042ae891ea17f0bc03740 (table default.Table_ddfa02b01d2248a188748eda117387da [id=65b5bbb9004b4c28b8233868e05c293a]). Expected version 1 got 0
I20260620 07:00:59.999687 1240 consensus_queue.cc:237] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:00.015141 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 168fb1666e2c41358213240d34ef9572 consensus state has no leader
I20260620 07:01:00.015553 1165 rpcz_store.cc:276] 0620 07:00:58.736689 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.737096 (+ 407us) service_pool.cc:227] Handling call
0620 07:00:59.935351 (+1198255us) ts_tablet_manager.cc:1145] Deleting tablet 04d5d361a5404dcf99a89e93ac1f7dd8
0620 07:00:59.935367 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.935496 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1197933}
I20260620 07:01:00.016103 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 179) took 1279 ms. Trace:
I20260620 07:01:00.017010 1165 rpcz_store.cc:276] 0620 07:00:58.736866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.737428 (+ 562us) service_pool.cc:227] Handling call
0620 07:01:00.015929 (+1278501us) ts_tablet_manager.cc:1145] Deleting tablet 360880717af145628606b5b9fb26e350
0620 07:01:00.015943 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.016057 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1278303}
I20260620 07:01:00.017454 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 180) took 1280 ms. Trace:
W20260620 07:01:00.018570 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0e54f1185cd4c5c8e5d2ed289b61650 consensus state has no leader
I20260620 07:01:00.021891 730 tablet_service.cc:1467] Processing CreateTablet for tablet 4302edba0ec04d7abc2789bc7be1beca (DEFAULT_TABLE table=default.Table_4d3d2172df004ee39d7e56f81179364f [id=d553eceadb64462ba38a1e7026cb0a83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.022248 723 tablet_service.cc:1467] Processing CreateTablet for tablet b5c1567e0c9448dca870bd3d8502bf02 (DEFAULT_TABLE table=default.Table_064fe848c6a04392901aeeb0168f99b4 [id=4315970d1a304e3d8d41ff5b0e452ebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.022542 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4302edba0ec04d7abc2789bc7be1beca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.022807 722 tablet_service.cc:1467] Processing CreateTablet for tablet 704e8aaabe6d40138b6611bdc30abf16 (DEFAULT_TABLE table=default.Table_5345217f0b8545a29bddb73746b3d846 [id=6a49cf444e3b409bbf2fc6a73764cfe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.023175 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704e8aaabe6d40138b6611bdc30abf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.022668 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c11d0890ced54dabb9c71dfbe7d94d2a" } modify_external_catalogs: true
I20260620 07:01:00.023904 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c11d0890ced54dabb9c71dfbe7d94d2a" } modify_external_catalogs: true
I20260620 07:01:00.027275 727 tablet_service.cc:1467] Processing CreateTablet for tablet a1c683a2169e4938b6941f83308cd392 (DEFAULT_TABLE table=default.Table_b12d35c7af0b4279880ff02a830fcdd2 [id=97b9e95433cf44f9a615d21ae24f7130]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.027760 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1c683a2169e4938b6941f83308cd392. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:00.020463 1501 consensus_queue.cc:1159] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2b84cae646b24bc7bd424eb8434ad425" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260620 07:01:00.031148 1169 ts_tablet_manager.cc:1905] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:00.031090 726 tablet_service.cc:1467] Processing CreateTablet for tablet 6229a52adf8d4b17bdf89347e01621ed (DEFAULT_TABLE table=default.Table_cad45c9dbce34e7a98ad913944183256 [id=e4ea9f9e77f74312a2ead7c22390b268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.031486 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6229a52adf8d4b17bdf89347e01621ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.033438 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5345217f0b8545a29bddb73746b3d846" } modify_external_catalogs: true
I20260620 07:01:00.033761 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5345217f0b8545a29bddb73746b3d846" } modify_external_catalogs: true
I20260620 07:01:00.035121 725 tablet_service.cc:1467] Processing CreateTablet for tablet f793a91ab247408bbe4a9f7cb370fffe (DEFAULT_TABLE table=default.Table_6f694d1dc105473b93ba18dc487d0d55 [id=4a2d8361d2404c1eb6710cc8f5190708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.035791 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f793a91ab247408bbe4a9f7cb370fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.038012 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_28d4fe83bbd14c4a9421d93152913831" } modify_external_catalogs: true
I20260620 07:01:00.038281 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_28d4fe83bbd14c4a9421d93152913831" } modify_external_catalogs: true
I20260620 07:01:00.038661 1169 ts_tablet_manager.cc:1918] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:00.038780 1169 log.cc:1196] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/1f763b0e91544700bd672c2ef751b4d2
I20260620 07:01:00.039791 734 tablet_service.cc:1467] Processing CreateTablet for tablet cf0bae39e1634710af12de493f7f58d5 (DEFAULT_TABLE table=default.Table_7ff3385435e3457aa03dba26530f9f0b [id=c5d6638ed0bf48e1b8339e21c50f9a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.040166 1169 ts_tablet_manager.cc:1939] T 1f763b0e91544700bd672c2ef751b4d2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:00.040205 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0bae39e1634710af12de493f7f58d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.040973 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 201) took 1075 ms. Trace:
I20260620 07:01:00.041131 1169 rpcz_store.cc:276] 0620 07:00:58.965986 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.966635 (+ 649us) service_pool.cc:227] Handling call
0620 07:00:59.883220 (+916585us) ts_tablet_manager.cc:1145] Deleting tablet 1f763b0e91544700bd672c2ef751b4d2
0620 07:00:59.883229 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:00:59.958503 (+ 75274us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x6150001025a4. stack: 00007fa60e27666e 00007fa60e276430 00007fa60d2fd5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6197ae04d 00007fa61aa525ec 00007fa61d3e12e6 00007fa61d413404 00007fa61d3f4870 00007fa61d3f45fd 00000000009edb7c 00007fa60e2bc344 00007fa60e2bf91b 00007fa60e2bf798
0620 07:01:00.034573 (+ 76070us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.038513 (+ 3940us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.040927 (+ 2414us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1199,"spinlock_wait_cycles":166035712,"tablet-delete.queue_time_us":915878}
I20260620 07:01:00.041641 1169 tablet_replica.cc:330] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:00.041882 1169 raft_consensus.cc:2229] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:00.039238 732 tablet_service.cc:1467] Processing CreateTablet for tablet cd75e318982a4fb9bf28cb35b030642f (DEFAULT_TABLE table=default.Table_7d53dfa17a784fa08192e52f450ee287 [id=5af5baece18749bdbccb48b3a793fbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.043550 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd75e318982a4fb9bf28cb35b030642f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.039479 721 tablet_service.cc:1467] Processing CreateTablet for tablet 58a4f3b5450948768c8db382d200cc19 (DEFAULT_TABLE table=default.Table_cd9d406b4ab84e899550e53fce092e5f [id=3852c2f12adc4283b184a70b473d3260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.047399 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58a4f3b5450948768c8db382d200cc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.050333 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_06b2bcb778eb4444828c3050a4ed47ec" } modify_external_catalogs: true
I20260620 07:01:00.050616 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_06b2bcb778eb4444828c3050a4ed47ec" } modify_external_catalogs: true
I20260620 07:01:00.050980 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5c1567e0c9448dca870bd3d8502bf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.051867 1169 pending_rounds.cc:62] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:00.053094 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1e123882f2a44ed28dbe6198a0ac7098" } new_table_name: "default.Table_4fd706d123b84bd4869c44a4d0e794c3" modify_external_catalogs: true
I20260620 07:01:00.054412 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6d87b63c85c042d59cc7aebb8ee815f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.054916 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d87b63c85c042d59cc7aebb8ee815f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.060289 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 1f763b0e91544700bd672c2ef751b4d2 (table default.Table_61741807e243431395868ee24844d1aa [id=31b071f3fa7547fb8a222ac6b8bffd6a]) successfully deleted
I20260620 07:01:00.060667 729 tablet_service.cc:1467] Processing CreateTablet for tablet 4655d289c94c4bce9707be375fc4b850 (DEFAULT_TABLE table=default.Table_4b0078a40169404eb33b169cdb5f08df [id=8f652552eba04d87aad349983184c524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.061241 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4655d289c94c4bce9707be375fc4b850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.054778 1169 pending_rounds.cc:68] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821566346088448 op_type: NO_OP noop_request { }
I20260620 07:01:00.060667 728 tablet_service.cc:1467] Processing CreateTablet for tablet dac4a1434751433488eb2913b1ddfd23 (DEFAULT_TABLE table=default.Table_c1da229c30624077a49d8112967940c7 [id=7230178ddc264a3faaa90ddc66afffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.064901 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dac4a1434751433488eb2913b1ddfd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.063565 1169 raft_consensus.cc:2866] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:00.068902 1169 raft_consensus.cc:2258] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:00.075124 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 333eef8b98da4a279acceaead9405149
I20260620 07:01:00.076215 425 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0226ed3dd2fb4a11a23b1396d4e3f106
I20260620 07:01:00.076673 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 704e8aaabe6d40138b6611bdc30abf16
I20260620 07:01:00.077477 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2910da33bbdb4410a4a90ff9747a7de1
I20260620 07:01:00.087610 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 2910da33bbdb4410a4a90ff9747a7de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.087775 1169 ts_tablet_manager.cc:1905] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:00.095259 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8b961698fe54e7f9c16f41b90058093 consensus state has no leader
I20260620 07:01:00.096638 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_48b14443dddd46969ee0299cee27e93e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.097513 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48b14443dddd46969ee0299cee27e93e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.099568 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_690ab28d5a40472ebf9dfa50126f6c42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.100782 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_690ab28d5a40472ebf9dfa50126f6c42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.102955 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2906fe0a195149d2844232cc8d83f6dd
I20260620 07:01:00.104597 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ccdfbf066b8640709a0ff65043a63e9a" } new_table_name: "default.Table_17a1cb1a99834485911d40165811a7f1" modify_external_catalogs: true
I20260620 07:01:00.106848 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4f595f80f7f9445f956d6e24febead0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:00.107168 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 704e8aaabe6d40138b6611bdc30abf16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.107264 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_575cb7edd20f4e9c96fc6c3cc94f63f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.107517 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f595f80f7f9445f956d6e24febead0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:00.107802 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_575cb7edd20f4e9c96fc6c3cc94f63f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.106846 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1e0b2a9ca560420992035cf675a19d7a" } new_table_name: "default.Table_1016b85ff6404fc0aff750ab23813534" modify_external_catalogs: true
I20260620 07:01:00.109606 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ddf7eee68cd64d798dd0e8cced08b38a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:00.109798 730 tablet_service.cc:1467] Processing CreateTablet for tablet 333eef8b98da4a279acceaead9405149 (DEFAULT_TABLE table=default.Table_e032d39a4bb74ed18c922fb3ba622d07 [id=1135222d9b5f4d14bb527056194a68cd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:00.110129 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddf7eee68cd64d798dd0e8cced08b38a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.110275 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 333eef8b98da4a279acceaead9405149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.111907 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_50f2cabde77d417caa731bf4e56f48c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.112552 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50f2cabde77d417caa731bf4e56f48c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.112468 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6eb73392ffc1468dac3e5b45336416d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.113029 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6eb73392ffc1468dac3e5b45336416d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.114953 830 leader_election.cc:302] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:00.117075 1165 rpcz_store.cc:276] 0620 07:00:58.737028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.737648 (+ 620us) service_pool.cc:227] Handling call
0620 07:01:00.017298 (+1279650us) ts_tablet_manager.cc:1145] Deleting tablet 076926f7dffe4a7b80c25ea3c18e9958
0620 07:01:00.017310 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.017409 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1279426}
I20260620 07:01:00.119591 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 2906fe0a195149d2844232cc8d83f6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.119843 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 333eef8b98da4a279acceaead9405149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.147248 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f9d7421b549468e8a7782f467473bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.148120 1487 raft_consensus.cc:2781] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:00.148255 1487 raft_consensus.cc:482] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:00.148362 1487 raft_consensus.cc:3037] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:00.155231 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2e38178b9244152915d4c0a9dcf59dc consensus state has no leader
W20260620 07:01:00.158002 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5e08a38c42d4e3da20292343bf085b9 consensus state has no leader
W20260620 07:01:00.160619 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 188434us
I20260620 07:01:00.164657 1165 tablet_replica.cc:330] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:00.165962 1170 tablet_bootstrap.cc:492] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:00.166100 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864c95b908674e4f8425d765444c281b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.166216 1170 ts_tablet_manager.cc:1397] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.261s user 0.000s sys 0.019s
I20260620 07:01:00.166612 1496 raft_consensus.cc:2741] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260620 07:01:00.167021 1170 raft_consensus.cc:348] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.167294 1170 raft_consensus.cc:374] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:00.167415 1170 raft_consensus.cc:729] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:00.167663 1170 consensus_queue.cc:260] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.169201 1170 ts_tablet_manager.cc:1428] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 07:01:00.169507 1170 tablet_bootstrap.cc:492] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:00.181641 1170 tablet_bootstrap.cc:654] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:00.182013 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:00.179944 875 tablet_service.cc:1467] Processing CreateTablet for tablet b39e682e71ed4776a786f7d30158e7e0 (DEFAULT_TABLE table=default.Table_b7ac5938b8c54806a785eaac99c70caa [id=a7902aafbaad4905a6b5b03ad669eeae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.187706 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.188151 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 4302edba0ec04d7abc2789bc7be1beca (DEFAULT_TABLE table=default.Table_4d3d2172df004ee39d7e56f81179364f [id=d553eceadb64462ba38a1e7026cb0a83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.189954 1032 raft_consensus.cc:2454] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:00.190946 1003 tablet_service.cc:1467] Processing CreateTablet for tablet cf0bae39e1634710af12de493f7f58d5 (DEFAULT_TABLE table=default.Table_7ff3385435e3457aa03dba26530f9f0b [id=c5d6638ed0bf48e1b8339e21c50f9a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.194028 1167 tablet_bootstrap.cc:492] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:00.194280 1167 ts_tablet_manager.cc:1397] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.477s user 0.009s sys 0.006s
W20260620 07:01:00.194950 968 consensus_peers.cc:487] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f763b0e91544700bd672c2ef751b4d2. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:00.200503 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 134418us
I20260620 07:01:00.202963 1170 tablet_bootstrap.cc:492] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:00.203158 1170 ts_tablet_manager.cc:1397] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.008s
I20260620 07:01:00.200171 1524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.60:46775 every 8 connection(s)
I20260620 07:01:00.203405 862 tablet_service.cc:1467] Processing CreateTablet for tablet c8f81fa4e88945f1a392fbacfd031392 (DEFAULT_TABLE table=default.Table_a3dece319ace4b3c8341417bad1846e4 [id=0828a7e1651a4a46926570ca443cf647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.204304 1170 raft_consensus.cc:348] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.204891 1194 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.60:46775
I20260620 07:01:00.206990 1194 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/info.pb
I20260620 07:01:00.211038 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4u_93S/build/asan/bin/kudu as pid 1194
I20260620 07:01:00.213941 729 tablet_service.cc:1467] Processing CreateTablet for tablet 3456cf91d65a4413a35efe94513c723d (DEFAULT_TABLE table=default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9 [id=24e00ed0d7994f1cbebd87b708274b55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.220691 1170 raft_consensus.cc:374] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:00.220800 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3456cf91d65a4413a35efe94513c723d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.220857 1170 raft_consensus.cc:729] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:00.221160 1170 consensus_queue.cc:260] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.222827 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9c3075f87cd749e78ca23499c09b7b87" } new_table_name: "default.Table_833694b1c9684acb97bca68ebefecb45" modify_external_catalogs: true
I20260620 07:01:00.222913 725 tablet_service.cc:1467] Processing CreateTablet for tablet 95a109e7871241ec9467858dca467bbe (DEFAULT_TABLE table=default.Table_a14863df3baa41daa0a80ae9da10cf0a [id=2f50ee8c71f8435aad169b0637348a30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.223459 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95a109e7871241ec9467858dca467bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.223908 1170 ts_tablet_manager.cc:1428] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260620 07:01:00.224256 1170 tablet_bootstrap.cc:492] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:00.225992 1170 tablet_bootstrap.cc:654] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:00.228415 726 tablet_service.cc:1467] Processing CreateTablet for tablet b6e2c297072741eb927dff9bcf6a573f (DEFAULT_TABLE table=default.Table_323e0a217ebf4aad8ef0137a7599dd92 [id=d1ba4ce259044c45a86b285abab7b5ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.228924 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e2c297072741eb927dff9bcf6a573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.231767 734 tablet_service.cc:1467] Processing CreateTablet for tablet a9e70b585def4a4a9081a0938af8ce5b (DEFAULT_TABLE table=default.Table_b829d1b373034423ae5025caa27ff52f [id=a876d134592d456ea2e7b8336037020f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.232216 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9e70b585def4a4a9081a0938af8ce5b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:00.234004 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5014cf5cc70466bafb6921c9d46ba72 consensus state has no leader
I20260620 07:01:00.244174 732 tablet_service.cc:1467] Processing CreateTablet for tablet 88c6aeea7c504f36964e8bf41b0fc4f9 (DEFAULT_TABLE table=default.Table_b0ba90ad7d404eefaffdd72e2bbd6645 [id=b6dc41e1ec4b4b8c9aa8583c725fa886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.244274 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2a842ef988174540bb18300a4788c4cc" } new_table_name: "default.Table_edddb8415e3043bd8364bbb691528ebf" modify_external_catalogs: true
I20260620 07:01:00.254933 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88c6aeea7c504f36964e8bf41b0fc4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.256863 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d4b8aa362e80457697662fb3098721a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.257743 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4b8aa362e80457697662fb3098721a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.259351 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1b9cc73341544ad1b1f8a9ec66412603"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.260102 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b9cc73341544ad1b1f8a9ec66412603 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.266778 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 9e643fb0890042ae891ea17f0bc03740 (table default.Table_ddfa02b01d2248a188748eda117387da [id=65b5bbb9004b4c28b8233868e05c293a]). Expected version 1 got 0
I20260620 07:01:00.267108 420 catalog_manager.cc:5495] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:00.267702 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 610a25c729cf41b4bd71372bc36365a8 (table default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3]). Expected version 2 got 0
W20260620 07:01:00.272629 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a4390225af348f89c934f0f179ddab5 consensus state has no leader
I20260620 07:01:00.285497 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39e682e71ed4776a786f7d30158e7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.286247 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ee94c1a799a47f997469f96005167dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.286571 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 46689d13712842bf9145ad2bc3fc2acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.286810 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a46df2909bf43f297b412c33f18a329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.287709 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_49629c65f95a46ff815a7d39c7143227" } modify_external_catalogs: true
I20260620 07:01:00.288020 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_49629c65f95a46ff815a7d39c7143227" } modify_external_catalogs: true
I20260620 07:01:00.290606 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6eb73392ffc1468dac3e5b45336416d2" } modify_external_catalogs: true
I20260620 07:01:00.291091 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6eb73392ffc1468dac3e5b45336416d2" } modify_external_catalogs: true
I20260620 07:01:00.292007 863 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 205) took 1305 ms. Trace:
I20260620 07:01:00.292130 863 rpcz_store.cc:276] 0620 07:00:58.886221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.887281 (+ 1060us) service_pool.cc:227] Handling call
0620 07:00:59.081178 (+193897us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.081198 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.017577 (+936379us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.191322 (+173745us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.191517 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.294240 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a" } modify_external_catalogs: true
I20260620 07:01:00.294492 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a" } modify_external_catalogs: true
I20260620 07:01:00.301409 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_17a1cb1a99834485911d40165811a7f1" } modify_external_catalogs: true
I20260620 07:01:00.301702 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_17a1cb1a99834485911d40165811a7f1" } modify_external_catalogs: true
I20260620 07:01:00.308970 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:00.309749 728 tablet_service.cc:1467] Processing CreateTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e (DEFAULT_TABLE table=default.Table_d980ceff63f447adbc0aaf600b24f40e [id=ea3947fe0a794502a317ef69c47c0444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.316720 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a14863df3baa41daa0a80ae9da10cf0a" } new_table_name: "default.Table_53068d3c2f9c41c3847aca8716b94221" modify_external_catalogs: true
I20260620 07:01:00.319729 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1b9cc73341544ad1b1f8a9ec66412603" } modify_external_catalogs: true
I20260620 07:01:00.319998 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1b9cc73341544ad1b1f8a9ec66412603" } modify_external_catalogs: true
I20260620 07:01:00.322698 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f9c3eac07b6040a280cd24392454206b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:00.323338 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8f81fa4e88945f1a392fbacfd031392. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:00.323442 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9c3eac07b6040a280cd24392454206b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.324956 1165 raft_consensus.cc:2229] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:00.325239 1165 raft_consensus.cc:2258] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:00.327813 860 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 212) took 1201 ms. Trace:
I20260620 07:01:00.323817 1168 raft_consensus.cc:348] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.329891 1165 ts_tablet_manager.cc:1905] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:00.332334 863 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 (DEFAULT_TABLE table=default.Table_642c62b94c31483480661843e4bcbe5c [id=aec61ada90ac43b6b4ca3d6c297c8bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.332986 874 tablet_service.cc:1467] Processing CreateTablet for tablet c2e38178b9244152915d4c0a9dcf59dc (DEFAULT_TABLE table=default.Table_1e0b2a9ca560420992035cf675a19d7a [id=202a9df145344ba48e0563ba13f1849f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.335110 858 tablet_service.cc:1514] Processing DeleteTablet for tablet eeb082e189304f13909d115f7197c5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.335666 858 tablet_service.cc:1467] Processing CreateTablet for tablet ab60101b34144f85b0afd2e8c4846e48 (DEFAULT_TABLE table=default.Table_22154b88a133429f981e2e3a4d1fd4aa [id=76b0e45d4d264794a80b3293898b6064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.334390 868 tablet_service.cc:1467] Processing CreateTablet for tablet eeb082e189304f13909d115f7197c5a1 (DEFAULT_TABLE table=default.Table_a40bbf24d40c42a693a3c8694f7dac84 [id=6bf90216e3494e01b7d8c51f68a83db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.339252 859 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 222) took 1041 ms. Trace:
I20260620 07:01:00.339414 859 rpcz_store.cc:276] 0620 07:00:59.256927 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.256982 (+ 55us) service_pool.cc:227] Handling call
0620 07:00:59.298864 (+ 41882us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.298887 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:00:59.924470 (+625583us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.291858 (+367388us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.297909 (+ 6051us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.340066 859 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 (DEFAULT_TABLE table=default.Table_95a1a4e2127e468a819635950d7f6b5f [id=441ab9871f3141a28fb5f7c8c26e41bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.341549 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.344159 860 rpcz_store.cc:276] 0620 07:00:59.096626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.096687 (+ 61us) service_pool.cc:227] Handling call
0620 07:00:59.149980 (+ 53293us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.150008 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:00:59.710238 (+560230us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.291709 (+581471us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.297845 (+ 6136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.344770 860 tablet_service.cc:1467] Processing CreateTablet for tablet f8be5f41f1d64d918b727e3eef18738e (DEFAULT_TABLE table=default.Table_68b350ce02ec4ae8bedc85e7b6258775 [id=d55d6c70a1b34227b4820944e280fde8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.344969 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 261f0d97e1084e828b9562cb30ea422b
I20260620 07:01:00.345144 1168 raft_consensus.cc:374] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:00.345248 1168 raft_consensus.cc:729] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:00.345525 1168 consensus_queue.cc:260] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.346278 1168 ts_tablet_manager.cc:1428] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.356s user 0.002s sys 0.000s
I20260620 07:01:00.346657 1168 tablet_bootstrap.cc:492] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:00.347345 1470 raft_consensus.cc:504] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:00.348040 1470 leader_election.cc:288] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:00.348294 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb082e189304f13909d115f7197c5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.352267 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8be5f41f1d64d918b727e3eef18738e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.355185 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.358970 426 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 88b2ba29bcca48cb8eed0742f47ce24d
I20260620 07:01:00.341187 1487 raft_consensus.cc:504] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:00.360172 1487 leader_election.cc:288] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:00.360965 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e5b6c578055d4f95b44c85eba8e92ac8
I20260620 07:01:00.363209 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b5e08a38c42d4e3da20292343bf085b9
I20260620 07:01:00.364207 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 261f0d97e1084e828b9562cb30ea422b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.365046 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab60101b34144f85b0afd2e8c4846e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.365092 1169 ts_tablet_manager.cc:1918] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:00.365451 1169 log.cc:1196] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/9d05d17792e54877b29431754676dcad
I20260620 07:01:00.371869 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2e38178b9244152915d4c0a9dcf59dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.373564 1169 ts_tablet_manager.cc:1939] T 9d05d17792e54877b29431754676dcad P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:00.376294 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 202) took 1410 ms. Trace:
I20260620 07:01:00.376605 1169 rpcz_store.cc:276] 0620 07:00:58.966158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.967385 (+ 1227us) service_pool.cc:227] Handling call
0620 07:01:00.041564 (+1074179us) ts_tablet_manager.cc:1145] Deleting tablet 9d05d17792e54877b29431754676dcad
0620 07:01:00.041576 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.239664 (+198088us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.348768 (+109104us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.376157 (+ 27389us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1073904}
I20260620 07:01:00.390851 734 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b6c578055d4f95b44c85eba8e92ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.391556 734 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e08a38c42d4e3da20292343bf085b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.396880 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 9d05d17792e54877b29431754676dcad (table default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]) successfully deleted
I20260620 07:01:00.397748 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1099ae03924f4f4b95324ddaac35f9cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.398466 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1099ae03924f4f4b95324ddaac35f9cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.405798 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_575cb7edd20f4e9c96fc6c3cc94f63f2" } new_table_name: "default.Table_3d3f1c18a48b4a4baa02626e6a328c14" modify_external_catalogs: true
I20260620 07:01:00.410530 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7a520f90f9534374822183a6768a4d99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:00.410811 1168 tablet_bootstrap.cc:654] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:00.411191 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a520f90f9534374822183a6768a4d99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.418769 1170 tablet_bootstrap.cc:492] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:00.418965 1170 ts_tablet_manager.cc:1397] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.195s user 0.015s sys 0.025s
I20260620 07:01:00.419847 1170 raft_consensus.cc:348] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.420099 1170 raft_consensus.cc:374] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:00.420190 1170 raft_consensus.cc:729] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:00.420591 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63dfade71c254d7e908e00acada93638" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:00.421078 1170 consensus_queue.cc:260] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.421917 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c3468f43caff46b1903034e2d5a4279f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:00.422277 1170 ts_tablet_manager.cc:1428] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:00.422605 1170 tablet_bootstrap.cc:492] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:00.422688 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3468f43caff46b1903034e2d5a4279f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.424180 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_51c799b6e1ca4b06828745a6337bdaa0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:00.424527 895 raft_consensus.cc:2379] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06a32ef63b2b495a9ade1de48c024ae9 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:01:00.424770 1170 tablet_bootstrap.cc:654] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:00.424770 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51c799b6e1ca4b06828745a6337bdaa0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.433178 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_34297eefaa884ce0b9f16d67c2f95c14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:00.433637 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 207) took 1296 ms. Trace:
W20260620 07:01:00.433828 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34297eefaa884ce0b9f16d67c2f95c14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.433775 1169 rpcz_store.cc:276] 0620 07:00:59.137246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.137301 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:00.433443 (+1296142us) ts_tablet_manager.cc:1145] Deleting tablet eea1525b54cc42b78180ba6867957f76
0620 07:01:00.433458 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.433597 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1295892}
I20260620 07:01:00.434305 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 208) took 1296 ms. Trace:
I20260620 07:01:00.434441 1169 rpcz_store.cc:276] 0620 07:00:59.138094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.138141 (+ 47us) service_pool.cc:227] Handling call
0620 07:01:00.434136 (+1295995us) ts_tablet_manager.cc:1145] Deleting tablet a5757e05e9a2403a86ca98f455e11754
0620 07:01:00.434146 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.434270 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1295790}
I20260620 07:01:00.434806 1169 tablet_replica.cc:330] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:00.435078 1169 raft_consensus.cc:2229] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:00.435048 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_68b350ce02ec4ae8bedc85e7b6258775" } new_table_name: "default.Table_3122a50618184dc7bf7cb696dca2a55b" modify_external_catalogs: true
I20260620 07:01:00.435271 1169 raft_consensus.cc:2258] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:00.435434 1240 raft_consensus.cc:482] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:00.435576 1240 raft_consensus.cc:504] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.436308 1240 leader_election.cc:288] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:00.437290 1169 ts_tablet_manager.cc:1905] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:00.444908 1240 raft_consensus.cc:482] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:00.445137 1240 raft_consensus.cc:504] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.445835 1240 leader_election.cc:288] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:00.455747 726 tablet_service.cc:1467] Processing CreateTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 (DEFAULT_TABLE table=default.Table_1aeab74931f24831bafc5e0ba0dd2a6e [id=1217f9b44b2f484d86191921e496bd0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.455727 734 tablet_service.cc:1467] Processing CreateTablet for tablet 97e01aa120cc4c189017236ad57de811 (DEFAULT_TABLE table=default.Table_7b68309da41f4767a4a2ac0898fa91c2 [id=19dd20742533400980193075baec1956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.456208 729 tablet_service.cc:1467] Processing CreateTablet for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (DEFAULT_TABLE table=default.Table_49352a35a6414ff4b6f4a0e417cc7a48 [id=ce2f89c1e2544dbd8f7c27716b0b8624]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:00.457181 869 consensus_meta.cc:287] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: Time spent flushing consensus metadata: real 0.533s user 0.002s sys 0.003s
W20260620 07:01:00.459151 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet eea1525b54cc42b78180ba6867957f76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eea1525b54cc42b78180ba6867957f76 already in progress: creating tablet
I20260620 07:01:00.466656 869 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 232) took 1129 ms. Trace:
I20260620 07:01:00.466926 869 rpcz_store.cc:276] 0620 07:00:59.328405 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.370687 (+ 42282us) service_pool.cc:227] Handling call
0620 07:00:59.520503 (+149816us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.520535 (+ 32us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:00:59.924420 (+403885us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.457401 (+532981us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.457598 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:00.467391 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a5757e05e9a2403a86ca98f455e11754 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5757e05e9a2403a86ca98f455e11754 already in progress: creating tablet
I20260620 07:01:00.486759 869 tablet_service.cc:1467] Processing CreateTablet for tablet 864c95b908674e4f8425d765444c281b (DEFAULT_TABLE table=default.Table_3af42fa4c4614dab89c7853707b243cb [id=f3a3145cdeb841329b0b4af9d9aa4235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.498369 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864c95b908674e4f8425d765444c281b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.503633 1487 consensus_queue.cc:1035] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260620 07:01:00.509917 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0c41bf6a8a448ad809292d66ebf9c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.510767 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97e01aa120cc4c189017236ad57de811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.511103 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 967cc8f19ad64278910c86ffc4cb3ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.511349 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35cb81ac0ebd4865b9d53259ed5787d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.515733 1240 raft_consensus.cc:482] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:00.515933 1240 raft_consensus.cc:504] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.516745 1240 leader_election.cc:288] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:00.519084 1169 ts_tablet_manager.cc:1918] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:00.519261 1169 log.cc:1196] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/8b8d90f8d63e45ce990aead6166bcfb6
I20260620 07:01:00.519665 1169 ts_tablet_manager.cc:1939] T 8b8d90f8d63e45ce990aead6166bcfb6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:00.520800 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 209) took 1381 ms. Trace:
I20260620 07:01:00.520938 1169 rpcz_store.cc:276] 0620 07:00:59.139014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.139180 (+ 166us) service_pool.cc:227] Handling call
0620 07:01:00.434729 (+1295549us) ts_tablet_manager.cc:1145] Deleting tablet 8b8d90f8d63e45ce990aead6166bcfb6
0620 07:01:00.434739 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.515250 (+ 80511us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.518959 (+ 3709us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.520728 (+ 1769us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1295336}
I20260620 07:01:00.521517 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 210) took 1380 ms. Trace:
I20260620 07:01:00.521647 1169 rpcz_store.cc:276] 0620 07:00:59.140712 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.140820 (+ 108us) service_pool.cc:227] Handling call
0620 07:01:00.521302 (+1380482us) ts_tablet_manager.cc:1145] Deleting tablet a292d66ee14a48959c1f6a63e0a0f492
0620 07:01:00.521316 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.521440 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1380120}
I20260620 07:01:00.522081 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 211) took 1379 ms. Trace:
I20260620 07:01:00.522193 1169 rpcz_store.cc:276] 0620 07:00:59.142535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.142663 (+ 128us) service_pool.cc:227] Handling call
0620 07:01:00.521931 (+1379268us) ts_tablet_manager.cc:1145] Deleting tablet d066c73ae0104cb3be792790b1dfb93d
0620 07:01:00.521944 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.522026 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1373643}
I20260620 07:01:00.522584 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 212) took 1372 ms. Trace:
I20260620 07:01:00.522691 1169 rpcz_store.cc:276] 0620 07:00:59.149964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.151444 (+ 1480us) service_pool.cc:227] Handling call
0620 07:01:00.522429 (+1370985us) ts_tablet_manager.cc:1145] Deleting tablet 82020156f3e44a1e84a9435d1f994124
0620 07:01:00.522438 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.522516 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1370583}
I20260620 07:01:00.523111 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 214) took 1365 ms. Trace:
I20260620 07:01:00.523244 1169 rpcz_store.cc:276] 0620 07:00:59.157855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.157911 (+ 56us) service_pool.cc:227] Handling call
0620 07:01:00.522931 (+1365020us) ts_tablet_manager.cc:1145] Deleting tablet b6e36ffd69974ef897390a257f63a509
0620 07:01:00.522940 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.523055 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364339}
I20260620 07:01:00.523612 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 213) took 1367 ms. Trace:
I20260620 07:01:00.523738 1169 rpcz_store.cc:276] 0620 07:00:59.156031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.156103 (+ 72us) service_pool.cc:227] Handling call
0620 07:01:00.523460 (+1367357us) ts_tablet_manager.cc:1145] Deleting tablet f9df1d52393e47ce991b5295d03624e8
0620 07:01:00.523470 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.523554 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364090}
I20260620 07:01:00.524077 1169 tablet_replica.cc:330] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:00.524314 1169 raft_consensus.cc:2229] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:00.524537 1169 raft_consensus.cc:2258] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:00.525194 1169 ts_tablet_manager.cc:1905] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:00.529745 875 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 245) took 1200 ms. Trace:
W20260620 07:01:00.530094 831 leader_election.cc:341] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:00.535359 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:00.536703 683 leader_election.cc:341] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: fcc92630252b40a6a306c3a578fa3e59
I20260620 07:01:00.536849 683 leader_election.cc:302] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:00.537019 683 raft_consensus.cc:2670] T fcc92630252b40a6a306c3a578fa3e59 P 2b84cae646b24bc7bd424eb8434ad425: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:00.538697 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 289405cbf0784916b971b038279309d8 (table default.Table_dc7b02e7defe4ddc8c4305ecb34bb7ab [id=ca68189e4cd34f43a8fbdb53a834be16]) successfully deleted
W20260620 07:01:00.538980 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04d5d361a5404dcf99a89e93ac1f7dd8 already in progress: creating tablet
W20260620 07:01:00.539242 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 076926f7dffe4a7b80c25ea3c18e9958 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 076926f7dffe4a7b80c25ea3c18e9958 already in progress: creating tablet
I20260620 07:01:00.539716 751 raft_consensus.cc:3037] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:00.539831 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:00.540043 747 raft_consensus.cc:2454] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:00.540135 1169 ts_tablet_manager.cc:1918] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:00.540271 1169 log.cc:1196] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f90f1b2facc0415ab378fb81b60b0202
I20260620 07:01:00.540686 1169 ts_tablet_manager.cc:1939] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:00.541174 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 239) took 1089 ms. Trace:
I20260620 07:01:00.541306 1169 rpcz_store.cc:276] 0620 07:00:59.451372 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.451574 (+ 202us) service_pool.cc:227] Handling call
0620 07:01:00.523969 (+1072395us) ts_tablet_manager.cc:1145] Deleting tablet f90f1b2facc0415ab378fb81b60b0202
0620 07:01:00.523979 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.529101 (+ 5122us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.539972 (+ 10871us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.541131 (+ 1159us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1072104}
I20260620 07:01:00.541728 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 240) took 1077 ms. Trace:
I20260620 07:01:00.541844 1169 rpcz_store.cc:276] 0620 07:00:59.464208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.464306 (+ 98us) service_pool.cc:227] Handling call
0620 07:01:00.541588 (+1077282us) ts_tablet_manager.cc:1145] Deleting tablet 2ee94c1a799a47f997469f96005167dc
0620 07:01:00.541598 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.541691 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1076935}
I20260620 07:01:00.542284 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63dfade71c254d7e908e00acada93638" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:00.542605 748 raft_consensus.cc:2379] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 978f112862c64141b1009856bef3d624 in current term 1: Already voted for candidate 06a32ef63b2b495a9ade1de48c024ae9 in this term.
I20260620 07:01:00.542640 1169 tablet_replica.cc:330] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:00.542902 1169 raft_consensus.cc:2229] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:00.543053 1169 raft_consensus.cc:2258] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:00.543634 1169 ts_tablet_manager.cc:1905] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:00.544489 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54bb495eea4c49b7ad7bf2300ad0e60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.548153 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
W20260620 07:01:00.554513 1005 consensus_meta.cc:287] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent flushing consensus metadata: real 0.697s user 0.005s sys 0.000s
W20260620 07:01:00.556566 1030 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s user 0.025s sys 0.012s
I20260620 07:01:00.556598 1013 tablet_service.cc:1467] Processing CreateTablet for tablet b5c1567e0c9448dca870bd3d8502bf02 (DEFAULT_TABLE table=default.Table_064fe848c6a04392901aeeb0168f99b4 [id=4315970d1a304e3d8d41ff5b0e452ebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.558557 1169 ts_tablet_manager.cc:1918] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:00.558702 1169 log.cc:1196] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/b8799f2a2aed4688aa4e6e590dc83a4e
I20260620 07:01:00.559125 1169 ts_tablet_manager.cc:1939] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:00.560009 1169 tablet_replica.cc:330] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:00.560241 1169 raft_consensus.cc:2229] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:00.560434 1169 raft_consensus.cc:2258] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:00.560487 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe79bcf487fc4d118a91f4c62628d8a5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:00.561021 1169 ts_tablet_manager.cc:1905] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:00.561559 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95a109e7871241ec9467858dca467bbe consensus state has no leader
W20260620 07:01:00.562394 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0435678022914e6991c974e116d1a9f7 has no consensus state
I20260620 07:01:00.564322 424 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 7eddd6dab4414fdcbbbdabace754f93a
I20260620 07:01:00.564553 424 master_service.cc:946] ReplaceTablet: received request to replace tablet c38c628514c44c6fa5aff64928e515d9 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:00.565815 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:00.574930 1169 ts_tablet_manager.cc:1918] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:00.575085 1169 log.cc:1196] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/63dfade71c254d7e908e00acada93638
I20260620 07:01:00.575459 1169 ts_tablet_manager.cc:1939] T 63dfade71c254d7e908e00acada93638 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:00.571060 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_aaf29f2847544df2a6556397c39653c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.575902 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aaf29f2847544df2a6556397c39653c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.577764 1169 tablet_replica.cc:330] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:00.578001 1169 raft_consensus.cc:2229] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:00.578169 1169 pending_rounds.cc:62] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:00.571283 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_da9edc7da5e6428a9a79cda404009949"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:00.578249 1169 pending_rounds.cc:68] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7298821566566371328 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "2906fe0a195149d2844232cc8d83f6dd" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 3 new_table_name: "default.Table_06b2bcb778eb4444828c3050a4ed47ec" dest_uuid: "978f112862c64141b1009856bef3d624" new_extra_config { } }
I20260620 07:01:00.578678 1169 raft_consensus.cc:2258] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:00.578761 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da9edc7da5e6428a9a79cda404009949 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.577503 870 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 233) took 1239 ms. Trace:
I20260620 07:01:00.571895 424 master_service.cc:946] ReplaceTablet: received request to replace tablet ea6102e0da4e42cd9f1d6e294bb372b2 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:00.567520 865 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 241) took 1238 ms. Trace:
I20260620 07:01:00.547451 872 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 231) took 1163 ms. Trace:
I20260620 07:01:00.581350 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_89b9acd5b1b34e06a9040bd30c2b7f3c" } new_table_name: "default.Table_904f4a1baff64c6da846a77c48f9ee64" modify_external_catalogs: true
I20260620 07:01:00.579934 870 rpcz_store.cc:276] 0620 07:00:59.328489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.380567 (+ 52078us) service_pool.cc:227] Handling call
0620 07:00:59.407435 (+ 26868us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.407465 (+ 30us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.321463 (+913998us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.567807 (+246344us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.567967 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.582348 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:00.578024 861 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 242) took 1202 ms. Trace:
I20260620 07:01:00.573287 418 master_service.cc:946] ReplaceTablet: received request to replace tablet b8799f2a2aed4688aa4e6e590dc83a4e from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:00.583962 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a1392579a049482496f7035d9dacbb76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:00.584388 1170 tablet_bootstrap.cc:492] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:00.584543 1170 ts_tablet_manager.cc:1397] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.162s user 0.052s sys 0.048s
W20260620 07:01:00.584697 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1392579a049482496f7035d9dacbb76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.585384 1170 raft_consensus.cc:348] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.585631 1170 raft_consensus.cc:374] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:00.585714 1170 raft_consensus.cc:729] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:00.574350 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 3 got 0
I20260620 07:01:00.585952 1170 consensus_queue.cc:260] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.575196 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9201e532fd5c4a5da602ce54ccfd3d68" } new_table_name: "default.Table_1f805755212a4ca8861811107079a79b" modify_external_catalogs: true
I20260620 07:01:00.586884 1170 ts_tablet_manager.cc:1428] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:00.587306 1170 tablet_bootstrap.cc:492] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:00.569389 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 8b8d90f8d63e45ce990aead6166bcfb6 (table default.Table_26f927ce5e714da5ae118310d32e42a3 [id=2c972f7177414e16be4a7133dc2dac9d]) successfully deleted
I20260620 07:01:00.589144 1170 tablet_bootstrap.cc:654] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:00.590356 1169 ts_tablet_manager.cc:1905] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:00.590967 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a292d66ee14a48959c1f6a63e0a0f492 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a292d66ee14a48959c1f6a63e0a0f492 already in progress: creating tablet
I20260620 07:01:00.594607 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:00.595265 1033 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s user 0.007s sys 0.023s
I20260620 07:01:00.595640 1167 raft_consensus.cc:348] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.596037 1167 raft_consensus.cc:374] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:00.596163 1167 raft_consensus.cc:729] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:00.596454 1167 consensus_queue.cc:260] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.597282 1167 ts_tablet_manager.cc:1428] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.403s user 0.002s sys 0.000s
I20260620 07:01:00.597622 1167 tablet_bootstrap.cc:492] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:00.601229 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d066c73ae0104cb3be792790b1dfb93d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d066c73ae0104cb3be792790b1dfb93d already in progress: creating tablet
I20260620 07:01:00.604188 896 raft_consensus.cc:2379] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:01:00.604214 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8799f2a2aed4688aa4e6e590dc83a4e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:00.605691 1525 sys_catalog.cc:263] Verifying existing consensus state
I20260620 07:01:00.605835 872 rpcz_store.cc:276] 0620 07:00:59.328311 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.362180 (+ 33869us) service_pool.cc:227] Handling call
0620 07:00:59.382693 (+ 20513us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.382757 (+ 64us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.418132 (+1035375us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.492042 (+ 73910us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.492260 (+ 218us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:00.606557 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 82020156f3e44a1e84a9435d1f994124 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82020156f3e44a1e84a9435d1f994124 already in progress: creating tablet
W20260620 07:01:00.606884 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b6e36ffd69974ef897390a257f63a509 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6e36ffd69974ef897390a257f63a509 already in progress: creating tablet
W20260620 07:01:00.607139 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f9df1d52393e47ce991b5295d03624e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9df1d52393e47ce991b5295d03624e8 already in progress: creating tablet
I20260620 07:01:00.607499 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f90f1b2facc0415ab378fb81b60b0202 (table default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]) successfully deleted
W20260620 07:01:00.607681 999 consensus_meta.cc:287] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent flushing consensus metadata: real 0.759s user 0.003s sys 0.001s
W20260620 07:01:00.607743 1029 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s user 0.014s sys 0.027s
W20260620 07:01:00.607945 1029 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s user 0.014s sys 0.027s
I20260620 07:01:00.607806 1005 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 222) took 1226 ms. Trace:
I20260620 07:01:00.608069 999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 218) took 1307 ms. Trace:
I20260620 07:01:00.608204 999 rpcz_store.cc:276] 0620 07:00:59.301059 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.301501 (+ 442us) service_pool.cc:227] Handling call
0620 07:00:59.324272 (+ 22771us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.324337 (+ 65us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:00:59.786139 (+461802us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.607857 (+821718us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.608018 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:00.608338 1030 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s user 0.025s sys 0.012s
W20260620 07:01:00.608662 967 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.610s user 0.000s sys 0.038s
W20260620 07:01:00.608747 967 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.625s user 0.000s sys 0.038s
I20260620 07:01:00.608774 999 tablet_service.cc:1467] Processing CreateTablet for tablet 704e8aaabe6d40138b6611bdc30abf16 (DEFAULT_TABLE table=default.Table_5345217f0b8545a29bddb73746b3d846 [id=6a49cf444e3b409bbf2fc6a73764cfe6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:00.608995 1033 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s user 0.007s sys 0.023s
W20260620 07:01:00.609177 968 consensus_peers.cc:487] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a56f30ca69e45e3a9ddd41f117f61e2. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:00.608119 1005 rpcz_store.cc:276] 0620 07:00:59.333630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.385223 (+ 51593us) service_pool.cc:227] Handling call
0620 07:00:59.549875 (+164652us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.549899 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:00:59.844259 (+294360us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.555947 (+711688us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.556108 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.615531 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5c1567e0c9448dca870bd3d8502bf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.616174 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5b6c578055d4f95b44c85eba8e92ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.616134 1005 tablet_service.cc:1467] Processing CreateTablet for tablet a1c683a2169e4938b6941f83308cd392 (DEFAULT_TABLE table=default.Table_b12d35c7af0b4279880ff02a830fcdd2 [id=97b9e95433cf44f9a615d21ae24f7130]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.616518 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704e8aaabe6d40138b6611bdc30abf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.616760 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1c683a2169e4938b6941f83308cd392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.617100 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab60101b34144f85b0afd2e8c4846e48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:00.618873 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 407184us
I20260620 07:01:00.622699 861 rpcz_store.cc:276] 0620 07:00:59.329318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.866218 (+536900us) service_pool.cc:227] Handling call
0620 07:00:59.914601 (+ 48383us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.914627 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.327068 (+412441us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.531641 (+204573us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.531854 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.625674 865 rpcz_store.cc:276] 0620 07:00:59.329232 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.833148 (+503916us) service_pool.cc:227] Handling call
0620 07:00:59.833734 (+ 586us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.833758 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.343006 (+509248us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.567326 (+224320us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.567474 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.630919 870 tablet_service.cc:1514] Processing DeleteTablet for tablet 7200877be18c4eaca57df88c25d30c01 with delete_type TABLET_DATA_DELETED (replaced by tablet 4655d289c94c4bce9707be375fc4b850) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.631395 870 tablet_service.cc:1514] Processing DeleteTablet for tablet 04db48e910514d46bb4deb9acf54f7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.631708 870 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.631951 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:00.632050 870 tablet_service.cc:1514] Processing DeleteTablet for tablet c38c628514c44c6fa5aff64928e515d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.632226 896 raft_consensus.cc:2379] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:01:00.632599 1170 tablet_bootstrap.cc:492] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:00.633399 870 tablet_service.cc:1467] Processing CreateTablet for tablet cf0bae39e1634710af12de493f7f58d5 (DEFAULT_TABLE table=default.Table_7ff3385435e3457aa03dba26530f9f0b [id=c5d6638ed0bf48e1b8339e21c50f9a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.633862 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0bae39e1634710af12de493f7f58d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.634006 857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 239) took 1291 ms. Trace:
I20260620 07:01:00.634172 857 rpcz_store.cc:276] 0620 07:00:59.329041 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.824708 (+495667us) service_pool.cc:227] Handling call
0620 07:00:59.839901 (+ 15193us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.839952 (+ 51us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.448888 (+608936us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.620398 (+171510us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.620598 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.634730 857 tablet_service.cc:1467] Processing CreateTablet for tablet 4302edba0ec04d7abc2789bc7be1beca (DEFAULT_TABLE table=default.Table_4d3d2172df004ee39d7e56f81179364f [id=d553eceadb64462ba38a1e7026cb0a83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.635469 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 63dfade71c254d7e908e00acada93638 with delete_type TABLET_DATA_DELETED (replaced by tablet dac4a1434751433488eb2913b1ddfd23) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.636087 1170 ts_tablet_manager.cc:1397] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.025s
I20260620 07:01:00.636128 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:00.636231 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2ee94c1a799a47f997469f96005167dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ee94c1a799a47f997469f96005167dc already in progress: creating tablet
W20260620 07:01:00.636585 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 46689d13712842bf9145ad2bc3fc2acf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46689d13712842bf9145ad2bc3fc2acf already in progress: creating tablet
I20260620 07:01:00.635664 1169 ts_tablet_manager.cc:1918] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260620 07:01:00.636855 1169 log.cc:1196] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/2906fe0a195149d2844232cc8d83f6dd
I20260620 07:01:00.637427 1169 ts_tablet_manager.cc:1939] T 2906fe0a195149d2844232cc8d83f6dd P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:00.635880 872 tablet_service.cc:1467] Processing CreateTablet for tablet b5c1567e0c9448dca870bd3d8502bf02 (DEFAULT_TABLE table=default.Table_064fe848c6a04392901aeeb0168f99b4 [id=4315970d1a304e3d8d41ff5b0e452ebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.640314 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4302edba0ec04d7abc2789bc7be1beca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.641120 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5c1567e0c9448dca870bd3d8502bf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.642839 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f90f1b2facc0415ab378fb81b60b0202" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:00.643162 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.643900 875 rpcz_store.cc:276] 0620 07:00:59.329559 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.160252 (+830693us) service_pool.cc:227] Handling call
0620 07:01:00.182502 (+ 22250us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.182530 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.398265 (+215735us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.529498 (+131233us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.529681 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.644042 865 tablet_service.cc:1467] Processing CreateTablet for tablet 704e8aaabe6d40138b6611bdc30abf16 (DEFAULT_TABLE table=default.Table_5345217f0b8545a29bddb73746b3d846 [id=6a49cf444e3b409bbf2fc6a73764cfe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.644345 875 tablet_service.cc:1467] Processing CreateTablet for tablet a1c683a2169e4938b6941f83308cd392 (DEFAULT_TABLE table=default.Table_b12d35c7af0b4279880ff02a830fcdd2 [id=97b9e95433cf44f9a615d21ae24f7130]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.644402 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e643fb0890042ae891ea17f0bc03740" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:00.646569 799 heartbeater.cc:347] Connected to a master server at 127.0.97.60:46775
I20260620 07:01:00.646855 1525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: Bootstrap starting.
I20260620 07:01:00.650987 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704e8aaabe6d40138b6611bdc30abf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.652838 873 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 240) took 1319 ms. Trace:
W20260620 07:01:00.653187 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 9a46df2909bf43f297b412c33f18a329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a46df2909bf43f297b412c33f18a329 already in progress: creating tablet
W20260620 07:01:00.653445 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet eeb082e189304f13909d115f7197c5a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eeb082e189304f13909d115f7197c5a1 already in progress: creating tablet
I20260620 07:01:00.653640 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet b8799f2a2aed4688aa4e6e590dc83a4e (table default.Table_551c55403131424c87aee4c019ca1466 [id=fc9d4751547b40ae866b1c82804da11a]) successfully deleted
W20260620 07:01:00.653856 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7200877be18c4eaca57df88c25d30c01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7200877be18c4eaca57df88c25d30c01 already in progress: creating tablet
I20260620 07:01:00.654047 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 63dfade71c254d7e908e00acada93638 (table default.Table_c1da229c30624077a49d8112967940c7 [id=7230178ddc264a3faaa90ddc66afffd1]) successfully deleted
W20260620 07:01:00.654302 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95f9a6b2f2cb41e6b74715b2618d8a70 already in progress: creating tablet
W20260620 07:01:00.654526 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 04db48e910514d46bb4deb9acf54f7c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04db48e910514d46bb4deb9acf54f7c0 already in progress: creating tablet
W20260620 07:01:00.654704 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 already in progress: creating tablet
W20260620 07:01:00.654927 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c38c628514c44c6fa5aff64928e515d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c38c628514c44c6fa5aff64928e515d9 already in progress: creating tablet
W20260620 07:01:00.655133 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2910da33bbdb4410a4a90ff9747a7de1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2910da33bbdb4410a4a90ff9747a7de1 already in progress: creating tablet
W20260620 07:01:00.655330 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 704e8aaabe6d40138b6611bdc30abf16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 704e8aaabe6d40138b6611bdc30abf16 already in progress: creating tablet
I20260620 07:01:00.655601 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 2906fe0a195149d2844232cc8d83f6dd (table default.Table_06b2bcb778eb4444828c3050a4ed47ec [id=f12e60a2a8a341c8b574d0dc90fa315a]) successfully deleted
W20260620 07:01:00.655808 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 333eef8b98da4a279acceaead9405149 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 333eef8b98da4a279acceaead9405149 already in progress: creating tablet
W20260620 07:01:00.655985 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 261f0d97e1084e828b9562cb30ea422b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 261f0d97e1084e828b9562cb30ea422b already in progress: creating tablet
W20260620 07:01:00.656195 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet e5b6c578055d4f95b44c85eba8e92ac8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5b6c578055d4f95b44c85eba8e92ac8 already in progress: creating tablet
W20260620 07:01:00.656438 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b5e08a38c42d4e3da20292343bf085b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e08a38c42d4e3da20292343bf085b9 already in progress: creating tablet
I20260620 07:01:00.657090 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_06bc01b8cb5d447ea25fd376cc255a6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.657769 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06bc01b8cb5d447ea25fd376cc255a6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.657761 1170 raft_consensus.cc:348] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.658113 1170 raft_consensus.cc:374] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:00.658308 1170 raft_consensus.cc:729] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:00.658705 1170 consensus_queue.cc:260] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.648545 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e643fb0890042ae891ea17f0bc03740" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:00.659525 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69113a64960d4aee9a2a4fcb28570bf2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:00.660557 1170 ts_tablet_manager.cc:1428] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260620 07:01:00.660941 1170 tablet_bootstrap.cc:492] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:00.660914 681 leader_election.cc:341] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:00.661286 681 leader_election.cc:341] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:00.662034 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8f81fa4e88945f1a392fbacfd031392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.665169 1525 log.cc:824] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: Log is configured to *not* fsync() on all Append() calls
I20260620 07:01:00.666110 1170 tablet_bootstrap.cc:654] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:00.670941 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8be5f41f1d64d918b727e3eef18738e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.672436 1033 raft_consensus.cc:2454] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:00.677951 681 leader_election.cc:302] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:00.678292 1240 raft_consensus.cc:2781] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:00.678421 1240 raft_consensus.cc:482] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:00.678509 1240 raft_consensus.cc:3037] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:00.681137 1240 raft_consensus.cc:504] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.681838 1240 leader_election.cc:288] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:00.684525 683 leader_election.cc:302] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:00.684921 1240 raft_consensus.cc:2726] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:00.685364 683 leader_election.cc:302] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:00.685695 683 raft_consensus.cc:2670] T b8799f2a2aed4688aa4e6e590dc83a4e P 2b84cae646b24bc7bd424eb8434ad425: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:00.696719 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0d2790345adb48f6b1c2e10d634207e3" } modify_external_catalogs: true
I20260620 07:01:00.697002 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0d2790345adb48f6b1c2e10d634207e3" } modify_external_catalogs: true
I20260620 07:01:00.696945 995 tablet_service.cc:1467] Processing CreateTablet for tablet 6229a52adf8d4b17bdf89347e01621ed (DEFAULT_TABLE table=default.Table_cad45c9dbce34e7a98ad913944183256 [id=e4ea9f9e77f74312a2ead7c22390b268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.697597 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_48b14443dddd46969ee0299cee27e93e" } modify_external_catalogs: true
I20260620 07:01:00.697780 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_48b14443dddd46969ee0299cee27e93e" } modify_external_catalogs: true
I20260620 07:01:00.704701 1011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 226) took 1293 ms. Trace:
I20260620 07:01:00.711413 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1aeab74931f24831bafc5e0ba0dd2a6e" } modify_external_catalogs: true
I20260620 07:01:00.711666 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1aeab74931f24831bafc5e0ba0dd2a6e" } modify_external_catalogs: true
W20260620 07:01:00.712481 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8be5f41f1d64d918b727e3eef18738e consensus state has no leader
I20260620 07:01:00.712937 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c649dd8a94d74f428ec6a8c9b77288c2" } modify_external_catalogs: true
I20260620 07:01:00.713131 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c649dd8a94d74f428ec6a8c9b77288c2" } modify_external_catalogs: true
I20260620 07:01:00.713560 1240 raft_consensus.cc:482] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:00.713601 1201 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s user 0.014s sys 0.028s
W20260620 07:01:00.713722 1201 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s user 0.014s sys 0.028s
I20260620 07:01:00.713738 1240 raft_consensus.cc:504] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.714027 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:00.714272 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c11f2678559c41d3bc71d4fa04efd0ac consensus state has no leader
I20260620 07:01:00.714373 1240 leader_election.cc:288] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:00.715158 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4e3145a872348b6a85a19d1678636bc consensus state has no leader
W20260620 07:01:00.722457 681 leader_election.cc:341] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 21f51aeb329e42359cfaf7de2a039d13
I20260620 07:01:00.723560 1033 raft_consensus.cc:3037] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:00.732199 1167 tablet_bootstrap.cc:654] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:00.738701 728 tablet_service.cc:1467] Processing CreateTablet for tablet 7b781d0578834708ae64b24419959cca (DEFAULT_TABLE table=default.Table_4f595f80f7f9445f956d6e24febead0a [id=84ff58148b4f4e10b31009115fe83352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.739202 722 tablet_service.cc:1467] Processing CreateTablet for tablet 9da80903ac124d1aae937c2329f9b13e (DEFAULT_TABLE table=default.Table_ddf7eee68cd64d798dd0e8cced08b38a [id=2943ebfc86e54b75a06a5727fdcc6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.739254 734 tablet_service.cc:1467] Processing CreateTablet for tablet 6fbd069552314f2c9ee010c054386644 (DEFAULT_TABLE table=default.Table_d4b8aa362e80457697662fb3098721a3 [id=ee69fd0e35dd410b9193d36a7d7e1c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.739508 726 tablet_service.cc:1467] Processing CreateTablet for tablet 6a36a5319a044e9da7dc7b666484e257 (DEFAULT_TABLE table=default.Table_690ab28d5a40472ebf9dfa50126f6c42 [id=0b2270efe0844d8aa33eac8150145bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.739796 732 tablet_service.cc:1467] Processing CreateTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 (DEFAULT_TABLE table=default.Table_50f2cabde77d417caa731bf4e56f48c8 [id=d2b994c9f22b4fa7a068b180dc980bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.740468 730 tablet_service.cc:1467] Processing CreateTablet for tablet 0435678022914e6991c974e116d1a9f7 (DEFAULT_TABLE table=default.Table_3d3f1c18a48b4a4baa02626e6a328c14 [id=3497d9fc568f4979baf33dfdd30ce222]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.739202 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b781d0578834708ae64b24419959cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.741096 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da80903ac124d1aae937c2329f9b13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.740784 725 tablet_service.cc:1467] Processing CreateTablet for tablet 3651ef9790d342ec96f554134ae714dc (DEFAULT_TABLE table=default.Table_6d87b63c85c042d59cc7aebb8ee815f5 [id=e6ffdd91974a44eabefbcf60974613cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.741489 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3651ef9790d342ec96f554134ae714dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.745855 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fbd069552314f2c9ee010c054386644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.746189 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a36a5319a044e9da7dc7b666484e257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.738771 1011 rpcz_store.cc:276] 0620 07:00:59.411378 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.598077 (+186699us) service_pool.cc:227] Handling call
0620 07:00:59.608304 (+ 10227us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.608326 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.700846 (+1092520us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.704432 (+ 3586us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.704649 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.752043 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06fd96feb4a74b9f8d3243b7d774f388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.752197 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4302edba0ec04d7abc2789bc7be1beca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.752365 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0435678022914e6991c974e116d1a9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.753962 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0c51ecf0f006400597f0e7f776698854
I20260620 07:01:00.754729 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet da1e30385ed44c7f8b7db868f2e2bc29
I20260620 07:01:00.755399 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 35cb81ac0ebd4865b9d53259ed5787d1
I20260620 07:01:00.756093 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8cb04a2e17f3417aaf0f89f0c7f78159
I20260620 07:01:00.755898 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:00.756268 721 tablet_service.cc:1467] Processing CreateTablet for tablet 0c51ecf0f006400597f0e7f776698854 (DEFAULT_TABLE table=default.Table_48b14443dddd46969ee0299cee27e93e [id=3a5017c5c8104328b9446a42bf0354a6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:00.756762 1012 consensus_meta.cc:287] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent flushing consensus metadata: real 0.750s user 0.002s sys 0.003s
I20260620 07:01:00.757951 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c51ecf0f006400597f0e7f776698854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.773517 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.773840 723 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e30385ed44c7f8b7db868f2e2bc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:00.777753 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cb04a2e17f3417aaf0f89f0c7f78159 already in progress: creating tablet
W20260620 07:01:00.778012 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet da1e30385ed44c7f8b7db868f2e2bc29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da1e30385ed44c7f8b7db868f2e2bc29 already in progress: creating tablet
I20260620 07:01:00.779788 1170 tablet_bootstrap.cc:492] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:00.793318 425 catalog_manager.cc:5495] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:00.793857 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_dc7f658802694547b6670d0c962fe652 [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 2 got 0
I20260620 07:01:00.794219 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
I20260620 07:01:00.794426 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 62ef9a12e3684d27b6696f631c68a5af (table default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]). Expected version 1 got 0
I20260620 07:01:00.794610 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 3 got 0
I20260620 07:01:00.797451 1525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=27 overwritten=0 applied=27 ignored=0} inserts{seen=23 ignored=0} mutations{seen=20 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 07:01:00.803963 683 leader_election.cc:302] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:00.804718 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.805362 1170 ts_tablet_manager.cc:1397] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.119s user 0.018s sys 0.016s
I20260620 07:01:00.806005 1525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: Bootstrap complete.
I20260620 07:01:00.806716 1170 raft_consensus.cc:348] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.808192 1170 raft_consensus.cc:374] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:00.808298 1170 raft_consensus.cc:729] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
W20260620 07:01:00.809717 683 raft_consensus.cc:2670] T f90f1b2facc0415ab378fb81b60b0202 P 2b84cae646b24bc7bd424eb8434ad425: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:00.808629 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c51ecf0f006400597f0e7f776698854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.810693 733 tablet_service.cc:1467] Processing CreateTablet for tablet 8d2c706414684bb1bacc6f9b870fc9c1 (DEFAULT_TABLE table=default.Table_da9edc7da5e6428a9a79cda404009949 [id=7cff577663c14bf997e9091e37d1c832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.811887 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d2c706414684bb1bacc6f9b870fc9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.810708 1170 consensus_queue.cc:260] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.812656 1170 ts_tablet_manager.cc:1428] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260620 07:01:00.812793 727 tablet_service.cc:1467] Processing CreateTablet for tablet 5c083ebc2e054e09a531a8768802dcb1 (DEFAULT_TABLE table=default.Table_34297eefaa884ce0b9f16d67c2f95c14 [id=385bf04b4ae34c42a697ff301d15945d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.813370 1170 tablet_bootstrap.cc:492] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:00.814507 723 tablet_service.cc:1467] Processing CreateTablet for tablet 7294e5678ad44622a3249c1113b5e297 (DEFAULT_TABLE table=default.Table_51c799b6e1ca4b06828745a6337bdaa0 [id=15a7bd9071df42ba9ad669edd278e5f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.814806 731 tablet_service.cc:1467] Processing CreateTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 (DEFAULT_TABLE table=default.Table_a1392579a049482496f7035d9dacbb76 [id=017e06014ef0443086ed5034c5dc1a37]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:00.815199 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 35cb81ac0ebd4865b9d53259ed5787d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35cb81ac0ebd4865b9d53259ed5787d1 already in progress: creating tablet
I20260620 07:01:00.815313 724 tablet_service.cc:1467] Processing CreateTablet for tablet d53c90eff33044479838ff67dea93057 (DEFAULT_TABLE table=default.Table_7a520f90f9534374822183a6768a4d99 [id=22da0fcad0664913b2d2c6f80e9f1801]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:00.815459 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 0c51ecf0f006400597f0e7f776698854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c51ecf0f006400597f0e7f776698854 already in progress: creating tablet
I20260620 07:01:00.816663 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c083ebc2e054e09a531a8768802dcb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.818380 722 tablet_service.cc:1467] Processing CreateTablet for tablet 390a327225344afda3076c341202cc1d (DEFAULT_TABLE table=default.Table_c3468f43caff46b1903034e2d5a4279f [id=d7198485f2104c2092955ef5305900cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.822913 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 390a327225344afda3076c341202cc1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.823405 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7294e5678ad44622a3249c1113b5e297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.824977 728 tablet_service.cc:1467] Processing CreateTablet for tablet c9d344f9e4b444e4b6018fdf0cf762fd (DEFAULT_TABLE table=default.Table_f9c3eac07b6040a280cd24392454206b [id=9010989df9a341b986e65d49b59a5cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.826761 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6bdcd8cd2574acf867b7ec487559db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.762136 1078 heartbeater.cc:347] Connected to a master server at 127.0.97.60:46775
I20260620 07:01:00.762358 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6229a52adf8d4b17bdf89347e01621ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.771183 1333 raft_consensus.cc:482] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:00.771360 1012 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 228) took 1209 ms. Trace:
I20260620 07:01:00.774837 969 leader_election.cc:302] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:00.792701 1033 raft_consensus.cc:2454] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:00.776391 1263 consensus_queue.cc:1035] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
I20260620 07:01:00.772435 1029 raft_consensus.cc:1261] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Refusing update from remote peer 2b84cae646b24bc7bd424eb8434ad425: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:01:00.829854 681 leader_election.cc:302] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:00.826637 720 tablet_service.cc:1467] Processing CreateTablet for tablet 3eda988492234d6aaeaee87f84f99d06 (DEFAULT_TABLE table=default.Table_06bc01b8cb5d447ea25fd376cc255a6d [id=188e640d71fa4d34ba29242cb1198020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.762036 1011 tablet_service.cc:1467] Processing CreateTablet for tablet cd75e318982a4fb9bf28cb35b030642f (DEFAULT_TABLE table=default.Table_7d53dfa17a784fa08192e52f450ee287 [id=5af5baece18749bdbccb48b3a793fbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.830528 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d53c90eff33044479838ff67dea93057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.792727 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 58a4f3b5450948768c8db382d200cc19 (DEFAULT_TABLE table=default.Table_cd9d406b4ab84e899550e53fce092e5f [id=3852c2f12adc4283b184a70b473d3260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.834955 1012 rpcz_store.cc:276] 0620 07:00:59.547929 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.602148 (+ 54219us) service_pool.cc:227] Handling call
0620 07:00:59.631026 (+ 28878us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.631052 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.000074 (+369022us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.756953 (+756879us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.757125 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.835498 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 333eef8b98da4a279acceaead9405149 (DEFAULT_TABLE table=default.Table_e032d39a4bb74ed18c922fb3ba622d07 [id=1135222d9b5f4d14bb527056194a68cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.833664 1078 heartbeater.cc:503] Master 127.0.97.60:46775 was elected leader, sending a full tablet report...
I20260620 07:01:00.838362 1201 raft_consensus.cc:2741] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260620 07:01:00.839419 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9d344f9e4b444e4b6018fdf0cf762fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.841857 734 tablet_service.cc:1467] Processing CreateTablet for tablet 033c8b817757441ea7ebc2dbf77aa2dd (DEFAULT_TABLE table=default.Table_1099ae03924f4f4b95324ddaac35f9cf [id=a7528a9274144f0ebbcd1efa102a2a1b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:00.843097 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 72467.1us
I20260620 07:01:00.841229 1333 raft_consensus.cc:504] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.847478 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
I20260620 07:01:00.849412 1240 raft_consensus.cc:2781] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:00.838071 1525 raft_consensus.cc:348] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:01:00.804935 997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 225) took 1423 ms. Trace:
I20260620 07:01:00.797477 996 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 229) took 1247 ms. Trace:
I20260620 07:01:00.839095 1001 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 227) took 1295 ms. Trace:
I20260620 07:01:00.860105 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_53068d3c2f9c41c3847aca8716b94221" } new_table_name: "default.Table_61fb27a9ecc44d718bdfa4051514a36a" modify_external_catalogs: true
I20260620 07:01:00.861649 1333 leader_election.cc:288] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:00.861833 1201 consensus_queue.cc:1035] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260620 07:01:00.756273 896 raft_consensus.cc:2454] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:00.867956 861 tablet_service.cc:1467] Processing CreateTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 (DEFAULT_TABLE table=default.Table_877047b74134494489f2e58811a97682 [id=55c4c9a5f69b4cf7bb05ce4157f8a5e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.868396 876 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 244) took 1349 ms. Trace:
I20260620 07:01:00.868927 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_228578e017344fbfb4d357cfbeaf6ea8" } new_table_name: "default.Table_52bd8cf613ad458b8436906e69e4cbd8" modify_external_catalogs: true
I20260620 07:01:00.871094 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ea9e545f34d741778517df5391bca063"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.871726 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea9e545f34d741778517df5391bca063 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.871632 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_49d850227cc94454b2919e6c54793f35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.872093 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49d850227cc94454b2919e6c54793f35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:00.874378 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95a109e7871241ec9467858dca467bbe consensus state has no leader
I20260620 07:01:00.756273 871 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 198) took 1765 ms. Trace:
I20260620 07:01:00.864960 867 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 243) took 1314 ms. Trace:
I20260620 07:01:00.874993 831 leader_election.cc:302] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:00.877239 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1016b85ff6404fc0aff750ab23813534" } modify_external_catalogs: true
I20260620 07:01:00.877472 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1016b85ff6404fc0aff750ab23813534" } modify_external_catalogs: true
I20260620 07:01:00.879768 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7a5303b56656451abf7fe7036ad961f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.880865 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a5303b56656451abf7fe7036ad961f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.884092 1539 raft_consensus.cc:2781] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:00.884135 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69113a64960d4aee9a2a4fcb28570bf2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:00.874806 874 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 253) took 1013 ms. Trace:
I20260620 07:01:00.885843 871 rpcz_store.cc:276] 0620 07:00:58.877544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.879429 (+ 1885us) service_pool.cc:227] Handling call
0620 07:00:59.081286 (+201857us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.081311 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.415667 (+1334356us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.627466 (+211799us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.642545 (+ 15079us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.886132 867 rpcz_store.cc:276] 0620 07:00:59.329379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.867989 (+538610us) service_pool.cc:227] Handling call
0620 07:00:59.914978 (+ 46989us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.914995 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.390376 (+475381us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.643775 (+253399us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.643895 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:00.889083 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f690e150839a4d23860932712f61e7c8 consensus state has no leader
I20260620 07:01:00.851105 1525 raft_consensus.cc:729] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f32c3995c70946c38ce1a3094aaaffb1, State: Initialized, Role: FOLLOWER
I20260620 07:01:00.891716 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_890aba75c15e4e5990b4c0cae43dd28e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.892378 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_890aba75c15e4e5990b4c0cae43dd28e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.892334 1525 consensus_queue.cc:260] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 27, Last appended: 2.27, Last appended by leader: 27, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:01:00.893137 876 rpcz_store.cc:276] 0620 07:00:59.329470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.906430 (+576960us) service_pool.cc:227] Handling call
0620 07:00:59.929613 (+ 23183us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.929645 (+ 32us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.463275 (+533630us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.678367 (+215092us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.678552 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.893757 876 tablet_service.cc:1467] Processing CreateTablet for tablet cd75e318982a4fb9bf28cb35b030642f (DEFAULT_TABLE table=default.Table_7d53dfa17a784fa08192e52f450ee287 [id=5af5baece18749bdbccb48b3a793fbe9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:00.894025 831 consensus_peers.cc:487] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:00.894671 873 rpcz_store.cc:276] 0620 07:00:59.329155 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.827417 (+498262us) service_pool.cc:227] Handling call
0620 07:00:59.853046 (+ 25629us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.853076 (+ 30us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.403835 (+550759us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.648388 (+244553us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.648518 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.895406 1470 consensus_queue.cc:1035] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260620 07:01:00.896528 867 tablet_service.cc:1467] Processing CreateTablet for tablet f793a91ab247408bbe4a9f7cb370fffe (DEFAULT_TABLE table=default.Table_6f694d1dc105473b93ba18dc487d0d55 [id=4a2d8361d2404c1eb6710cc8f5190708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.850574 1170 tablet_bootstrap.cc:654] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:00.854223 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83451bba9a3c4c209dddf4250fea8806" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:00.897342 751 raft_consensus.cc:2454] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:00.852787 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3eda988492234d6aaeaee87f84f99d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.898175 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 033c8b817757441ea7ebc2dbf77aa2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.899014 873 tablet_service.cc:1467] Processing CreateTablet for tablet 58a4f3b5450948768c8db382d200cc19 (DEFAULT_TABLE table=default.Table_cd9d406b4ab84e899550e53fce092e5f [id=3852c2f12adc4283b184a70b473d3260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.884991 862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 246) took 1069 ms. Trace:
W20260620 07:01:00.850390 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 74711.3us
I20260620 07:01:00.905723 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_128623186307486c86826727c2978537"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.906440 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_128623186307486c86826727c2978537 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.906831 874 rpcz_store.cc:276] 0620 07:00:59.852191 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.297768 (+445577us) service_pool.cc:227] Handling call
0620 07:01:00.333222 (+ 35454us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.333246 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.614758 (+281512us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.679137 (+ 64379us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.865460 (+186323us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18145}
I20260620 07:01:00.912422 871 tablet_service.cc:1467] Processing CreateTablet for tablet 6229a52adf8d4b17bdf89347e01621ed (DEFAULT_TABLE table=default.Table_cad45c9dbce34e7a98ad913944183256 [id=e4ea9f9e77f74312a2ead7c22390b268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.913582 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c2e38178b9244152915d4c0a9dcf59dc
I20260620 07:01:00.916213 862 rpcz_store.cc:276] 0620 07:00:59.580894 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.183324 (+602430us) service_pool.cc:227] Handling call
0620 07:01:00.293692 (+110368us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.293750 (+ 58us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.594330 (+300580us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.649647 (+ 55317us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.649771 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.917069 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d6954c46581045c4baef6b4145f331a3" } new_table_name: "default.Table_324f5669c94c4bb3a55c0e0848c983a3" modify_external_catalogs: true
I20260620 07:01:00.920508 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f0ce8fdcfe2e4b7ab9659cfbb3fdf49b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.921267 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0ce8fdcfe2e4b7ab9659cfbb3fdf49b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.922398 862 tablet_service.cc:1467] Processing CreateTablet for tablet dac4a1434751433488eb2913b1ddfd23 (DEFAULT_TABLE table=default.Table_c1da229c30624077a49d8112967940c7 [id=7230178ddc264a3faaa90ddc66afffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.924531 874 tablet_service.cc:1467] Processing CreateTablet for tablet 333eef8b98da4a279acceaead9405149 (DEFAULT_TABLE table=default.Table_e032d39a4bb74ed18c922fb3ba622d07 [id=1135222d9b5f4d14bb527056194a68cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.926445 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d66e26edeccc4a138950de609d6c107f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.927238 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d66e26edeccc4a138950de609d6c107f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.930452 868 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 250) took 1098 ms. Trace:
I20260620 07:01:00.931890 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_34297eefaa884ce0b9f16d67c2f95c14" } new_table_name: "default.Table_47d31a0327544bb19e95144d24753b08" modify_external_catalogs: true
I20260620 07:01:00.937225 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5d2a4e7b8377498685861a195b5c2401"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.937999 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d2a4e7b8377498685861a195b5c2401 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:00.938583 683 leader_election.cc:341] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:00.939652 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_51a5ad47a8104b21839dba3fcd13be8e" } new_table_name: "default.Table_539855f37f7542ab94467c452b14b6e7" modify_external_catalogs: true
I20260620 07:01:00.942744 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9e2f2ecd97ee48f89579302e371615a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.943286 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e2f2ecd97ee48f89579302e371615a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.945756 683 leader_election.cc:302] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:00.941367 721 tablet_service.cc:1467] Processing CreateTablet for tablet 302adda3630e44289d371de591061692 (DEFAULT_TABLE table=default.Table_aaf29f2847544df2a6556397c39653c9 [id=92e4f74224ab4135982722f846eb9e73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.947717 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 302adda3630e44289d371de591061692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:00.949692 723 tablet_service.cc:1514] Processing DeleteTablet for tablet c2e38178b9244152915d4c0a9dcf59dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:00.943542 868 rpcz_store.cc:276] 0620 07:00:59.831582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.286927 (+455345us) service_pool.cc:227] Handling call
0620 07:01:00.338030 (+ 51103us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.338055 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.470084 (+132029us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.890223 (+420139us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.930410 (+ 40187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.950811 868 tablet_service.cc:1467] Processing CreateTablet for tablet 4655d289c94c4bce9707be375fc4b850 (DEFAULT_TABLE table=default.Table_4b0078a40169404eb33b169cdb5f08df [id=8f652552eba04d87aad349983184c524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.950938 859 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 255) took 1032 ms. Trace:
I20260620 07:01:00.951552 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_106ca3379ea3425d9151703d76671d6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:00.952266 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_106ca3379ea3425d9151703d76671d6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:00.953444 859 rpcz_store.cc:276] 0620 07:00:59.899074 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.339694 (+440620us) service_pool.cc:227] Handling call
0620 07:01:00.340260 (+ 566us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.340287 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.436048 (+ 95761us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.924408 (+488360us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.931478 (+ 7070us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.957515 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 333eef8b98da4a279acceaead9405149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.957836 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 704e8aaabe6d40138b6611bdc30abf16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:00.963351 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c2e38178b9244152915d4c0a9dcf59dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2e38178b9244152915d4c0a9dcf59dc already in progress: creating tablet
I20260620 07:01:00.965237 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 2910da33bbdb4410a4a90ff9747a7de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.965638 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 2906fe0a195149d2844232cc8d83f6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:00.971002 1547 consensus_queue.cc:1035] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:00.971644 859 tablet_service.cc:1467] Processing CreateTablet for tablet a9e70b585def4a4a9081a0938af8ce5b (DEFAULT_TABLE table=default.Table_b829d1b373034423ae5025caa27ff52f [id=a876d134592d456ea2e7b8336037020f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:00.971938 1547 raft_consensus.cc:482] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:00.972189 1547 raft_consensus.cc:504] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.972911 1170 tablet_bootstrap.cc:492] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:00.973088 1170 ts_tablet_manager.cc:1397] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.160s user 0.012s sys 0.011s
W20260620 07:01:00.974164 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9d4ef3ba51e432f889fb927a6af8b49 consensus state has no leader
I20260620 07:01:00.975880 1170 raft_consensus.cc:348] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.976732 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2411c7dd68274c07a75cd0b3ae3e2d32" } modify_external_catalogs: true
I20260620 07:01:00.977419 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2411c7dd68274c07a75cd0b3ae3e2d32" } modify_external_catalogs: true
W20260620 07:01:00.969064 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 135962us
I20260620 07:01:00.978582 1170 raft_consensus.cc:374] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:00.978983 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8e6e4c363d6f44828436c4fca5227174" } modify_external_catalogs: true
I20260620 07:01:00.976789 1240 raft_consensus.cc:686] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:00.979212 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8e6e4c363d6f44828436c4fca5227174" } modify_external_catalogs: true
I20260620 07:01:00.974089 1552 raft_consensus.cc:2726] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:00.973039 1547 leader_election.cc:288] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:00.979151 1170 raft_consensus.cc:729] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:00.979660 1240 consensus_queue.cc:237] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.981837 1170 consensus_queue.cc:260] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:00.982036 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_833694b1c9684acb97bca68ebefecb45" } modify_external_catalogs: true
I20260620 07:01:00.982259 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_833694b1c9684acb97bca68ebefecb45" } modify_external_catalogs: true
I20260620 07:01:00.983814 1170 ts_tablet_manager.cc:1428] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260620 07:01:00.986027 1170 tablet_bootstrap.cc:492] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:00.988829 1170 tablet_bootstrap.cc:654] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:00.989351 1165 ts_tablet_manager.cc:1918] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260620 07:01:00.990895 413 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 34dc2af503684aaba8388a4611fab48e (table default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 34dc2af503684aaba8388a4611fab48e consensus state has no leader
I20260620 07:01:00.995267 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_659d4f17a45b47f5a065e40e30ab00b7" } modify_external_catalogs: true
I20260620 07:01:00.995572 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_659d4f17a45b47f5a065e40e30ab00b7" } modify_external_catalogs: true
I20260620 07:01:00.995101 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1c683a2169e4938b6941f83308cd392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.009451 1170 tablet_bootstrap.cc:492] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:01.009675 1170 ts_tablet_manager.cc:1397] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.003s
I20260620 07:01:01.010367 1525 sys_catalog.cc:564] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 07:01:01.010685 1170 raft_consensus.cc:348] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.011188 1170 raft_consensus.cc:374] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:01.011298 1170 raft_consensus.cc:729] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:01.011637 1170 consensus_queue.cc:260] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.012485 1170 ts_tablet_manager.cc:1428] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 07:01:01.012867 1170 tablet_bootstrap.cc:492] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:01.016928 997 rpcz_store.cc:276] 0620 07:00:59.372573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.536946 (+164373us) service_pool.cc:227] Handling call
0620 07:00:59.801472 (+264526us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.801499 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.629553 (+828054us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.795514 (+165961us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.795654 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.018253 1001 rpcz_store.cc:276] 0620 07:00:59.528898 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.598230 (+ 69332us) service_pool.cc:227] Handling call
0620 07:00:59.631380 (+ 33150us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.631397 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.670976 (+1039579us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.824203 (+153227us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.824452 (+ 249us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:00.842844 994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 233) took 1204 ms. Trace:
I20260620 07:01:01.010020 1553 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:01:01.019465 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63dfade71c254d7e908e00acada93638" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:01.019537 1553 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:01:01.019721 997 tablet_service.cc:1467] Processing CreateTablet for tablet dac4a1434751433488eb2913b1ddfd23 (DEFAULT_TABLE table=default.Table_c1da229c30624077a49d8112967940c7 [id=7230178ddc264a3faaa90ddc66afffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.019107 1170 tablet_bootstrap.cc:654] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:01.019860 1002 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 221) took 1532 ms. Trace:
I20260620 07:01:01.023016 1333 raft_consensus.cc:482] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:00.862296 1496 consensus_queue.cc:1035] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.177s
I20260620 07:01:01.023204 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610a25c729cf41b4bd71372bc36365a8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:01.018142 998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 239) took 1211 ms. Trace:
I20260620 07:01:01.024191 998 rpcz_store.cc:276] 0620 07:00:59.631339 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.758070 (+126731us) service_pool.cc:227] Handling call
0620 07:00:59.807689 (+ 49619us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.807738 (+ 49us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.813642 (+1005904us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.842420 (+ 28778us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.842589 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:01.034736 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c083ebc2e054e09a531a8768802dcb1 consensus state has no leader
I20260620 07:01:01.041189 1000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 240) took 1225 ms. Trace:
I20260620 07:01:01.041488 1000 rpcz_store.cc:276] 0620 07:00:59.631451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.766150 (+134699us) service_pool.cc:227] Handling call
0620 07:00:59.896671 (+130521us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.896698 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.728828 (+832130us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.856640 (+127812us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.856809 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.041846 721 tablet_service.cc:1467] Processing CreateTablet for tablet e6bae5090f81417cbcf4b4d598b438da (DEFAULT_TABLE table=default.Table_ea9e545f34d741778517df5391bca063 [id=e872cbca26c7448ea0b1e65fd692f96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.042624 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6bae5090f81417cbcf4b4d598b438da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.043658 968 leader_election.cc:302] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:01.043809 734 tablet_service.cc:1467] Processing CreateTablet for tablet 2bc3dd1306af4e49a9fec197b5740374 (DEFAULT_TABLE table=default.Table_49d850227cc94454b2919e6c54793f35 [id=501af04cab4f4a0da5d8396e8f629397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.044414 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bc3dd1306af4e49a9fec197b5740374. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:01.044538 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 69337.9us
I20260620 07:01:01.045274 996 rpcz_store.cc:276] 0620 07:00:59.549831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.603989 (+ 54158us) service_pool.cc:227] Handling call
0620 07:00:59.617005 (+ 13016us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.617049 (+ 44us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.698175 (+1081126us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.797317 (+ 99142us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.797442 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.045585 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 2910da33bbdb4410a4a90ff9747a7de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:01.046226 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 2906fe0a195149d2844232cc8d83f6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:01.046634 996 tablet_service.cc:1467] Processing CreateTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e (DEFAULT_TABLE table=default.Table_d980ceff63f447adbc0aaf600b24f40e [id=ea3947fe0a794502a317ef69c47c0444]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:01.050395 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fc63351f767447c99b819fe7848d381 consensus state has no leader
I20260620 07:01:01.052196 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd75e318982a4fb9bf28cb35b030642f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.053465 1010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 242) took 1269 ms. Trace:
I20260620 07:01:01.058266 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 4655d289c94c4bce9707be375fc4b850 (DEFAULT_TABLE table=default.Table_4b0078a40169404eb33b169cdb5f08df [id=8f652552eba04d87aad349983184c524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.058256 1002 rpcz_store.cc:276] 0620 07:00:59.325002 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.325098 (+ 96us) service_pool.cc:227] Handling call
0620 07:00:59.331165 (+ 6067us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.331192 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.802074 (+1470882us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.846642 (+ 44568us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.857074 (+ 10432us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.059484 1333 raft_consensus.cc:504] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.060206 1333 leader_election.cc:288] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:01.061458 1029 raft_consensus.cc:2379] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 978f112862c64141b1009856bef3d624 in current term 1: Already voted for candidate 2b84cae646b24bc7bd424eb8434ad425 in this term.
I20260620 07:01:01.062515 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 333eef8b98da4a279acceaead9405149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:01.063733 1446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 2 FOLLOWER]: Advancing to term 3
I20260620 07:01:01.065809 1170 tablet_bootstrap.cc:492] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:01.065243 998 tablet_service.cc:1467] Processing CreateTablet for tablet b6e2c297072741eb927dff9bcf6a573f (DEFAULT_TABLE table=default.Table_323e0a217ebf4aad8ef0137a7599dd92 [id=d1ba4ce259044c45a86b285abab7b5ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.065405 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 95a109e7871241ec9467858dca467bbe (DEFAULT_TABLE table=default.Table_a14863df3baa41daa0a80ae9da10cf0a [id=2f50ee8c71f8435aad169b0637348a30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.077615 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9b2f0c28057b4534a8a400d1ca7f3991
W20260620 07:01:01.080060 968 consensus_peers.cc:487] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63dfade71c254d7e908e00acada93638. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:01.079972 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2f0c28057b4534a8a400d1ca7f3991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.080636 1496 raft_consensus.cc:2781] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:01.080778 1496 raft_consensus.cc:482] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:01.080762 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17590c6a1a96414f84632a8b0e0a795b" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:01.080892 1496 raft_consensus.cc:3037] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:01.081489 968 leader_election.cc:341] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:01.081807 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 9b2f0c28057b4534a8a400d1ca7f3991 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b2f0c28057b4534a8a400d1ca7f3991 already in progress: creating tablet
I20260620 07:01:01.081809 1170 ts_tablet_manager.cc:1397] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.004s
I20260620 07:01:01.083884 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dc7f658802694547b6670d0c962fe652" } new_table_name: "default.Table_1e9b65d54a164a3f811eb9afb9c090ff" modify_external_catalogs: true
I20260620 07:01:01.085227 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83451bba9a3c4c209dddf4250fea8806" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:01.085196 994 rpcz_store.cc:276] 0620 07:00:59.618324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.628698 (+ 10374us) service_pool.cc:227] Handling call
0620 07:00:59.718849 (+ 90151us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.718878 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.718442 (+999564us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.815561 (+ 97119us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.823153 (+ 7592us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.085826 994 tablet_service.cc:1467] Processing CreateTablet for tablet a9e70b585def4a4a9081a0938af8ce5b (DEFAULT_TABLE table=default.Table_b829d1b373034423ae5025caa27ff52f [id=a876d134592d456ea2e7b8336037020f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.084841 1496 raft_consensus.cc:504] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.086764 1033 raft_consensus.cc:2379] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 06a32ef63b2b495a9ade1de48c024ae9 in this term.
I20260620 07:01:01.087514 1496 leader_election.cc:288] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:01.087852 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83451bba9a3c4c209dddf4250fea8806" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:01.087909 1010 rpcz_store.cc:276] 0620 07:00:59.783956 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.826404 (+ 42448us) service_pool.cc:227] Handling call
0620 07:00:59.872248 (+ 45844us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.872271 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.779857 (+907586us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.053277 (+273420us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.053432 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.088083 751 raft_consensus.cc:3037] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:01.088229 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 261f0d97e1084e828b9562cb30ea422b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:01.088435 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b6c578055d4f95b44c85eba8e92ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:01.088590 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e08a38c42d4e3da20292343bf085b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:01.088975 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 88c6aeea7c504f36964e8bf41b0fc4f9 (DEFAULT_TABLE table=default.Table_b0ba90ad7d404eefaffdd72e2bbd6645 [id=b6dc41e1ec4b4b8c9aa8583c725fa886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.089352 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0c41bf6a8a448ad809292d66ebf9c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.091217 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95a109e7871241ec9467858dca467bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.094705 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e2c297072741eb927dff9bcf6a573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.095103 751 raft_consensus.cc:2454] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:01.095752 968 leader_election.cc:302] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:01.096204 1496 raft_consensus.cc:2781] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:01.096501 1496 raft_consensus.cc:686] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:01.096803 1496 consensus_queue.cc:237] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.098047 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 333eef8b98da4a279acceaead9405149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.099967 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d4b8aa362e80457697662fb3098721a3" } new_table_name: "default.Table_6b7421166e034804801bd91c1a520a3d" modify_external_catalogs: true
I20260620 07:01:01.102344 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_efed404b281b40a9b74f079c46716d6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.103181 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efed404b281b40a9b74f079c46716d6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.104051 1170 raft_consensus.cc:348] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.104313 1170 raft_consensus.cc:374] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:01.104408 1170 raft_consensus.cc:729] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:01.104635 1170 consensus_queue.cc:260] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.105301 1170 ts_tablet_manager.cc:1428] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.022s user 0.000s sys 0.000s
I20260620 07:01:01.105211 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1e18ab4a35f347abb061df0a7db49226"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:01.105593 1170 tablet_bootstrap.cc:492] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:01.101872 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a9daee42d5c748ceaed7dc94f551c0d1
W20260620 07:01:01.107450 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e18ab4a35f347abb061df0a7db49226 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:01.107967 864 consensus_meta.cc:287] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: Time spent flushing consensus metadata: real 0.513s user 0.002s sys 0.000s
I20260620 07:01:01.109915 721 tablet_service.cc:1514] Processing DeleteTablet for tablet a9daee42d5c748ceaed7dc94f551c0d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.115936 1240 raft_consensus.cc:482] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:01.116146 1240 raft_consensus.cc:504] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.116848 1240 leader_election.cc:288] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:01.117674 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a9daee42d5c748ceaed7dc94f551c0d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9daee42d5c748ceaed7dc94f551c0d1 already in progress: creating tablet
I20260620 07:01:00.996690 858 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 254) took 1106 ms. Trace:
I20260620 07:01:01.119601 1165 log.cc:1196] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/8a56f30ca69e45e3a9ddd41f117f61e2
I20260620 07:01:01.120328 1165 ts_tablet_manager.cc:1939] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:01.120549 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 333eef8b98da4a279acceaead9405149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.125151 1170 tablet_bootstrap.cc:654] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:00.884244 1539 raft_consensus.cc:482] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:01.128041 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dac4a1434751433488eb2913b1ddfd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.128393 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9e8cd4ec5619416a8983e1bc1b6b6a09
I20260620 07:01:01.129434 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7d53dfa17a784fa08192e52f450ee287" } modify_external_catalogs: true
I20260620 07:01:01.129662 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7d53dfa17a784fa08192e52f450ee287" } modify_external_catalogs: true
I20260620 07:01:01.132483 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b5014cf5cc70466bafb6921c9d46ba72
I20260620 07:01:01.135876 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.137574 721 tablet_service.cc:1514] Processing DeleteTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:01.146051 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 already in progress: creating tablet
W20260620 07:01:01.149160 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b5014cf5cc70466bafb6921c9d46ba72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5014cf5cc70466bafb6921c9d46ba72 already in progress: creating tablet
I20260620 07:01:01.150867 1170 tablet_bootstrap.cc:492] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:01.153470 1170 ts_tablet_manager.cc:1397] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.003s
I20260620 07:01:01.160764 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dac4a1434751433488eb2913b1ddfd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.162233 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 3456cf91d65a4413a35efe94513c723d (DEFAULT_TABLE table=default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9 [id=24e00ed0d7994f1cbebd87b708274b55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.162885 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3456cf91d65a4413a35efe94513c723d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.163774 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8e736cf278274ffc858ff174e1567e0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.164368 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e736cf278274ffc858ff174e1567e0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.167860 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 704e8aaabe6d40138b6611bdc30abf16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:01.168236 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fa5e48ba0ba24f30a0212db6021bc618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.168794 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa5e48ba0ba24f30a0212db6021bc618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:01.172823 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6fbd069552314f2c9ee010c054386644 consensus state has no leader
I20260620 07:01:01.181661 1170 raft_consensus.cc:348] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.182421 1170 raft_consensus.cc:374] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:01.182615 1170 raft_consensus.cc:729] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:01.183076 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7a5303b56656451abf7fe7036ad961f9" } new_table_name: "default.Table_c0c512543c584906a978970ff6a532dc" modify_external_catalogs: true
I20260620 07:01:01.183885 1170 consensus_queue.cc:260] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.184625 1170 ts_tablet_manager.cc:1428] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.030s user 0.000s sys 0.002s
I20260620 07:01:01.185061 1170 tablet_bootstrap.cc:492] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:01.185823 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ded62bf712ad4611be190bac322171a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.186124 863 consensus_meta.cc:287] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: Time spent flushing consensus metadata: real 0.519s user 0.007s sys 0.000s
W20260620 07:01:01.186642 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ded62bf712ad4611be190bac322171a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.187417 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6229a52adf8d4b17bdf89347e01621ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.187638 1170 tablet_bootstrap.cc:654] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:01.190299 729 consensus_meta.cc:287] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent flushing consensus metadata: real 0.675s user 0.000s sys 0.003s
I20260620 07:01:01.193037 1166 ts_tablet_manager.cc:1918] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:01.195549 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58a4f3b5450948768c8db382d200cc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.203950 1170 tablet_bootstrap.cc:492] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:01.205799 1170 ts_tablet_manager.cc:1397] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.003s
I20260620 07:01:01.207850 1170 raft_consensus.cc:348] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.209060 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_74f679a388334846998550d74680bff4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.209960 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74f679a388334846998550d74680bff4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.211903 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b16e5dbf81bc4141936830a4dc9b06fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.212625 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b16e5dbf81bc4141936830a4dc9b06fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.212416 1170 raft_consensus.cc:374] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:01.213449 1170 raft_consensus.cc:729] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:01.215816 1170 consensus_queue.cc:260] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.220167 863 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 252) took 1348 ms. Trace:
I20260620 07:01:01.220955 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 181) took 2419 ms. Trace:
I20260620 07:01:01.222558 1170 ts_tablet_manager.cc:1428] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260620 07:01:01.223556 860 tablet_service.cc:1467] Processing CreateTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e (DEFAULT_TABLE table=default.Table_d980ceff63f447adbc0aaf600b24f40e [id=ea3947fe0a794502a317ef69c47c0444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.225226 1170 tablet_bootstrap.cc:492] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:01.228088 748 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.679s user 0.000s sys 0.010s
W20260620 07:01:01.228313 748 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.679s user 0.000s sys 0.010s
I20260620 07:01:01.228441 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet cd75e318982a4fb9bf28cb35b030642f
I20260620 07:01:01.231475 729 tablet_service.cc:1514] Processing DeleteTablet for tablet cd75e318982a4fb9bf28cb35b030642f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.237396 1240 raft_consensus.cc:482] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:01.237566 1240 raft_consensus.cc:504] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.238230 1240 leader_election.cc:288] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:01.239733 872 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 267) took 1088 ms. Trace:
W20260620 07:01:01.241449 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet cd75e318982a4fb9bf28cb35b030642f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd75e318982a4fb9bf28cb35b030642f already in progress: creating tablet
I20260620 07:01:01.243196 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58a4f3b5450948768c8db382d200cc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.246744 1170 tablet_bootstrap.cc:654] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:01.248714 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3d3f1c18a48b4a4baa02626e6a328c14" } new_table_name: "default.Table_75ab289e7312420ab8ab0523df0aa16e" modify_external_catalogs: true
I20260620 07:01:01.249576 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d5d361a5404dcf99a89e93ac1f7dd8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:01.252137 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5ddbd67fa9074a4b817bbe12a7725343"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.252543 681 leader_election.cc:341] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:01.252928 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ddbd67fa9074a4b817bbe12a7725343 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.253029 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0bae39e1634710af12de493f7f58d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.250835 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 (DEFAULT_TABLE table=default.Table_1aeab74931f24831bafc5e0ba0dd2a6e [id=1217f9b44b2f484d86191921e496bd0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.259799 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2de23d7d170247068bfba22c795a5c56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.260645 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2de23d7d170247068bfba22c795a5c56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.262610 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4f595f80f7f9445f956d6e24febead0a" } new_table_name: "default.Table_6d1419cac1c54567a909e7a7b5bc2ff0" modify_external_catalogs: true
W20260620 07:01:01.274581 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 370454us
I20260620 07:01:01.276172 1170 tablet_bootstrap.cc:492] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:01.279868 1170 ts_tablet_manager.cc:1397] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.006s
I20260620 07:01:01.280829 1170 raft_consensus.cc:348] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.281148 1170 raft_consensus.cc:374] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:01.281272 1170 raft_consensus.cc:729] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:01.283361 1170 consensus_queue.cc:260] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.284490 1170 ts_tablet_manager.cc:1428] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:01.286237 1170 tablet_bootstrap.cc:492] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:01.288208 1170 tablet_bootstrap.cc:654] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:01.290014 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 125e8a5e20bf484cade408f0358489a1 has no consensus state
I20260620 07:01:01.292833 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ed11da599e5c4b44b63531233e52da80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.293644 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed11da599e5c4b44b63531233e52da80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.298174 1170 tablet_bootstrap.cc:492] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:01.298944 1170 ts_tablet_manager.cc:1397] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260620 07:01:01.300027 1170 raft_consensus.cc:348] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.301319 1170 raft_consensus.cc:374] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:01.301601 1170 raft_consensus.cc:729] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:01.302084 1170 consensus_queue.cc:260] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.302608 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7200877be18c4eaca57df88c25d30c01" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:01.303288 1170 ts_tablet_manager.cc:1428] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:01:01.311084 1539 raft_consensus.cc:3037] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:01.311635 863 rpcz_store.cc:276] 0620 07:00:59.838404 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.292369 (+453965us) service_pool.cc:227] Handling call
0620 07:01:00.332602 (+ 40233us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.332634 (+ 32us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.497365 (+164731us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.186291 (+688926us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.186454 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.312419 863 tablet_service.cc:1467] Processing CreateTablet for tablet 3456cf91d65a4413a35efe94513c723d (DEFAULT_TABLE table=default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9 [id=24e00ed0d7994f1cbebd87b708274b55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.242987 1165 rpcz_store.cc:276] 0620 07:00:58.752364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.752689 (+ 325us) service_pool.cc:227] Handling call
0620 07:01:00.117430 (+1364741us) ts_tablet_manager.cc:1145] Deleting tablet 8a56f30ca69e45e3a9ddd41f117f61e2
0620 07:01:00.117444 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.610590 (+493146us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.989205 (+378615us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.171629 (+182424us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44157,"tablet-delete.queue_time_us":1364518}
I20260620 07:01:01.318959 1170 tablet_bootstrap.cc:492] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:01.320840 858 rpcz_store.cc:276] 0620 07:00:59.890173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.335311 (+445138us) service_pool.cc:227] Handling call
0620 07:01:00.335874 (+ 563us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.335902 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.621918 (+286016us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:00.996459 (+374541us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:00.996636 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.320960 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_407d8f13b4bd41fb8675708922430b28" } modify_external_catalogs: true
I20260620 07:01:01.321185 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_407d8f13b4bd41fb8675708922430b28" } modify_external_catalogs: true
I20260620 07:01:01.321841 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9e70b585def4a4a9081a0938af8ce5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.321861 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_625f2cf95ae74282910b8556035bc856" } modify_external_catalogs: true
I20260620 07:01:01.322026 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_625f2cf95ae74282910b8556035bc856" } modify_external_catalogs: true
I20260620 07:01:01.324304 1170 tablet_bootstrap.cc:654] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:01.331987 1168 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.814s user 0.004s sys 0.003s
I20260620 07:01:01.335359 1170 tablet_bootstrap.cc:492] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:01.337304 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 97e01aa120cc4c189017236ad57de811 (DEFAULT_TABLE table=default.Table_7b68309da41f4767a4a2ac0898fa91c2 [id=19dd20742533400980193075baec1956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.338183 1170 ts_tablet_manager.cc:1397] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260620 07:01:01.339540 1170 raft_consensus.cc:348] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.341938 1170 raft_consensus.cc:374] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:01.342553 1170 raft_consensus.cc:729] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:01.347777 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (DEFAULT_TABLE table=default.Table_49352a35a6414ff4b6f4a0e417cc7a48 [id=ce2f89c1e2544dbd8f7c27716b0b8624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.364568 424 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 610a25c729cf41b4bd71372bc36365a8 (table default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3]). Expected version 2 got 0
I20260620 07:01:01.364312 1166 log.cc:1196] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/289405cbf0784916b971b038279309d8
I20260620 07:01:01.366441 419 master_service.cc:946] ReplaceTablet: received request to replace tablet a292d66ee14a48959c1f6a63e0a0f492 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:01.367666 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0" } modify_external_catalogs: true
I20260620 07:01:01.367854 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0" } modify_external_catalogs: true
I20260620 07:01:01.368495 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_49d850227cc94454b2919e6c54793f35" } modify_external_catalogs: true
I20260620 07:01:01.368680 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_49d850227cc94454b2919e6c54793f35" } modify_external_catalogs: true
I20260620 07:01:01.376703 1166 ts_tablet_manager.cc:1939] T 289405cbf0784916b971b038279309d8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:01.378168 1029 raft_consensus.cc:2454] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:01.382400 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9e70b585def4a4a9081a0938af8ce5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.310518 999 tablet_service.cc:1467] Processing CreateTablet for tablet f793a91ab247408bbe4a9f7cb370fffe (DEFAULT_TABLE table=default.Table_6f694d1dc105473b93ba18dc487d0d55 [id=4a2d8361d2404c1eb6710cc8f5190708]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:01.387094 1167 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.615s user 0.009s sys 0.006s
I20260620 07:01:01.390910 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 967cc8f19ad64278910c86ffc4cb3ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.396337 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 157) took 2960 ms. Trace:
I20260620 07:01:01.396510 1166 rpcz_store.cc:276] 0620 07:00:58.423897 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.446195 (+ 22298us) service_pool.cc:227] Handling call
0620 07:00:59.636101 (+1189906us) ts_tablet_manager.cc:1145] Deleting tablet 289405cbf0784916b971b038279309d8
0620 07:00:59.636161 (+ 60us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:00.760212 (+1124051us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.167216 (+407004us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.384376 (+217160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1,"spinlock_wait_cycles":896,"tablet-delete.queue_time_us":1189522}
W20260620 07:01:01.396399 1167 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.615s user 0.009s sys 0.006s
I20260620 07:01:01.407059 996 tablet_service.cc:1467] Processing CreateTablet for tablet 6fbd069552314f2c9ee010c054386644 (DEFAULT_TABLE table=default.Table_d4b8aa362e80457697662fb3098721a3 [id=ee69fd0e35dd410b9193d36a7d7e1c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.411185 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 289405cbf0784916b971b038279309d8 (table default.Table_dc7b02e7defe4ddc8c4305ecb34bb7ab [id=ca68189e4cd34f43a8fbdb53a834be16]) successfully deleted
I20260620 07:01:01.417292 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97e01aa120cc4c189017236ad57de811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.433943 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 62ef9a12e3684d27b6696f631c68a5af (table default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]). Expected version 1 got 0
I20260620 07:01:01.434192 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 978f99d2a7d6448aba8dcd2611b75af3 (table default.Table_407d8f13b4bd41fb8675708922430b28 [id=c6b286f7e44a496aa9f070c73a885062]). Expected version 2 got 0
I20260620 07:01:01.438000 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_539855f37f7542ab94467c452b14b6e7" } new_table_name: "default.Table_e84e884648ed447c91e20b4a2be65197" modify_external_catalogs: true
W20260620 07:01:01.440088 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0435678022914e6991c974e116d1a9f7 consensus state has no leader
I20260620 07:01:01.441303 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b7ac5938b8c54806a785eaac99c70caa" } new_table_name: "default.Table_ca5b5e6066a343a59aeaf1e58f8a8a67" modify_external_catalogs: true
I20260620 07:01:01.463271 998 tablet_service.cc:1467] Processing CreateTablet for tablet 7b781d0578834708ae64b24419959cca (DEFAULT_TABLE table=default.Table_4f595f80f7f9445f956d6e24febead0a [id=84ff58148b4f4e10b31009115fe83352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.466426 858 tablet_service.cc:1467] Processing CreateTablet for tablet 95a109e7871241ec9467858dca467bbe (DEFAULT_TABLE table=default.Table_a14863df3baa41daa0a80ae9da10cf0a [id=2f50ee8c71f8435aad169b0637348a30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.378759 681 leader_election.cc:302] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
W20260620 07:01:01.466811 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 88066.3us
I20260620 07:01:01.401755 1556 raft_consensus.cc:482] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:01.467080 1556 raft_consensus.cc:504] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.467988 1556 leader_election.cc:288] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:01.468187 1556 raft_consensus.cc:2781] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:01.468307 1556 raft_consensus.cc:482] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:01.468403 1556 raft_consensus.cc:3037] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:01.469353 995 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 255) took 1224 ms. Trace:
I20260620 07:01:01.445129 729 tablet_service.cc:1467] Processing CreateTablet for tablet 25b878def9344cbdae65b209cac4067f (DEFAULT_TABLE table=default.Table_9e2f2ecd97ee48f89579302e371615a7 [id=07e9b630b86b44ad8440941033df1efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.445554 728 tablet_service.cc:1467] Processing CreateTablet for tablet 877a71e8db5f4bf689df39f83735f326 (DEFAULT_TABLE table=default.Table_890aba75c15e4e5990b4c0cae43dd28e [id=a302748f0b1e46209ebe7622280629a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.445582 721 tablet_service.cc:1467] Processing CreateTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f (DEFAULT_TABLE table=default.Table_5d2a4e7b8377498685861a195b5c2401 [id=91c7f13bfdb84770a1ef410a269a10e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.445835 734 tablet_service.cc:1467] Processing CreateTablet for tablet eb0f7d4b6fa14811a1f02456418f95a4 (DEFAULT_TABLE table=default.Table_f0ce8fdcfe2e4b7ab9659cfbb3fdf49b [id=ea9135e430a142ab992288c43fe54bf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.446244 724 tablet_service.cc:1467] Processing CreateTablet for tablet 125e8a5e20bf484cade408f0358489a1 (DEFAULT_TABLE table=default.Table_c0c512543c584906a978970ff6a532dc [id=bb41cdc85465446193c33f0722351f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.446636 720 tablet_service.cc:1467] Processing CreateTablet for tablet 4260b0c953c14a198dbf9b64a30e7e05 (DEFAULT_TABLE table=default.Table_d66e26edeccc4a138950de609d6c107f [id=dbe2ab45243b4aeca16c961149135563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.447077 723 tablet_service.cc:1467] Processing CreateTablet for tablet 91f8c4955c164e6b9061ac607bbe081c (DEFAULT_TABLE table=default.Table_128623186307486c86826727c2978537 [id=ceb3d35427694e1099764949625fac6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.471566 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25b878def9344cbdae65b209cac4067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.466144 872 rpcz_store.cc:276] 0620 07:01:00.151636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.635683 (+484047us) service_pool.cc:227] Handling call
0620 07:01:00.638146 (+ 2463us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.638176 (+ 30us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.236365 (+598189us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.239485 (+ 3120us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.239680 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:01.472963 1168 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.920s user 0.004s sys 0.003s
I20260620 07:01:01.474123 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3456cf91d65a4413a35efe94513c723d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.474970 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb0f7d4b6fa14811a1f02456418f95a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.474910 872 tablet_service.cc:1467] Processing CreateTablet for tablet b6e2c297072741eb927dff9bcf6a573f (DEFAULT_TABLE table=default.Table_323e0a217ebf4aad8ef0137a7599dd92 [id=d1ba4ce259044c45a86b285abab7b5ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.475406 1165 tablet_replica.cc:330] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:01.479243 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91f8c4955c164e6b9061ac607bbe081c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.483093 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.487102 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877a71e8db5f4bf689df39f83735f326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.475683 864 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 226) took 1780 ms. Trace:
I20260620 07:01:01.487556 864 rpcz_store.cc:276] 0620 07:00:59.327801 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.331967 (+ 4166us) service_pool.cc:227] Handling call
0620 07:00:59.349202 (+ 17235us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.349223 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.594675 (+1245452us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.108150 (+513475us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.108344 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.491297 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4260b0c953c14a198dbf9b64a30e7e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.495473 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 125e8a5e20bf484cade408f0358489a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.495383 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8d71ef260d5149c9aa47d33c9b4e3c8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.496042 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d71ef260d5149c9aa47d33c9b4e3c8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:01.497305 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b781d0578834708ae64b24419959cca consensus state has no leader
I20260620 07:01:01.497713 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_16d8164f00f14ef5bfa42f210bf3aed7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.498198 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16d8164f00f14ef5bfa42f210bf3aed7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.499629 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a1392579a049482496f7035d9dacbb76" } modify_external_catalogs: true
I20260620 07:01:01.499816 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a1392579a049482496f7035d9dacbb76" } modify_external_catalogs: true
I20260620 07:01:01.500722 1539 raft_consensus.cc:504] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.501514 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2bc3dd1306af4e49a9fec197b5740374
I20260620 07:01:01.502288 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_429cabf4e04f4125b89d28e55eca678b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.502897 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_429cabf4e04f4125b89d28e55eca678b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.503871 799 heartbeater.cc:347] Connected to a master server at 127.0.97.60:46775
W20260620 07:01:01.507340 831 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.613s user 0.001s sys 0.017s
W20260620 07:01:01.510762 866 consensus_meta.cc:287] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624: Time spent flushing consensus metadata: real 0.934s user 0.005s sys 0.001s
I20260620 07:01:01.507045 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 261f0d97e1084e828b9562cb30ea422b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.512104 864 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b6c578055d4f95b44c85eba8e92ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.515010 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bc3dd1306af4e49a9fec197b5740374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.516028 874 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 274) took 1332 ms. Trace:
W20260620 07:01:01.516072 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2bc3dd1306af4e49a9fec197b5740374 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bc3dd1306af4e49a9fec197b5740374 already in progress: creating tablet
I20260620 07:01:01.516340 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95a109e7871241ec9467858dca467bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.516590 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3b70b1674e43768b29dea84b09a1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.518280 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4655d289c94c4bce9707be375fc4b850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.522043 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e2c297072741eb927dff9bcf6a573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.522428 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd75e318982a4fb9bf28cb35b030642f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:01.524183 865 consensus_meta.cc:287] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: Time spent flushing consensus metadata: real 0.582s user 0.005s sys 0.000s
W20260620 07:01:01.527580 895 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.933s user 0.119s sys 0.187s
I20260620 07:01:01.529388 1539 leader_election.cc:288] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:01.529603 1539 raft_consensus.cc:482] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:01.529861 1539 raft_consensus.cc:504] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.530625 1539 leader_election.cc:288] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:01.530861 1487 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.960s user 0.004s sys 0.013s
W20260620 07:01:01.530966 1487 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.984s user 0.004s sys 0.013s
I20260620 07:01:01.530974 1539 raft_consensus.cc:482] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:01.531221 1539 raft_consensus.cc:504] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:01.531487 1364 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.952s user 0.010s sys 0.009s
W20260620 07:01:01.531584 1364 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.977s user 0.010s sys 0.009s
I20260620 07:01:01.536927 1556 raft_consensus.cc:504] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.529244 1538 tablet.cc:1722] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:01.537627 1556 leader_election.cc:288] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:01.539784 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0c41bf6a8a448ad809292d66ebf9c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.540485 865 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 268) took 1376 ms. Trace:
I20260620 07:01:01.549722 875 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 269) took 1384 ms. Trace:
W20260620 07:01:01.550925 869 consensus_meta.cc:287] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: Time spent flushing consensus metadata: real 0.844s user 0.002s sys 0.001s
I20260620 07:01:01.552342 866 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 238) took 2182 ms. Trace:
I20260620 07:01:01.552479 866 rpcz_store.cc:276] 0620 07:00:59.328938 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.697318 (+368380us) service_pool.cc:227] Handling call
0620 07:00:59.698209 (+ 891us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.698298 (+ 89us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.576755 (+878457us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.510972 (+934217us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.511181 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.553033 866 tablet_service.cc:1467] Processing CreateTablet for tablet 88c6aeea7c504f36964e8bf41b0fc4f9 (DEFAULT_TABLE table=default.Table_b0ba90ad7d404eefaffdd72e2bbd6645 [id=b6dc41e1ec4b4b8c9aa8583c725fa886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.553467 864 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e08a38c42d4e3da20292343bf085b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.553673 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 54bb495eea4c49b7ad7bf2300ad0e60a
I20260620 07:01:01.553869 864 tablet_service.cc:1467] Processing CreateTablet for tablet 97e01aa120cc4c189017236ad57de811 (DEFAULT_TABLE table=default.Table_7b68309da41f4767a4a2ac0898fa91c2 [id=19dd20742533400980193075baec1956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.554462 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_254d991dafd44638affdf98c4da87aa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.555250 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_254d991dafd44638affdf98c4da87aa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.464040 1581 tablet.cc:1722] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260620 07:01:01.555992 831 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.613s user 0.001s sys 0.017s
W20260620 07:01:01.556247 831 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 661904us
I20260620 07:01:01.556627 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet cfff2a14b1184d39bd7ac1091ef749c9
W20260620 07:01:01.557114 831 consensus_peers.cc:487] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2906fe0a195149d2844232cc8d83f6dd. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:01.557237 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_74f679a388334846998550d74680bff4" } new_table_name: "default.Table_e027fe5ccca8447d86ad610b8cec54f0" modify_external_catalogs: true
W20260620 07:01:01.557457 831 consensus_peers.cc:487] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1dc3bc9ec1334f1bb3d9f653b2472bc7. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:01.557853 831 consensus_peers.cc:487] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33517843ce1d4d8786c91fd738d81ab2. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:01.558614 683 leader_election.cc:341] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:01.558748 683 leader_election.cc:302] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:01.559827 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]) successfully deleted
I20260620 07:01:01.560748 747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:01.561329 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 167) took 2693 ms. Trace:
I20260620 07:01:01.561460 1166 rpcz_store.cc:276] 0620 07:00:58.739136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.739467 (+ 331us) service_pool.cc:227] Handling call
0620 07:01:01.423445 (+2683978us) ts_tablet_manager.cc:1145] Deleting tablet 04d5d361a5404dcf99a89e93ac1f7dd8
0620 07:01:01.423469 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:01.433057 (+ 9588us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2671167}
I20260620 07:01:01.562011 874 rpcz_store.cc:276] 0620 07:01:00.183075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.907188 (+724113us) service_pool.cc:227] Handling call
0620 07:01:00.931527 (+ 24339us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.931549 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.185457 (+253908us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.515815 (+330358us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.515980 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.562588 874 tablet_service.cc:1467] Processing CreateTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 (DEFAULT_TABLE table=default.Table_1aeab74931f24831bafc5e0ba0dd2a6e [id=1217f9b44b2f484d86191921e496bd0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.563144 1574 consensus_queue.cc:1035] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.229s
I20260620 07:01:01.565011 871 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 270) took 1348 ms. Trace:
I20260620 07:01:01.565140 871 rpcz_store.cc:276] 0620 07:01:00.151915 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.886107 (+734192us) service_pool.cc:227] Handling call
0620 07:01:00.931092 (+ 44985us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.931124 (+ 32us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.495803 (+564679us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.499856 (+ 4053us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.500056 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.565335 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 168) took 2822 ms. Trace:
W20260620 07:01:01.565531 1263 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.719s user 0.011s sys 0.009s
I20260620 07:01:01.565636 871 tablet_service.cc:1467] Processing CreateTablet for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (DEFAULT_TABLE table=default.Table_49352a35a6414ff4b6f4a0e417cc7a48 [id=ce2f89c1e2544dbd8f7c27716b0b8624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.567714 995 rpcz_store.cc:276] 0620 07:01:00.185997 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.631741 (+445744us) service_pool.cc:227] Handling call
0620 07:01:00.707358 (+ 75617us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.707383 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.031016 (+323633us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.379999 (+348983us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.410070 (+ 30071us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.565593 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f793a91ab247408bbe4a9f7cb370fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.574163 869 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 257) took 1625 ms. Trace:
I20260620 07:01:01.571913 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f793a91ab247408bbe4a9f7cb370fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.575367 869 rpcz_store.cc:276] 0620 07:00:59.926021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.467271 (+541250us) service_pool.cc:227] Handling call
0620 07:01:00.487179 (+ 19908us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.487212 (+ 33us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.650692 (+163480us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.551095 (+900403us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.551251 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.565480 1166 rpcz_store.cc:276] 0620 07:00:58.739303 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.739701 (+ 398us) service_pool.cc:227] Handling call
0620 07:01:01.561809 (+2822108us) ts_tablet_manager.cc:1145] Deleting tablet 360880717af145628606b5b9fb26e350
0620 07:01:01.561825 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:01.561966 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2821952}
I20260620 07:01:01.581418 870 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 265) took 1383 ms. Trace:
I20260620 07:01:01.581538 865 rpcz_store.cc:276] 0620 07:01:00.151723 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.643300 (+491577us) service_pool.cc:227] Handling call
0620 07:01:00.644198 (+ 898us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.644217 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:00.909901 (+265684us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.524412 (+614511us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.527755 (+ 3343us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.581547 870 rpcz_store.cc:276] 0620 07:01:00.151414 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.632330 (+480916us) service_pool.cc:227] Handling call
0620 07:01:00.633673 (+ 1343us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.633698 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.325379 (+691681us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.535213 (+209834us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.535358 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.582111 1168 tablet_bootstrap.cc:492] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:01.583287 1539 leader_election.cc:288] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:01.584443 1168 ts_tablet_manager.cc:1397] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 1.236s user 0.008s sys 0.004s
I20260620 07:01:01.581281 857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 266) took 1382 ms. Trace:
W20260620 07:01:01.584795 830 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.659s user 0.001s sys 0.019s
W20260620 07:01:01.585295 1263 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.722s user 0.011s sys 0.009s
I20260620 07:01:01.586011 857 rpcz_store.cc:276] 0620 07:01:00.151499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.634482 (+482983us) service_pool.cc:227] Handling call
0620 07:01:00.634970 (+ 488us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.634990 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.216926 (+581936us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.534015 (+317089us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.534191 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.586524 1240 raft_consensus.cc:2726] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:01.586906 830 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.709s user 0.001s sys 0.019s
W20260620 07:01:01.589316 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 710591us
I20260620 07:01:01.588184 875 rpcz_store.cc:276] 0620 07:01:00.151820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.644155 (+492335us) service_pool.cc:227] Handling call
0620 07:01:00.644515 (+ 360us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.644532 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.519428 (+874896us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.535720 (+ 16292us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.535840 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.590152 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97e01aa120cc4c189017236ad57de811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.591634 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35cb81ac0ebd4865b9d53259ed5787d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.592592 1167 tablet_bootstrap.cc:492] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:01.595669 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 54bb495eea4c49b7ad7bf2300ad0e60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.598488 1170 consensus_queue.cc:260] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.599334 1170 ts_tablet_manager.cc:1428] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.261s user 0.001s sys 0.001s
I20260620 07:01:01.599723 1170 tablet_bootstrap.cc:492] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:01.600914 724 tablet_service.cc:1514] Processing DeleteTablet for tablet cfff2a14b1184d39bd7ac1091ef749c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.603854 858 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 283) took 1199 ms. Trace:
I20260620 07:01:01.606197 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88c6aeea7c504f36964e8bf41b0fc4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.607967 830 leader_election.cc:302] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:01.608539 1470 raft_consensus.cc:2726] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 07:01:01.609011 868 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 276) took 1311 ms. Trace:
I20260620 07:01:01.597112 1004 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 237) took 1929 ms. Trace:
I20260620 07:01:01.610715 1004 rpcz_store.cc:276] 0620 07:00:59.631102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.720096 (+ 88994us) service_pool.cc:227] Handling call
0620 07:00:59.722000 (+ 1904us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.722023 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.194843 (+1472820us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.559973 (+365130us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.560168 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.612234 1165 raft_consensus.cc:2229] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:01.612596 875 tablet_service.cc:1467] Processing CreateTablet for tablet 6fbd069552314f2c9ee010c054386644 (DEFAULT_TABLE table=default.Table_d4b8aa362e80457697662fb3098721a3 [id=ee69fd0e35dd410b9193d36a7d7e1c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.612859 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 967cc8f19ad64278910c86ffc4cb3ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.613970 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 3651ef9790d342ec96f554134ae714dc (DEFAULT_TABLE table=default.Table_6d87b63c85c042d59cc7aebb8ee815f5 [id=e6ffdd91974a44eabefbcf60974613cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.615175 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4655d289c94c4bce9707be375fc4b850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.617957 995 tablet_service.cc:1467] Processing CreateTablet for tablet 6a36a5319a044e9da7dc7b666484e257 (DEFAULT_TABLE table=default.Table_690ab28d5a40472ebf9dfa50126f6c42 [id=0b2270efe0844d8aa33eac8150145bad]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:01.617982 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 54bb495eea4c49b7ad7bf2300ad0e60a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54bb495eea4c49b7ad7bf2300ad0e60a already in progress: creating tablet
I20260620 07:01:01.618611 1167 ts_tablet_manager.cc:1397] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.995s user 0.011s sys 0.011s
W20260620 07:01:01.619557 895 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.947s user 0.119s sys 0.187s
I20260620 07:01:01.618672 1168 raft_consensus.cc:348] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.619683 1167 raft_consensus.cc:348] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.619866 1168 raft_consensus.cc:374] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:01.619990 1167 raft_consensus.cc:374] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:01.620080 1167 raft_consensus.cc:729] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:01.620344 1167 consensus_queue.cc:260] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:01.620910 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet cfff2a14b1184d39bd7ac1091ef749c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfff2a14b1184d39bd7ac1091ef749c9 already in progress: creating tablet
I20260620 07:01:01.621668 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 169) took 2840 ms. Trace:
I20260620 07:01:01.621827 1166 rpcz_store.cc:276] 0620 07:00:58.739423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.739869 (+ 446us) service_pool.cc:227] Handling call
0620 07:01:01.577983 (+2838114us) ts_tablet_manager.cc:1145] Deleting tablet 076926f7dffe4a7b80c25ea3c18e9958
0620 07:01:01.578002 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:01.579740 (+ 1738us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2837984}
I20260620 07:01:01.622236 1166 tablet_replica.cc:330] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:01.622591 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 (DEFAULT_TABLE table=default.Table_50f2cabde77d417caa731bf4e56f48c8 [id=d2b994c9f22b4fa7a068b180dc980bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.625310 862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 275) took 1317 ms. Trace:
I20260620 07:01:01.625423 862 rpcz_store.cc:276] 0620 07:01:00.289133 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.916539 (+627406us) service_pool.cc:227] Handling call
0620 07:01:00.931193 (+ 14654us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.931212 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.576877 (+645665us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.606805 (+ 29928us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.606941 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:01.625912 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fc63351f767447c99b819fe7848d381 consensus state has no leader
I20260620 07:01:01.626389 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_262e214778774fe4aca99fb3c3bcf96d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.627018 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_262e214778774fe4aca99fb3c3bcf96d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.628690 873 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 273) took 1443 ms. Trace:
I20260620 07:01:01.629928 830 leader_election.cc:302] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:01.628885 858 rpcz_store.cc:276] 0620 07:01:00.393600 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.321133 (+927533us) service_pool.cc:227] Handling call
0620 07:01:01.466655 (+145522us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.466685 (+ 30us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.520239 (+ 53554us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.592755 (+ 72516us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.592911 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.633837 1012 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 259) took 1413 ms. Trace:
I20260620 07:01:01.636543 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88c6aeea7c504f36964e8bf41b0fc4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.639964 1170 tablet_bootstrap.cc:654] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:01.642722 1240 raft_consensus.cc:482] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:01.642902 1240 raft_consensus.cc:504] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.643862 1240 leader_election.cc:288] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:01.648402 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 978f99d2a7d6448aba8dcd2611b75af3
I20260620 07:01:01.649313 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3ab345e4abbc4b6c9cf08c26e1a95287"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.650075 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ab345e4abbc4b6c9cf08c26e1a95287 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:01.651087 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b39e682e71ed4776a786f7d30158e7e0 consensus state has no leader
I20260620 07:01:01.651607 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8bee6b731503444fa747e3bad786e4ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.652197 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bee6b731503444fa747e3bad786e4ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.659394 1012 rpcz_store.cc:276] 0620 07:01:00.198979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.835220 (+636241us) service_pool.cc:227] Handling call
0620 07:01:00.835679 (+ 459us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.835702 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.387131 (+551429us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.599243 (+212112us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.599416 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:01.659742 1496 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s user 0.021s sys 0.031s
I20260620 07:01:01.661545 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a36a5319a044e9da7dc7b666484e257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.663452 1165 raft_consensus.cc:2258] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:01.664083 1165 ts_tablet_manager.cc:1905] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:01.664135 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b781d0578834708ae64b24419959cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.664261 1168 raft_consensus.cc:729] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:01.664395 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06fd96feb4a74b9f8d3243b7d774f388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.664491 1168 consensus_queue.cc:260] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.665118 1168 ts_tablet_manager.cc:1428] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.080s user 0.003s sys 0.000s
I20260620 07:01:01.665416 1168 tablet_bootstrap.cc:492] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:01.665926 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fbd069552314f2c9ee010c054386644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.667040 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 0435678022914e6991c974e116d1a9f7 (DEFAULT_TABLE table=default.Table_3d3f1c18a48b4a4baa02626e6a328c14 [id=3497d9fc568f4979baf33dfdd30ce222]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:01.667307 1496 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s user 0.021s sys 0.031s
I20260620 07:01:01.668063 1168 tablet_bootstrap.cc:654] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:01.668578 1570 log.cc:924] Time spent T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
I20260620 07:01:01.669122 873 rpcz_store.cc:276] 0620 07:01:00.180892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.895040 (+714148us) service_pool.cc:227] Handling call
0620 07:01:00.931057 (+ 36017us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.931279 (+ 222us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.579428 (+648149us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.624247 (+ 44819us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.624404 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.669759 1587 raft_consensus.cc:2726] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260620 07:01:01.670100 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04d5d361a5404dcf99a89e93ac1f7dd8 already in progress: creating tablet
I20260620 07:01:01.672180 1013 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 267) took 1040 ms. Trace:
I20260620 07:01:01.672344 1013 rpcz_store.cc:276] 0620 07:01:00.631357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.055580 (+424223us) service_pool.cc:227] Handling call
0620 07:01:01.162606 (+107026us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.162642 (+ 36us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.414671 (+252029us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.671943 (+257272us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.672087 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.673352 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 9da80903ac124d1aae937c2329f9b13e (DEFAULT_TABLE table=default.Table_ddf7eee68cd64d798dd0e8cced08b38a [id=2943ebfc86e54b75a06a5727fdcc6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.673911 858 tablet_service.cc:1467] Processing CreateTablet for tablet 6a36a5319a044e9da7dc7b666484e257 (DEFAULT_TABLE table=default.Table_690ab28d5a40472ebf9dfa50126f6c42 [id=0b2270efe0844d8aa33eac8150145bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.674397 865 tablet_service.cc:1467] Processing CreateTablet for tablet 9da80903ac124d1aae937c2329f9b13e (DEFAULT_TABLE table=default.Table_ddf7eee68cd64d798dd0e8cced08b38a [id=2943ebfc86e54b75a06a5727fdcc6190]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:01.675303 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 220391us
I20260620 07:01:01.675292 869 tablet_service.cc:1467] Processing CreateTablet for tablet 0c51ecf0f006400597f0e7f776698854 (DEFAULT_TABLE table=default.Table_48b14443dddd46969ee0299cee27e93e [id=3a5017c5c8104328b9446a42bf0354a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.676545 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3651ef9790d342ec96f554134ae714dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.676776 868 rpcz_store.cc:276] 0620 07:01:00.296114 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.950103 (+653989us) service_pool.cc:227] Handling call
0620 07:01:00.953248 (+ 3145us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.953279 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.529037 (+575758us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.602638 (+ 73601us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.607312 (+ 4674us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.677681 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0435678022914e6991c974e116d1a9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.679425 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_49352a35a6414ff4b6f4a0e417cc7a48" } new_table_name: "default.Table_18733b0223c04573a9214aa964d79868" modify_external_catalogs: true
I20260620 07:01:01.679757 873 tablet_service.cc:1467] Processing CreateTablet for tablet 7b781d0578834708ae64b24419959cca (DEFAULT_TABLE table=default.Table_4f595f80f7f9445f956d6e24febead0a [id=84ff58148b4f4e10b31009115fe83352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.680903 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0948b3a7b876431dafb498c00e40cc2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.681483 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0948b3a7b876431dafb498c00e40cc2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.687261 859 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 285) took 1264 ms. Trace:
I20260620 07:01:01.686707 1167 ts_tablet_manager.cc:1428] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.068s user 0.004s sys 0.004s
I20260620 07:01:01.691493 857 tablet_service.cc:1467] Processing CreateTablet for tablet 3651ef9790d342ec96f554134ae714dc (DEFAULT_TABLE table=default.Table_6d87b63c85c042d59cc7aebb8ee815f5 [id=e6ffdd91974a44eabefbcf60974613cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.691991 870 tablet_service.cc:1467] Processing CreateTablet for tablet 0435678022914e6991c974e116d1a9f7 (DEFAULT_TABLE table=default.Table_3d3f1c18a48b4a4baa02626e6a328c14 [id=3497d9fc568f4979baf33dfdd30ce222]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.692509 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a36a5319a044e9da7dc7b666484e257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.693008 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0435678022914e6991c974e116d1a9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.693221 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c51ecf0f006400597f0e7f776698854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.693470 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3651ef9790d342ec96f554134ae714dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.695782 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b781d0578834708ae64b24419959cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.696425 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da80903ac124d1aae937c2329f9b13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.699615 1166 raft_consensus.cc:2229] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:01.704367 1167 tablet_bootstrap.cc:492] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:01.712427 1240 raft_consensus.cc:482] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:01.713064 1240 raft_consensus.cc:504] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.713865 1240 leader_election.cc:288] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:01.714653 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f6bdcd8cd2574acf867b7ec487559db2
I20260620 07:01:01.719249 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 21f51aeb329e42359cfaf7de2a039d13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.720927 1169 tablet_replica.cc:330] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:01.721169 1169 raft_consensus.cc:2229] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:01.721244 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b24a25dee4d246e28df4d574ec737953"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:01.721776 1169 raft_consensus.cc:2258] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:01.721909 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b24a25dee4d246e28df4d574ec737953 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.722543 1169 ts_tablet_manager.cc:1905] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:01.724864 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_da9edc7da5e6428a9a79cda404009949" } new_table_name: "default.Table_27b3605ce0ed4b8a8c04f4f83227b678" modify_external_catalogs: true
I20260620 07:01:01.730685 862 tablet_service.cc:1467] Processing CreateTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 (DEFAULT_TABLE table=default.Table_50f2cabde77d417caa731bf4e56f48c8 [id=d2b994c9f22b4fa7a068b180dc980bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.733316 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 978f99d2a7d6448aba8dcd2611b75af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.733970 724 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:01.734581 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:01.731014 859 rpcz_store.cc:276] 0620 07:01:00.406440 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.965821 (+559381us) service_pool.cc:227] Handling call
0620 07:01:00.971904 (+ 6083us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.971933 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.582644 (+610711us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.670446 (+ 87802us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.670584 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.736346 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c51ecf0f006400597f0e7f776698854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.740374 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35cb81ac0ebd4865b9d53259ed5787d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.743671 859 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e30385ed44c7f8b7db868f2e2bc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.744009 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.744815 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da80903ac124d1aae937c2329f9b13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.748569 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06fd96feb4a74b9f8d3243b7d774f388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.750232 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_698d63bac258457f957bc5370591aebf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.750988 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_698d63bac258457f957bc5370591aebf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.756044 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8d90f8d63e45ce990aead6166bcfb6" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:01.756469 941 heartbeater.cc:347] Connected to a master server at 127.0.97.60:46775
I20260620 07:01:01.756516 859 tablet_service.cc:1467] Processing CreateTablet for tablet 8d2c706414684bb1bacc6f9b870fc9c1 (DEFAULT_TABLE table=default.Table_da9edc7da5e6428a9a79cda404009949 [id=7cff577663c14bf997e9091e37d1c832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.756548 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.759316 1033 raft_consensus.cc:2379] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 978f112862c64141b1009856bef3d624 in current term 1: Already voted for candidate 2b84cae646b24bc7bd424eb8434ad425 in this term.
I20260620 07:01:01.758420 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83451bba9a3c4c209dddf4250fea8806" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:01.767588 865 tablet_service.cc:1467] Processing CreateTablet for tablet 5c083ebc2e054e09a531a8768802dcb1 (DEFAULT_TABLE table=default.Table_34297eefaa884ce0b9f16d67c2f95c14 [id=385bf04b4ae34c42a697ff301d15945d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.762746 1008 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 251) took 1577 ms. Trace:
I20260620 07:01:01.767341 1584 tablet.cc:1722] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:01.771970 1167 tablet_bootstrap.cc:654] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:01.777130 876 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 272) took 1602 ms. Trace:
I20260620 07:01:01.777308 876 rpcz_store.cc:276] 0620 07:01:00.174906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.893435 (+718529us) service_pool.cc:227] Handling call
0620 07:01:00.930594 (+ 37159us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.930642 (+ 48us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.629375 (+698733us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.776864 (+147489us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.777072 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.777961 876 tablet_service.cc:1467] Processing CreateTablet for tablet 390a327225344afda3076c341202cc1d (DEFAULT_TABLE table=default.Table_c3468f43caff46b1903034e2d5a4279f [id=d7198485f2104c2092955ef5305900cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.778275 997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 260) took 1578 ms. Trace:
I20260620 07:01:01.779582 875 tablet_service.cc:1467] Processing CreateTablet for tablet c9d344f9e4b444e4b6018fdf0cf762fd (DEFAULT_TABLE table=default.Table_f9c3eac07b6040a280cd24392454206b [id=9010989df9a341b986e65d49b59a5cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.780309 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7200877be18c4eaca57df88c25d30c01" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:01.781903 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fbd069552314f2c9ee010c054386644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.782384 1006 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 231) took 2153 ms. Trace:
I20260620 07:01:01.782537 1006 rpcz_store.cc:276] 0620 07:00:59.602949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.626665 (+ 23716us) service_pool.cc:227] Handling call
0620 07:00:59.876583 (+249918us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.876609 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.464348 (+1587739us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.735477 (+271129us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.756433 (+ 20956us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.782883 1166 raft_consensus.cc:2258] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:01.783649 1166 ts_tablet_manager.cc:1905] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:01.784814 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d9d4b5a69484176a7b0f4fded010867 has no consensus state
I20260620 07:01:01.785341 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6b7421166e034804801bd91c1a520a3d" } modify_external_catalogs: true
I20260620 07:01:01.785588 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6b7421166e034804801bd91c1a520a3d" } modify_external_catalogs: true
I20260620 07:01:01.788834 868 tablet_service.cc:1467] Processing CreateTablet for tablet 302adda3630e44289d371de591061692 (DEFAULT_TABLE table=default.Table_aaf29f2847544df2a6556397c39653c9 [id=92e4f74224ab4135982722f846eb9e73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.790728 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d2c706414684bb1bacc6f9b870fc9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.744001 891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17590c6a1a96414f84632a8b0e0a795b" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:01.761025 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83451bba9a3c4c209dddf4250fea8806" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:01.791208 1592 consensus_queue.cc:1035] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260620 07:01:01.791164 872 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 284) took 1361 ms. Trace:
I20260620 07:01:01.780593 1009 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 258) took 1560 ms. Trace:
W20260620 07:01:01.796118 969 leader_election.cc:341] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:01.797551 1496 consensus_queue.cc:1035] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260620 07:01:01.798430 1033 raft_consensus.cc:3037] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:01.798394 997 rpcz_store.cc:276] 0620 07:01:00.200116 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.017275 (+817159us) service_pool.cc:227] Handling call
0620 07:01:01.019908 (+ 2633us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.019935 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.594309 (+574374us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.778041 (+183732us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.778213 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:01.798682 1583 log.cc:924] Time spent T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260620 07:01:01.798846 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c51ecf0f006400597f0e7f776698854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:01.800727 830 leader_election.cc:341] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: ba760b5fe1204df2932edd15bdcbaadf
W20260620 07:01:01.801096 830 leader_election.cc:341] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:01.801482 969 leader_election.cc:341] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:01.809514 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 390a327225344afda3076c341202cc1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.814669 872 rpcz_store.cc:276] 0620 07:01:00.401958 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.472505 (+1070547us) service_pool.cc:227] Handling call
0620 07:01:01.475147 (+ 2642us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.475178 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.627147 (+151969us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.763415 (+136268us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.763564 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.815374 872 tablet_service.cc:1467] Processing CreateTablet for tablet 7294e5678ad44622a3249c1113b5e297 (DEFAULT_TABLE table=default.Table_51c799b6e1ca4b06828745a6337bdaa0 [id=15a7bd9071df42ba9ad669edd278e5f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.782208 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "978f99d2a7d6448aba8dcd2611b75af3" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:01.816138 871 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 292) took 1298 ms. Trace:
I20260620 07:01:01.817391 1538 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:45984 (request call id 210) took 2793 ms. Trace:
I20260620 07:01:01.816872 871 rpcz_store.cc:276] 0620 07:01:00.493037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.565360 (+1072323us) service_pool.cc:227] Handling call
0620 07:01:01.565994 (+ 634us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.566054 (+ 60us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.771911 (+205857us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.791693 (+ 19782us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.791861 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.820777 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 0c51ecf0f006400597f0e7f776698854 (DEFAULT_TABLE table=default.Table_48b14443dddd46969ee0299cee27e93e [id=3a5017c5c8104328b9446a42bf0354a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.821214 874 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 291) took 1307 ms. Trace:
I20260620 07:01:01.821324 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c51ecf0f006400597f0e7f776698854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.823132 874 rpcz_store.cc:276] 0620 07:01:00.488722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.562249 (+1073527us) service_pool.cc:227] Handling call
0620 07:01:01.562823 (+ 574us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.562850 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.670963 (+108113us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.796385 (+125422us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.796536 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.823683 874 tablet_service.cc:1467] Processing CreateTablet for tablet d53c90eff33044479838ff67dea93057 (DEFAULT_TABLE table=default.Table_7a520f90f9534374822183a6768a4d99 [id=22da0fcad0664913b2d2c6f80e9f1801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.798902 1008 rpcz_store.cc:276] 0620 07:01:00.185506 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.187819 (+ 2313us) service_pool.cc:227] Handling call
0620 07:01:00.188404 (+ 585us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.188437 (+ 33us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.681189 (+1492752us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.762498 (+ 81309us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.762686 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.828356 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
I20260620 07:01:01.832177 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ddfa02b01d2248a188748eda117387da" } modify_external_catalogs: true
I20260620 07:01:01.832404 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ddfa02b01d2248a188748eda117387da" } modify_external_catalogs: true
I20260620 07:01:01.837419 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9d344f9e4b444e4b6018fdf0cf762fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.838536 864 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 290) took 1364 ms. Trace:
I20260620 07:01:01.850114 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7294e5678ad44622a3249c1113b5e297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.851392 870 tablet_service.cc:1467] Processing CreateTablet for tablet 033c8b817757441ea7ebc2dbf77aa2dd (DEFAULT_TABLE table=default.Table_1099ae03924f4f4b95324ddaac35f9cf [id=a7528a9274144f0ebbcd1efa102a2a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.815876 1009 rpcz_store.cc:276] 0620 07:01:00.186296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.791356 (+605060us) service_pool.cc:227] Handling call
0620 07:01:00.832527 (+ 41171us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.832549 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.594013 (+761464us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.734918 (+140905us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.746912 (+ 11994us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.853402 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_622b45b592db43659f3fb16e236d0fb3" } modify_external_catalogs: true
I20260620 07:01:01.853718 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_622b45b592db43659f3fb16e236d0fb3" } modify_external_catalogs: true
I20260620 07:01:01.855929 864 rpcz_store.cc:276] 0620 07:01:00.471777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.553632 (+1081855us) service_pool.cc:227] Handling call
0620 07:01:01.554039 (+ 407us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.554073 (+ 34us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.662276 (+108203us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.826224 (+163948us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.835778 (+ 9554us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.856653 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 302adda3630e44289d371de591061692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.859846 1005 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 275) took 1105 ms. Trace:
I20260620 07:01:01.860050 1005 rpcz_store.cc:276] 0620 07:01:00.714538 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.192487 (+477949us) service_pool.cc:227] Handling call
0620 07:01:01.364448 (+171961us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.365143 (+ 695us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.791062 (+425919us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.819341 (+ 28279us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.819523 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.860479 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 033c8b817757441ea7ebc2dbf77aa2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.860795 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 8d2c706414684bb1bacc6f9b870fc9c1 (DEFAULT_TABLE table=default.Table_da9edc7da5e6428a9a79cda404009949 [id=7cff577663c14bf997e9091e37d1c832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.861267 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d2c706414684bb1bacc6f9b870fc9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.861879 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d53c90eff33044479838ff67dea93057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.862746 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cb04a2e17f3417aaf0f89f0c7f78159" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:01.863346 969 leader_election.cc:341] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:01.863504 969 leader_election.cc:302] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:01.863926 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 43925.5us
I20260620 07:01:01.864377 1007 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 241) took 2186 ms. Trace:
I20260620 07:01:01.864516 1007 rpcz_store.cc:276] 0620 07:00:59.631592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.814412 (+182820us) service_pool.cc:227] Handling call
0620 07:00:59.966163 (+151751us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:00:59.966229 (+ 66us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.573711 (+1607482us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.816967 (+243256us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.818483 (+ 1516us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.865140 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 302adda3630e44289d371de591061692 (DEFAULT_TABLE table=default.Table_aaf29f2847544df2a6556397c39653c9 [id=92e4f74224ab4135982722f846eb9e73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.865651 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 302adda3630e44289d371de591061692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.866851 997 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e30385ed44c7f8b7db868f2e2bc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:01.867301 997 tablet_service.cc:1467] Processing CreateTablet for tablet 5c083ebc2e054e09a531a8768802dcb1 (DEFAULT_TABLE table=default.Table_34297eefaa884ce0b9f16d67c2f95c14 [id=385bf04b4ae34c42a697ff301d15945d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.867552 873 tablet_service.cc:1467] Processing CreateTablet for tablet 3eda988492234d6aaeaee87f84f99d06 (DEFAULT_TABLE table=default.Table_06bc01b8cb5d447ea25fd376cc255a6d [id=188e640d71fa4d34ba29242cb1198020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.867681 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c083ebc2e054e09a531a8768802dcb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.818428 1538 rpcz_store.cc:276] 0620 07:00:59.023377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.023435 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:01.817153 (+2793718us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:00:59.024840 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:00:59.024984 (+ 144us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:00:59.024996 (+ 12us) alter_schema_op.cc:65] Acquired schema lock
0620 07:00:59.025006 (+ 10us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:00:59.025057 (+ 51us) alter_schema_op.cc:126] START. Timestamp: 1781938859024993
0620 07:00:59.025063 (+ 6us) op_driver.cc:331] REPLICATION: starting
0620 07:00:59.025351 (+ 288us) log.cc:842] Serialized 173 byte log entry
0620 07:01:00.535643 (+1510292us) op_driver.cc:444] REPLICATION: finished
0620 07:01:01.505703 (+970060us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:01.591780 (+ 86077us) log.cc:842] Serialized 5 byte log entry
0620 07:01:01.800055 (+208275us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.816171 (+ 16116us) log.cc:842] Serialized 14 byte log entry
0620 07:01:01.816766 (+ 595us) alter_schema_op.cc:71] Released schema lock
0620 07:01:01.816770 (+ 4us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":969988,"prepare.queue_time_us":869,"prepare.run_cpu_time_us":21834,"prepare.run_wall_time_us":346035,"raft.queue_time_us":47,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":315,"replication_time_us":1510552,"thread_start_us":1436415,"threads_started":3,"wal-append.queue_time_us":480944,"wal-append.run_cpu_time_us":846,"wal-append.run_wall_time_us":1013162}]]}
I20260620 07:01:01.869103 1496 raft_consensus.cc:2726] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:01.870932 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:01.875092 1608 tablet.cc:1722] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260620 07:01:01.876422 681 leader_election.cc:341] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:01.876727 681 leader_election.cc:341] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:01.877168 1240 raft_consensus.cc:482] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:01.881524 867 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 271) took 1714 ms. Trace:
I20260620 07:01:01.881670 867 rpcz_store.cc:276] 0620 07:01:00.152010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.886320 (+734310us) service_pool.cc:227] Handling call
0620 07:01:00.930736 (+ 44416us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.930762 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.686597 (+755835us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.855888 (+169291us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.866962 (+ 11074us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.882345 867 tablet_service.cc:1467] Processing CreateTablet for tablet e6bae5090f81417cbcf4b4d598b438da (DEFAULT_TABLE table=default.Table_ea9e545f34d741778517df5391bca063 [id=e872cbca26c7448ea0b1e65fd692f96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.884336 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c083ebc2e054e09a531a8768802dcb1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:01.884336 1594 log.cc:924] Time spent T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260620 07:01:01.884698 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6bae5090f81417cbcf4b4d598b438da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.885756 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6102e0da4e42cd9f1d6e294bb372b2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:01.885825 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 390a327225344afda3076c341202cc1d (DEFAULT_TABLE table=default.Table_c3468f43caff46b1903034e2d5a4279f [id=d7198485f2104c2092955ef5305900cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.886221 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3eda988492234d6aaeaee87f84f99d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.889568 864 tablet_service.cc:1514] Processing DeleteTablet for tablet c2e38178b9244152915d4c0a9dcf59dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.890230 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a252a334ff554e9686916014b6d8d87c" } new_table_name: "default.Table_09cc34c1ecf8432980b9247bf2be1e8d" modify_external_catalogs: true
I20260620 07:01:01.887256 1011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 257) took 1672 ms. Trace:
W20260620 07:01:01.893432 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 967cc8f19ad64278910c86ffc4cb3ed2 consensus state has no leader
I20260620 07:01:01.893826 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_009386cbc364471099079c21ecb6c8e0" } modify_external_catalogs: true
I20260620 07:01:01.894038 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_009386cbc364471099079c21ecb6c8e0" } modify_external_catalogs: true
I20260620 07:01:01.894800 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_106ca3379ea3425d9151703d76671d6b" } new_table_name: "default.Table_fa9e987611db4bab92fcf3ed727698be" modify_external_catalogs: true
I20260620 07:01:01.890115 895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.97.3:42713 (request call id 59) took 1345 ms. Trace:
I20260620 07:01:01.896924 871 tablet_service.cc:1467] Processing CreateTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 (DEFAULT_TABLE table=default.Table_a1392579a049482496f7035d9dacbb76 [id=017e06014ef0443086ed5034c5dc1a37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.897531 863 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 282) took 1487 ms. Trace:
I20260620 07:01:01.898484 1581 tablet.cc:1722] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:01.890013 1538 tablet.cc:1722] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:01.899709 863 rpcz_store.cc:276] 0620 07:01:00.393495 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.312025 (+918530us) service_pool.cc:227] Handling call
0620 07:01:01.312677 (+ 652us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.312708 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.677737 (+365029us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.880724 (+202987us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.880884 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.900036 863 tablet_service.cc:1514] Processing DeleteTablet for tablet a9daee42d5c748ceaed7dc94f551c0d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.900246 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.900411 863 tablet_service.cc:1514] Processing DeleteTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.900575 863 tablet_service.cc:1514] Processing DeleteTablet for tablet cd75e318982a4fb9bf28cb35b030642f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.901058 863 tablet_service.cc:1467] Processing CreateTablet for tablet 25b878def9344cbdae65b209cac4067f (DEFAULT_TABLE table=default.Table_9e2f2ecd97ee48f89579302e371615a7 [id=07e9b630b86b44ad8440941033df1efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.901592 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25b878def9344cbdae65b209cac4067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.903292 418 catalog_manager.cc:5495] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:01.904000 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_1e9b65d54a164a3f811eb9afb9c090ff [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 3 got 0
I20260620 07:01:01.904407 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_5716ccac487c4d4296da6cdd2d2ceeb0 [id=2abd0f99a3034a0e8824bcb0002c91bd]). Expected version 1 got 0
W20260620 07:01:01.904750 681 leader_election.cc:341] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:01.904960 1240 raft_consensus.cc:504] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.906544 1240 leader_election.cc:288] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:01.908983 1169 ts_tablet_manager.cc:1918] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:01.913393 728 tablet_service.cc:1467] Processing CreateTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 (DEFAULT_TABLE table=default.Table_8e736cf278274ffc858ff174e1567e0e [id=26c4b0db3c984eb8a79d9aa31548a229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.913869 721 tablet_service.cc:1467] Processing CreateTablet for tablet a96030064de046e5873bdaab6f3dff60 (DEFAULT_TABLE table=default.Table_106ca3379ea3425d9151703d76671d6b [id=cd14c89b450240fcb6bf3b1a3b51346f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.914254 720 tablet_service.cc:1467] Processing CreateTablet for tablet 00a3ccec08ee4c8480a808b1402eb4a9 (DEFAULT_TABLE table=default.Table_ded62bf712ad4611be190bac322171a2 [id=7a412b5ded944c1bb75fef061cd6de07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.914623 729 tablet_service.cc:1467] Processing CreateTablet for tablet 88c01c4e10f345fc84e3e253e8501aff (DEFAULT_TABLE table=default.Table_1e18ab4a35f347abb061df0a7db49226 [id=3234298ef6b649e78f3c7c7c61facd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.914999 723 tablet_service.cc:1467] Processing CreateTablet for tablet 76237044ff2f4c8b84c6af43badd164a (DEFAULT_TABLE table=default.Table_efed404b281b40a9b74f079c46716d6d [id=9a5474f49e014c7481b0eeb4a0ca5554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.915385 727 tablet_service.cc:1467] Processing CreateTablet for tablet e37f336c01974ba79caeb25f4781667a (DEFAULT_TABLE table=default.Table_fa5e48ba0ba24f30a0212db6021bc618 [id=faf33298650347f1860fd8982c8a242a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.915776 734 tablet_service.cc:1467] Processing CreateTablet for tablet 1d9d4b5a69484176a7b0f4fded010867 (DEFAULT_TABLE table=default.Table_e027fe5ccca8447d86ad610b8cec54f0 [id=a974a44b8ef1483883a25d46c2673d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.916157 724 tablet_service.cc:1467] Processing CreateTablet for tablet 08ec769f903c4438bc1186d5fc1c5108 (DEFAULT_TABLE table=default.Table_b16e5dbf81bc4141936830a4dc9b06fb [id=654e042eb7604d72a01475f1d80bb47c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.918318 1169 log.cc:1196] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/21f51aeb329e42359cfaf7de2a039d13
I20260620 07:01:01.919066 1169 ts_tablet_manager.cc:1939] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:01.919766 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af743ffd2eb2427caa3779c7fceb8f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.924116 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6bdcd8cd2574acf867b7ec487559db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.926126 869 tablet_service.cc:1467] Processing CreateTablet for tablet 2bc3dd1306af4e49a9fec197b5740374 (DEFAULT_TABLE table=default.Table_49d850227cc94454b2919e6c54793f35 [id=501af04cab4f4a0da5d8396e8f629397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.926992 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00a3ccec08ee4c8480a808b1402eb4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.931005 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88c01c4e10f345fc84e3e253e8501aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.931304 860 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 281) took 1538 ms. Trace:
I20260620 07:01:01.935012 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a96030064de046e5873bdaab6f3dff60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.935561 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76237044ff2f4c8b84c6af43badd164a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.935865 873 tablet_service.cc:1467] Processing CreateTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f (DEFAULT_TABLE table=default.Table_5d2a4e7b8377498685861a195b5c2401 [id=91c7f13bfdb84770a1ef410a269a10e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.936015 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37f336c01974ba79caeb25f4781667a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.936447 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d9d4b5a69484176a7b0f4fded010867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.936926 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ec769f903c4438bc1186d5fc1c5108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.939375 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c2c8c59b79f3455e9ec512be24010087"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.940050 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2c8c59b79f3455e9ec512be24010087 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.946897 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2f0c28057b4534a8a400d1ca7f3991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.947412 864 tablet_service.cc:1467] Processing CreateTablet for tablet 125e8a5e20bf484cade408f0358489a1 (DEFAULT_TABLE table=default.Table_c0c512543c584906a978970ff6a532dc [id=bb41cdc85465446193c33f0722351f6a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:01.954629 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d2c706414684bb1bacc6f9b870fc9c1 consensus state has no leader
I20260620 07:01:01.955183 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_aa50efd3e2c24b94ae1de367ad45588e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:01.955906 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa50efd3e2c24b94ae1de367ad45588e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:01.923780 895 rpcz_store.cc:276] 0620 07:01:00.528900 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.528998 (+ 98us) service_pool.cc:227] Handling call
0620 07:01:00.529134 (+ 136us) raft_consensus.cc:1457] Updating replica for 1 ops
0620 07:01:00.529273 (+ 139us) raft_consensus.cc:1520] Early marking committed up to index 0
0620 07:01:00.529280 (+ 7us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0620 07:01:00.529485 (+ 205us) log.cc:842] Serialized 26 byte log entry
0620 07:01:00.576845 (+ 47360us) raft_consensus.cc:1631] Marking committed up to 1
0620 07:01:01.621810 (+1044965us) log.cc:842] Serialized 14 byte log entry
0620 07:01:01.796256 (+174446us) raft_consensus.cc:1683] Filling consensus response to leader.
0620 07:01:01.800105 (+ 3849us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0620 07:01:01.800116 (+ 11us) raft_consensus.cc:1671] finished
0620 07:01:01.800119 (+ 3us) raft_consensus.cc:1677] UpdateReplicas() finished
0620 07:01:01.874331 (+ 74212us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":916842,"prepare.run_cpu_time_us":12,"prepare.run_wall_time_us":13,"raft.queue_time_us":3410,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":93,"thread_start_us":1260667,"threads_started":3,"wal-append.queue_time_us":234170,"wal-append.run_cpu_time_us":757,"wal-append.run_wall_time_us":1001084}
I20260620 07:01:01.960729 866 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 289) took 1460 ms. Trace:
I20260620 07:01:01.964052 1168 tablet_bootstrap.cc:492] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:01.974952 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_890aba75c15e4e5990b4c0cae43dd28e" } modify_external_catalogs: true
I20260620 07:01:01.975291 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_890aba75c15e4e5990b4c0cae43dd28e" } modify_external_catalogs: true
I20260620 07:01:01.977737 866 rpcz_store.cc:276] 0620 07:01:00.458252 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.552693 (+1094441us) service_pool.cc:227] Handling call
0620 07:01:01.553231 (+ 538us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.553258 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.787961 (+234703us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.918564 (+130603us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.918730 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.980544 859 tablet_service.cc:1467] Processing CreateTablet for tablet eb0f7d4b6fa14811a1f02456418f95a4 (DEFAULT_TABLE table=default.Table_f0ce8fdcfe2e4b7ab9659cfbb3fdf49b [id=ea9135e430a142ab992288c43fe54bf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.978119 860 rpcz_store.cc:276] 0620 07:01:00.393343 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.173902 (+780559us) service_pool.cc:227] Handling call
0620 07:01:01.223909 (+ 50007us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.223952 (+ 43us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.825810 (+601858us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.931038 (+105228us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.931251 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.987617 861 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45984 (request call id 260) took 1843 ms. Trace:
I20260620 07:01:01.987777 861 rpcz_store.cc:276] 0620 07:01:00.115850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.623233 (+507383us) service_pool.cc:227] Handling call
0620 07:01:00.868235 (+245002us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.868259 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.570233 (+701974us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.952684 (+382451us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.958994 (+ 6310us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:01.988139 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bc3dd1306af4e49a9fec197b5740374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.988360 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 54bb495eea4c49b7ad7bf2300ad0e60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.988583 861 tablet_service.cc:1514] Processing DeleteTablet for tablet cfff2a14b1184d39bd7ac1091ef749c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.988793 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 978f99d2a7d6448aba8dcd2611b75af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.988976 861 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:01.989401 861 tablet_service.cc:1467] Processing CreateTablet for tablet 08ec769f903c4438bc1186d5fc1c5108 (DEFAULT_TABLE table=default.Table_b16e5dbf81bc4141936830a4dc9b06fb [id=654e042eb7604d72a01475f1d80bb47c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.990069 870 tablet_service.cc:1467] Processing CreateTablet for tablet 877a71e8db5f4bf689df39f83735f326 (DEFAULT_TABLE table=default.Table_890aba75c15e4e5990b4c0cae43dd28e [id=a302748f0b1e46209ebe7622280629a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.993155 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:01.994256 1240 raft_consensus.cc:482] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:01.994436 1240 raft_consensus.cc:504] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:01.995252 1240 leader_election.cc:288] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:01.996069 1169 tablet_replica.cc:330] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:01.996649 1169 raft_consensus.cc:2229] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:01.997326 1169 raft_consensus.cc:2258] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.005194 1033 raft_consensus.cc:2454] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:02.005842 414 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet b39e682e71ed4776a786f7d30158e7e0 (table default.Table_ca5b5e6066a343a59aeaf1e58f8a8a67 [id=a7902aafbaad4905a6b5b03ad669eeae], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b39e682e71ed4776a786f7d30158e7e0 consensus state has no leader
I20260620 07:01:02.006628 866 tablet_service.cc:1467] Processing CreateTablet for tablet 4260b0c953c14a198dbf9b64a30e7e05 (DEFAULT_TABLE table=default.Table_d66e26edeccc4a138950de609d6c107f [id=dbe2ab45243b4aeca16c961149135563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.006624 1168 ts_tablet_manager.cc:1397] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.300s user 0.016s sys 0.001s
I20260620 07:01:02.007112 860 tablet_service.cc:1467] Processing CreateTablet for tablet 91f8c4955c164e6b9061ac607bbe081c (DEFAULT_TABLE table=default.Table_128623186307486c86826727c2978537 [id=ceb3d35427694e1099764949625fac6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.010993 1078 heartbeater.cc:503] Master 127.0.97.60:46775 was elected leader, sending a full tablet report...
I20260620 07:01:02.013063 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 125e8a5e20bf484cade408f0358489a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.016530 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 21f51aeb329e42359cfaf7de2a039d13 (table default.Table_066c84335e324028aaab00d42e0e5aec [id=bbf8c2959d834ddc8bb8b9790c6fcd89]) successfully deleted
I20260620 07:01:02.019783 857 tablet_service.cc:1467] Processing CreateTablet for tablet 1d9d4b5a69484176a7b0f4fded010867 (DEFAULT_TABLE table=default.Table_e027fe5ccca8447d86ad610b8cec54f0 [id=a974a44b8ef1483883a25d46c2673d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.019992 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 390a327225344afda3076c341202cc1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.021931 1584 tablet.cc:1722] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260620 07:01:02.022420 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8ec1e179a704e5480f3deaf856156e7 consensus state has no leader
I20260620 07:01:02.023084 1003 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 250) took 1835 ms. Trace:
I20260620 07:01:02.023263 1003 rpcz_store.cc:276] 0620 07:01:00.166342 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.167023 (+ 681us) service_pool.cc:227] Handling call
0620 07:01:00.192012 (+ 24989us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.192034 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.658104 (+1466070us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.892297 (+234193us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.001669 (+109372us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.023859 1003 tablet_service.cc:1467] Processing CreateTablet for tablet c9d344f9e4b444e4b6018fdf0cf762fd (DEFAULT_TABLE table=default.Table_f9c3eac07b6040a280cd24392454206b [id=9010989df9a341b986e65d49b59a5cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.024279 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9d344f9e4b444e4b6018fdf0cf762fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.024556 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4260b0c953c14a198dbf9b64a30e7e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.025290 1165 ts_tablet_manager.cc:1918] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:02.025425 1165 log.cc:1196] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/1dc3bc9ec1334f1bb3d9f653b2472bc7
I20260620 07:01:02.026011 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.029608 1538 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:45984 (request call id 211) took 2954 ms. Trace:
I20260620 07:01:02.029748 1538 rpcz_store.cc:276] 0620 07:00:59.065199 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.065263 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:02.019445 (+2954182us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:00:59.332303 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:00:59.350613 (+ 18310us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:00:59.350626 (+ 13us) alter_schema_op.cc:65] Acquired schema lock
0620 07:00:59.350635 (+ 9us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:00:59.350696 (+ 61us) alter_schema_op.cc:126] START. Timestamp: 1781938859350626
0620 07:00:59.350701 (+ 5us) op_driver.cc:331] REPLICATION: starting
0620 07:00:59.365706 (+ 15005us) log.cc:842] Serialized 173 byte log entry
0620 07:01:01.762364 (+2396658us) op_driver.cc:444] REPLICATION: finished
0620 07:01:01.868088 (+105724us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:01.899782 (+ 31694us) log.cc:842] Serialized 5 byte log entry
0620 07:01:02.019044 (+119262us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.019333 (+ 289us) log.cc:842] Serialized 14 byte log entry
0620 07:01:02.019392 (+ 59us) alter_schema_op.cc:71] Released schema lock
0620 07:01:02.019395 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":96860,"prepare.queue_time_us":266695,"prepare.run_cpu_time_us":937,"prepare.run_wall_time_us":33547,"raft.queue_time_us":390,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":304,"replication_time_us":2411634,"thread_start_us":417569,"threads_started":2}]]}
I20260620 07:01:02.030614 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91f8c4955c164e6b9061ac607bbe081c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.030972 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d9d4b5a69484176a7b0f4fded010867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.039137 1168 raft_consensus.cc:348] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.039688 1011 rpcz_store.cc:276] 0620 07:01:00.186208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.746842 (+560634us) service_pool.cc:227] Handling call
0620 07:01:00.831297 (+ 84455us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:00.831320 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.729225 (+897905us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:01.858905 (+129680us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:01.859111 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.042011 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bc3dd1306af4e49a9fec197b5740374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.043298 1168 raft_consensus.cc:374] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.043789 1168 raft_consensus.cc:729] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.048688 998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 280) took 1024 ms. Trace:
I20260620 07:01:02.048859 998 rpcz_store.cc:276] 0620 07:01:01.024032 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.386589 (+362557us) service_pool.cc:227] Handling call
0620 07:01:01.464098 (+ 77509us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.464129 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.807286 (+343157us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.048454 (+241168us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.048636 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.048977 1168 consensus_queue.cc:260] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.049373 998 tablet_service.cc:1467] Processing CreateTablet for tablet d53c90eff33044479838ff67dea93057 (DEFAULT_TABLE table=default.Table_7a520f90f9534374822183a6768a4d99 [id=22da0fcad0664913b2d2c6f80e9f1801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.049791 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d53c90eff33044479838ff67dea93057. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:02.050029 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a96030064de046e5873bdaab6f3dff60 consensus state has no leader
I20260620 07:01:02.050048 1168 ts_tablet_manager.cc:1428] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260620 07:01:02.050498 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_58581d650c544165bfe1d9b23cb0af2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.051115 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58581d650c544165bfe1d9b23cb0af2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.054620 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 610a25c729cf41b4bd71372bc36365a8 (table default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3]). Expected version 2 got 0
I20260620 07:01:02.054966 422 catalog_manager.cc:5495] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:02.055466 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 3 got 0
I20260620 07:01:02.055616 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 7294e5678ad44622a3249c1113b5e297 (DEFAULT_TABLE table=default.Table_51c799b6e1ca4b06828745a6337bdaa0 [id=15a7bd9071df42ba9ad669edd278e5f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.057538 1167 tablet_bootstrap.cc:492] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:02.057693 1167 ts_tablet_manager.cc:1397] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.370s user 0.025s sys 0.044s
I20260620 07:01:02.058146 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6fbd069552314f2c9ee010c054386644
I20260620 07:01:02.058626 1608 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 278) took 1034 ms. Trace:
I20260620 07:01:02.058732 1011 tablet_service.cc:1467] Processing CreateTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 (DEFAULT_TABLE table=default.Table_a1392579a049482496f7035d9dacbb76 [id=017e06014ef0443086ed5034c5dc1a37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.059005 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet cb26f1d10f9a4978b41afbd8894f1102
I20260620 07:01:02.059281 1167 raft_consensus.cc:348] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.058815 1608 rpcz_store.cc:276] 0620 07:01:01.023822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.337934 (+314112us) service_pool.cc:227] Handling call
0620 07:01:02.058569 (+720635us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:01.386309 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:01.386391 (+ 82us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:01.386402 (+ 11us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:01.386409 (+ 7us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:01.386447 (+ 38us) alter_schema_op.cc:126] START. Timestamp: 1781938861386413
0620 07:01:01.386450 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:01.388134 (+ 1684us) log.cc:842] Serialized 173 byte log entry
0620 07:01:01.730157 (+342023us) op_driver.cc:444] REPLICATION: finished
0620 07:01:01.875011 (+144854us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:01.875673 (+ 662us) log.cc:842] Serialized 5 byte log entry
0620 07:01:02.058222 (+182549us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.058487 (+ 265us) log.cc:842] Serialized 14 byte log entry
0620 07:01:02.058530 (+ 43us) alter_schema_op.cc:71] Released schema lock
0620 07:01:02.058533 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":144784,"prepare.queue_time_us":2926,"prepare.run_cpu_time_us":517,"prepare.run_wall_time_us":1938,"raft.queue_time_us":434,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":255,"replication_time_us":343672,"thread_start_us":147344,"threads_started":1}]]}
I20260620 07:01:02.059522 1167 raft_consensus.cc:374] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.059633 1167 raft_consensus.cc:729] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.059595 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_21e2f7c931b949399e8536e32bf83d59" } new_table_name: "default.Table_d3fd7d3a8e7e4f609d7ea14c91a2329c" modify_external_catalogs: true
I20260620 07:01:02.059792 1608 tablet.cc:1722] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:02.059818 872 tablet_service.cc:1467] Processing CreateTablet for tablet 00a3ccec08ee4c8480a808b1402eb4a9 (DEFAULT_TABLE table=default.Table_ded62bf712ad4611be190bac322171a2 [id=7a412b5ded944c1bb75fef061cd6de07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.061546 1165 ts_tablet_manager.cc:1939] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:02.062251 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cd006a20258f4cedbcd2af7947903296"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.062937 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd006a20258f4cedbcd2af7947903296 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.065753 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ec769f903c4438bc1186d5fc1c5108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.066220 858 tablet_service.cc:1467] Processing CreateTablet for tablet a96030064de046e5873bdaab6f3dff60 (DEFAULT_TABLE table=default.Table_106ca3379ea3425d9151703d76671d6b [id=cd14c89b450240fcb6bf3b1a3b51346f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:01.998322 1170 tablet_bootstrap.cc:492] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:02.067581 868 tablet_service.cc:1467] Processing CreateTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 (DEFAULT_TABLE table=default.Table_8e736cf278274ffc858ff174e1567e0e [id=26c4b0db3c984eb8a79d9aa31548a229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.070004 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 182) took 3311 ms. Trace:
I20260620 07:01:02.070137 1168 tablet_bootstrap.cc:492] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:02.059901 1167 consensus_queue.cc:260] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.078728 862 tablet_service.cc:1467] Processing CreateTablet for tablet 88c01c4e10f345fc84e3e253e8501aff (DEFAULT_TABLE table=default.Table_1e18ab4a35f347abb061df0a7db49226 [id=3234298ef6b649e78f3c7c7c61facd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.079033 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a96030064de046e5873bdaab6f3dff60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.080695 994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 270) took 1418 ms. Trace:
I20260620 07:01:02.080896 995 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 281) took 1051 ms. Trace:
I20260620 07:01:02.080983 995 rpcz_store.cc:276] 0620 07:01:01.024121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.568017 (+543896us) service_pool.cc:227] Handling call
0620 07:01:01.618189 (+ 50172us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.618218 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.810357 (+192139us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.074882 (+264525us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.075378 (+ 496us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":355}
I20260620 07:01:02.081624 995 tablet_service.cc:1467] Processing CreateTablet for tablet 3eda988492234d6aaeaee87f84f99d06 (DEFAULT_TABLE table=default.Table_06bc01b8cb5d447ea25fd376cc255a6d [id=188e640d71fa4d34ba29242cb1198020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.082118 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3eda988492234d6aaeaee87f84f99d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.084756 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6ff06bc5fc684b9195c719cbf39d34a6
I20260620 07:01:02.085680 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8397d634bfa34d018ebbafc7803a6963"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.086325 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8397d634bfa34d018ebbafc7803a6963 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.087090 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9e643fb0890042ae891ea17f0bc03740
I20260620 07:01:02.087815 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b8429caf0e3d441cb3b0c1e46841a3d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.088356 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8429caf0e3d441cb3b0c1e46841a3d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.092247 681 leader_election.cc:302] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:02.093459 863 tablet_service.cc:1467] Processing CreateTablet for tablet 76237044ff2f4c8b84c6af43badd164a (DEFAULT_TABLE table=default.Table_efed404b281b40a9b74f079c46716d6d [id=9a5474f49e014c7481b0eeb4a0ca5554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.096639 1556 raft_consensus.cc:2781] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:02.096942 1002 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 283) took 1043 ms. Trace:
I20260620 07:01:02.086184 1165 rpcz_store.cc:276] 0620 07:00:58.752481 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.752944 (+ 463us) service_pool.cc:227] Handling call
0620 07:01:01.323167 (+2570223us) ts_tablet_manager.cc:1145] Deleting tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7
0620 07:01:01.323182 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:01.848963 (+525781us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.022071 (+173108us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.063440 (+ 41369us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":128027,"tablet-delete.queue_time_us":2570007}
I20260620 07:01:02.097256 1165 tablet_replica.cc:330] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:02.097797 1240 raft_consensus.cc:482] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:02.104274 1169 ts_tablet_manager.cc:1905] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.104667 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00a3ccec08ee4c8480a808b1402eb4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.106401 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877a71e8db5f4bf689df39f83735f326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.104507 1240 raft_consensus.cc:504] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.105011 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fbd069552314f2c9ee010c054386644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.106998 728 tablet_service.cc:1514] Processing DeleteTablet for tablet cb26f1d10f9a4978b41afbd8894f1102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.096380 1170 ts_tablet_manager.cc:1397] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.468s user 0.009s sys 0.025s
I20260620 07:01:02.116528 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb0f7d4b6fa14811a1f02456418f95a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.118019 997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 293) took 1055 ms. Trace:
I20260620 07:01:02.118916 994 rpcz_store.cc:276] 0620 07:01:00.662333 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.085445 (+423112us) service_pool.cc:227] Handling call
0620 07:01:01.086109 (+ 664us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.086160 (+ 51us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.774149 (+687989us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.080486 (+306337us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.080642 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.120333 1240 leader_election.cc:288] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:02.122237 864 tablet_service.cc:1467] Processing CreateTablet for tablet e37f336c01974ba79caeb25f4781667a (DEFAULT_TABLE table=default.Table_fa5e48ba0ba24f30a0212db6021bc618 [id=faf33298650347f1860fd8982c8a242a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.122241 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ff06bc5fc684b9195c719cbf39d34a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.122486 1002 rpcz_store.cc:276] 0620 07:01:01.031993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.613674 (+581681us) service_pool.cc:227] Handling call
0620 07:01:01.614206 (+ 532us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.614234 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.010369 (+396135us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.074895 (+ 64526us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.075105 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":79,"spinlock_wait_cycles":62336}
I20260620 07:01:02.122961 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7294e5678ad44622a3249c1113b5e297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.123117 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e643fb0890042ae891ea17f0bc03740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.126104 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fbd069552314f2c9ee010c054386644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.130328 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af743ffd2eb2427caa3779c7fceb8f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.131172 1170 raft_consensus.cc:348] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.131431 1170 raft_consensus.cc:374] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.131511 1170 raft_consensus.cc:729] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.131911 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88c01c4e10f345fc84e3e253e8501aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.132192 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6bdcd8cd2574acf867b7ec487559db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.132850 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7883c1fc8c5b4c998ab3e869467a79b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.133512 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7883c1fc8c5b4c998ab3e869467a79b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.134316 997 rpcz_store.cc:276] 0620 07:01:01.034177 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.867013 (+832836us) service_pool.cc:227] Handling call
0620 07:01:01.867472 (+ 459us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.867492 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.007944 (+140452us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.089787 (+ 81843us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.089955 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.134760 997 tablet_service.cc:1514] Processing DeleteTablet for tablet c2e38178b9244152915d4c0a9dcf59dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.135470 997 tablet_service.cc:1467] Processing CreateTablet for tablet e6bae5090f81417cbcf4b4d598b438da (DEFAULT_TABLE table=default.Table_ea9e545f34d741778517df5391bca063 [id=e872cbca26c7448ea0b1e65fd692f96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.135914 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6bae5090f81417cbcf4b4d598b438da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.137377 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c6f6140b587a47069d1123f1ff4eef8b" } new_table_name: "default.Table_a48735bdc4c54529aa2a8ee62db1c4b0" modify_external_catalogs: true
I20260620 07:01:02.140938 1013 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 285) took 1088 ms. Trace:
I20260620 07:01:02.141106 1013 rpcz_store.cc:276] 0620 07:01:01.032277 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.672844 (+640567us) service_pool.cc:227] Handling call
0620 07:01:01.673753 (+ 909us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.673808 (+ 55us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.049961 (+376153us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.120219 (+ 70258us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.120496 (+ 277us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.142158 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 2bc3dd1306af4e49a9fec197b5740374 (DEFAULT_TABLE table=default.Table_49d850227cc94454b2919e6c54793f35 [id=501af04cab4f4a0da5d8396e8f629397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.142402 1167 ts_tablet_manager.cc:1428] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.057s user 0.003s sys 0.000s
I20260620 07:01:02.142976 1167 tablet_bootstrap.cc:492] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:02.144600 1167 tablet_bootstrap.cc:654] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.131734 1170 consensus_queue.cc:260] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.142602 995 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 299) took 1096 ms. Trace:
I20260620 07:01:02.142494 1010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 274) took 1424 ms. Trace:
I20260620 07:01:02.145815 1010 rpcz_store.cc:276] 0620 07:01:00.705360 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.088671 (+383311us) service_pool.cc:227] Handling call
0620 07:01:01.089158 (+ 487us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.089184 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.066461 (+977277us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.129268 (+ 62807us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.129443 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.146138 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2f0c28057b4534a8a400d1ca7f3991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.146337 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet a9daee42d5c748ceaed7dc94f551c0d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.146520 1168 tablet_bootstrap.cc:654] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.146522 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.146697 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.146899 995 rpcz_store.cc:276] 0620 07:01:01.035776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.081302 (+1045526us) service_pool.cc:227] Handling call
0620 07:01:02.081849 (+ 547us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.081874 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.116713 (+ 34839us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.131898 (+ 15185us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.132118 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.147464 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet cd75e318982a4fb9bf28cb35b030642f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.147853 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 25b878def9344cbdae65b209cac4067f (DEFAULT_TABLE table=default.Table_9e2f2ecd97ee48f89579302e371615a7 [id=07e9b630b86b44ad8440941033df1efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.148303 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25b878def9344cbdae65b209cac4067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.149739 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76237044ff2f4c8b84c6af43badd164a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.151083 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bc3dd1306af4e49a9fec197b5740374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.155547 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e643fb0890042ae891ea17f0bc03740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.159822 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 877a71e8db5f4bf689df39f83735f326
I20260620 07:01:02.163784 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]). Expected version 1 got 0
I20260620 07:01:02.164049 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_1e9b65d54a164a3f811eb9afb9c090ff [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 3 got 0
I20260620 07:01:02.167021 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_122650b95e6f401ca38b940863232ee4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.167819 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_122650b95e6f401ca38b940863232ee4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.138286 994 tablet_service.cc:1467] Processing CreateTablet for tablet 033c8b817757441ea7ebc2dbf77aa2dd (DEFAULT_TABLE table=default.Table_1099ae03924f4f4b95324ddaac35f9cf [id=a7528a9274144f0ebbcd1efa102a2a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.175314 1165 raft_consensus.cc:2229] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.181354 418 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3] alter complete (version 2)
I20260620 07:01:02.182513 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7200877be18c4eaca57df88c25d30c01" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.183266 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83451bba9a3c4c209dddf4250fea8806" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.183504 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8822fe581d474be2a24d69357f8c3331"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.184248 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8822fe581d474be2a24d69357f8c3331 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.186311 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ff06bc5fc684b9195c719cbf39d34a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.187870 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 033c8b817757441ea7ebc2dbf77aa2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.191434 890 raft_consensus.cc:1261] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Refusing update from remote peer 2b84cae646b24bc7bd424eb8434ad425: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:01:02.196739 874 tablet_service.cc:1514] Processing DeleteTablet for tablet cb26f1d10f9a4978b41afbd8894f1102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.201510 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_95a1a4e2127e468a819635950d7f6b5f" } new_table_name: "default.Table_9dd2793fba0e423ab605fac4be9fc8c9" modify_external_catalogs: true
I20260620 07:01:02.201642 999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 256) took 2015 ms. Trace:
I20260620 07:01:02.203249 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b0faf91f2f469f9b06e17caa4709e4" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:02.203431 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6dca84adc5940e5a5505378e7276731 consensus state has no leader
I20260620 07:01:02.203948 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0936aaf00bfd443a9fb64da285fd6a89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.204533 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0936aaf00bfd443a9fb64da285fd6a89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.206305 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d5d361a5404dcf99a89e93ac1f7dd8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.207818 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37f336c01974ba79caeb25f4781667a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.210479 1240 raft_consensus.cc:482] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:02.213071 1165 pending_rounds.cc:62] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:02.214820 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e275d82068074370ba1e32b7ca5fdcc3" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:02.222472 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.222816 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 7200877be18c4eaca57df88c25d30c01 with delete_type TABLET_DATA_DELETED (replaced by tablet 4655d289c94c4bce9707be375fc4b850) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.223037 723 tablet_service.cc:1514] Processing DeleteTablet for tablet 17590c6a1a96414f84632a8b0e0a795b with delete_type TABLET_DATA_DELETED (replaced by tablet 2ee94c1a799a47f997469f96005167dc) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.223232 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.216051 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f53f0302d1a4fb3a0fe3e1d98583550" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:02.224476 1240 raft_consensus.cc:504] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.225086 1240 leader_election.cc:288] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:02.225510 728 tablet_service.cc:1514] Processing DeleteTablet for tablet e275d82068074370ba1e32b7ca5fdcc3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89f5e2f055fb469dbbb935bba724dcb5) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.225836 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 877a71e8db5f4bf689df39f83735f326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.225987 720 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d1e4719cd441dd8054b24861cbd8a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.226102 727 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6102e0da4e42cd9f1d6e294bb372b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.226836 1170 ts_tablet_manager.cc:1428] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.049s user 0.003s sys 0.000s
I20260620 07:01:02.227233 1170 tablet_bootstrap.cc:492] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:02.230424 1170 tablet_bootstrap.cc:654] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.235247 999 rpcz_store.cc:276] 0620 07:01:00.186119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.692862 (+506743us) service_pool.cc:227] Handling call
0620 07:01:01.392297 (+699435us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.392330 (+ 33us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.814897 (+422567us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.201448 (+386551us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.201607 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.236624 1169 ts_tablet_manager.cc:1918] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:02.236789 1169 log.cc:1196] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/978f99d2a7d6448aba8dcd2611b75af3
I20260620 07:01:02.237175 1169 ts_tablet_manager.cc:1939] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:02.240623 995 tablet_service.cc:1467] Processing CreateTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f (DEFAULT_TABLE table=default.Table_5d2a4e7b8377498685861a195b5c2401 [id=91c7f13bfdb84770a1ef410a269a10e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.241084 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.241765 1556 raft_consensus.cc:686] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:02.240965 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21f51aeb329e42359cfaf7de2a039d13" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.240211 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "978f99d2a7d6448aba8dcd2611b75af3" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.243462 892 raft_consensus.cc:2379] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:01:02.242091 1581 tablet.cc:1717] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: Skipping requested alter to schema version 2, tablet already version 2
I20260620 07:01:02.243762 1165 pending_rounds.cc:68] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821565434601472 op_type: NO_OP noop_request { }
I20260620 07:01:02.245030 1581 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49218 (request call id 315) took 1119 ms. Trace:
I20260620 07:01:02.245167 1581 rpcz_store.cc:276] 0620 07:01:01.125469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.125527 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:02.244995 (+1119468us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:01.126094 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:01.126228 (+ 134us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:01.639247 (+513019us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:01.639260 (+ 13us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:01.639313 (+ 53us) alter_schema_op.cc:126] START. Timestamp: 1781938861639291
0620 07:01:01.639318 (+ 5us) op_driver.cc:331] REPLICATION: starting
0620 07:01:01.639529 (+ 211us) log.cc:842] Serialized 173 byte log entry
0620 07:01:02.241900 (+602371us) op_driver.cc:444] REPLICATION: finished
0620 07:01:02.242008 (+ 108us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:02.244913 (+ 2905us) log.cc:842] Serialized 94 byte log entry
0620 07:01:02.244957 (+ 44us) alter_schema_op.cc:71] Released schema lock
0620 07:01:02.244961 (+ 4us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":49,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":35513,"prepare.run_wall_time_us":513932,"replication_time_us":602556}]]}
I20260620 07:01:02.242084 1556 consensus_queue.cc:237] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.249418 999 tablet_service.cc:1467] Processing CreateTablet for tablet eb0f7d4b6fa14811a1f02456418f95a4 (DEFAULT_TABLE table=default.Table_f0ce8fdcfe2e4b7ab9659cfbb3fdf49b [id=ea9135e430a142ab992288c43fe54bf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.249572 1006 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 286) took 1214 ms. Trace:
I20260620 07:01:02.249711 1006 rpcz_store.cc:276] 0620 07:01:01.032393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.783853 (+751460us) service_pool.cc:227] Handling call
0620 07:01:01.821064 (+ 37211us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.821093 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:01.853861 (+ 32768us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.246599 (+392738us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.247296 (+ 697us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":542}
I20260620 07:01:02.254851 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cb04a2e17f3417aaf0f89f0c7f78159" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.254937 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6102e0da4e42cd9f1d6e294bb372b2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.255103 894 raft_consensus.cc:2454] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:02.248113 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17590c6a1a96414f84632a8b0e0a795b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:02.256125 1012 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 284) took 1214 ms. Trace:
I20260620 07:01:02.256989 1170 tablet_bootstrap.cc:492] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:02.257225 1170 ts_tablet_manager.cc:1397] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s
I20260620 07:01:02.257995 1170 raft_consensus.cc:348] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.255488 1027 raft_consensus.cc:2454] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:02.258424 1170 raft_consensus.cc:374] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.259037 1170 raft_consensus.cc:729] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.259336 1170 consensus_queue.cc:260] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.259948 1170 ts_tablet_manager.cc:1428] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260620 07:01:02.260313 1170 tablet_bootstrap.cc:492] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:02.262053 1170 tablet_bootstrap.cc:654] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.253244 1165 raft_consensus.cc:2866] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:02.262336 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b0faf91f2f469f9b06e17caa4709e4" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.262423 1165 raft_consensus.cc:2258] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.265264 1169 tablet_replica.cc:330] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:02.265643 1169 raft_consensus.cc:2229] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.266222 1169 raft_consensus.cc:2258] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.267969 1012 rpcz_store.cc:276] 0620 07:01:01.032165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.659716 (+627551us) service_pool.cc:227] Handling call
0620 07:01:01.674458 (+ 14742us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.674482 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.068665 (+394183us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.239397 (+170732us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.246990 (+ 7593us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.268340 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e275d82068074370ba1e32b7ca5fdcc3" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.268596 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 125e8a5e20bf484cade408f0358489a1 (DEFAULT_TABLE table=default.Table_c0c512543c584906a978970ff6a532dc [id=bb41cdc85465446193c33f0722351f6a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:02.269384 969 consensus_peers.cc:487] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:02.269891 1004 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 282) took 1240 ms. Trace:
I20260620 07:01:02.269997 1004 rpcz_store.cc:276] 0620 07:01:01.031801 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.611079 (+579278us) service_pool.cc:227] Handling call
0620 07:01:01.623019 (+ 11940us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.623044 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.054455 (+431411us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.264979 (+210524us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.265145 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.271822 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb0f7d4b6fa14811a1f02456418f95a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.272285 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 4260b0c953c14a198dbf9b64a30e7e05 (DEFAULT_TABLE table=default.Table_d66e26edeccc4a138950de609d6c107f [id=dbe2ab45243b4aeca16c961149135563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.273066 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 978f99d2a7d6448aba8dcd2611b75af3 (table default.Table_407d8f13b4bd41fb8675708922430b28 [id=c6b286f7e44a496aa9f070c73a885062]) successfully deleted
W20260620 07:01:02.273502 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f6bdcd8cd2574acf867b7ec487559db2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6bdcd8cd2574acf867b7ec487559db2 already in progress: creating tablet
I20260620 07:01:02.273753 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 125e8a5e20bf484cade408f0358489a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:02.273823 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6fbd069552314f2c9ee010c054386644 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fbd069552314f2c9ee010c054386644 already in progress: creating tablet
W20260620 07:01:02.274060 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet cb26f1d10f9a4978b41afbd8894f1102 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb26f1d10f9a4978b41afbd8894f1102 already in progress: creating tablet
W20260620 07:01:02.274281 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6ff06bc5fc684b9195c719cbf39d34a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ff06bc5fc684b9195c719cbf39d34a6 already in progress: creating tablet
I20260620 07:01:02.269237 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 877a71e8db5f4bf689df39f83735f326 (DEFAULT_TABLE table=default.Table_890aba75c15e4e5990b4c0cae43dd28e [id=a302748f0b1e46209ebe7622280629a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.276373 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4260b0c953c14a198dbf9b64a30e7e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.277187 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7200877be18c4eaca57df88c25d30c01" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:02.277165 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_323e0a217ebf4aad8ef0137a7599dd92" } new_table_name: "default.Table_82b05df0be154af2a16995218ce6f735" modify_external_catalogs: true
I20260620 07:01:02.277390 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877a71e8db5f4bf689df39f83735f326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.286329 1165 ts_tablet_manager.cc:1905] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.288306 1538 tablet.cc:1722] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:02.292690 998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 298) took 1257 ms. Trace:
I20260620 07:01:02.292958 998 rpcz_store.cc:276] 0620 07:01:01.035672 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.049081 (+1013409us) service_pool.cc:227] Handling call
0620 07:01:02.049555 (+ 474us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.049577 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.289766 (+240189us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.292460 (+ 2694us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.292649 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.293669 998 tablet_service.cc:1467] Processing CreateTablet for tablet 91f8c4955c164e6b9061ac607bbe081c (DEFAULT_TABLE table=default.Table_128623186307486c86826727c2978537 [id=ceb3d35427694e1099764949625fac6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.294229 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91f8c4955c164e6b9061ac607bbe081c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.300680 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e54f1185cd4c5c8e5d2ed289b61650" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.301973 1011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 297) took 1266 ms. Trace:
I20260620 07:01:02.302922 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 (table default.Table_c3a21b866a364f0e97c74a240faf1dff [id=a53fbb10c3c84cb698f8973d0e23bce0]) successfully deleted
I20260620 07:01:02.268015 1169 ts_tablet_manager.cc:1905] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:02.301929 683 leader_election.cc:341] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:02.306979 683 leader_election.cc:341] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.307104 683 leader_election.cc:302] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:02.309213 852 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45966 (request call id 132) took 1432 ms. Trace:
I20260620 07:01:02.310549 852 rpcz_store.cc:276] 0620 07:01:00.876992 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.877888 (+ 896us) service_pool.cc:227] Handling call
0620 07:01:01.944034 (+1066146us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x6150000c8b24. stack: 00007f3d444d566e 00007f3d444d5430 00007f3d4355c5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3d4f9dd630 00007f3d535b5c7f 00007f3d4e121016 00007f3d4e120d45 00007f3d4b0119be 00007f3d4b01079e 00007f3d4b016b25 00007f3d4b01754f 00007f3d4b017378 00000000009edb7c
0620 07:01:02.309166 (+365132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":764464512}
I20260620 07:01:02.282948 1618 raft_consensus.cc:482] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:02.313585 1618 raft_consensus.cc:504] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.314355 1618 leader_election.cc:288] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:02.314517 1618 raft_consensus.cc:2726] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.314726 1618 consensus_queue.cc:1035] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:02.308403 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17590c6a1a96414f84632a8b0e0a795b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.323508 1168 tablet_bootstrap.cc:492] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:02.323707 1168 ts_tablet_manager.cc:1397] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.273s user 0.009s sys 0.014s
I20260620 07:01:02.325030 856 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45966 (request call id 134) took 1431 ms. Trace:
W20260620 07:01:02.331480 683 leader_election.cc:341] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.331751 683 leader_election.cc:302] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:02.332463 683 leader_election.cc:341] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.332651 683 leader_election.cc:302] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:02.332856 683 raft_consensus.cc:2670] T 21f51aeb329e42359cfaf7de2a039d13 P 2b84cae646b24bc7bd424eb8434ad425: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:02.307960 1007 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 292) took 1273 ms. Trace:
I20260620 07:01:02.308544 1166 ts_tablet_manager.cc:1918] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260620 07:01:02.333774 683 leader_election.cc:341] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.310633 996 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 279) took 1286 ms. Trace:
I20260620 07:01:02.316563 1000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 276) took 1598 ms. Trace:
I20260620 07:01:02.322093 1008 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 294) took 1286 ms. Trace:
I20260620 07:01:02.334064 683 leader_election.cc:302] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:02.273043 1606 consensus_queue.cc:1035] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.055s
W20260620 07:01:02.334353 683 raft_consensus.cc:2670] T 978f99d2a7d6448aba8dcd2611b75af3 P 2b84cae646b24bc7bd424eb8434ad425: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:02.324188 1005 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 291) took 1290 ms. Trace:
I20260620 07:01:02.327378 1001 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 261) took 1786 ms. Trace:
W20260620 07:01:02.334733 683 leader_election.cc:341] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.335107 683 leader_election.cc:302] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:02.335417 855 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45966 (request call id 131) took 1461 ms. Trace:
I20260620 07:01:02.335721 683 leader_election.cc:302] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:02.336696 1618 raft_consensus.cc:2726] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.336975 1618 raft_consensus.cc:2726] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.337212 1618 raft_consensus.cc:2781] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:02.337365 1618 raft_consensus.cc:482] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:02.337505 1618 raft_consensus.cc:3037] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:02.340751 1618 raft_consensus.cc:504] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.332362 831 leader_election.cc:302] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:02.344640 1011 rpcz_store.cc:276] 0620 07:01:01.035563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.040089 (+1004526us) service_pool.cc:227] Handling call
0620 07:01:02.117850 (+ 77761us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x618000005118. stack: 00007f5f3ef5866e 00007f5f3ef58430 00007f5f3dfdf5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f5f3ef4e0fd 00007f5f3ef4dd1e 00007f5f51e573cd 00007f5f51e5736c 00007f5f4e0dd334 00007f5f4e0b634a 00007f5f4e00e40b 00007f5f48637ac6 00007f5f486377f5 00007f5f45a949be
0620 07:01:02.117892 (+ 42us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.117920 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.244613 (+126693us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.301747 (+ 57134us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.301920 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":14962944}
I20260620 07:01:02.345573 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bc3dd1306af4e49a9fec197b5740374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.346190 856 rpcz_store.cc:276] 0620 07:01:00.877226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.877342 (+ 116us) service_pool.cc:227] Handling call
0620 07:01:01.943633 (+1066291us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x6150000c8b24. stack: 00007f3d444d566e 00007f3d444d5430 00007f3d4355c5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3d4f9dd630 00007f3d535b5c7f 00007f3d4e121016 00007f3d4e120d45 00007f3d4b0119be 00007f3d4b01079e 00007f3d4b016b25 00007f3d4b01754f 00007f3d4b017378 00000000009edb7c
0620 07:01:02.308327 (+364694us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":942493056}
I20260620 07:01:02.349313 854 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45966 (request call id 133) took 1455 ms. Trace:
I20260620 07:01:02.349437 854 rpcz_store.cc:276] 0620 07:01:00.877129 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.877278 (+ 149us) service_pool.cc:227] Handling call
0620 07:01:01.943841 (+1066563us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x6150000c8b24. stack: 00007f3d444d566e 00007f3d444d5430 00007f3d4355c5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3d4f9dd630 00007f3d535b5c7f 00007f3d4e121016 00007f3d4e120d45 00007f3d4b0119be 00007f3d4b01079e 00007f3d4b016b25 00007f3d4b01754f 00007f3d4b017378 00000000009edb7c
0620 07:01:02.139707 (+195866us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x6150000cdda4. stack: 00007f3d444d566e 00007f3d444d5430 00007f3d4355c5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3d4f9dd630 00007f3d535b5c7f 00007f3d4e121016 00007f3d4e120d45 00007f3d4b0119be 00007f3d4b01079e 00007f3d4b016b25 00007f3d4b01754f 00007f3d4b017378 00000000009edb7c
0620 07:01:02.332962 (+193255us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":948151040}
I20260620 07:01:02.351913 890 raft_consensus.cc:2454] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:02.344723 1168 raft_consensus.cc:348] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.352293 1168 raft_consensus.cc:374] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.353433 1168 raft_consensus.cc:729] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.353760 1168 consensus_queue.cc:260] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.360373 1168 ts_tablet_manager.cc:1428] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20260620 07:01:02.360731 1168 tablet_bootstrap.cc:492] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:02.362598 941 heartbeater.cc:347] Connected to a master server at 127.0.97.60:46775
I20260620 07:01:02.347041 1606 raft_consensus.cc:482] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:02.364987 996 rpcz_store.cc:276] 0620 07:01:01.023939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.384136 (+360197us) service_pool.cc:227] Handling call
0620 07:01:01.407397 (+ 23261us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.407430 (+ 33us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.260211 (+852781us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.310457 (+ 50246us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.310603 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.365829 1008 rpcz_store.cc:276] 0620 07:01:01.035225 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.871099 (+835874us) service_pool.cc:227] Handling call
0620 07:01:01.886024 (+ 14925us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.886050 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.265577 (+379527us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.321881 (+ 56304us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.322032 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.366201 1005 rpcz_store.cc:276] 0620 07:01:01.033973 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.860393 (+826420us) service_pool.cc:227] Handling call
0620 07:01:01.861032 (+ 639us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.861066 (+ 34us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.140442 (+279376us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.323999 (+183557us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.324133 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.347973 1007 rpcz_store.cc:276] 0620 07:01:01.034088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.864802 (+830714us) service_pool.cc:227] Handling call
0620 07:01:01.865407 (+ 605us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.865438 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.138995 (+273557us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.307734 (+168739us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.307895 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.368917 1000 rpcz_store.cc:276] 0620 07:01:00.717798 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.168101 (+450303us) service_pool.cc:227] Handling call
0620 07:01:01.257652 (+ 89551us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.257686 (+ 34us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.239603 (+981917us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.316110 (+ 76507us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.316520 (+ 410us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.370083 1166 log.cc:1196] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/8a56f30ca69e45e3a9ddd41f117f61e2
I20260620 07:01:02.366540 1001 rpcz_store.cc:276] 0620 07:01:00.540917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.018629 (+477712us) service_pool.cc:227] Handling call
0620 07:01:01.058721 (+ 40092us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:01.058746 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.214412 (+1155666us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.327160 (+112748us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.327327 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.371726 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.372182 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 1d9d4b5a69484176a7b0f4fded010867 (DEFAULT_TABLE table=default.Table_e027fe5ccca8447d86ad610b8cec54f0 [id=a974a44b8ef1483883a25d46c2673d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.369588 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 08ec769f903c4438bc1186d5fc1c5108 (DEFAULT_TABLE table=default.Table_b16e5dbf81bc4141936830a4dc9b06fb [id=654e042eb7604d72a01475f1d80bb47c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.381721 1165 ts_tablet_manager.cc:1918] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:02.382208 1165 log.cc:1196] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/7d9f7cf9e3a14e28ac20662b5e86dc41
I20260620 07:01:02.382830 1165 ts_tablet_manager.cc:1939] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:02.384336 996 tablet_service.cc:1514] Processing DeleteTablet for tablet cfff2a14b1184d39bd7ac1091ef749c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:02.385398 969 consensus_peers.cc:487] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:02.385991 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d9d4b5a69484176a7b0f4fded010867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.383437 1537 raft_consensus.cc:2726] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.383560 855 rpcz_store.cc:276] 0620 07:01:00.873721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.874044 (+ 323us) service_pool.cc:227] Handling call
0620 07:01:01.927615 (+1053571us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x6150000c8b24. stack: 00007f3d444d566e 00007f3d444d5430 00007f3d4355c5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3d4f9dd630 00007f3d535b5c7f 00007f3d4e121016 00007f3d4e120d45 00007f3d4b0119be 00007f3d4b01079e 00007f3d4b016b25 00007f3d4b01754f 00007f3d4b017378 00000000009edb7c
0620 07:01:02.139308 (+211693us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x6150000cdda4. stack: 00007f3d444d566e 00007f3d444d5430 00007f3d4355c5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3d4f9dd630 00007f3d535b5c7f 00007f3d4e121016 00007f3d4e120d45 00007f3d4b0119be 00007f3d4b01079e 00007f3d4b016b25 00007f3d4b01754f 00007f3d4b017378 00000000009edb7c
0620 07:01:02.333081 (+193773us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x616000141530. stack: 00007f3d444d566e 00007f3d444d5430 00007f3d4355c5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3d50cbafea 00007f3d535b5a88 00007f3d4e121016 00007f3d4e120d45 00007f3d4b0119be 00007f3d4b01079e 00007f3d4b016b25 00007f3d4b01754f 00007f3d4b017378 00000000009edb7c
0620 07:01:02.335350 (+ 2269us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":920352128}
W20260620 07:01:02.383836 831 leader_election.cc:341] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 8b8d90f8d63e45ce990aead6166bcfb6
I20260620 07:01:02.386910 831 leader_election.cc:302] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:02.387295 1537 raft_consensus.cc:2726] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:02.387816 831 leader_election.cc:341] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ba760b5fe1204df2932edd15bdcbaadf
I20260620 07:01:02.388031 831 leader_election.cc:302] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:02.389393 1537 raft_consensus.cc:2726] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 07:01:02.390012 831 consensus_peers.cc:487] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8799f2a2aed4688aa4e6e590dc83a4e. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:02.391702 1618 leader_election.cc:288] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:02.391901 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 88c01c4e10f345fc84e3e253e8501aff (DEFAULT_TABLE table=default.Table_1e18ab4a35f347abb061df0a7db49226 [id=3234298ef6b649e78f3c7c7c61facd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.392544 996 tablet_service.cc:1467] Processing CreateTablet for tablet a96030064de046e5873bdaab6f3dff60 (DEFAULT_TABLE table=default.Table_106ca3379ea3425d9151703d76671d6b [id=cd14c89b450240fcb6bf3b1a3b51346f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.393560 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 877a71e8db5f4bf689df39f83735f326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.394163 1009 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 296) took 1358 ms. Trace:
I20260620 07:01:02.395000 1009 rpcz_store.cc:276] 0620 07:01:01.035467 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.026190 (+990723us) service_pool.cc:227] Handling call
0620 07:01:02.075154 (+ 48964us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.075186 (+ 32us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.243086 (+167900us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.393978 (+150892us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.394126 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.395471 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 183) took 3642 ms. Trace:
I20260620 07:01:02.395659 1165 rpcz_store.cc:276] 0620 07:00:58.752636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.753189 (+ 553us) service_pool.cc:227] Handling call
0620 07:01:02.097199 (+3344010us) ts_tablet_manager.cc:1145] Deleting tablet 7d9f7cf9e3a14e28ac20662b5e86dc41
0620 07:01:02.097209 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:02.198037 (+100828us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x6150000cdda4. stack: 00007f3d444d566e 00007f3d444d5430 00007f3d4355c5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3d4fa0d04d 00007f3d50cb15ec 00007f3d536402e6 00007f3d53672404 00007f3d53653870 00007f3d536535fd 00000000009edb7c 00007f3d4451b344 00007f3d4451e91b 00007f3d4451e798
0620 07:01:02.375481 (+177444us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.381562 (+ 6081us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.395434 (+ 13872us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":87884672,"tablet-delete.queue_time_us":3343817}
I20260620 07:01:02.395853 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 76237044ff2f4c8b84c6af43badd164a (DEFAULT_TABLE table=default.Table_efed404b281b40a9b74f079c46716d6d [id=9a5474f49e014c7481b0eeb4a0ca5554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.396301 1165 tablet_replica.cc:330] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:02.396746 1165 raft_consensus.cc:2229] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.399250 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 00a3ccec08ee4c8480a808b1402eb4a9 (DEFAULT_TABLE table=default.Table_ded62bf712ad4611be190bac322171a2 [id=7a412b5ded944c1bb75fef061cd6de07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.397413 1606 raft_consensus.cc:504] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.399864 1168 tablet_bootstrap.cc:654] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:02.401324 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 134f76587b6147afaf4e94fde5574efc consensus state has no leader
I20260620 07:01:02.401373 1606 leader_election.cc:288] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:02.405242 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69113a64960d4aee9a2a4fcb28570bf2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.406224 1165 raft_consensus.cc:2258] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.406039 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 (table default.Table_a8832b6e92294c9c9e051bc22e13b5e4 [id=1b7f0b11c53649f29df954f7abcd30f1]) successfully deleted
W20260620 07:01:02.407475 1579 lock_manager.cc:586] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 18149383899969019341) tablet 00000000000000000000000000000000 cur holder 0x617000070b00
I20260620 07:01:02.407640 1165 ts_tablet_manager.cc:1905] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.407701 994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 300) took 1353 ms. Trace:
I20260620 07:01:02.408084 994 rpcz_store.cc:276] 0620 07:01:01.035872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.119225 (+1083353us) service_pool.cc:227] Handling call
0620 07:01:02.172770 (+ 53545us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.172801 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.313045 (+140244us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.388881 (+ 75836us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.389037 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.408751 994 tablet_service.cc:1467] Processing CreateTablet for tablet e37f336c01974ba79caeb25f4781667a (DEFAULT_TABLE table=default.Table_fa5e48ba0ba24f30a0212db6021bc618 [id=faf33298650347f1860fd8982c8a242a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.410568 997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 303) took 1367 ms. Trace:
I20260620 07:01:02.410799 997 rpcz_store.cc:276] 0620 07:01:01.043137 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.135170 (+1092033us) service_pool.cc:227] Handling call
0620 07:01:02.135723 (+ 553us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.135748 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.229355 (+ 93607us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.410101 (+180746us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.410264 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.411873 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fbd069552314f2c9ee010c054386644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.412358 997 tablet_service.cc:1514] Processing DeleteTablet for tablet cb26f1d10f9a4978b41afbd8894f1102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.415443 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e643fb0890042ae891ea17f0bc03740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.424089 1165 ts_tablet_manager.cc:1918] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:02.424984 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 076926f7dffe4a7b80c25ea3c18e9958 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:02.426097 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c7ad555de0774a6e9ecf9af82802275d" } new_table_name: "default.Table_e31ff399ff5e4a309b29286a69aea7f0" modify_external_catalogs: true
I20260620 07:01:02.427029 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_52bd8cf613ad458b8436906e69e4cbd8" } modify_external_catalogs: true
I20260620 07:01:02.427219 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_52bd8cf613ad458b8436906e69e4cbd8" } modify_external_catalogs: true
I20260620 07:01:02.427703 1165 log.cc:1196] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/537ab1626d4e44c38d8cca8c51921424
I20260620 07:01:02.427995 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_61fb27a9ecc44d718bdfa4051514a36a" } modify_external_catalogs: true
I20260620 07:01:02.428203 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_61fb27a9ecc44d718bdfa4051514a36a" } modify_external_catalogs: true
I20260620 07:01:02.428536 1165 ts_tablet_manager.cc:1939] T 537ab1626d4e44c38d8cca8c51921424 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:02.428761 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9" } modify_external_catalogs: true
I20260620 07:01:02.428946 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9" } modify_external_catalogs: true
I20260620 07:01:02.429687 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 185) took 3671 ms. Trace:
I20260620 07:01:02.429831 1165 rpcz_store.cc:276] 0620 07:00:58.757998 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.758039 (+ 41us) service_pool.cc:227] Handling call
0620 07:01:02.396211 (+3638172us) ts_tablet_manager.cc:1145] Deleting tablet 537ab1626d4e44c38d8cca8c51921424
0620 07:01:02.396245 (+ 34us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:02.411797 (+ 15552us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.423963 (+ 12166us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.429598 (+ 5635us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3637925}
I20260620 07:01:02.429932 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c756f636ed334c2980b9a0850b223922"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:02.430481 1165 tablet_replica.cc:330] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:02.430534 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c756f636ed334c2980b9a0850b223922 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.431041 1165 raft_consensus.cc:2229] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.431367 1165 raft_consensus.cc:2258] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:02.430186 969 leader_election.cc:341] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.432497 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a3dece319ace4b3c8341417bad1846e4" } modify_external_catalogs: true
I20260620 07:01:02.432675 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a3dece319ace4b3c8341417bad1846e4" } modify_external_catalogs: true
I20260620 07:01:02.432837 1168 tablet_bootstrap.cc:492] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:02.433049 1168 ts_tablet_manager.cc:1397] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.008s
W20260620 07:01:02.433497 1584 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.355s user 0.017s sys 0.001s
I20260620 07:01:02.433955 1168 raft_consensus.cc:348] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.434278 1168 raft_consensus.cc:374] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.434374 1168 raft_consensus.cc:729] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:02.434432 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 consensus state has no leader
I20260620 07:01:02.434697 1168 consensus_queue.cc:260] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.434739 1001 tablet_service.cc:1467] Processing CreateTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 (DEFAULT_TABLE table=default.Table_8e736cf278274ffc858ff174e1567e0e [id=26c4b0db3c984eb8a79d9aa31548a229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.435595 1168 ts_tablet_manager.cc:1428] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:02.435900 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 978f99d2a7d6448aba8dcd2611b75af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.435999 1168 tablet_bootstrap.cc:492] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:02.436580 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ff06bc5fc684b9195c719cbf39d34a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.436962 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ec769f903c4438bc1186d5fc1c5108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.438584 423 master_service.cc:946] ReplaceTablet: received request to replace tablet e5b6c578055d4f95b44c85eba8e92ac8 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:02.439283 1165 ts_tablet_manager.cc:1905] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.439718 1003 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 295) took 1331 ms. Trace:
I20260620 07:01:02.439877 1003 rpcz_store.cc:276] 0620 07:01:01.035359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.023530 (+988171us) service_pool.cc:227] Handling call
0620 07:01:02.024069 (+ 539us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.024095 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.285265 (+261170us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.366871 (+ 81606us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.367053 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.440286 1166 ts_tablet_manager.cc:1939] T 8a56f30ca69e45e3a9ddd41f117f61e2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:02.440723 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 170) took 3686 ms. Trace:
I20260620 07:01:02.440843 1166 rpcz_store.cc:276] 0620 07:00:58.753751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.754068 (+ 317us) service_pool.cc:227] Handling call
0620 07:01:01.622146 (+2868078us) ts_tablet_manager.cc:1145] Deleting tablet 8a56f30ca69e45e3a9ddd41f117f61e2
0620 07:01:01.622158 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:01.756433 (+134275us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x6160000a36a0. stack: 00007f5f3ef5866e 00007f5f3ef58430 00007f5f3dfdf5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f5f4a3b06b0 00007f5f4a39809e 00007f5f4a4235ec 00007f5f4a490130 00007f5f4b7345ec 00007f5f4e0c32e6 00007f5f4e0f5404 00007f5f4e0d6870 00007f5f4e0d65fd 00000000009edb7c
0620 07:01:02.212342 (+455909us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.308410 (+ 96068us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.440688 (+132278us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70151,"spinlock_wait_cycles":81266048,"tablet-delete.queue_time_us":2861941}
I20260620 07:01:02.441283 1166 tablet_replica.cc:330] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:02.441936 1166 raft_consensus.cc:2229] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.442164 1166 raft_consensus.cc:2258] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.443446 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 8a56f30ca69e45e3a9ddd41f117f61e2 (table default.Table_04030fe8e5944650b8eb6f7dd65772a8 [id=2c07cdb2efd841a290e899541b97dcec]) successfully deleted
I20260620 07:01:02.444394 1168 tablet_bootstrap.cc:654] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.444303 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 6c4b81f2b92f4363829034d3fe290742 (DEFAULT_TABLE table=default.Table_262e214778774fe4aca99fb3c3bcf96d [id=6fcbcf995f28481ea31b3a41340a978b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:02.445372 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6e2c297072741eb927dff9bcf6a573f consensus state has no leader
I20260620 07:01:02.445688 1167 tablet_bootstrap.cc:492] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:01:02.447405 1028 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.598s user 0.000s sys 0.018s
W20260620 07:01:02.447584 1028 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.668s user 0.000s sys 0.018s
W20260620 07:01:02.447999 1030 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s user 0.003s sys 0.011s
I20260620 07:01:02.447904 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9e3ed63a3519442893a8e57bbe75d01c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:02.448237 864 tablet_service.cc:1467] Processing CreateTablet for tablet 5926946427294a5ca6fbc72d3e1b612d (DEFAULT_TABLE table=default.Table_0948b3a7b876431dafb498c00e40cc2e [id=fe4914615d844910998e00900b81fe05]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:02.448472 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e3ed63a3519442893a8e57bbe75d01c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:02.448518 1030 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s user 0.003s sys 0.011s
I20260620 07:01:02.448690 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5926946427294a5ca6fbc72d3e1b612d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:02.448383 1201 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.676s user 0.000s sys 0.015s
W20260620 07:01:02.448866 1201 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.748s user 0.000s sys 0.016s
I20260620 07:01:02.449712 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4b0078a40169404eb33b169cdb5f08df" } modify_external_catalogs: true
I20260620 07:01:02.449892 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4b0078a40169404eb33b169cdb5f08df" } modify_external_catalogs: true
I20260620 07:01:02.451570 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_76c9c7cd30ad48e1ae0eca9e170fd5d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.452123 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76c9c7cd30ad48e1ae0eca9e170fd5d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.452335 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af743ffd2eb2427caa3779c7fceb8f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.453845 860 tablet_service.cc:1467] Processing CreateTablet for tablet 0a4bebaa8ed1431d8c775f4856a3d808 (DEFAULT_TABLE table=default.Table_ed11da599e5c4b44b63531233e52da80 [id=5129c45c780d450ea02914b5e4c1754f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.454771 868 tablet_service.cc:1467] Processing CreateTablet for tablet 6c4b81f2b92f4363829034d3fe290742 (DEFAULT_TABLE table=default.Table_262e214778774fe4aca99fb3c3bcf96d [id=6fcbcf995f28481ea31b3a41340a978b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.455288 863 tablet_service.cc:1467] Processing CreateTablet for tablet 9ad723586ff545049dad658221e6455b (DEFAULT_TABLE table=default.Table_254d991dafd44638affdf98c4da87aa5 [id=ff75396ba7974241b25eeda39f6974db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.455673 861 tablet_service.cc:1467] Processing CreateTablet for tablet 485ce059be9b4900adb1dbc3268efb55 (DEFAULT_TABLE table=default.Table_3ab345e4abbc4b6c9cf08c26e1a95287 [id=96b547ecb1de4ab3838dab042caeac95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.455976 869 tablet_service.cc:1467] Processing CreateTablet for tablet 2a064674792b42d49e9ff20a7496f820 (DEFAULT_TABLE table=default.Table_2de23d7d170247068bfba22c795a5c56 [id=c086fc9d1bb843ce811a4028237375f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.456840 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c4b81f2b92f4363829034d3fe290742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.459484 862 tablet_service.cc:1467] Processing CreateTablet for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (DEFAULT_TABLE table=default.Table_8bee6b731503444fa747e3bad786e4ad [id=bd3649f95ee640eeaeb1d585ac20e4e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.460706 871 tablet_service.cc:1467] Processing CreateTablet for tablet c73bcb81a0c84cdfb4dea0561647828a (DEFAULT_TABLE table=default.Table_5ddbd67fa9074a4b817bbe12a7725343 [id=166782c539214a359fa49796e3643504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.461011 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a4bebaa8ed1431d8c775f4856a3d808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.462534 1166 ts_tablet_manager.cc:1905] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.463974 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 54bb495eea4c49b7ad7bf2300ad0e60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.464394 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 0a4bebaa8ed1431d8c775f4856a3d808 (DEFAULT_TABLE table=default.Table_ed11da599e5c4b44b63531233e52da80 [id=5129c45c780d450ea02914b5e4c1754f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.464406 870 tablet_service.cc:1467] Processing CreateTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb (DEFAULT_TABLE table=default.Table_16d8164f00f14ef5bfa42f210bf3aed7 [id=37e74ef650534d1c90d6669ca2b43d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.464722 859 tablet_service.cc:1467] Processing CreateTablet for tablet 2c0bb50405d0446488272384523c2deb (DEFAULT_TABLE table=default.Table_429cabf4e04f4125b89d28e55eca678b [id=f31a91ff5fe241a1832414544e7a1e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.464916 866 tablet_service.cc:1467] Processing CreateTablet for tablet 4128a4e9a228456cb5cd08eef2bf73d4 (DEFAULT_TABLE table=default.Table_8d71ef260d5149c9aa47d33c9b4e3c8f [id=c263c37cb6584037bd9fbd704dd61f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.465205 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ad723586ff545049dad658221e6455b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.466096 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 5926946427294a5ca6fbc72d3e1b612d (DEFAULT_TABLE table=default.Table_0948b3a7b876431dafb498c00e40cc2e [id=fe4914615d844910998e00900b81fe05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.468694 997 tablet_service.cc:1467] Processing CreateTablet for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (DEFAULT_TABLE table=default.Table_8bee6b731503444fa747e3bad786e4ad [id=bd3649f95ee640eeaeb1d585ac20e4e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.367511 1556 consensus_queue.cc:1035] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:02.367830 683 leader_election.cc:341] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:02.471424 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 103598us
W20260620 07:01:02.471693 683 leader_election.cc:341] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:02.471887 683 leader_election.cc:341] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:02.472292 683 leader_election.cc:341] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.472481 683 leader_election.cc:302] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:02.473030 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 485ce059be9b4900adb1dbc3268efb55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.473371 1556 raft_consensus.cc:2781] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:02.473462 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c4b81f2b92f4363829034d3fe290742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.473467 1556 raft_consensus.cc:482] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:02.473577 1556 raft_consensus.cc:3037] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:02.476255 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 2a064674792b42d49e9ff20a7496f820 (DEFAULT_TABLE table=default.Table_2de23d7d170247068bfba22c795a5c56 [id=c086fc9d1bb843ce811a4028237375f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.476352 1556 raft_consensus.cc:504] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.477226 1556 leader_election.cc:288] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:02.342393 1170 tablet_bootstrap.cc:492] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:02.402895 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69113a64960d4aee9a2a4fcb28570bf2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:02.477810 751 raft_consensus.cc:2454] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:02.418440 1581 tablet.cc:1722] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:02.459969 723 tablet_service.cc:1467] Processing CreateTablet for tablet 0a4bebaa8ed1431d8c775f4856a3d808 (DEFAULT_TABLE table=default.Table_ed11da599e5c4b44b63531233e52da80 [id=5129c45c780d450ea02914b5e4c1754f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.460196 720 tablet_service.cc:1467] Processing CreateTablet for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (DEFAULT_TABLE table=default.Table_8bee6b731503444fa747e3bad786e4ad [id=bd3649f95ee640eeaeb1d585ac20e4e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.460417 721 tablet_service.cc:1467] Processing CreateTablet for tablet 2a064674792b42d49e9ff20a7496f820 (DEFAULT_TABLE table=default.Table_2de23d7d170247068bfba22c795a5c56 [id=c086fc9d1bb843ce811a4028237375f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.460527 724 tablet_service.cc:1467] Processing CreateTablet for tablet 6c4b81f2b92f4363829034d3fe290742 (DEFAULT_TABLE table=default.Table_262e214778774fe4aca99fb3c3bcf96d [id=6fcbcf995f28481ea31b3a41340a978b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.478726 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a4bebaa8ed1431d8c775f4856a3d808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.460764 729 tablet_service.cc:1467] Processing CreateTablet for tablet 2c0bb50405d0446488272384523c2deb (DEFAULT_TABLE table=default.Table_429cabf4e04f4125b89d28e55eca678b [id=f31a91ff5fe241a1832414544e7a1e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.460835 728 tablet_service.cc:1467] Processing CreateTablet for tablet 9ad723586ff545049dad658221e6455b (DEFAULT_TABLE table=default.Table_254d991dafd44638affdf98c4da87aa5 [id=ff75396ba7974241b25eeda39f6974db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.459969 727 tablet_service.cc:1467] Processing CreateTablet for tablet 5926946427294a5ca6fbc72d3e1b612d (DEFAULT_TABLE table=default.Table_0948b3a7b876431dafb498c00e40cc2e [id=fe4914615d844910998e00900b81fe05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.461128 734 tablet_service.cc:1467] Processing CreateTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb (DEFAULT_TABLE table=default.Table_16d8164f00f14ef5bfa42f210bf3aed7 [id=37e74ef650534d1c90d6669ca2b43d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.479730 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a064674792b42d49e9ff20a7496f820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.480664 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c73bcb81a0c84cdfb4dea0561647828a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.481470 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e30fb1d050c4439bb72a21a0f2b13eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.481673 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ad723586ff545049dad658221e6455b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.482774 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba189cfcef094a7bb45bc7d5f4ee5b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.486960 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c4b81f2b92f4363829034d3fe290742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.488227 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5926946427294a5ca6fbc72d3e1b612d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.490928 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a064674792b42d49e9ff20a7496f820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.491340 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c0bb50405d0446488272384523c2deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.495157 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba189cfcef094a7bb45bc7d5f4ee5b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.510020 1170 ts_tablet_manager.cc:1397] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.250s user 0.002s sys 0.002s
I20260620 07:01:02.510849 1170 raft_consensus.cc:348] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.511181 1170 raft_consensus.cc:374] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.511289 1170 raft_consensus.cc:729] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.511548 1170 consensus_queue.cc:260] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.512655 1170 ts_tablet_manager.cc:1428] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:02.512806 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4128a4e9a228456cb5cd08eef2bf73d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.512974 1170 tablet_bootstrap.cc:492] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:02.514758 1170 tablet_bootstrap.cc:654] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.515061 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e30fb1d050c4439bb72a21a0f2b13eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.517690 1240 raft_consensus.cc:482] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:02.517827 1240 raft_consensus.cc:504] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.518548 1240 leader_election.cc:288] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:02.518867 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 319027us
I20260620 07:01:02.519021 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c0bb50405d0446488272384523c2deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.521000 1169 ts_tablet_manager.cc:1918] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:02.520788 681 leader_election.cc:341] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.521539 1169 log.cc:1196] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/9e643fb0890042ae891ea17f0bc03740
I20260620 07:01:02.521318 681 leader_election.cc:302] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:02.521942 1169 ts_tablet_manager.cc:1939] T 9e643fb0890042ae891ea17f0bc03740 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:02.522349 1240 raft_consensus.cc:2726] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.523805 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17590c6a1a96414f84632a8b0e0a795b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:02.524024 894 raft_consensus.cc:3037] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:02.524315 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360880717af145628606b5b9fb26e350" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.525086 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7d1e4719cd441dd8054b24861cbd8a2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.525460 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 877a71e8db5f4bf689df39f83735f326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.526049 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 485ce059be9b4900adb1dbc3268efb55 (DEFAULT_TABLE table=default.Table_3ab345e4abbc4b6c9cf08c26e1a95287 [id=96b547ecb1de4ab3838dab042caeac95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.526539 968 leader_election.cc:302] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:02.526726 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76237044ff2f4c8b84c6af43badd164a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.524039 896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cb04a2e17f3417aaf0f89f0c7f78159" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:02.527103 896 raft_consensus.cc:3037] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:02.527338 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a4bebaa8ed1431d8c775f4856a3d808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.528095 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5926946427294a5ca6fbc72d3e1b612d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:02.529531 683 leader_election.cc:341] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:02.529769 683 leader_election.cc:341] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.530575 896 raft_consensus.cc:2454] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:02.531395 683 leader_election.cc:302] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:02.531585 894 raft_consensus.cc:2454] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:02.531719 1622 raft_consensus.cc:2781] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:02.531894 1622 raft_consensus.cc:686] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:02.532318 1167 ts_tablet_manager.cc:1397] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.303s user 0.005s sys 0.004s
I20260620 07:01:02.532733 683 leader_election.cc:302] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:02.533063 1240 raft_consensus.cc:2781] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:02.533238 1240 raft_consensus.cc:686] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:02.533548 1240 consensus_queue.cc:237] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.532361 1622 consensus_queue.cc:237] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.534548 721 tablet_service.cc:1467] Processing CreateTablet for tablet c73bcb81a0c84cdfb4dea0561647828a (DEFAULT_TABLE table=default.Table_5ddbd67fa9074a4b817bbe12a7725343 [id=166782c539214a359fa49796e3643504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.535277 734 tablet_service.cc:1467] Processing CreateTablet for tablet 4128a4e9a228456cb5cd08eef2bf73d4 (DEFAULT_TABLE table=default.Table_8d71ef260d5149c9aa47d33c9b4e3c8f [id=c263c37cb6584037bd9fbd704dd61f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.535744 723 tablet_service.cc:1467] Processing CreateTablet for tablet 485ce059be9b4900adb1dbc3268efb55 (DEFAULT_TABLE table=default.Table_3ab345e4abbc4b6c9cf08c26e1a95287 [id=96b547ecb1de4ab3838dab042caeac95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.538854 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 9e643fb0890042ae891ea17f0bc03740 (table default.Table_ddfa02b01d2248a188748eda117387da [id=65b5bbb9004b4c28b8233868e05c293a]) successfully deleted
I20260620 07:01:02.544186 1333 raft_consensus.cc:2781] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:02.544338 1333 raft_consensus.cc:482] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:02.545547 1333 raft_consensus.cc:3037] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:02.546442 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 50971.6us
I20260620 07:01:02.549965 1170 tablet_bootstrap.cc:492] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:02.550457 1170 ts_tablet_manager.cc:1397] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.001s
I20260620 07:01:02.553292 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cb04a2e17f3417aaf0f89f0c7f78159" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:02.553817 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17590c6a1a96414f84632a8b0e0a795b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:02.560253 1031 raft_consensus.cc:3037] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:02.561376 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00a3ccec08ee4c8480a808b1402eb4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.561932 1538 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:02.564965 1615 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:02.565649 1031 raft_consensus.cc:2454] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:02.566931 1581 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:02.570113 1608 tablet.cc:1717] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: Skipping requested alter to schema version 2, tablet already version 2
I20260620 07:01:02.571493 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c73bcb81a0c84cdfb4dea0561647828a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.573086 1169 tablet_replica.cc:330] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:02.573364 1169 raft_consensus.cc:2229] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.575356 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7d1e4719cd441dd8054b24861cbd8a2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:02.578002 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a96030064de046e5873bdaab6f3dff60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.578212 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4128a4e9a228456cb5cd08eef2bf73d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.581302 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 485ce059be9b4900adb1dbc3268efb55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.581754 1538 tablet.cc:1722] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:02.584816 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 4128a4e9a228456cb5cd08eef2bf73d4 (DEFAULT_TABLE table=default.Table_8d71ef260d5149c9aa47d33c9b4e3c8f [id=c263c37cb6584037bd9fbd704dd61f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.592070 421 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6] alter complete (version 1)
W20260620 07:01:02.594383 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2b0faf91f2f469f9b06e17caa4709e4 consensus state has no leader
I20260620 07:01:02.595116 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3456cf91d65a4413a35efe94513c723d
I20260620 07:01:02.595798 427 master_service.cc:946] ReplaceTablet: received request to replace tablet f8ec1e179a704e5480f3deaf856156e7 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:02.596871 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 3456cf91d65a4413a35efe94513c723d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.599630 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 95a109e7871241ec9467858dca467bbe
I20260620 07:01:02.600445 426 master_service.cc:946] ReplaceTablet: received request to replace tablet b39e682e71ed4776a786f7d30158e7e0 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:02.600992 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_1e9b65d54a164a3f811eb9afb9c090ff [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 3 got 0
I20260620 07:01:02.602453 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cd006a20258f4cedbcd2af7947903296" } new_table_name: "default.Table_5c2cb157c156453ab32c75abc2ab6a09" modify_external_catalogs: true
I20260620 07:01:02.602567 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 95a109e7871241ec9467858dca467bbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.604524 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f690e150839a4d23860932712f61e7c8
I20260620 07:01:02.605400 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5e8dce362a8a4795b0f72083fae12317"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.606176 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e8dce362a8a4795b0f72083fae12317 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.607519 859 tablet_service.cc:1514] Processing DeleteTablet for tablet f690e150839a4d23860932712f61e7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.610754 1581 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:02.612604 421 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:02.626976 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 3456cf91d65a4413a35efe94513c723d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.628158 723 tablet_service.cc:1514] Processing DeleteTablet for tablet f690e150839a4d23860932712f61e7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.628500 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 95a109e7871241ec9467858dca467bbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:02.631450 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 45283.4us
I20260620 07:01:02.644232 1169 raft_consensus.cc:2258] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.645042 1169 ts_tablet_manager.cc:1905] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.647764 1170 raft_consensus.cc:348] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.648175 1170 raft_consensus.cc:374] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.648311 1170 raft_consensus.cc:729] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.648733 1170 consensus_queue.cc:260] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.649416 1170 ts_tablet_manager.cc:1428] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.099s user 0.002s sys 0.000s
I20260620 07:01:02.659551 1538 tablet.cc:1717] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: Skipping requested alter to schema version 2, tablet already version 2
W20260620 07:01:02.672966 681 leader_election.cc:341] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.673180 681 leader_election.cc:302] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:02.673728 681 leader_election.cc:341] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.674178 1170 tablet_bootstrap.cc:492] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:02.677419 1170 tablet_bootstrap.cc:654] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.679971 1538 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:02.687296 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c8f81fa4e88945f1a392fbacfd031392
I20260620 07:01:02.592767 1615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 301) took 1556 ms. Trace:
I20260620 07:01:02.597431 1333 raft_consensus.cc:504] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.688469 1333 leader_election.cc:288] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:02.688062 1615 rpcz_store.cc:276] 0620 07:01:01.035962 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.122802 (+1086840us) service_pool.cc:227] Handling call
0620 07:01:02.592719 (+469917us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:02.205247 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:02.205312 (+ 65us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:02.205318 (+ 6us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:02.205322 (+ 4us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:02.205359 (+ 37us) alter_schema_op.cc:126] START. Timestamp: 1781938862205301
0620 07:01:02.205362 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:02.449184 (+243822us) log.cc:842] Serialized 173 byte log entry
0620 07:01:02.449608 (+ 424us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x6150000ea224. stack: 00007f5f3ef5866e 00007f5f3ef58430 00007f5f3dfdf5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f5f4a466d02 00007f5f4b7997f1 00007f5f4b798359 00007f5f4b7a01bb 00007f5f4b7a0038 00000000009edb7c 00007f5f3ef9e344 00007f5f3efa191b 00007f5f3efa1798 00000000009edb7c
0620 07:01:02.529505 (+ 79897us) op_driver.cc:444] REPLICATION: finished
0620 07:01:02.530665 (+ 1160us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:02.588397 (+ 57732us) log.cc:842] Serialized 5 byte log entry
0620 07:01:02.591949 (+ 3552us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.592435 (+ 486us) log.cc:842] Serialized 14 byte log entry
0620 07:01:02.592679 (+ 244us) alter_schema_op.cc:71] Released schema lock
0620 07:01:02.592682 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":79,"prepare.queue_time_us":32949,"prepare.run_cpu_time_us":2773,"prepare.run_wall_time_us":244422,"raft.queue_time_us":5045,"raft.run_cpu_time_us":553,"raft.run_wall_time_us":686,"replication_time_us":324106,"spinlock_wait_cycles":560155520,"thread_start_us":242992,"threads_started":1}]]}
I20260620 07:01:02.691608 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 3 got 0
I20260620 07:01:02.600428 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e54f1185cd4c5c8e5d2ed289b61650" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:02.628473 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360880717af145628606b5b9fb26e350" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:02.628702 1201 raft_consensus.cc:482] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:02.694092 859 tablet_service.cc:1514] Processing DeleteTablet for tablet c8f81fa4e88945f1a392fbacfd031392 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.628813 995 tablet_service.cc:1467] Processing CreateTablet for tablet 9ad723586ff545049dad658221e6455b (DEFAULT_TABLE table=default.Table_254d991dafd44638affdf98c4da87aa5 [id=ff75396ba7974241b25eeda39f6974db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.629033 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb (DEFAULT_TABLE table=default.Table_16d8164f00f14ef5bfa42f210bf3aed7 [id=37e74ef650534d1c90d6669ca2b43d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.629194 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88c01c4e10f345fc84e3e253e8501aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.635234 999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 313) took 1060 ms. Trace:
I20260620 07:01:02.633277 1608 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:02.644860 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 2c0bb50405d0446488272384523c2deb (DEFAULT_TABLE table=default.Table_429cabf4e04f4125b89d28e55eca678b [id=f31a91ff5fe241a1832414544e7a1e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.646543 1167 raft_consensus.cc:348] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.655998 1007 tablet_service.cc:1467] Processing CreateTablet for tablet c73bcb81a0c84cdfb4dea0561647828a (DEFAULT_TABLE table=default.Table_5ddbd67fa9074a4b817bbe12a7725343 [id=166782c539214a359fa49796e3643504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.659003 1013 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 304) took 1456 ms. Trace:
I20260620 07:01:02.668999 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 3456cf91d65a4413a35efe94513c723d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.680635 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 95a109e7871241ec9467858dca467bbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.699301 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37f336c01974ba79caeb25f4781667a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.699558 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c0bb50405d0446488272384523c2deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.699885 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a064674792b42d49e9ff20a7496f820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.701090 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 485ce059be9b4900adb1dbc3268efb55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.702144 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba189cfcef094a7bb45bc7d5f4ee5b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.702584 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4128a4e9a228456cb5cd08eef2bf73d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.702875 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69113a64960d4aee9a2a4fcb28570bf2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
W20260620 07:01:02.704358 969 leader_election.cc:341] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.706883 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ad723586ff545049dad658221e6455b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.674400 1618 raft_consensus.cc:2726] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.673635 1622 consensus_queue.cc:1035] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:02.708550 1167 raft_consensus.cc:374] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.708665 1167 raft_consensus.cc:729] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.693113 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69113a64960d4aee9a2a4fcb28570bf2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:02.708935 1167 consensus_queue.cc:260] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.709239 753 raft_consensus.cc:3037] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:02.709502 999 rpcz_store.cc:276] 0620 07:01:01.567473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.235659 (+668186us) service_pool.cc:227] Handling call
0620 07:01:02.249769 (+ 14110us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.249793 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.330008 (+ 80215us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.628101 (+298093us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.628303 (+ 202us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.713208 1167 ts_tablet_manager.cc:1428] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.177s user 0.002s sys 0.000s
I20260620 07:01:02.713635 1013 rpcz_store.cc:276] 0620 07:01:01.047454 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.141423 (+1093969us) service_pool.cc:227] Handling call
0620 07:01:02.150861 (+ 9438us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.150896 (+ 35us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.373128 (+222232us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.502562 (+129434us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.503464 (+ 902us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.716006 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet c8f81fa4e88945f1a392fbacfd031392 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.717590 753 raft_consensus.cc:2454] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:02.712801 1201 raft_consensus.cc:504] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.722148 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet f690e150839a4d23860932712f61e7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:02.674366 681 leader_election.cc:341] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.703852 721 tablet_service.cc:1514] Processing DeleteTablet for tablet c8f81fa4e88945f1a392fbacfd031392 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.724602 681 leader_election.cc:302] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:02.725445 1622 raft_consensus.cc:2726] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:02.726011 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 51643.6us
W20260620 07:01:02.727531 681 leader_election.cc:341] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.728191 681 leader_election.cc:302] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:02.730697 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b39e682e71ed4776a786f7d30158e7e0
I20260620 07:01:02.731159 426 catalog_manager.cc:6565] ReplaceTablet: tablet b39e682e71ed4776a786f7d30158e7e0 deleted and replaced by tablet d9a7fab4d1684604be1b81d4d4bbe560
I20260620 07:01:02.732810 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4655d289c94c4bce9707be375fc4b850
I20260620 07:01:02.733896 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_625f280b139743a0a8a21f7e57df0f21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.734701 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_625f280b139743a0a8a21f7e57df0f21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.734760 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c73bcb81a0c84cdfb4dea0561647828a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.739054 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8d90f8d63e45ce990aead6166bcfb6" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:02.743813 1169 ts_tablet_manager.cc:1918] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:02.736727 418 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad] alter complete (version 1)
I20260620 07:01:02.737833 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1c43b2d4813c4afa9752e8e55c232a42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.745478 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c43b2d4813c4afa9752e8e55c232a42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.738488 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_87c64053fbc3481390a21b3940acb5ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:02.738710 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b829d1b373034423ae5025caa27ff52f" } new_table_name: "default.Table_3b7824f8ca9245a4808576761591080d" modify_external_catalogs: true
W20260620 07:01:02.747617 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87c64053fbc3481390a21b3940acb5ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.747949 1169 log.cc:1196] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/04d5d361a5404dcf99a89e93ac1f7dd8
I20260620 07:01:02.740693 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8cec159b248a44ed97cd71cca66c5e9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.748548 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cec159b248a44ed97cd71cca66c5e9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.749096 1169 ts_tablet_manager.cc:1939] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:02.750082 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet b39e682e71ed4776a786f7d30158e7e0 with delete_type TABLET_DATA_DELETED (replaced by tablet d9a7fab4d1684604be1b81d4d4bbe560) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.751199 895 raft_consensus.cc:2454] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:02.753417 859 tablet_service.cc:1514] Processing DeleteTablet for tablet b39e682e71ed4776a786f7d30158e7e0 with delete_type TABLET_DATA_DELETED (replaced by tablet d9a7fab4d1684604be1b81d4d4bbe560) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.755422 1167 tablet_bootstrap.cc:492] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:02.753180 1622 raft_consensus.cc:2726] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.754001 1169 tablet_replica.cc:330] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:02.755597 969 leader_election.cc:302] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:02.755947 1333 raft_consensus.cc:2781] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:02.755993 1169 raft_consensus.cc:2229] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:02.756414 1169 pending_rounds.cc:62] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:02.756541 1169 pending_rounds.cc:68] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821579764416512 op_type: NO_OP noop_request { }
I20260620 07:01:02.756783 1169 raft_consensus.cc:2866] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:02.756942 1169 raft_consensus.cc:2258] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.757851 1169 ts_tablet_manager.cc:1905] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.760280 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e30fb1d050c4439bb72a21a0f2b13eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.767882 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 4655d289c94c4bce9707be375fc4b850 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.768136 1333 raft_consensus.cc:482] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:02.768254 1333 raft_consensus.cc:3037] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:02.768936 1201 leader_election.cc:288] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:02.764814 968 leader_election.cc:302] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:02.770967 1608 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 309) took 1415 ms. Trace:
I20260620 07:01:02.771087 1608 rpcz_store.cc:276] 0620 07:01:01.342965 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.147135 (+804170us) service_pool.cc:227] Handling call
0620 07:01:02.758330 (+611195us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:02.449709 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:02.449806 (+ 97us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:02.592697 (+142891us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:02.592706 (+ 9us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:02.592803 (+ 97us) alter_schema_op.cc:126] START. Timestamp: 1781938862592728
0620 07:01:02.592806 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:02.593138 (+ 332us) log.cc:842] Serialized 173 byte log entry
0620 07:01:02.609088 (+ 15950us) op_driver.cc:444] REPLICATION: finished
0620 07:01:02.609206 (+ 118us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:02.704876 (+ 95670us) log.cc:842] Serialized 5 byte log entry
0620 07:01:02.757863 (+ 52987us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.758206 (+ 343us) log.cc:842] Serialized 14 byte log entry
0620 07:01:02.758266 (+ 60us) alter_schema_op.cc:71] Released schema lock
0620 07:01:02.758273 (+ 7us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":62,"prepare.queue_time_us":250505,"prepare.run_cpu_time_us":8676,"prepare.run_wall_time_us":143808,"raft.queue_time_us":970,"raft.run_cpu_time_us":551,"raft.run_wall_time_us":3216,"replication_time_us":16253}]]}
I20260620 07:01:02.772053 1201 raft_consensus.cc:2781] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:02.773353 1201 raft_consensus.cc:686] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:02.773758 1201 consensus_queue.cc:237] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:02.775643 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 51069.1us
I20260620 07:01:02.776327 1168 tablet_bootstrap.cc:492] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:02.776528 1168 ts_tablet_manager.cc:1397] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.341s user 0.003s sys 0.002s
I20260620 07:01:02.777024 866 tablet_service.cc:1514] Processing DeleteTablet for tablet 4655d289c94c4bce9707be375fc4b850 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.781754 1168 raft_consensus.cc:348] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.782166 1168 raft_consensus.cc:374] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.782285 1168 raft_consensus.cc:729] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.782560 1168 consensus_queue.cc:260] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.785193 1538 tablet.cc:1717] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Skipping requested alter to schema version 3, tablet already version 3
I20260620 07:01:02.785662 1169 ts_tablet_manager.cc:1918] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:02.785822 1169 log.cc:1196] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/7200877be18c4eaca57df88c25d30c01
I20260620 07:01:02.786080 1168 ts_tablet_manager.cc:1428] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260620 07:01:02.786559 1168 tablet_bootstrap.cc:492] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:02.789239 1639 raft_consensus.cc:482] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:02.789616 1169 ts_tablet_manager.cc:1939] T 7200877be18c4eaca57df88c25d30c01 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:02.789419 1639 raft_consensus.cc:504] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.790333 1639 leader_election.cc:288] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:02.791081 831 leader_election.cc:341] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 9e643fb0890042ae891ea17f0bc03740
I20260620 07:01:02.794044 1608 tablet.cc:1717] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Skipping requested alter to schema version 3, tablet already version 3
I20260620 07:01:02.794508 1608 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 321) took 1128 ms. Trace:
I20260620 07:01:02.794945 1169 tablet_replica.cc:330] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:02.795506 1169 raft_consensus.cc:2229] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:02.796020 1608 rpcz_store.cc:276] 0620 07:01:01.665949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.366171 (+700222us) service_pool.cc:227] Handling call
0620 07:01:02.794466 (+428295us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:02.593630 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:02.593831 (+ 201us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:02.759199 (+165368us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:02.759211 (+ 12us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:02.759260 (+ 49us) alter_schema_op.cc:126] START. Timestamp: 1781938862759191
0620 07:01:02.759262 (+ 2us) op_driver.cc:331] REPLICATION: starting
0620 07:01:02.759466 (+ 204us) log.cc:842] Serialized 173 byte log entry
0620 07:01:02.779932 (+ 20466us) op_driver.cc:444] REPLICATION: finished
0620 07:01:02.786210 (+ 6278us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:02.794354 (+ 8144us) log.cc:842] Serialized 94 byte log entry
0620 07:01:02.794410 (+ 56us) alter_schema_op.cc:71] Released schema lock
0620 07:01:02.794417 (+ 7us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":6171,"mutex_wait_us":484,"prepare.queue_time_us":205057,"prepare.run_cpu_time_us":16076,"prepare.run_wall_time_us":166457,"raft.queue_time_us":575,"raft.run_cpu_time_us":639,"raft.run_wall_time_us":11109,"replication_time_us":20616}]]}
I20260620 07:01:02.797268 1169 pending_rounds.cc:62] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:02.797663 1169 pending_rounds.cc:68] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821580940562432 op_type: NO_OP noop_request { }
I20260620 07:01:02.798065 1169 raft_consensus.cc:2866] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:02.800678 1169 raft_consensus.cc:2258] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.803159 1169 ts_tablet_manager.cc:1905] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.803560 1168 tablet_bootstrap.cc:654] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.794989 1622 raft_consensus.cc:482] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:02.813638 1581 tablet.cc:1717] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Skipping requested alter to schema version 3, tablet already version 3
I20260620 07:01:02.815455 1165 ts_tablet_manager.cc:1918] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:02.815631 1165 log.cc:1196] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/1f763b0e91544700bd672c2ef751b4d2
I20260620 07:01:02.816147 1165 ts_tablet_manager.cc:1939] T 1f763b0e91544700bd672c2ef751b4d2 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:02.816599 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 184) took 4058 ms. Trace:
I20260620 07:01:02.816736 1165 rpcz_store.cc:276] 0620 07:00:58.757867 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.757919 (+ 52us) service_pool.cc:227] Handling call
0620 07:01:02.430360 (+3672441us) ts_tablet_manager.cc:1145] Deleting tablet 1f763b0e91544700bd672c2ef751b4d2
0620 07:01:02.430371 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:02.626408 (+196037us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.815269 (+188861us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.816559 (+ 1290us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3666303}
I20260620 07:01:02.817413 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 1f763b0e91544700bd672c2ef751b4d2 (table default.Table_61741807e243431395868ee24844d1aa [id=31b071f3fa7547fb8a222ac6b8bffd6a]) successfully deleted
I20260620 07:01:02.817847 1165 tablet_replica.cc:330] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:02.818142 1165 raft_consensus.cc:2229] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.818361 1165 raft_consensus.cc:2258] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.819152 1165 ts_tablet_manager.cc:1905] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.822000 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e643fb0890042ae891ea17f0bc03740" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:02.823482 1622 raft_consensus.cc:504] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.824523 1622 leader_election.cc:288] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:02.824553 1078 heartbeater.cc:503] Master 127.0.97.60:46775 was elected leader, sending a full tablet report...
I20260620 07:01:02.824819 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169b93c38e59435db218152f2d25bdfa" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:02.825330 683 leader_election.cc:341] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:02.828990 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 102224us
W20260620 07:01:02.829365 681 leader_election.cc:341] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.829553 681 leader_election.cc:302] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:02.829857 1622 raft_consensus.cc:2726] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.831068 721 tablet_service.cc:1514] Processing DeleteTablet for tablet b39e682e71ed4776a786f7d30158e7e0 with delete_type TABLET_DATA_DELETED (replaced by tablet d9a7fab4d1684604be1b81d4d4bbe560) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.831775 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 4655d289c94c4bce9707be375fc4b850 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.833012 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 04d5d361a5404dcf99a89e93ac1f7dd8 (table default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]) successfully deleted
I20260620 07:01:02.836377 1169 ts_tablet_manager.cc:1918] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:02.840565 1169 log.cc:1196] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/17590c6a1a96414f84632a8b0e0a795b
I20260620 07:01:02.841264 1169 ts_tablet_manager.cc:1939] T 17590c6a1a96414f84632a8b0e0a795b P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:02.843183 1169 tablet_replica.cc:330] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:01:02.844666 969 consensus_peers.cc:487] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 537ab1626d4e44c38d8cca8c51921424. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:02.845082 1169 raft_consensus.cc:2229] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:02.845806 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 17590c6a1a96414f84632a8b0e0a795b (table default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]) successfully deleted
W20260620 07:01:02.846191 830 leader_election.cc:341] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.846364 830 leader_election.cc:302] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:02.846683 1640 raft_consensus.cc:2726] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.846933 1169 pending_rounds.cc:62] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:02.847078 1169 pending_rounds.cc:68] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821580942114816 op_type: NO_OP noop_request { }
I20260620 07:01:02.847311 1169 raft_consensus.cc:2866] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:02.847558 1169 raft_consensus.cc:2258] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.847784 1170 tablet_bootstrap.cc:492] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:02.847942 1170 ts_tablet_manager.cc:1397] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.174s user 0.003s sys 0.003s
I20260620 07:01:02.848734 1170 raft_consensus.cc:348] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.848999 1170 raft_consensus.cc:374] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.849121 1170 raft_consensus.cc:729] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.849453 1170 consensus_queue.cc:260] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:02.849778 968 leader_election.cc:341] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 8b8d90f8d63e45ce990aead6166bcfb6
I20260620 07:01:02.850102 1170 ts_tablet_manager.cc:1428] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:02.851233 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.852941 1170 tablet_bootstrap.cc:492] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:02.855907 1169 ts_tablet_manager.cc:1905] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.861500 1165 ts_tablet_manager.cc:1918] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:02.862089 998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 317) took 1250 ms. Trace:
I20260620 07:01:02.876066 1169 ts_tablet_manager.cc:1918] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:02.876379 1169 log.cc:1196] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/8cb04a2e17f3417aaf0f89f0c7f78159
I20260620 07:01:02.877118 1169 ts_tablet_manager.cc:1939] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:02.878171 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169b93c38e59435db218152f2d25bdfa" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:02.879938 1169 tablet_replica.cc:330] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:02.880661 998 rpcz_store.cc:276] 0620 07:01:01.597753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.293347 (+695594us) service_pool.cc:227] Handling call
0620 07:01:02.293986 (+ 639us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:02.294017 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:02.595866 (+301849us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.847594 (+251728us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:02.847764 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:02.880996 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 8cb04a2e17f3417aaf0f89f0c7f78159 (table default.Table_c649dd8a94d74f428ec6a8c9b77288c2 [id=82c73c656d3148df95ac377dfe7f38fd]) successfully deleted
I20260620 07:01:02.883883 1168 tablet_bootstrap.cc:492] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:02.885352 1168 ts_tablet_manager.cc:1397] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.099s user 0.006s sys 0.001s
W20260620 07:01:02.885499 681 leader_election.cc:341] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.885653 681 leader_election.cc:302] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:02.885936 1622 raft_consensus.cc:2726] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.887430 1168 raft_consensus.cc:348] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.889626 1168 raft_consensus.cc:374] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:02.889786 1168 raft_consensus.cc:729] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:02.890156 1168 consensus_queue.cc:260] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:02.893124 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6c7b3977b604cb69df671318fae1212 has no consensus state
I20260620 07:01:02.893697 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a3d3d98477d84cc790b30ecc0d2d8e98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.894351 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3d3d98477d84cc790b30ecc0d2d8e98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.895766 1169 raft_consensus.cc:2229] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.895984 1169 raft_consensus.cc:2258] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.895912 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c3468f43caff46b1903034e2d5a4279f" } new_table_name: "default.Table_4563e27d87354007895f9d9819e8d8a0" modify_external_catalogs: true
I20260620 07:01:02.897290 419 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_1e9b65d54a164a3f811eb9afb9c090ff [id=be57b2e7e64a4f669ef82569004d523e] alter complete (version 3)
I20260620 07:01:02.897900 1166 ts_tablet_manager.cc:1918] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:02.898222 1169 ts_tablet_manager.cc:1905] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.898717 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_92260deae314470797bd29ca83c08e68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.899329 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92260deae314470797bd29ca83c08e68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:02.900712 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9e70b585def4a4a9081a0938af8ce5b consensus state has no leader
I20260620 07:01:02.903077 418 master_service.cc:946] ReplaceTablet: received request to replace tablet b39e682e71ed4776a786f7d30158e7e0 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:02.905702 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_904f4a1baff64c6da846a77c48f9ee64" } new_table_name: "default.Table_c74dcab9083d4b6f894cee0e428ad089" modify_external_catalogs: true
I20260620 07:01:02.894968 1333 raft_consensus.cc:504] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.906956 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f8ec1e179a704e5480f3deaf856156e7
I20260620 07:01:02.907362 427 catalog_manager.cc:6565] ReplaceTablet: tablet f8ec1e179a704e5480f3deaf856156e7 deleted and replaced by tablet 13c7f0513df34ddb8104b06e5733fb62
I20260620 07:01:02.907649 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_70cd2b21da3a42e99c045dd88f19eb5e" } modify_external_catalogs: true
I20260620 07:01:02.907869 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_70cd2b21da3a42e99c045dd88f19eb5e" } modify_external_catalogs: true
I20260620 07:01:02.908780 1333 leader_election.cc:288] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:02.910209 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_79f82cf183f64103a58283b6793b810f" } new_table_name: "default.Table_b4024ad63b56439d939324ae131affe6" modify_external_catalogs: true
I20260620 07:01:02.911890 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4fd706d123b84bd4869c44a4d0e794c3" } modify_external_catalogs: true
I20260620 07:01:02.912096 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4fd706d123b84bd4869c44a4d0e794c3" } modify_external_catalogs: true
I20260620 07:01:02.915982 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 360880717af145628606b5b9fb26e350 with delete_type TABLET_DATA_DELETED (replaced by tablet 2910da33bbdb4410a4a90ff9747a7de1) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.916210 723 tablet_service.cc:1514] Processing DeleteTablet for tablet 17590c6a1a96414f84632a8b0e0a795b with delete_type TABLET_DATA_DELETED (replaced by tablet 2ee94c1a799a47f997469f96005167dc) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.916370 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.916512 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 81704d3a3cf648d987d4b40a270f7508 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.917033 1169 ts_tablet_manager.cc:1918] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:02.917158 1169 log.cc:1196] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/e275d82068074370ba1e32b7ca5fdcc3
I20260620 07:01:02.917560 1169 ts_tablet_manager.cc:1939] T e275d82068074370ba1e32b7ca5fdcc3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:02.919054 724 tablet_service.cc:1514] Processing DeleteTablet for tablet f8ec1e179a704e5480f3deaf856156e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c7f0513df34ddb8104b06e5733fb62) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:02.919886 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 169b93c38e59435db218152f2d25bdfa with delete_type TABLET_DATA_DELETED (replaced by tablet 5a4390225af348f89c934f0f179ddab5) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:02.922832 968 leader_election.cc:341] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 8b8d90f8d63e45ce990aead6166bcfb6
I20260620 07:01:02.927243 1170 tablet_bootstrap.cc:654] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.930060 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet e275d82068074370ba1e32b7ca5fdcc3 (table default.Table_89bf00306e9c44a0a0de2e0a7235f436 [id=24b0b6eb9f944dbb971530ee8f603c0e]) successfully deleted
W20260620 07:01:02.930361 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 877a71e8db5f4bf689df39f83735f326 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 877a71e8db5f4bf689df39f83735f326 already in progress: creating tablet
I20260620 07:01:02.904572 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.904858 866 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f763b0e91544700bd672c2ef751b4d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:56 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.911644 870 tablet_service.cc:1514] Processing DeleteTablet for tablet f8ec1e179a704e5480f3deaf856156e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c7f0513df34ddb8104b06e5733fb62) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:02.915710 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8d90f8d63e45ce990aead6166bcfb6" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:02.931149 893 raft_consensus.cc:3037] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:02.931818 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet f8ec1e179a704e5480f3deaf856156e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c7f0513df34ddb8104b06e5733fb62) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:02.933775 1168 ts_tablet_manager.cc:1428] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.048s user 0.001s sys 0.001s
I20260620 07:01:02.934234 893 raft_consensus.cc:2454] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:02.934868 1168 tablet_bootstrap.cc:492] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:02.935171 1640 raft_consensus.cc:482] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:02.935329 1640 raft_consensus.cc:504] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.936110 1640 leader_election.cc:288] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:02.937441 969 leader_election.cc:302] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:02.937570 831 leader_election.cc:341] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 04d5d361a5404dcf99a89e93ac1f7dd8
I20260620 07:01:02.930171 1169 tablet_replica.cc:330] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:02.938190 1165 log.cc:1196] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/9d05d17792e54877b29431754676dcad
I20260620 07:01:02.938216 1169 raft_consensus.cc:2229] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.938421 1169 raft_consensus.cc:2258] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.938439 1333 raft_consensus.cc:2781] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:02.938594 1165 ts_tablet_manager.cc:1939] T 9d05d17792e54877b29431754676dcad P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:02.938601 1333 raft_consensus.cc:686] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:02.939026 1169 ts_tablet_manager.cc:1905] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.939088 1333 consensus_queue.cc:237] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:02.938819 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d5d361a5404dcf99a89e93ac1f7dd8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:02.940688 830 leader_election.cc:341] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:02.941190 1167 tablet_bootstrap.cc:654] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.943924 830 leader_election.cc:302] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:02.944387 1640 raft_consensus.cc:2726] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:02.944701 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 186) took 4180 ms. Trace:
I20260620 07:01:02.944792 1165 rpcz_store.cc:276] 0620 07:00:58.758163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.758407 (+ 244us) service_pool.cc:227] Handling call
0620 07:01:02.817763 (+4059356us) ts_tablet_manager.cc:1145] Deleting tablet 9d05d17792e54877b29431754676dcad
0620 07:01:02.817781 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:02.826652 (+ 8871us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.861392 (+ 34740us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.938924 (+ 77532us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4053540}
I20260620 07:01:02.945542 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 9d05d17792e54877b29431754676dcad (table default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]) successfully deleted
I20260620 07:01:02.946102 1165 tablet_replica.cc:330] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:02.946662 1165 raft_consensus.cc:2229] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.947108 1166 log.cc:1196] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/1dc3bc9ec1334f1bb3d9f653b2472bc7
I20260620 07:01:02.940667 1168 tablet_bootstrap.cc:654] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:02.947744 1166 ts_tablet_manager.cc:1939] T 1dc3bc9ec1334f1bb3d9f653b2472bc7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:02.947896 1165 raft_consensus.cc:2258] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.948181 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 171) took 4194 ms. Trace:
I20260620 07:01:02.949373 1165 ts_tablet_manager.cc:1905] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.950016 1166 rpcz_store.cc:276] 0620 07:00:58.753880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.754311 (+ 431us) service_pool.cc:227] Handling call
0620 07:01:02.441216 (+3686905us) ts_tablet_manager.cc:1145] Deleting tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7
0620 07:01:02.441228 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:02.860918 (+419690us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.883759 (+ 22841us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:02.948131 (+ 64372us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3680951}
I20260620 07:01:02.950169 1169 ts_tablet_manager.cc:1918] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:02.950313 1169 log.cc:1196] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/e7d1e4719cd441dd8054b24861cbd8a2
I20260620 07:01:02.950533 1603 raft_consensus.cc:482] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fe29008ed9b430ea13d40e54e3ddfcc)
I20260620 07:01:02.951123 1169 ts_tablet_manager.cc:1939] T e7d1e4719cd441dd8054b24861cbd8a2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:02.950850 1553 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe29008ed9b430ea13d40e54e3ddfcc. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:01:02.950874 1603 raft_consensus.cc:504] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:01:02.951224 1553 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:01:02.952033 1644 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:01:02.952561 1644 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:01:02.954290 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet e7d1e4719cd441dd8054b24861cbd8a2 (table default.Table_705dc245b225442eb3ba5fc4731c8e12 [id=b9301ede677241efa94753841070351a]) successfully deleted
I20260620 07:01:02.954810 1603 leader_election.cc:288] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fe29008ed9b430ea13d40e54e3ddfcc (127.0.97.62:36007), 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455)
I20260620 07:01:02.965590 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 1dc3bc9ec1334f1bb3d9f653b2472bc7 (table default.Table_c3a21b866a364f0e97c74a240faf1dff [id=a53fbb10c3c84cb698f8973d0e23bce0]) successfully deleted
I20260620 07:01:02.969254 1666 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 07:01:02.978683 1169 tablet_replica.cc:330] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:02.979266 1169 raft_consensus.cc:2229] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:02.979923 1169 raft_consensus.cc:2258] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.980697 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3af42fa4c4614dab89c7853707b243cb" } modify_external_catalogs: true
I20260620 07:01:02.980926 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3af42fa4c4614dab89c7853707b243cb" } modify_external_catalogs: true
I20260620 07:01:02.980983 1166 tablet_replica.cc:330] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:02.980837 1169 ts_tablet_manager.cc:1905] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:02.982379 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 390a327225344afda3076c341202cc1d consensus state has no leader
I20260620 07:01:02.982815 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3eb134c36c8746dc9cbeb8c11a9063c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:02.983351 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3eb134c36c8746dc9cbeb8c11a9063c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:02.984181 1166 raft_consensus.cc:2229] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:02.984750 1166 raft_consensus.cc:2258] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:02.984779 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 81704d3a3cf648d987d4b40a270f7508 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:02.985174 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c11f2678559c41d3bc71d4fa04efd0ac consensus state has no leader
I20260620 07:01:02.985558 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 63dfade71c254d7e908e00acada93638 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:02.986120 1166 ts_tablet_manager.cc:1905] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.989270 870 tablet_service.cc:1467] Processing CreateTablet for tablet 113dd3d57c144088ae7204dc5229f883 (DEFAULT_TABLE table=default.Table_0936aaf00bfd443a9fb64da285fd6a89 [id=16e82920837948a798536c72832e30ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.989817 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 113dd3d57c144088ae7204dc5229f883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.989930 871 tablet_service.cc:1467] Processing CreateTablet for tablet a6c7b3977b604cb69df671318fae1212 (DEFAULT_TABLE table=default.Table_5c2cb157c156453ab32c75abc2ab6a09 [id=fb404678cbde40e4bd8996bb2d228e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.990319 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c7b3977b604cb69df671318fae1212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.995133 866 tablet_service.cc:1467] Processing CreateTablet for tablet c8aa75356fb54672a0ada533fc634613 (DEFAULT_TABLE table=default.Table_8822fe581d474be2a24d69357f8c3331 [id=9872a758911d490c98d27afe035475b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.995483 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8aa75356fb54672a0ada533fc634613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:02.999097 859 tablet_service.cc:1467] Processing CreateTablet for tablet 777a6b981b7f43a4ba8978ba6f3971e1 (DEFAULT_TABLE table=default.Table_122650b95e6f401ca38b940863232ee4 [id=480d35deefed493692a6b99af40b1f9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:02.999477 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 777a6b981b7f43a4ba8978ba6f3971e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.000653 1167 tablet_bootstrap.cc:492] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:03.000783 1167 ts_tablet_manager.cc:1397] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.287s user 0.005s sys 0.006s
I20260620 07:01:03.002874 1170 tablet_bootstrap.cc:492] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:03.003043 1170 ts_tablet_manager.cc:1397] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.150s user 0.006s sys 0.001s
I20260620 07:01:03.003114 862 tablet_service.cc:1467] Processing CreateTablet for tablet 816218c726a9473e9849b7a97c820678 (DEFAULT_TABLE table=default.Table_7883c1fc8c5b4c998ab3e869467a79b4 [id=28eabd7db6d149c594279815f0ab8f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.003520 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 816218c726a9473e9849b7a97c820678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.004041 1170 raft_consensus.cc:348] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.004300 1170 raft_consensus.cc:374] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.004367 1170 raft_consensus.cc:729] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.004598 1170 consensus_queue.cc:260] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.005127 1170 ts_tablet_manager.cc:1428] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:03.007118 864 tablet_service.cc:1467] Processing CreateTablet for tablet d0f7e6245c074c82a5a72be79ab1987f (DEFAULT_TABLE table=default.Table_8397d634bfa34d018ebbafc7803a6963 [id=71cc7324d22343d994423250a5716606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.007498 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0f7e6245c074c82a5a72be79ab1987f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.007524 1170 tablet_bootstrap.cc:492] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:03.009080 1170 tablet_bootstrap.cc:654] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.010421 1167 raft_consensus.cc:348] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.010710 1167 raft_consensus.cc:374] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.010830 1167 raft_consensus.cc:729] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.011023 861 tablet_service.cc:1467] Processing CreateTablet for tablet 52d2a46f972e45f5aeadb09101a68149 (DEFAULT_TABLE table=default.Table_b8429caf0e3d441cb3b0c1e46841a3d2 [id=aa5eb6347e824667b681aa8b7e4a5447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.011410 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52d2a46f972e45f5aeadb09101a68149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.014719 860 tablet_service.cc:1467] Processing CreateTablet for tablet ca86563e5b014bb88ccb74c628670c46 (DEFAULT_TABLE table=default.Table_58581d650c544165bfe1d9b23cb0af2a [id=81b33eb4aa244515a1fa2baf7d11124e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.015151 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca86563e5b014bb88ccb74c628670c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.018574 869 tablet_service.cc:1467] Processing CreateTablet for tablet a0a5967c84434000a51fe7d819fac439 (DEFAULT_TABLE table=default.Table_c2c8c59b79f3455e9ec512be24010087 [id=75aa959a850d49e8af3dc9d607aa19bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.019014 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0a5967c84434000a51fe7d819fac439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.020624 1167 consensus_queue.cc:260] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.021677 1167 ts_tablet_manager.cc:1428] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260620 07:01:03.021979 1167 tablet_bootstrap.cc:492] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:03.022501 868 tablet_service.cc:1467] Processing CreateTablet for tablet 0fa3702db6004ecba6fff98c09623fe0 (DEFAULT_TABLE table=default.Table_698d63bac258457f957bc5370591aebf [id=75b81588f2b84fcd9941c8181a5801e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.022954 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fa3702db6004ecba6fff98c09623fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.023811 1167 tablet_bootstrap.cc:654] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.026348 1166 ts_tablet_manager.cc:1918] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:03.026473 1166 log.cc:1196] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/7d9f7cf9e3a14e28ac20662b5e86dc41
I20260620 07:01:03.026471 863 tablet_service.cc:1467] Processing CreateTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 (DEFAULT_TABLE table=default.Table_b24a25dee4d246e28df4d574ec737953 [id=ffd94fcc85484772af776d4ccbe875af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.026881 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960fca9c94764f3d8d2daae20a0f8388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.026997 1166 ts_tablet_manager.cc:1939] T 7d9f7cf9e3a14e28ac20662b5e86dc41 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:03.027782 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 172) took 4273 ms. Trace:
I20260620 07:01:03.027917 1166 rpcz_store.cc:276] 0620 07:00:58.754007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.754472 (+ 465us) service_pool.cc:227] Handling call
0620 07:01:02.965141 (+4210669us) ts_tablet_manager.cc:1145] Deleting tablet 7d9f7cf9e3a14e28ac20662b5e86dc41
0620 07:01:02.965155 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:02.990176 (+ 25021us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.026214 (+ 36038us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.027745 (+ 1531us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1885,"tablet-delete.queue_time_us":4204084}
I20260620 07:01:03.030519 873 tablet_service.cc:1467] Processing CreateTablet for tablet 00a34f01ce5d4d5696248dc88802dafd (DEFAULT_TABLE table=default.Table_aa50efd3e2c24b94ae1de367ad45588e [id=e61a54c0965a44489938c39ebae31a30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.031019 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00a34f01ce5d4d5696248dc88802dafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.032297 1166 tablet_replica.cc:330] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:03.032552 1166 raft_consensus.cc:2229] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:03.032944 1166 raft_consensus.cc:2258] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:03.033818 1166 ts_tablet_manager.cc:1905] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:02.970870 1446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40894 (request call id 0) took 2330 ms. Trace:
I20260620 07:01:02.998848 1424 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "978f112862c64141b1009856bef3d624" instance_seqno: 1781938853580019) as {username='slave'} at 127.0.97.2:58793; Asking this server to re-register.
I20260620 07:01:03.017701 1423 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" instance_seqno: 1781938854080208) as {username='slave'} at 127.0.97.3:52485; Asking this server to re-register.
I20260620 07:01:03.019253 1418 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" instance_seqno: 1781938853072211) as {username='slave'} at 127.0.97.1:51549; Asking this server to re-register.
I20260620 07:01:03.036335 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3ab345e4abbc4b6c9cf08c26e1a95287" } modify_external_catalogs: true
I20260620 07:01:03.036522 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3ab345e4abbc4b6c9cf08c26e1a95287" } modify_external_catalogs: true
I20260620 07:01:03.037464 941 heartbeater.cc:464] Registering TS with master...
I20260620 07:01:03.038328 799 heartbeater.cc:464] Registering TS with master...
I20260620 07:01:03.038208 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cae8e192c99a43f3975359ae78131167"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.038825 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cae8e192c99a43f3975359ae78131167 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.039433 1078 heartbeater.cc:464] Registering TS with master...
I20260620 07:01:03.040050 1424 ts_manager.cc:194] Registered new tserver with Master: 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:03.041834 1418 ts_manager.cc:194] Registered new tserver with Master: 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:03.042881 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 (table default.Table_a8832b6e92294c9c9e051bc22e13b5e4 [id=1b7f0b11c53649f29df954f7abcd30f1]) successfully deleted
I20260620 07:01:03.043326 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 113dd3d57c144088ae7204dc5229f883 (DEFAULT_TABLE table=default.Table_0936aaf00bfd443a9fb64da285fd6a89 [id=16e82920837948a798536c72832e30ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.044010 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 113dd3d57c144088ae7204dc5229f883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.045327 995 tablet_service.cc:1467] Processing CreateTablet for tablet d0f7e6245c074c82a5a72be79ab1987f (DEFAULT_TABLE table=default.Table_8397d634bfa34d018ebbafc7803a6963 [id=71cc7324d22343d994423250a5716606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.045711 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0f7e6245c074c82a5a72be79ab1987f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.048486 1006 tablet_service.cc:1467] Processing CreateTablet for tablet c8aa75356fb54672a0ada533fc634613 (DEFAULT_TABLE table=default.Table_8822fe581d474be2a24d69357f8c3331 [id=9872a758911d490c98d27afe035475b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.049223 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 816218c726a9473e9849b7a97c820678 (DEFAULT_TABLE table=default.Table_7883c1fc8c5b4c998ab3e869467a79b4 [id=28eabd7db6d149c594279815f0ab8f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.050673 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 777a6b981b7f43a4ba8978ba6f3971e1 (DEFAULT_TABLE table=default.Table_122650b95e6f401ca38b940863232ee4 [id=480d35deefed493692a6b99af40b1f9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.050774 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 3 got 0
I20260620 07:01:03.051148 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8aa75356fb54672a0ada533fc634613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.052618 994 tablet_service.cc:1467] Processing CreateTablet for tablet 0fa3702db6004ecba6fff98c09623fe0 (DEFAULT_TABLE table=default.Table_698d63bac258457f957bc5370591aebf [id=75b81588f2b84fcd9941c8181a5801e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.052778 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 52d2a46f972e45f5aeadb09101a68149 (DEFAULT_TABLE table=default.Table_b8429caf0e3d441cb3b0c1e46841a3d2 [id=aa5eb6347e824667b681aa8b7e4a5447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.053804 1009 tablet_service.cc:1467] Processing CreateTablet for tablet ca86563e5b014bb88ccb74c628670c46 (DEFAULT_TABLE table=default.Table_58581d650c544165bfe1d9b23cb0af2a [id=81b33eb4aa244515a1fa2baf7d11124e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.054100 998 tablet_service.cc:1467] Processing CreateTablet for tablet a6c7b3977b604cb69df671318fae1212 (DEFAULT_TABLE table=default.Table_5c2cb157c156453ab32c75abc2ab6a09 [id=fb404678cbde40e4bd8996bb2d228e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.054417 1008 tablet_service.cc:1467] Processing CreateTablet for tablet a0a5967c84434000a51fe7d819fac439 (DEFAULT_TABLE table=default.Table_c2c8c59b79f3455e9ec512be24010087 [id=75aa959a850d49e8af3dc9d607aa19bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.054739 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet a9e70b585def4a4a9081a0938af8ce5b (table default.Table_3b7824f8ca9245a4808576761591080d [id=a876d134592d456ea2e7b8336037020f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a9e70b585def4a4a9081a0938af8ce5b consensus state has no leader
W20260620 07:01:03.055810 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1c64df83a18a470c98a9c1fd6bb38918 consensus state has no leader
I20260620 07:01:03.055857 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 816218c726a9473e9849b7a97c820678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.056599 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 777a6b981b7f43a4ba8978ba6f3971e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.057230 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fa3702db6004ecba6fff98c09623fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.061587 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 00a34f01ce5d4d5696248dc88802dafd (DEFAULT_TABLE table=default.Table_aa50efd3e2c24b94ae1de367ad45588e [id=e61a54c0965a44489938c39ebae31a30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.065048 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c7b3977b604cb69df671318fae1212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.065205 1169 ts_tablet_manager.cc:1918] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:03.065400 1169 log.cc:1196] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ea6102e0da4e42cd9f1d6e294bb372b2
I20260620 07:01:03.065834 1169 ts_tablet_manager.cc:1939] T ea6102e0da4e42cd9f1d6e294bb372b2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:03.067845 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00a34f01ce5d4d5696248dc88802dafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.072579 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0a5967c84434000a51fe7d819fac439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.075543 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca86563e5b014bb88ccb74c628670c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.076412 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52d2a46f972e45f5aeadb09101a68149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.080163 1169 tablet_replica.cc:330] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:03.080458 1169 raft_consensus.cc:2229] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:03.080673 1169 raft_consensus.cc:2258] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:03.075306 969 consensus_peers.cc:487] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f763b0e91544700bd672c2ef751b4d2. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:03.081284 1169 ts_tablet_manager.cc:1905] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:03.088620 1169 ts_tablet_manager.cc:1918] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:03.088789 1169 log.cc:1196] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/360880717af145628606b5b9fb26e350
I20260620 07:01:03.089203 1169 ts_tablet_manager.cc:1939] T 360880717af145628606b5b9fb26e350 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:03.092731 1169 tablet_replica.cc:330] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:03.092931 1169 raft_consensus.cc:2229] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:03.093101 1169 raft_consensus.cc:2258] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:03.101879 1424 ts_manager.cc:194] Registered new tserver with Master: 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:03.103446 413 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.61:33455, user_credentials={real_user=slave}} blocked reactor thread for 131436us
I20260620 07:01:03.103729 1168 tablet_bootstrap.cc:492] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:03.103886 1168 ts_tablet_manager.cc:1397] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.169s user 0.003s sys 0.000s
I20260620 07:01:03.105294 1168 raft_consensus.cc:348] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.105897 720 tablet_service.cc:1467] Processing CreateTablet for tablet ca86563e5b014bb88ccb74c628670c46 (DEFAULT_TABLE table=default.Table_58581d650c544165bfe1d9b23cb0af2a [id=81b33eb4aa244515a1fa2baf7d11124e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.106420 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca86563e5b014bb88ccb74c628670c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.106391 724 tablet_service.cc:1467] Processing CreateTablet for tablet 113dd3d57c144088ae7204dc5229f883 (DEFAULT_TABLE table=default.Table_0936aaf00bfd443a9fb64da285fd6a89 [id=16e82920837948a798536c72832e30ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.106758 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 113dd3d57c144088ae7204dc5229f883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.110165 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ea6102e0da4e42cd9f1d6e294bb372b2 (table default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]) successfully deleted
W20260620 07:01:03.110584 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3456cf91d65a4413a35efe94513c723d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3456cf91d65a4413a35efe94513c723d already in progress: creating tablet
W20260620 07:01:03.110841 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f690e150839a4d23860932712f61e7c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f690e150839a4d23860932712f61e7c8 already in progress: creating tablet
W20260620 07:01:03.111025 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 95a109e7871241ec9467858dca467bbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95a109e7871241ec9467858dca467bbe already in progress: creating tablet
W20260620 07:01:03.111222 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c8f81fa4e88945f1a392fbacfd031392 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8f81fa4e88945f1a392fbacfd031392 already in progress: creating tablet
W20260620 07:01:03.111397 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b39e682e71ed4776a786f7d30158e7e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b39e682e71ed4776a786f7d30158e7e0 already in progress: creating tablet
I20260620 07:01:03.111361 734 tablet_service.cc:1467] Processing CreateTablet for tablet c8aa75356fb54672a0ada533fc634613 (DEFAULT_TABLE table=default.Table_8822fe581d474be2a24d69357f8c3331 [id=9872a758911d490c98d27afe035475b2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.111580 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 4655d289c94c4bce9707be375fc4b850 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4655d289c94c4bce9707be375fc4b850 already in progress: creating tablet
I20260620 07:01:03.111735 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 360880717af145628606b5b9fb26e350 (table default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]) successfully deleted
I20260620 07:01:03.111795 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8aa75356fb54672a0ada533fc634613. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:03.111930 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 17590c6a1a96414f84632a8b0e0a795b because the tablet was not found. No further retry: Not found: Tablet not found: 17590c6a1a96414f84632a8b0e0a795b
W20260620 07:01:03.112128 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8cb04a2e17f3417aaf0f89f0c7f78159 because the tablet was not found. No further retry: Not found: Tablet not found: 8cb04a2e17f3417aaf0f89f0c7f78159
I20260620 07:01:03.113926 1168 raft_consensus.cc:374] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.114148 1168 raft_consensus.cc:729] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.115132 723 tablet_service.cc:1467] Processing CreateTablet for tablet 777a6b981b7f43a4ba8978ba6f3971e1 (DEFAULT_TABLE table=default.Table_122650b95e6f401ca38b940863232ee4 [id=480d35deefed493692a6b99af40b1f9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.115547 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 777a6b981b7f43a4ba8978ba6f3971e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.115590 1622 raft_consensus.cc:482] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:03.115746 1622 raft_consensus.cc:504] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.116501 1622 leader_election.cc:288] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:03.115120 1168 consensus_queue.cc:260] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.117918 1168 ts_tablet_manager.cc:1428] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.014s user 0.002s sys 0.001s
I20260620 07:01:03.118314 1168 tablet_bootstrap.cc:492] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:03.118835 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5d9a850a34eb477c9d9810332fbb14c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:03.119132 721 tablet_service.cc:1467] Processing CreateTablet for tablet 816218c726a9473e9849b7a97c820678 (DEFAULT_TABLE table=default.Table_7883c1fc8c5b4c998ab3e869467a79b4 [id=28eabd7db6d149c594279815f0ab8f81]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.119441 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d9a850a34eb477c9d9810332fbb14c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.119498 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 816218c726a9473e9849b7a97c820678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.120493 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff06bc5fc684b9195c719cbf39d34a6" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:03.121140 681 leader_election.cc:341] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:03.122051 1170 tablet_bootstrap.cc:492] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:03.122207 1170 ts_tablet_manager.cc:1397] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.115s user 0.014s sys 0.013s
I20260620 07:01:03.123119 729 tablet_service.cc:1467] Processing CreateTablet for tablet d0f7e6245c074c82a5a72be79ab1987f (DEFAULT_TABLE table=default.Table_8397d634bfa34d018ebbafc7803a6963 [id=71cc7324d22343d994423250a5716606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.123492 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0f7e6245c074c82a5a72be79ab1987f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.125810 1170 raft_consensus.cc:348] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.126066 1170 raft_consensus.cc:374] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.126175 1170 raft_consensus.cc:729] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.126425 1170 consensus_queue.cc:260] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.127126 727 tablet_service.cc:1467] Processing CreateTablet for tablet 52d2a46f972e45f5aeadb09101a68149 (DEFAULT_TABLE table=default.Table_b8429caf0e3d441cb3b0c1e46841a3d2 [id=aa5eb6347e824667b681aa8b7e4a5447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.127213 1170 ts_tablet_manager.cc:1428] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260620 07:01:03.127547 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52d2a46f972e45f5aeadb09101a68149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.127643 1170 tablet_bootstrap.cc:492] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:03.129096 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9e2f2ecd97ee48f89579302e371615a7" } modify_external_catalogs: true
I20260620 07:01:03.129313 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9e2f2ecd97ee48f89579302e371615a7" } modify_external_catalogs: true
I20260620 07:01:03.130425 893 raft_consensus.cc:3037] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:03.130698 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff06bc5fc684b9195c719cbf39d34a6" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:03.131110 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8e736cf278274ffc858ff174e1567e0e" } new_table_name: "default.Table_16bc98530ef6482fbf02e2aa78c0ea47" modify_external_catalogs: true
I20260620 07:01:03.132732 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_15538b00a4f041cfb5143bd9afba2a95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.133225 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15538b00a4f041cfb5143bd9afba2a95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.148389 1165 ts_tablet_manager.cc:1918] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:03.148635 1165 log.cc:1196] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ba760b5fe1204df2932edd15bdcbaadf
I20260620 07:01:03.061493 996 tablet_service.cc:1467] Processing CreateTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 (DEFAULT_TABLE table=default.Table_b24a25dee4d246e28df4d574ec737953 [id=ffd94fcc85484772af776d4ccbe875af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.149327 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960fca9c94764f3d8d2daae20a0f8388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.149374 1165 ts_tablet_manager.cc:1939] T ba760b5fe1204df2932edd15bdcbaadf P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:03.149708 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 187) took 4391 ms. Trace:
I20260620 07:01:03.149821 1165 rpcz_store.cc:276] 0620 07:00:58.758308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.758504 (+ 196us) service_pool.cc:227] Handling call
0620 07:01:02.946006 (+4187502us) ts_tablet_manager.cc:1145] Deleting tablet ba760b5fe1204df2932edd15bdcbaadf
0620 07:01:02.946020 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.144648 (+198628us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.148256 (+ 3608us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.149672 (+ 1416us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4181652}
I20260620 07:01:03.150182 1165 tablet_replica.cc:330] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:03.150560 1165 raft_consensus.cc:2229] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:03.150985 1165 raft_consensus.cc:2258] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:03.151613 1165 ts_tablet_manager.cc:1905] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:03.152308 733 tablet_service.cc:1467] Processing CreateTablet for tablet 0fa3702db6004ecba6fff98c09623fe0 (DEFAULT_TABLE table=default.Table_698d63bac258457f957bc5370591aebf [id=75b81588f2b84fcd9941c8181a5801e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.152639 1170 tablet_bootstrap.cc:654] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:03.152607 683 leader_election.cc:341] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:03.152817 683 leader_election.cc:302] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:03.153286 1622 raft_consensus.cc:2726] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:03.156466 731 tablet_service.cc:1467] Processing CreateTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 (DEFAULT_TABLE table=default.Table_b24a25dee4d246e28df4d574ec737953 [id=ffd94fcc85484772af776d4ccbe875af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.156791 722 tablet_service.cc:1467] Processing CreateTablet for tablet a6c7b3977b604cb69df671318fae1212 (DEFAULT_TABLE table=default.Table_5c2cb157c156453ab32c75abc2ab6a09 [id=fb404678cbde40e4bd8996bb2d228e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.157042 728 tablet_service.cc:1467] Processing CreateTablet for tablet a0a5967c84434000a51fe7d819fac439 (DEFAULT_TABLE table=default.Table_c2c8c59b79f3455e9ec512be24010087 [id=75aa959a850d49e8af3dc9d607aa19bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.157444 732 tablet_service.cc:1467] Processing CreateTablet for tablet 00a34f01ce5d4d5696248dc88802dafd (DEFAULT_TABLE table=default.Table_aa50efd3e2c24b94ae1de367ad45588e [id=e61a54c0965a44489938c39ebae31a30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.161324 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fa3702db6004ecba6fff98c09623fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.162156 1622 raft_consensus.cc:482] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:03.162307 1167 tablet_bootstrap.cc:492] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:03.162592 1167 ts_tablet_manager.cc:1397] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.141s user 0.000s sys 0.003s
I20260620 07:01:03.163453 1167 raft_consensus.cc:348] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.163774 1167 raft_consensus.cc:374] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.163847 1167 raft_consensus.cc:729] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.164115 1167 consensus_queue.cc:260] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.164250 1622 raft_consensus.cc:504] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.164940 1622 leader_election.cc:288] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:03.165809 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960fca9c94764f3d8d2daae20a0f8388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.166240 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e36ffd69974ef897390a257f63a509" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:03.167021 681 leader_election.cc:341] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:03.167044 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0a5967c84434000a51fe7d819fac439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.168597 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e36ffd69974ef897390a257f63a509" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:03.168686 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ff06bc5fc684b9195c719cbf39d34a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.169260 1167 ts_tablet_manager.cc:1428] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260620 07:01:03.169517 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c7b3977b604cb69df671318fae1212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.169836 1167 tablet_bootstrap.cc:492] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:03.170964 683 leader_election.cc:341] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:03.171097 683 leader_election.cc:302] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:03.172264 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00a34f01ce5d4d5696248dc88802dafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.172266 1165 ts_tablet_manager.cc:1918] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:03.172425 1165 log.cc:1196] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/e275d82068074370ba1e32b7ca5fdcc3
I20260620 07:01:03.172576 1167 tablet_bootstrap.cc:654] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.172852 1165 ts_tablet_manager.cc:1939] T e275d82068074370ba1e32b7ca5fdcc3 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:03.174680 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 188) took 4395 ms. Trace:
I20260620 07:01:03.175441 1165 rpcz_store.cc:276] 0620 07:00:58.779051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.779266 (+ 215us) service_pool.cc:227] Handling call
0620 07:01:03.150122 (+4370856us) ts_tablet_manager.cc:1145] Deleting tablet e275d82068074370ba1e32b7ca5fdcc3
0620 07:01:03.150134 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.162984 (+ 12850us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.172154 (+ 9170us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.174619 (+ 2465us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4370659}
I20260620 07:01:03.176234 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet e275d82068074370ba1e32b7ca5fdcc3 (table default.Table_89bf00306e9c44a0a0de2e0a7235f436 [id=24b0b6eb9f944dbb971530ee8f603c0e]) successfully deleted
I20260620 07:01:03.176939 1622 raft_consensus.cc:2726] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:03.176752 1165 tablet_replica.cc:330] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:03.177356 1165 raft_consensus.cc:2229] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:03.178323 1165 raft_consensus.cc:2258] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:03.178936 1165 ts_tablet_manager.cc:1905] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:03.180826 1167 tablet_bootstrap.cc:492] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:03.180979 1167 ts_tablet_manager.cc:1397] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260620 07:01:03.181026 1168 tablet_bootstrap.cc:654] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.181810 1167 raft_consensus.cc:348] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.182044 1167 raft_consensus.cc:374] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.182137 1167 raft_consensus.cc:729] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.182464 1167 consensus_queue.cc:260] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.183317 1167 ts_tablet_manager.cc:1428] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:03.183581 1167 tablet_bootstrap.cc:492] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:03.185469 1167 tablet_bootstrap.cc:654] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.194106 1167 tablet_bootstrap.cc:492] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:03.194288 1167 ts_tablet_manager.cc:1397] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260620 07:01:03.195174 1167 raft_consensus.cc:348] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.195436 1167 raft_consensus.cc:374] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.195510 1167 raft_consensus.cc:729] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.195819 1165 ts_tablet_manager.cc:1918] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:03.195840 1167 consensus_queue.cc:260] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.196493 1167 ts_tablet_manager.cc:1428] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:03.196789 1167 tablet_bootstrap.cc:492] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:03.196956 1165 log.cc:1196] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/33517843ce1d4d8786c91fd738d81ab2
I20260620 07:01:03.197607 1165 ts_tablet_manager.cc:1939] T 33517843ce1d4d8786c91fd738d81ab2 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:03.198009 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 189) took 4418 ms. Trace:
I20260620 07:01:03.198295 1168 tablet_bootstrap.cc:492] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:03.198180 1165 rpcz_store.cc:276] 0620 07:00:58.779214 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.779501 (+ 287us) service_pool.cc:227] Handling call
0620 07:01:03.176071 (+4396570us) ts_tablet_manager.cc:1145] Deleting tablet 33517843ce1d4d8786c91fd738d81ab2
0620 07:01:03.176657 (+ 586us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.186374 (+ 9717us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.195680 (+ 9306us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.197967 (+ 2287us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4396394}
I20260620 07:01:03.198387 1167 tablet_bootstrap.cc:654] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.198763 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 33517843ce1d4d8786c91fd738d81ab2 (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]) successfully deleted
I20260620 07:01:03.198437 1168 ts_tablet_manager.cc:1397] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.002s
I20260620 07:01:03.199676 1168 raft_consensus.cc:348] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.200001 1168 raft_consensus.cc:374] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.200116 1168 raft_consensus.cc:729] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.200405 1168 consensus_queue.cc:260] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.200994 1168 ts_tablet_manager.cc:1428] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:03.201339 1168 tablet_bootstrap.cc:492] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:03.201680 1167 tablet_bootstrap.cc:492] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:03.201810 1167 ts_tablet_manager.cc:1397] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260620 07:01:03.202613 1167 raft_consensus.cc:348] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.202883 1167 raft_consensus.cc:374] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.202972 1167 raft_consensus.cc:729] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.202998 1165 tablet_replica.cc:330] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:03.203274 1165 raft_consensus.cc:2229] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:03.203187 1167 consensus_queue.cc:260] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.203538 1165 raft_consensus.cc:2258] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:03.203903 1167 ts_tablet_manager.cc:1428] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:03.204160 1167 tablet_bootstrap.cc:492] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:03.204509 1168 tablet_bootstrap.cc:654] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.205245 1170 tablet_bootstrap.cc:492] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:03.205408 1170 ts_tablet_manager.cc:1397] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.078s user 0.010s sys 0.013s
I20260620 07:01:03.206269 1167 tablet_bootstrap.cc:654] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.206188 1170 raft_consensus.cc:348] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.206439 1170 raft_consensus.cc:374] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.206516 1170 raft_consensus.cc:729] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.206743 1170 consensus_queue.cc:260] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.207304 1170 ts_tablet_manager.cc:1428] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:03.207621 1170 tablet_bootstrap.cc:492] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:03.208405 1165 ts_tablet_manager.cc:1905] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:03.216219 1165 ts_tablet_manager.cc:1918] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:03.219233 1165 log.cc:1196] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/17590c6a1a96414f84632a8b0e0a795b
I20260620 07:01:03.219862 1165 ts_tablet_manager.cc:1939] T 17590c6a1a96414f84632a8b0e0a795b P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:03.220876 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 190) took 4437 ms. Trace:
I20260620 07:01:03.222944 1165 rpcz_store.cc:276] 0620 07:00:58.783015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.783078 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:03.198625 (+4415547us) ts_tablet_manager.cc:1145] Deleting tablet 17590c6a1a96414f84632a8b0e0a795b
0620 07:01:03.202908 (+ 4283us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.212924 (+ 10016us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.216115 (+ 3191us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.220817 (+ 4702us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4414775}
I20260620 07:01:03.222828 1168 tablet_bootstrap.cc:492] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:03.223771 1168 ts_tablet_manager.cc:1397] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.004s
I20260620 07:01:03.224596 1168 raft_consensus.cc:348] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.224926 1168 raft_consensus.cc:374] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.225069 1168 raft_consensus.cc:729] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.225359 1168 consensus_queue.cc:260] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.227010 1168 ts_tablet_manager.cc:1428] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260620 07:01:03.227322 1168 tablet_bootstrap.cc:492] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:03.228770 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 191) took 4438 ms. Trace:
I20260620 07:01:03.228919 1165 rpcz_store.cc:276] 0620 07:00:58.789822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.789885 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:03.228589 (+4438704us) ts_tablet_manager.cc:1145] Deleting tablet 581573cafab14ac79ff7ad19da0580b4
0620 07:01:03.228599 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.228719 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4438513}
W20260620 07:01:03.230211 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 581573cafab14ac79ff7ad19da0580b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 581573cafab14ac79ff7ad19da0580b4 already in progress: creating tablet
I20260620 07:01:03.230597 1165 tablet_replica.cc:330] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:03.230868 1165 raft_consensus.cc:2229] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:03.231474 1165 raft_consensus.cc:2258] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:03.232076 1165 ts_tablet_manager.cc:1905] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:03.229806 1168 tablet_bootstrap.cc:654] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.244786 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 864c95b908674e4f8425d765444c281b
I20260620 07:01:03.247032 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d15ea9529afe40b6b4a702035479aef3
I20260620 07:01:03.247202 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c95b908674e4f8425d765444c281b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.248708 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c95b908674e4f8425d765444c281b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.248936 860 tablet_service.cc:1514] Processing DeleteTablet for tablet d15ea9529afe40b6b4a702035479aef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.251398 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet d15ea9529afe40b6b4a702035479aef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.252599 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f8b961698fe54e7f9c16f41b90058093
I20260620 07:01:03.253690 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_abf326e06bac4ac9a638a5a2e4c97619"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.254288 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abf326e06bac4ac9a638a5a2e4c97619 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.255620 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c0c512543c584906a978970ff6a532dc" } new_table_name: "default.Table_072aff5d28cf4c61bbecd2cadb3e58c3" modify_external_catalogs: true
I20260620 07:01:03.258574 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 485ce059be9b4900adb1dbc3268efb55
I20260620 07:01:03.261384 860 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b961698fe54e7f9c16f41b90058093 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.270872 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b961698fe54e7f9c16f41b90058093 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.270979 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3a8207eeb3544a2cb063745765f5f8e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.271560 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a8207eeb3544a2cb063745765f5f8e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.274443 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 485ce059be9b4900adb1dbc3268efb55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.275658 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 9da80903ac124d1aae937c2329f9b13e from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:03.276093 1639 raft_consensus.cc:482] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:03.276381 1639 raft_consensus.cc:504] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.277195 427 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 3 got 0
I20260620 07:01:03.277251 1639 leader_election.cc:288] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:03.278004 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 95f9a6b2f2cb41e6b74715b2618d8a70 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:03.278003 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 485ce059be9b4900adb1dbc3268efb55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.279875 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 33517843ce1d4d8786c91fd738d81ab2 with delete_type TABLET_DATA_DELETED (replaced by tablet 134f76587b6147afaf4e94fde5574efc) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.279896 1201 raft_consensus.cc:482] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:03.280048 1201 raft_consensus.cc:504] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.280555 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "978f99d2a7d6448aba8dcd2611b75af3" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:03.280786 1033 raft_consensus.cc:2454] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:03.280921 1201 leader_election.cc:288] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:03.281426 830 leader_election.cc:302] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:03.282138 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cb04a2e17f3417aaf0f89f0c7f78159" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:03.282471 895 raft_consensus.cc:2379] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06a32ef63b2b495a9ade1de48c024ae9 in current term 1: Already voted for candidate 2b84cae646b24bc7bd424eb8434ad425 in this term.
I20260620 07:01:03.282827 1639 raft_consensus.cc:2781] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:03.282932 1639 raft_consensus.cc:482] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:03.283061 1639 raft_consensus.cc:3037] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:03.285838 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af743ffd2eb2427caa3779c7fceb8f30 consensus state has no leader
I20260620 07:01:03.302668 860 tablet_service.cc:1467] Processing CreateTablet for tablet cf978ab301954866aeb77b7abaf2c77e (DEFAULT_TABLE table=default.Table_92260deae314470797bd29ca83c08e68 [id=2aae99ca0f614c63b2d25aa6ce51bc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.303220 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf978ab301954866aeb77b7abaf2c77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.305999 859 tablet_service.cc:1467] Processing CreateTablet for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f (DEFAULT_TABLE table=default.Table_a3d3d98477d84cc790b30ecc0d2d8e98 [id=5a6f00263fcb44be91e7cfadb7702509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.306141 1639 raft_consensus.cc:504] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.306450 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.307968 995 tablet_service.cc:1467] Processing CreateTablet for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f (DEFAULT_TABLE table=default.Table_a3d3d98477d84cc790b30ecc0d2d8e98 [id=5a6f00263fcb44be91e7cfadb7702509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.308076 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "978f99d2a7d6448aba8dcd2611b75af3" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:03.308292 1033 raft_consensus.cc:3037] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:03.308370 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:03.308471 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 125e8a5e20bf484cade408f0358489a1 consensus state has no leader
I20260620 07:01:03.309728 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 3 got 0
I20260620 07:01:03.310021 420 catalog_manager.cc:5495] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:03.310472 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:03.311126 996 tablet_service.cc:1467] Processing CreateTablet for tablet f2426d52b8ff40f39887545e0341a91a (DEFAULT_TABLE table=default.Table_8cec159b248a44ed97cd71cca66c5e9c [id=eaa024e7fc254777b8ed67fd19a9747f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.311570 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2426d52b8ff40f39887545e0341a91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.311640 1033 raft_consensus.cc:2454] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:03.312800 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8f962786c05b4ad2931bf26dab569bea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.313458 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f962786c05b4ad2931bf26dab569bea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.315083 994 tablet_service.cc:1467] Processing CreateTablet for tablet fbf912f51bfd4df0afe7aa28815a897e (DEFAULT_TABLE table=default.Table_1c43b2d4813c4afa9752e8e55c232a42 [id=3fd599fba7f44137a7b32121a1507b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.315527 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbf912f51bfd4df0afe7aa28815a897e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.315845 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cad45c9dbce34e7a98ad913944183256" } new_table_name: "default.Table_1d413e8cd6774f26b9f2a394c5903495" modify_external_catalogs: true
I20260620 07:01:03.316149 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0058a55bf8db4c36b3a1ec4a97690363"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.316605 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0058a55bf8db4c36b3a1ec4a97690363 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.318282 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6cfbc068f51142a59236d86d8e246da5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.318740 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cfbc068f51142a59236d86d8e246da5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.319078 1007 tablet_service.cc:1467] Processing CreateTablet for tablet c06bf6c4d1af40479c81bd1d85e2848f (DEFAULT_TABLE table=default.Table_625f280b139743a0a8a21f7e57df0f21 [id=34c82c4f4c1f42e9b70f1a8a3463f282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.319478 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c06bf6c4d1af40479c81bd1d85e2848f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.322273 869 tablet_service.cc:1467] Processing CreateTablet for tablet f2426d52b8ff40f39887545e0341a91a (DEFAULT_TABLE table=default.Table_8cec159b248a44ed97cd71cca66c5e9c [id=eaa024e7fc254777b8ed67fd19a9747f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.323130 1012 tablet_service.cc:1467] Processing CreateTablet for tablet ce8ed68b221b4215812934844447d60e (DEFAULT_TABLE table=default.Table_9e3ed63a3519442893a8e57bbe75d01c [id=94a90e06bbdb4e16968b9d103712349f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.323581 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8ed68b221b4215812934844447d60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.323652 868 tablet_service.cc:1467] Processing CreateTablet for tablet fbf912f51bfd4df0afe7aa28815a897e (DEFAULT_TABLE table=default.Table_1c43b2d4813c4afa9752e8e55c232a42 [id=3fd599fba7f44137a7b32121a1507b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.324195 873 tablet_service.cc:1467] Processing CreateTablet for tablet c06bf6c4d1af40479c81bd1d85e2848f (DEFAULT_TABLE table=default.Table_625f280b139743a0a8a21f7e57df0f21 [id=34c82c4f4c1f42e9b70f1a8a3463f282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.324688 863 tablet_service.cc:1467] Processing CreateTablet for tablet ce8ed68b221b4215812934844447d60e (DEFAULT_TABLE table=default.Table_9e3ed63a3519442893a8e57bbe75d01c [id=94a90e06bbdb4e16968b9d103712349f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.327072 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 9647383a4f1b46278348bc25aae2d621 (DEFAULT_TABLE table=default.Table_c756f636ed334c2980b9a0850b223922 [id=4b693fa955894ee0a580772d54edf233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.327442 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9647383a4f1b46278348bc25aae2d621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.330883 1002 tablet_service.cc:1467] Processing CreateTablet for tablet d9a7fab4d1684604be1b81d4d4bbe560 (DEFAULT_TABLE table=default.Table_ca5b5e6066a343a59aeaf1e58f8a8a67 [id=a7902aafbaad4905a6b5b03ad669eeae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.330677 861 tablet_service.cc:1467] Processing CreateTablet for tablet d9a7fab4d1684604be1b81d4d4bbe560 (DEFAULT_TABLE table=default.Table_ca5b5e6066a343a59aeaf1e58f8a8a67 [id=a7902aafbaad4905a6b5b03ad669eeae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.331262 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a7fab4d1684604be1b81d4d4bbe560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.335801 1010 tablet_service.cc:1467] Processing CreateTablet for tablet ee90d961729b4088b0a312ec770d3cd0 (DEFAULT_TABLE table=default.Table_87c64053fbc3481390a21b3940acb5ab [id=e942f08f38194edbb28ef9d04779f0ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.336243 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee90d961729b4088b0a312ec770d3cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.336529 436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 387 } } ignore_live_leader: false dest_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" is_pre_election: true
I20260620 07:01:03.331954 870 tablet_service.cc:1467] Processing CreateTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 (DEFAULT_TABLE table=default.Table_09cc34c1ecf8432980b9247bf2be1e8d [id=0597dd0aeaa9466b8804375281de13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.338992 508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 387 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5" is_pre_election: true
I20260620 07:01:03.339094 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 294f8a632f9d4191b925d1da605bd80e (DEFAULT_TABLE table=default.Table_76c9c7cd30ad48e1ae0eca9e170fd5d5 [id=5d6d90a583ff484a8c9352efad051b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.339453 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 294f8a632f9d4191b925d1da605bd80e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.342892 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 (DEFAULT_TABLE table=default.Table_09cc34c1ecf8432980b9247bf2be1e8d [id=0597dd0aeaa9466b8804375281de13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.343253 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13c7f0513df34ddb8104b06e5733fb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.348510 1170 tablet_bootstrap.cc:654] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.350719 1329 leader_election.cc:302] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f32c3995c70946c38ce1a3094aaaffb1; no voters: 2395d394cd84440ebae89d1ecfa13fb5, 2fe29008ed9b430ea13d40e54e3ddfcc
W20260620 07:01:03.353969 831 leader_election.cc:341] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 978f99d2a7d6448aba8dcd2611b75af3
I20260620 07:01:03.354029 1603 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 07:01:03.311123 1004 tablet_service.cc:1467] Processing CreateTablet for tablet cf978ab301954866aeb77b7abaf2c77e (DEFAULT_TABLE table=default.Table_92260deae314470797bd29ca83c08e68 [id=2aae99ca0f614c63b2d25aa6ce51bc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.354739 998 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 (DEFAULT_TABLE table=default.Table_5e8dce362a8a4795b0f72083fae12317 [id=f25842df576f4bf4bc6238f4916cfb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.355073 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf978ab301954866aeb77b7abaf2c77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.355336 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8d48f0f9dd4911876ec8f812688439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.358374 1537 raft_consensus.cc:482] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:03.359483 830 leader_election.cc:302] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:03.359589 864 tablet_service.cc:1467] Processing CreateTablet for tablet 9647383a4f1b46278348bc25aae2d621 (DEFAULT_TABLE table=default.Table_c756f636ed334c2980b9a0850b223922 [id=4b693fa955894ee0a580772d54edf233]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.359725 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 47338.5us
I20260620 07:01:03.359946 1554 raft_consensus.cc:2781] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:03.360085 1554 raft_consensus.cc:686] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:03.360404 1554 consensus_queue.cc:237] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.361464 862 tablet_service.cc:1467] Processing CreateTablet for tablet ee90d961729b4088b0a312ec770d3cd0 (DEFAULT_TABLE table=default.Table_87c64053fbc3481390a21b3940acb5ab [id=e942f08f38194edbb28ef9d04779f0ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.361860 866 tablet_service.cc:1467] Processing CreateTablet for tablet 294f8a632f9d4191b925d1da605bd80e (DEFAULT_TABLE table=default.Table_76c9c7cd30ad48e1ae0eca9e170fd5d5 [id=5d6d90a583ff484a8c9352efad051b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.362250 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2426d52b8ff40f39887545e0341a91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.366045 871 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 (DEFAULT_TABLE table=default.Table_5e8dce362a8a4795b0f72083fae12317 [id=f25842df576f4bf4bc6238f4916cfb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.366469 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8d48f0f9dd4911876ec8f812688439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.366811 1537 raft_consensus.cc:504] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.367659 1537 leader_election.cc:288] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:03.368355 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 294f8a632f9d4191b925d1da605bd80e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.368765 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9647383a4f1b46278348bc25aae2d621. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:03.368887 830 leader_election.cc:341] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 21f51aeb329e42359cfaf7de2a039d13
I20260620 07:01:03.369572 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee90d961729b4088b0a312ec770d3cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.376222 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5d9a850a34eb477c9d9810332fbb14c6" } new_table_name: "default.Table_af0d9826ce374c2596807c0f8ef53481" modify_external_catalogs: true
I20260620 07:01:03.378954 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8ed68b221b4215812934844447d60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.383821 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_528cd9a3d9074784ac9b1808f448896e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.384568 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_528cd9a3d9074784ac9b1808f448896e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.384789 1618 raft_consensus.cc:482] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:03.389304 831 leader_election.cc:341] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 978f99d2a7d6448aba8dcd2611b75af3
W20260620 07:01:03.389585 831 leader_election.cc:341] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 21f51aeb329e42359cfaf7de2a039d13
I20260620 07:01:03.389937 831 leader_election.cc:302] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:03.390916 1537 raft_consensus.cc:2726] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:03.392151 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c06bf6c4d1af40479c81bd1d85e2848f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.395314 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13c7f0513df34ddb8104b06e5733fb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.396682 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbf912f51bfd4df0afe7aa28815a897e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.398823 1618 raft_consensus.cc:504] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.399559 1618 leader_election.cc:288] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:03.402854 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a7fab4d1684604be1b81d4d4bbe560. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:03.403683 968 leader_election.cc:341] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 8cb04a2e17f3417aaf0f89f0c7f78159
I20260620 07:01:03.403851 968 leader_election.cc:302] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:03.404129 1333 raft_consensus.cc:3037] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:03.406562 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369c205d7f7841598cb99f661b25736f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:03.407368 1333 raft_consensus.cc:2726] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:03.409286 1169 ts_tablet_manager.cc:1905] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:03.409590 1333 raft_consensus.cc:482] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:03.409750 1333 raft_consensus.cc:504] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.410308 1333 leader_election.cc:288] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:03.414983 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369c205d7f7841598cb99f661b25736f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:03.416666 969 leader_election.cc:341] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e275d82068074370ba1e32b7ca5fdcc3
I20260620 07:01:03.417305 1639 leader_election.cc:288] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:03.422315 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6229a52adf8d4b17bdf89347e01621ed consensus state has no leader
I20260620 07:01:03.424826 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6d87b63c85c042d59cc7aebb8ee815f5" } new_table_name: "default.Table_5f1815876abd4a8282d506949e5adcda" modify_external_catalogs: true
I20260620 07:01:03.426106 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9da80903ac124d1aae937c2329f9b13e
I20260620 07:01:03.426513 423 catalog_manager.cc:6565] ReplaceTablet: tablet 9da80903ac124d1aae937c2329f9b13e deleted and replaced by tablet 95ba8444d70342f781bd84edefbca71f
W20260620 07:01:03.426637 968 leader_election.cc:341] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e275d82068074370ba1e32b7ca5fdcc3
I20260620 07:01:03.426826 968 leader_election.cc:302] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:03.427212 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 25b878def9344cbdae65b209cac4067f
I20260620 07:01:03.427875 732 tablet_service.cc:1514] Processing DeleteTablet for tablet d15ea9529afe40b6b4a702035479aef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.429661 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c95b908674e4f8425d765444c281b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.430652 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da80903ac124d1aae937c2329f9b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 95ba8444d70342f781bd84edefbca71f) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.430910 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b878def9344cbdae65b209cac4067f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.431529 727 tablet_service.cc:1467] Processing CreateTablet for tablet cf978ab301954866aeb77b7abaf2c77e (DEFAULT_TABLE table=default.Table_92260deae314470797bd29ca83c08e68 [id=2aae99ca0f614c63b2d25aa6ce51bc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.434114 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.434171 1333 raft_consensus.cc:2726] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:03.441649 871 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da80903ac124d1aae937c2329f9b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 95ba8444d70342f781bd84edefbca71f) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.444970 722 tablet_service.cc:1514] Processing DeleteTablet for tablet b6e36ffd69974ef897390a257f63a509 with delete_type TABLET_DATA_DELETED (replaced by tablet 54bb495eea4c49b7ad7bf2300ad0e60a) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.446151 998 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6102e0da4e42cd9f1d6e294bb372b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.447678 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 04d5d361a5404dcf99a89e93ac1f7dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.448041 730 tablet_service.cc:1467] Processing CreateTablet for tablet f2426d52b8ff40f39887545e0341a91a (DEFAULT_TABLE table=default.Table_8cec159b248a44ed97cd71cca66c5e9c [id=eaa024e7fc254777b8ed67fd19a9747f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.452798 724 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b961698fe54e7f9c16f41b90058093 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.453431 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f45dda87379a48449ff996a365bf8802"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.454066 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f45dda87379a48449ff996a365bf8802 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.454238 729 tablet_service.cc:1514] Processing DeleteTablet for tablet bea895c735c847f59794ab8c3282447d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.454283 733 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 (DEFAULT_TABLE table=default.Table_5e8dce362a8a4795b0f72083fae12317 [id=f25842df576f4bf4bc6238f4916cfb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.459700 720 tablet_service.cc:1467] Processing CreateTablet for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f (DEFAULT_TABLE table=default.Table_a3d3d98477d84cc790b30ecc0d2d8e98 [id=5a6f00263fcb44be91e7cfadb7702509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.460804 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_625f280b139743a0a8a21f7e57df0f21" } modify_external_catalogs: true
I20260620 07:01:03.461035 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_625f280b139743a0a8a21f7e57df0f21" } modify_external_catalogs: true
I20260620 07:01:03.463218 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf978ab301954866aeb77b7abaf2c77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.465744 871 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b878def9344cbdae65b209cac4067f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.469776 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8397d634bfa34d018ebbafc7803a6963" } modify_external_catalogs: true
I20260620 07:01:03.470013 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8397d634bfa34d018ebbafc7803a6963" } modify_external_catalogs: true
I20260620 07:01:03.470400 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.471596 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2426d52b8ff40f39887545e0341a91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.477710 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b4bc05fef78b45329e64eb0cf441b4ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.478394 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4bc05fef78b45329e64eb0cf441b4ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.478762 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6d1419cac1c54567a909e7a7b5bc2ff0" } modify_external_catalogs: true
I20260620 07:01:03.478982 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6d1419cac1c54567a909e7a7b5bc2ff0" } modify_external_catalogs: true
I20260620 07:01:03.480471 726 tablet_service.cc:1467] Processing CreateTablet for tablet c06bf6c4d1af40479c81bd1d85e2848f (DEFAULT_TABLE table=default.Table_625f280b139743a0a8a21f7e57df0f21 [id=34c82c4f4c1f42e9b70f1a8a3463f282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.481073 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da80903ac124d1aae937c2329f9b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 95ba8444d70342f781bd84edefbca71f) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.484516 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0f52b588d09748288097316c7b3de423" } modify_external_catalogs: true
I20260620 07:01:03.484730 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0f52b588d09748288097316c7b3de423" } modify_external_catalogs: true
I20260620 07:01:03.489570 719 tablet_service.cc:1467] Processing CreateTablet for tablet ce8ed68b221b4215812934844447d60e (DEFAULT_TABLE table=default.Table_9e3ed63a3519442893a8e57bbe75d01c [id=94a90e06bbdb4e16968b9d103712349f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.486128 725 tablet_service.cc:1467] Processing CreateTablet for tablet fbf912f51bfd4df0afe7aa28815a897e (DEFAULT_TABLE table=default.Table_1c43b2d4813c4afa9752e8e55c232a42 [id=3fd599fba7f44137a7b32121a1507b2f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.491448 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50200e70f4d3492083f6da65f867be31 has no consensus state
I20260620 07:01:03.491904 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5e8dce362a8a4795b0f72083fae12317" } new_table_name: "default.Table_92f22e086c354b20820548c568f04d5f" modify_external_catalogs: true
I20260620 07:01:03.492141 732 tablet_service.cc:1467] Processing CreateTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 (DEFAULT_TABLE table=default.Table_09cc34c1ecf8432980b9247bf2be1e8d [id=0597dd0aeaa9466b8804375281de13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.490610 723 tablet_service.cc:1514] Processing DeleteTablet for tablet 485ce059be9b4900adb1dbc3268efb55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:03.493444 681 leader_election.cc:341] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:03.493639 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 86293.8us
I20260620 07:01:03.495129 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4fbc5f8014db428194ff4b905ceb3bfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.495781 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fbc5f8014db428194ff4b905ceb3bfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.496096 718 tablet_service.cc:1467] Processing CreateTablet for tablet 9647383a4f1b46278348bc25aae2d621 (DEFAULT_TABLE table=default.Table_c756f636ed334c2980b9a0850b223922 [id=4b693fa955894ee0a580772d54edf233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.497934 717 tablet_service.cc:1467] Processing CreateTablet for tablet d9a7fab4d1684604be1b81d4d4bbe560 (DEFAULT_TABLE table=default.Table_ca5b5e6066a343a59aeaf1e58f8a8a67 [id=a7902aafbaad4905a6b5b03ad669eeae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.498754 716 tablet_service.cc:1467] Processing CreateTablet for tablet ee90d961729b4088b0a312ec770d3cd0 (DEFAULT_TABLE table=default.Table_87c64053fbc3481390a21b3940acb5ab [id=e942f08f38194edbb28ef9d04779f0ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.501919 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b878def9344cbdae65b209cac4067f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.502939 729 tablet_service.cc:1514] Processing DeleteTablet for tablet f9df1d52393e47ce991b5295d03624e8 with delete_type TABLET_DATA_DELETED (replaced by tablet b39e682e71ed4776a786f7d30158e7e0) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.501421 715 tablet_service.cc:1467] Processing CreateTablet for tablet 294f8a632f9d4191b925d1da605bd80e (DEFAULT_TABLE table=default.Table_76c9c7cd30ad48e1ae0eca9e170fd5d5 [id=5d6d90a583ff484a8c9352efad051b4f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.508656 683 leader_election.cc:341] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:03.509083 683 leader_election.cc:302] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:03.509964 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 93688.7us
I20260620 07:01:03.519938 425 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 3 got 0
I20260620 07:01:03.520231 425 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:03.524572 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8d48f0f9dd4911876ec8f812688439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.525279 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_93a86466c0d84a5d99d50bb785e28e32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:03.525791 998 tablet_service.cc:1467] Processing CreateTablet for tablet 50200e70f4d3492083f6da65f867be31 (DEFAULT_TABLE table=default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.525918 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93a86466c0d84a5d99d50bb785e28e32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.526352 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50200e70f4d3492083f6da65f867be31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.539749 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 29b8ce279cfe4684bd296a48e8783e1b (DEFAULT_TABLE table=default.Table_cae8e192c99a43f3975359ae78131167 [id=81b7028a393b4c80a76f60c519581f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.540266 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b8ce279cfe4684bd296a48e8783e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.542363 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbf912f51bfd4df0afe7aa28815a897e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.542708 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8ed68b221b4215812934844447d60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.543141 996 tablet_service.cc:1467] Processing CreateTablet for tablet 228af95ef5b24823a4a98b876a50d9af (DEFAULT_TABLE table=default.Table_3eb134c36c8746dc9cbeb8c11a9063c8 [id=d01569425ba447b59b2349fe24a75acd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.543529 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 228af95ef5b24823a4a98b876a50d9af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:03.542924 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3651ef9790d342ec96f554134ae714dc consensus state has no leader
I20260620 07:01:03.547026 1166 ts_tablet_manager.cc:1918] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:03.547143 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 602f6d47f23e4d7f80f372a6a507d095 (DEFAULT_TABLE table=default.Table_15538b00a4f041cfb5143bd9afba2a95 [id=1fd990051b8b4d7abcef0e69f95e4f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.547360 1166 log.cc:1196] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/537ab1626d4e44c38d8cca8c51921424
I20260620 07:01:03.548595 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 602f6d47f23e4d7f80f372a6a507d095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.549398 866 tablet_service.cc:1467] Processing CreateTablet for tablet 602f6d47f23e4d7f80f372a6a507d095 (DEFAULT_TABLE table=default.Table_15538b00a4f041cfb5143bd9afba2a95 [id=1fd990051b8b4d7abcef0e69f95e4f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.549827 861 tablet_service.cc:1467] Processing CreateTablet for tablet 50200e70f4d3492083f6da65f867be31 (DEFAULT_TABLE table=default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.558734 1166 ts_tablet_manager.cc:1939] T 537ab1626d4e44c38d8cca8c51921424 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:03.561316 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 173) took 4794 ms. Trace:
I20260620 07:01:03.561758 1166 rpcz_store.cc:276] 0620 07:00:58.766404 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.766848 (+ 444us) service_pool.cc:227] Handling call
0620 07:01:03.032232 (+4265384us) ts_tablet_manager.cc:1145] Deleting tablet 537ab1626d4e44c38d8cca8c51921424
0620 07:01:03.032243 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.371019 (+338776us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.546530 (+175511us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.561140 (+ 14610us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4265156}
I20260620 07:01:03.560665 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a3d3d98477d84cc790b30ecc0d2d8e98" } new_table_name: "default.Table_2d68ec4a72bf44408ae7549661a637e3" modify_external_catalogs: true
I20260620 07:01:03.563910 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 602f6d47f23e4d7f80f372a6a507d095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.566998 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50200e70f4d3492083f6da65f867be31. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:03.569896 1686 log.cc:924] Time spent T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
W20260620 07:01:03.576988 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a8d48f0f9dd4911876ec8f812688439 consensus state has no leader
I20260620 07:01:03.579450 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ce14069f084d4a07b63b223c700024cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.580180 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce14069f084d4a07b63b223c700024cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.585637 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_12d9e4d1ff354d6e957774c34d5af410"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:03.585817 873 tablet_service.cc:1467] Processing CreateTablet for tablet 228af95ef5b24823a4a98b876a50d9af (DEFAULT_TABLE table=default.Table_3eb134c36c8746dc9cbeb8c11a9063c8 [id=d01569425ba447b59b2349fe24a75acd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.586323 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12d9e4d1ff354d6e957774c34d5af410 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.586836 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13c7f0513df34ddb8104b06e5733fb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.587924 1618 raft_consensus.cc:2726] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:03.588153 1556 raft_consensus.cc:482] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:03.578938 863 tablet_service.cc:1467] Processing CreateTablet for tablet 29b8ce279cfe4684bd296a48e8783e1b (DEFAULT_TABLE table=default.Table_cae8e192c99a43f3975359ae78131167 [id=81b7028a393b4c80a76f60c519581f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.590628 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 228af95ef5b24823a4a98b876a50d9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.586910 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 21f51aeb329e42359cfaf7de2a039d13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.595053 1556 raft_consensus.cc:504] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.595901 1556 leader_election.cc:288] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:03.596647 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bea895c735c847f59794ab8c3282447d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:03.597934 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a2d6f7f2b5b3473aa010b8982a03aa5e
I20260620 07:01:03.598493 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9647383a4f1b46278348bc25aae2d621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.598886 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7b781d0578834708ae64b24419959cca
I20260620 07:01:03.599426 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c06bf6c4d1af40479c81bd1d85e2848f
I20260620 07:01:03.599932 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d0f7e6245c074c82a5a72be79ab1987f
I20260620 07:01:03.601013 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c06bf6c4d1af40479c81bd1d85e2848f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.601063 729 tablet_service.cc:1467] Processing CreateTablet for tablet 50200e70f4d3492083f6da65f867be31 (DEFAULT_TABLE table=default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.601838 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50200e70f4d3492083f6da65f867be31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.602651 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b8ce279cfe4684bd296a48e8783e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.602834 721 tablet_service.cc:1467] Processing CreateTablet for tablet 29b8ce279cfe4684bd296a48e8783e1b (DEFAULT_TABLE table=default.Table_cae8e192c99a43f3975359ae78131167 [id=81b7028a393b4c80a76f60c519581f3f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.601029 681 leader_election.cc:341] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:03.603919 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b8ce279cfe4684bd296a48e8783e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.604724 870 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f7e6245c074c82a5a72be79ab1987f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.607398 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d6f7f2b5b3473aa010b8982a03aa5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.607723 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b781d0578834708ae64b24419959cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.607848 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f7e6245c074c82a5a72be79ab1987f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.608352 871 tablet_service.cc:1514] Processing DeleteTablet for tablet c06bf6c4d1af40479c81bd1d85e2848f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.615084 724 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d6f7f2b5b3473aa010b8982a03aa5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.615832 723 tablet_service.cc:1467] Processing CreateTablet for tablet 602f6d47f23e4d7f80f372a6a507d095 (DEFAULT_TABLE table=default.Table_15538b00a4f041cfb5143bd9afba2a95 [id=1fd990051b8b4d7abcef0e69f95e4f26]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.619417 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0e6ef65b5f44f6d9f2100dd404b2e5f consensus state has no leader
I20260620 07:01:03.626557 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee90d961729b4088b0a312ec770d3cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.628509 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 602f6d47f23e4d7f80f372a6a507d095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.618669 734 tablet_service.cc:1467] Processing CreateTablet for tablet 228af95ef5b24823a4a98b876a50d9af (DEFAULT_TABLE table=default.Table_3eb134c36c8746dc9cbeb8c11a9063c8 [id=d01569425ba447b59b2349fe24a75acd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.631584 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b781d0578834708ae64b24419959cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.637133 724 tablet_service.cc:1514] Processing DeleteTablet for tablet c06bf6c4d1af40479c81bd1d85e2848f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.637383 728 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f7e6245c074c82a5a72be79ab1987f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.638938 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_877047b74134494489f2e58811a97682" } new_table_name: "default.Table_ec98cedea527437ebc2237e75dcc45ec" modify_external_catalogs: true
I20260620 07:01:03.640522 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e87c138cdb1e4f0db439b552e8404b8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.641038 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e87c138cdb1e4f0db439b552e8404b8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.641558 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bea895c735c847f59794ab8c3282447d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:03.642254 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_aef745e818a14008a6e35cd29c256c42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.642714 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aef745e818a14008a6e35cd29c256c42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.643357 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a7fab4d1684604be1b81d4d4bbe560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.643862 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e027fe5ccca8447d86ad610b8cec54f0" } modify_external_catalogs: true
I20260620 07:01:03.644043 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e027fe5ccca8447d86ad610b8cec54f0" } modify_external_catalogs: true
I20260620 07:01:03.644488 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 816218c726a9473e9849b7a97c820678 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:03.644934 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_542fe82ba52d4ad88f324849a55d8fcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.645407 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_542fe82ba52d4ad88f324849a55d8fcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.646348 868 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d6f7f2b5b3473aa010b8982a03aa5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:03.647293 683 leader_election.cc:341] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:03.648316 683 leader_election.cc:302] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:03.651089 1556 raft_consensus.cc:2726] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:03.654578 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe3b70b1674e43768b29dea84b09a1a0 consensus state has no leader
I20260620 07:01:03.658916 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b781d0578834708ae64b24419959cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.661167 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 816218c726a9473e9849b7a97c820678
I20260620 07:01:03.661616 427 catalog_manager.cc:6565] ReplaceTablet: tablet 816218c726a9473e9849b7a97c820678 deleted and replaced by tablet 494a2bc5b3b843c6b29f019974fa0a92
I20260620 07:01:03.662998 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 816218c726a9473e9849b7a97c820678 with delete_type TABLET_DATA_DELETED (replaced by tablet 494a2bc5b3b843c6b29f019974fa0a92) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.663379 420 master_service.cc:946] ReplaceTablet: received request to replace tablet f9df1d52393e47ce991b5295d03624e8 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:03.666352 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 294f8a632f9d4191b925d1da605bd80e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.667856 998 tablet_service.cc:1514] Processing DeleteTablet for tablet c06bf6c4d1af40479c81bd1d85e2848f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.674031 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 816218c726a9473e9849b7a97c820678 with delete_type TABLET_DATA_DELETED (replaced by tablet 494a2bc5b3b843c6b29f019974fa0a92) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.675239 1170 tablet_bootstrap.cc:492] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:03.675446 1170 ts_tablet_manager.cc:1397] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.468s user 0.018s sys 0.061s
I20260620 07:01:03.677987 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 228af95ef5b24823a4a98b876a50d9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.693579 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 3 got 0
I20260620 07:01:03.695398 1170 raft_consensus.cc:348] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.696230 1170 raft_consensus.cc:374] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.697901 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1489f6b875284b46aa9ea05d1b2dfbd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.698503 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1489f6b875284b46aa9ea05d1b2dfbd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.700578 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_262e214778774fe4aca99fb3c3bcf96d" } new_table_name: "default.Table_ecd2d34af33b4920a820e7a49409c63b" modify_external_catalogs: true
I20260620 07:01:03.706528 1170 raft_consensus.cc:729] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.707799 1165 ts_tablet_manager.cc:1918] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:03.708299 1170 consensus_queue.cc:260] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:03.709807 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c4b81f2b92f4363829034d3fe290742 consensus state has no leader
I20260620 07:01:03.718921 1165 log.cc:1196] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f90f1b2facc0415ab378fb81b60b0202
I20260620 07:01:03.719605 1165 ts_tablet_manager.cc:1939] T f90f1b2facc0415ab378fb81b60b0202 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:03.720139 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 209) took 4756 ms. Trace:
I20260620 07:01:03.720121 1170 ts_tablet_manager.cc:1428] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.034s user 0.003s sys 0.000s
I20260620 07:01:03.720386 1165 rpcz_store.cc:276] 0620 07:00:58.964066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.964142 (+ 76us) service_pool.cc:227] Handling call
0620 07:01:03.230517 (+4266375us) ts_tablet_manager.cc:1145] Deleting tablet f90f1b2facc0415ab378fb81b60b0202
0620 07:01:03.230527 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.236996 (+ 6469us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.545766 (+308770us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.720098 (+174332us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4164668}
I20260620 07:01:03.708025 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 816218c726a9473e9849b7a97c820678 with delete_type TABLET_DATA_DELETED (replaced by tablet 494a2bc5b3b843c6b29f019974fa0a92) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.711529 1690 tablet.cc:1722] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:03.720979 1165 tablet_replica.cc:330] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:03.721215 1165 raft_consensus.cc:2229] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:03.721587 1165 raft_consensus.cc:2258] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:03.722061 1170 tablet_bootstrap.cc:492] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:03.722184 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f90f1b2facc0415ab378fb81b60b0202 (table default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]) successfully deleted
I20260620 07:01:03.725302 1689 tablet.cc:1722] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:03.727421 1168 tablet_bootstrap.cc:492] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:03.740295 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1d9d4b5a69484176a7b0f4fded010867
I20260620 07:01:03.741329 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d9d4b5a69484176a7b0f4fded010867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.741528 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d9d4b5a69484176a7b0f4fded010867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.745429 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f30c54c24f5f4cf9a19e699edc793a12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.746107 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f30c54c24f5f4cf9a19e699edc793a12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.746856 1165 ts_tablet_manager.cc:1905] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:03.747169 1168 ts_tablet_manager.cc:1397] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.500s user 0.019s sys 0.021s
I20260620 07:01:03.748045 1168 raft_consensus.cc:348] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.748356 1168 raft_consensus.cc:374] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.748440 1168 raft_consensus.cc:729] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.748858 1168 consensus_queue.cc:260] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.749374 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b16e5dbf81bc4141936830a4dc9b06fb" } new_table_name: "default.Table_6265551265c24c08b658f79709b7887d" modify_external_catalogs: true
I20260620 07:01:03.758157 420 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_82f52a84b6a04edea83f64b1e1ac450f [id=04c170b69f3b43eb88b51e1654ec86df] alter complete (version 3)
I20260620 07:01:03.758231 1168 ts_tablet_manager.cc:1428] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260620 07:01:03.761099 1168 tablet_bootstrap.cc:492] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:03.744181 1600 raft_consensus.cc:482] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:03.757464 1167 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.550s user 0.054s sys 0.136s
W20260620 07:01:03.762382 1167 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.555s user 0.054s sys 0.136s
I20260620 07:01:03.762481 1600 raft_consensus.cc:504] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.763830 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d5d361a5404dcf99a89e93ac1f7dd8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:03.764014 1167 tablet_bootstrap.cc:492] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:03.764112 893 raft_consensus.cc:2454] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:03.764173 1167 ts_tablet_manager.cc:1397] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.560s user 0.056s sys 0.137s
I20260620 07:01:03.764920 1167 raft_consensus.cc:348] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.765220 1167 raft_consensus.cc:374] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.765241 969 leader_election.cc:302] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:03.765322 1167 raft_consensus.cc:729] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.765621 1600 leader_election.cc:288] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:03.765558 1167 consensus_queue.cc:260] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.766229 1167 ts_tablet_manager.cc:1428] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260620 07:01:03.765566 1201 raft_consensus.cc:2781] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:03.766433 1201 raft_consensus.cc:482] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:03.766541 1201 raft_consensus.cc:3037] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:03.768388 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08ec769f903c4438bc1186d5fc1c5108 consensus state has no leader
I20260620 07:01:03.769814 1201 raft_consensus.cc:504] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.770479 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3306fa38cf3a46f984a8fcde184d39a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:03.770987 1167 tablet_bootstrap.cc:492] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:03.771644 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 6229a52adf8d4b17bdf89347e01621ed from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:03.773056 1167 tablet_bootstrap.cc:654] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:03.774227 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3306fa38cf3a46f984a8fcde184d39a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.770560 1201 leader_election.cc:288] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:03.777312 1168 tablet_bootstrap.cc:654] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.777487 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d5d361a5404dcf99a89e93ac1f7dd8" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:03.778869 893 raft_consensus.cc:3037] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:03.779650 1201 raft_consensus.cc:482] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:03.779819 1201 raft_consensus.cc:504] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.780552 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d1e4719cd441dd8054b24861cbd8a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.781759 1201 leader_election.cc:288] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:03.785672 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 25b878def9344cbdae65b209cac4067f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:03.783535 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e643fb0890042ae891ea17f0bc03740" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:03.785877 895 raft_consensus.cc:2454] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:03.786384 969 leader_election.cc:302] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:03.786895 1201 raft_consensus.cc:2781] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:03.787016 1201 raft_consensus.cc:482] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:03.787125 1201 raft_consensus.cc:3037] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:03.787295 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6f6ace27f2824931a73aa8b2546c3db1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.787915 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f6ace27f2824931a73aa8b2546c3db1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.789016 1166 tablet_replica.cc:330] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:03.789186 1166 raft_consensus.cc:2229] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:03.789453 1166 raft_consensus.cc:2258] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:03.790033 1166 ts_tablet_manager.cc:1905] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:03.789923 1201 raft_consensus.cc:504] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.790956 1201 leader_election.cc:288] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:03.791934 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ff4515912eae481fbffd1f927fa46455" } new_table_name: "default.Table_b043963ee56e4494be5b5a95ea01d158" modify_external_catalogs: true
I20260620 07:01:03.792215 893 raft_consensus.cc:2454] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:03.792941 969 leader_election.cc:302] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:03.793310 1201 raft_consensus.cc:2781] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:03.794147 1201 raft_consensus.cc:686] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:03.794420 1201 consensus_queue.cc:237] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.797377 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e643fb0890042ae891ea17f0bc03740" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:03.797593 893 raft_consensus.cc:3037] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:03.797811 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6229a52adf8d4b17bdf89347e01621ed
I20260620 07:01:03.798599 427 catalog_manager.cc:6565] ReplaceTablet: tablet 6229a52adf8d4b17bdf89347e01621ed deleted and replaced by tablet 883d1959ed484c58935db467aa2dc50a
I20260620 07:01:03.799036 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 6229a52adf8d4b17bdf89347e01621ed with delete_type TABLET_DATA_DELETED (replaced by tablet 883d1959ed484c58935db467aa2dc50a) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.799353 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 6229a52adf8d4b17bdf89347e01621ed with delete_type TABLET_DATA_DELETED (replaced by tablet 883d1959ed484c58935db467aa2dc50a) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.802826 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0948b3a7b876431dafb498c00e40cc2e" } modify_external_catalogs: true
I20260620 07:01:03.803045 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0948b3a7b876431dafb498c00e40cc2e" } modify_external_catalogs: true
I20260620 07:01:03.804327 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f9c3eac07b6040a280cd24392454206b" } modify_external_catalogs: true
I20260620 07:01:03.804510 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f9c3eac07b6040a280cd24392454206b" } modify_external_catalogs: true
I20260620 07:01:03.805500 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ce14069f084d4a07b63b223c700024cc" } modify_external_catalogs: true
I20260620 07:01:03.805702 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ce14069f084d4a07b63b223c700024cc" } modify_external_catalogs: true
I20260620 07:01:03.809653 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5f1815876abd4a8282d506949e5adcda" } modify_external_catalogs: true
I20260620 07:01:03.809859 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5f1815876abd4a8282d506949e5adcda" } modify_external_catalogs: true
I20260620 07:01:03.811823 1165 ts_tablet_manager.cc:1918] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:03.811990 1165 log.cc:1196] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/b8799f2a2aed4688aa4e6e590dc83a4e
I20260620 07:01:03.812884 1165 ts_tablet_manager.cc:1939] T b8799f2a2aed4688aa4e6e590dc83a4e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:03.813272 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 208) took 4849 ms. Trace:
I20260620 07:01:03.813382 1165 rpcz_store.cc:276] 0620 07:00:58.963912 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.971616 (+ 7704us) service_pool.cc:227] Handling call
0620 07:01:03.720904 (+4749288us) ts_tablet_manager.cc:1145] Deleting tablet b8799f2a2aed4688aa4e6e590dc83a4e
0620 07:01:03.720917 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.796313 (+ 75396us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.811675 (+ 15362us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.813219 (+ 1544us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4654983}
I20260620 07:01:03.814572 893 raft_consensus.cc:2454] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:03.815186 969 leader_election.cc:302] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:03.815528 1600 raft_consensus.cc:2781] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:03.815668 1600 raft_consensus.cc:686] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
W20260620 07:01:03.815805 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad consensus state has no leader
I20260620 07:01:03.815987 1600 consensus_queue.cc:237] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:03.817987 968 consensus_peers.cc:487] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b8d90f8d63e45ce990aead6166bcfb6. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:03.818512 968 leader_election.cc:341] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 9e643fb0890042ae891ea17f0bc03740
I20260620 07:01:03.819288 730 tablet_service.cc:1514] Processing DeleteTablet for tablet add9e860802d4edebcfbc9fa3c4a6b24 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a46df2909bf43f297b412c33f18a329) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.823491 859 tablet_service.cc:1467] Processing CreateTablet for tablet 3b45cb0153184218ae4f706a898d0657 (DEFAULT_TABLE table=default.Table_528cd9a3d9074784ac9b1808f448896e [id=b20568195d57401eb9e4adb5e985ba48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.823894 1170 tablet_bootstrap.cc:654] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:03.823971 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b45cb0153184218ae4f706a898d0657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.826187 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c9d344f9e4b444e4b6018fdf0cf762fd
I20260620 07:01:03.831410 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet c9d344f9e4b444e4b6018fdf0cf762fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.832126 859 tablet_service.cc:1514] Processing DeleteTablet for tablet c9d344f9e4b444e4b6018fdf0cf762fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.834978 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5926946427294a5ca6fbc72d3e1b612d
I20260620 07:01:03.836024 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 5926946427294a5ca6fbc72d3e1b612d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.836575 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 5926946427294a5ca6fbc72d3e1b612d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.836756 427 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 8947f8b4244a43af9417ce64d9cc009d
I20260620 07:01:03.838871 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_68cda40c45984d5facf4822b65e40a88" } new_table_name: "default.Table_155f286726eb4befbc18214b304e1db8" modify_external_catalogs: true
I20260620 07:01:03.841076 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_25928fd276674c5e968f012013d868b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.841779 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25928fd276674c5e968f012013d868b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.843449 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ce08a8656d2a43969f4efb5cd09cc70d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.843974 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce08a8656d2a43969f4efb5cd09cc70d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.845681 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_86b1f7775f464864a09df3e2246d8aa0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.846216 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86b1f7775f464864a09df3e2246d8aa0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.848063 893 raft_consensus.cc:3037] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:03.850394 968 leader_election.cc:341] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 9e643fb0890042ae891ea17f0bc03740
W20260620 07:01:03.850855 968 leader_election.cc:341] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 04d5d361a5404dcf99a89e93ac1f7dd8
W20260620 07:01:03.855479 968 leader_election.cc:341] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 04d5d361a5404dcf99a89e93ac1f7dd8
I20260620 07:01:03.858824 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ebb8f77ba56a41a4932ba0a1147da851"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.859512 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebb8f77ba56a41a4932ba0a1147da851 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.860080 1333 consensus_queue.cc:1035] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:03.860818 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fd76eaeee815495cb78cdb3c70f5a57b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.861351 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd76eaeee815495cb78cdb3c70f5a57b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.865120 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d37e4e9b4260490d8205e9ce30762f3b" } new_table_name: "default.Table_f99b2d2b64ca4a6b8acb835f5dbbc740" modify_external_catalogs: true
I20260620 07:01:03.866880 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d9d4b5a69484176a7b0f4fded010867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.869814 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:03.872022 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet b8799f2a2aed4688aa4e6e590dc83a4e (table default.Table_551c55403131424c87aee4c019ca1466 [id=fc9d4751547b40ae866b1c82804da11a]) successfully deleted
I20260620 07:01:03.872044 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 215) took 4723 ms. Trace:
I20260620 07:01:03.872149 1165 rpcz_store.cc:276] 0620 07:00:59.148591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.148677 (+ 86us) service_pool.cc:227] Handling call
0620 07:01:03.871865 (+4723188us) ts_tablet_manager.cc:1145] Deleting tablet a5757e05e9a2403a86ca98f455e11754
0620 07:01:03.871878 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.871990 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4722985}
I20260620 07:01:03.872340 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b566163fb83b419c87d03b76fdaf2240"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:03.873499 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b566163fb83b419c87d03b76fdaf2240 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.873665 1166 ts_tablet_manager.cc:1918] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:03.873827 1166 log.cc:1196] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/1f763b0e91544700bd672c2ef751b4d2
I20260620 07:01:03.874317 1166 ts_tablet_manager.cc:1939] T 1f763b0e91544700bd672c2ef751b4d2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:03.877272 733 tablet_service.cc:1467] Processing CreateTablet for tablet 3b45cb0153184218ae4f706a898d0657 (DEFAULT_TABLE table=default.Table_528cd9a3d9074784ac9b1808f448896e [id=b20568195d57401eb9e4adb5e985ba48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.877526 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 3b45cb0153184218ae4f706a898d0657 (DEFAULT_TABLE table=default.Table_528cd9a3d9074784ac9b1808f448896e [id=b20568195d57401eb9e4adb5e985ba48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.877627 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 6229a52adf8d4b17bdf89347e01621ed with delete_type TABLET_DATA_DELETED (replaced by tablet 883d1959ed484c58935db467aa2dc50a) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.877928 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b45cb0153184218ae4f706a898d0657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.878360 859 tablet_service.cc:1467] Processing CreateTablet for tablet 09886cbd967549118d3b1ba116f7834f (DEFAULT_TABLE table=default.Table_6cfbc068f51142a59236d86d8e246da5 [id=0d8a9d23ed1a400592cecf80efd0f0aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.879225 873 tablet_service.cc:1467] Processing CreateTablet for tablet 95ba8444d70342f781bd84edefbca71f (DEFAULT_TABLE table=default.Table_ddf7eee68cd64d798dd0e8cced08b38a [id=2943ebfc86e54b75a06a5727fdcc6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.879426 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b45cb0153184218ae4f706a898d0657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.879662 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09886cbd967549118d3b1ba116f7834f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.880121 863 tablet_service.cc:1467] Processing CreateTablet for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 (DEFAULT_TABLE table=default.Table_abf326e06bac4ac9a638a5a2e4c97619 [id=6f8cad1f8c064ec880389a6c890171dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.880656 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b17bbf2f844b4c01ad5d6dc36e096ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.881116 719 tablet_service.cc:1514] Processing DeleteTablet for tablet c9d344f9e4b444e4b6018fdf0cf762fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.881477 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 5926946427294a5ca6fbc72d3e1b612d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.883405 998 tablet_service.cc:1467] Processing CreateTablet for tablet 09886cbd967549118d3b1ba116f7834f (DEFAULT_TABLE table=default.Table_6cfbc068f51142a59236d86d8e246da5 [id=0d8a9d23ed1a400592cecf80efd0f0aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.883448 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 95ba8444d70342f781bd84edefbca71f (DEFAULT_TABLE table=default.Table_ddf7eee68cd64d798dd0e8cced08b38a [id=2943ebfc86e54b75a06a5727fdcc6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.883782 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09886cbd967549118d3b1ba116f7834f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.884141 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95ba8444d70342f781bd84edefbca71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.884994 720 tablet_service.cc:1467] Processing CreateTablet for tablet 203485ac9bc54f138bb4f2d547291418 (DEFAULT_TABLE table=default.Table_0058a55bf8db4c36b3a1ec4a97690363 [id=1d0a29a93c114cbb838ae452008b68f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.885812 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 203485ac9bc54f138bb4f2d547291418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.886861 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95ba8444d70342f781bd84edefbca71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.887228 996 tablet_service.cc:1467] Processing CreateTablet for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 (DEFAULT_TABLE table=default.Table_abf326e06bac4ac9a638a5a2e4c97619 [id=6f8cad1f8c064ec880389a6c890171dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.887640 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b17bbf2f844b4c01ad5d6dc36e096ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.888931 721 tablet_service.cc:1467] Processing CreateTablet for tablet 4444360e8ade484f958816c5b80dca7e (DEFAULT_TABLE table=default.Table_8f962786c05b4ad2931bf26dab569bea [id=6601ffafdbb94a36a8ac3340fdf24cb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.889714 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa (DEFAULT_TABLE table=default.Table_3a8207eeb3544a2cb063745765f5f8e1 [id=a6b66652e51f413093f45251bdafdab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.890080 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.891673 861 tablet_service.cc:1467] Processing CreateTablet for tablet 4444360e8ade484f958816c5b80dca7e (DEFAULT_TABLE table=default.Table_8f962786c05b4ad2931bf26dab569bea [id=6601ffafdbb94a36a8ac3340fdf24cb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.892108 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4444360e8ade484f958816c5b80dca7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.902374 863 tablet_service.cc:1467] Processing CreateTablet for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa (DEFAULT_TABLE table=default.Table_3a8207eeb3544a2cb063745765f5f8e1 [id=a6b66652e51f413093f45251bdafdab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.902894 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.903667 732 tablet_service.cc:1467] Processing CreateTablet for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa (DEFAULT_TABLE table=default.Table_3a8207eeb3544a2cb063745765f5f8e1 [id=a6b66652e51f413093f45251bdafdab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.903987 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3651ef9790d342ec96f554134ae714dc
I20260620 07:01:03.904110 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.905750 725 tablet_service.cc:1467] Processing CreateTablet for tablet 95ba8444d70342f781bd84edefbca71f (DEFAULT_TABLE table=default.Table_ddf7eee68cd64d798dd0e8cced08b38a [id=2943ebfc86e54b75a06a5727fdcc6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.906286 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 4444360e8ade484f958816c5b80dca7e (DEFAULT_TABLE table=default.Table_8f962786c05b4ad2931bf26dab569bea [id=6601ffafdbb94a36a8ac3340fdf24cb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.906689 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4444360e8ade484f958816c5b80dca7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.910501 730 tablet_service.cc:1467] Processing CreateTablet for tablet 09886cbd967549118d3b1ba116f7834f (DEFAULT_TABLE table=default.Table_6cfbc068f51142a59236d86d8e246da5 [id=0d8a9d23ed1a400592cecf80efd0f0aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.911808 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 3651ef9790d342ec96f554134ae714dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.912056 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 3651ef9790d342ec96f554134ae714dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.912379 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_dee364706a7749e88746a0779bb44a36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:03.912814 861 tablet_service.cc:1467] Processing CreateTablet for tablet 203485ac9bc54f138bb4f2d547291418 (DEFAULT_TABLE table=default.Table_0058a55bf8db4c36b3a1ec4a97690363 [id=1d0a29a93c114cbb838ae452008b68f2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:03.912948 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dee364706a7749e88746a0779bb44a36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.913300 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 203485ac9bc54f138bb4f2d547291418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.914283 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_aaf29f2847544df2a6556397c39653c9" } new_table_name: "default.Table_3963c0af021142c49a0afa8aa254302e" modify_external_catalogs: true
I20260620 07:01:03.916139 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 203485ac9bc54f138bb4f2d547291418 (DEFAULT_TABLE table=default.Table_0058a55bf8db4c36b3a1ec4a97690363 [id=1d0a29a93c114cbb838ae452008b68f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.916751 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 203485ac9bc54f138bb4f2d547291418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.929316 719 tablet_service.cc:1467] Processing CreateTablet for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 (DEFAULT_TABLE table=default.Table_abf326e06bac4ac9a638a5a2e4c97619 [id=6f8cad1f8c064ec880389a6c890171dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:03.931223 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 3651ef9790d342ec96f554134ae714dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:03.931851 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed69a44c466047d298cf7653b2a2bb23 consensus state has no leader
I20260620 07:01:03.933488 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:03.935376 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 218) took 4786 ms. Trace:
I20260620 07:01:03.940444 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4444360e8ade484f958816c5b80dca7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.944833 422 master_service.cc:946] ReplaceTablet: received request to replace tablet ab60101b34144f85b0afd2e8c4846e48 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:03.945081 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b17bbf2f844b4c01ad5d6dc36e096ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.946718 1165 rpcz_store.cc:276] 0620 07:00:59.149061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.154737 (+ 5676us) service_pool.cc:227] Handling call
0620 07:01:03.935182 (+4780445us) ts_tablet_manager.cc:1145] Deleting tablet d066c73ae0104cb3be792790b1dfb93d
0620 07:01:03.935193 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.935326 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4779691}
I20260620 07:01:03.946973 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_27b3605ce0ed4b8a8c04f4f83227b678" } modify_external_catalogs: true
I20260620 07:01:03.947168 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_27b3605ce0ed4b8a8c04f4f83227b678" } modify_external_catalogs: true
I20260620 07:01:03.947433 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 217) took 4798 ms. Trace:
I20260620 07:01:03.943461 1168 tablet_bootstrap.cc:492] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:03.947777 1168 ts_tablet_manager.cc:1397] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.187s user 0.004s sys 0.005s
W20260620 07:01:03.948465 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d066c73ae0104cb3be792790b1dfb93d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d066c73ae0104cb3be792790b1dfb93d already in progress: creating tablet
I20260620 07:01:03.948570 1168 raft_consensus.cc:348] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.948796 1168 raft_consensus.cc:374] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:03.948882 1168 raft_consensus.cc:729] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:03.947521 1165 rpcz_store.cc:276] 0620 07:00:59.148850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.149088 (+ 238us) service_pool.cc:227] Handling call
0620 07:01:03.947235 (+4798147us) ts_tablet_manager.cc:1145] Deleting tablet a292d66ee14a48959c1f6a63e0a0f492
0620 07:01:03.947247 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.947372 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4697492}
W20260620 07:01:03.949544 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a292d66ee14a48959c1f6a63e0a0f492 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a292d66ee14a48959c1f6a63e0a0f492 already in progress: creating tablet
I20260620 07:01:03.950111 1165 tablet_replica.cc:330] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:03.950311 1165 raft_consensus.cc:2229] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:03.950536 1165 raft_consensus.cc:2258] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:03.953652 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95ba8444d70342f781bd84edefbca71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.959388 1165 ts_tablet_manager.cc:1905] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:03.960237 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 302adda3630e44289d371de591061692 consensus state has no leader
I20260620 07:01:03.966449 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ab60101b34144f85b0afd2e8c4846e48
I20260620 07:01:03.967587 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8d2c706414684bb1bacc6f9b870fc9c1
I20260620 07:01:03.968319 422 catalog_manager.cc:6565] ReplaceTablet: tablet ab60101b34144f85b0afd2e8c4846e48 deleted and replaced by tablet 20fc99f79e7b4df2b74a79468656b6ab
I20260620 07:01:03.968942 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d2c706414684bb1bacc6f9b870fc9c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.969684 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet ab60101b34144f85b0afd2e8c4846e48 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fc99f79e7b4df2b74a79468656b6ab) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:03.969758 727 tablet_service.cc:1514] Processing DeleteTablet for tablet ab60101b34144f85b0afd2e8c4846e48 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fc99f79e7b4df2b74a79468656b6ab) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.969995 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09886cbd967549118d3b1ba116f7834f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.970938 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d2c706414684bb1bacc6f9b870fc9c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:03.972858 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_48a88b94cfe34d46ab9881c6bcb2cfc3" } new_table_name: "default.Table_6559046a0e474633ad24c9215e23b506" modify_external_catalogs: true
I20260620 07:01:03.975451 1703 raft_consensus.cc:482] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fe29008ed9b430ea13d40e54e3ddfcc)
I20260620 07:01:03.975666 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_064c212329924eecb592fc2ba757c492"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:03.975733 1703 raft_consensus.cc:504] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
W20260620 07:01:03.976389 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_064c212329924eecb592fc2ba757c492 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:03.979457 1703 leader_election.cc:288] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fe29008ed9b430ea13d40e54e3ddfcc (127.0.97.62:36007), 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455)
I20260620 07:01:03.980893 507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 387 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5" is_pre_election: true
I20260620 07:01:03.984740 436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 387 } } ignore_live_leader: false dest_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" is_pre_election: true
I20260620 07:01:03.986981 1329 leader_election.cc:302] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f32c3995c70946c38ce1a3094aaaffb1; no voters: 2395d394cd84440ebae89d1ecfa13fb5, 2fe29008ed9b430ea13d40e54e3ddfcc
I20260620 07:01:03.987187 1167 tablet_bootstrap.cc:492] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:03.987331 1167 ts_tablet_manager.cc:1397] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.216s user 0.005s sys 0.006s
I20260620 07:01:03.987403 1703 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 07:01:03.973743 863 tablet_service.cc:1514] Processing DeleteTablet for tablet ab60101b34144f85b0afd2e8c4846e48 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fc99f79e7b4df2b74a79468656b6ab) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.981225 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d2c706414684bb1bacc6f9b870fc9c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:03.982921 1168 consensus_queue.cc:260] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:03.991655 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:03.993260 1168 ts_tablet_manager.cc:1428] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.045s user 0.000s sys 0.002s
W20260620 07:01:03.994840 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5208f3136bcd45579de49b8b10745122 consensus state has no leader
I20260620 07:01:04.002189 1167 raft_consensus.cc:348] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.002936 1168 tablet_bootstrap.cc:492] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:04.005650 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 81704d3a3cf648d987d4b40a270f7508 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.006182 1167 raft_consensus.cc:374] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.006353 1167 raft_consensus.cc:729] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.006659 1167 consensus_queue.cc:260] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.009025 1167 ts_tablet_manager.cc:1428] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.022s user 0.002s sys 0.001s
I20260620 07:01:04.012892 1167 tablet_bootstrap.cc:492] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:04.016088 1167 tablet_bootstrap.cc:654] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.018587 1689 tablet.cc:1722] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260620 07:01:04.022415 969 consensus_peers.cc:487] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:04.024104 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_94105963fc7f435e8b8a16141f29f408"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.024712 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94105963fc7f435e8b8a16141f29f408 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.027024 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_55c10675b20148549679607191b74a20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.027606 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55c10675b20148549679607191b74a20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.028858 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c2c8c59b79f3455e9ec512be24010087" } new_table_name: "default.Table_01ee97109ccf4626922b6e3ec22f9423" modify_external_catalogs: true
I20260620 07:01:04.031265 1690 tablet.cc:1722] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:04.035895 1666 catalog_manager.cc:1259] Loaded cluster ID: f5f6212dc8bc4fbd93e00bcd73ee0625
I20260620 07:01:04.036096 1169 ts_tablet_manager.cc:1918] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:04.036255 1169 log.cc:1196] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/81704d3a3cf648d987d4b40a270f7508
I20260620 07:01:04.036684 1169 ts_tablet_manager.cc:1939] T 81704d3a3cf648d987d4b40a270f7508 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:04.037453 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 372) took 1121 ms. Trace:
I20260620 07:01:04.037588 1169 rpcz_store.cc:276] 0620 07:01:02.915509 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.916469 (+ 960us) service_pool.cc:227] Handling call
0620 07:01:03.092650 (+176181us) ts_tablet_manager.cc:1145] Deleting tablet 81704d3a3cf648d987d4b40a270f7508
0620 07:01:03.092658 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.669170 (+576512us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.033260 (+364090us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.037416 (+ 4156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":176066}
I20260620 07:01:04.038195 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 373) took 1119 ms. Trace:
I20260620 07:01:04.038307 1169 rpcz_store.cc:276] 0620 07:01:02.918806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.918858 (+ 52us) service_pool.cc:227] Handling call
0620 07:01:04.038043 (+1119185us) ts_tablet_manager.cc:1145] Deleting tablet f8ec1e179a704e5480f3deaf856156e7
0620 07:01:04.038054 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.038165 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1118836}
I20260620 07:01:04.039417 1169 tablet_replica.cc:330] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:04.039729 1169 raft_consensus.cc:2229] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:04.040596 1168 tablet_bootstrap.cc:654] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.057053 1169 raft_consensus.cc:2258] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:04.059728 413 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 302adda3630e44289d371de591061692 (table default.Table_3963c0af021142c49a0afa8aa254302e [id=92e4f74224ab4135982722f846eb9e73], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 302adda3630e44289d371de591061692 consensus state has no leader
I20260620 07:01:04.060531 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 81704d3a3cf648d987d4b40a270f7508 (table default.Table_90ae8d7513c948f8b7840964f5601249 [id=e7c8a5a3411f485abeddf596a8584e99]) successfully deleted
W20260620 07:01:04.060786 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f8ec1e179a704e5480f3deaf856156e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8ec1e179a704e5480f3deaf856156e7 already in progress: creating tablet
I20260620 07:01:04.061976 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f99b2d2b64ca4a6b8acb835f5dbbc740" } modify_external_catalogs: true
I20260620 07:01:04.062248 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f99b2d2b64ca4a6b8acb835f5dbbc740" } modify_external_catalogs: true
I20260620 07:01:04.062871 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 978f99d2a7d6448aba8dcd2611b75af3 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:04.063580 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e31ff399ff5e4a309b29286a69aea7f0" } modify_external_catalogs: true
I20260620 07:01:04.063843 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e31ff399ff5e4a309b29286a69aea7f0" } modify_external_catalogs: true
I20260620 07:01:04.064446 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e21acc07ea2349cc9a821839ff680062" } modify_external_catalogs: true
I20260620 07:01:04.064666 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e21acc07ea2349cc9a821839ff680062" } modify_external_catalogs: true
I20260620 07:01:04.067162 1170 tablet_bootstrap.cc:492] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:04.068257 1169 ts_tablet_manager.cc:1905] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:04.079475 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0a5967c84434000a51fe7d819fac439 consensus state has no leader
I20260620 07:01:04.081238 1170 ts_tablet_manager.cc:1397] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.345s user 0.005s sys 0.005s
I20260620 07:01:04.081349 1666 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: loading cluster ID for follower catalog manager: success
I20260620 07:01:04.082201 1170 raft_consensus.cc:348] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.082490 1170 raft_consensus.cc:374] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.082574 1170 raft_consensus.cc:729] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.082873 1170 consensus_queue.cc:260] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.086041 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 174) took 5319 ms. Trace:
I20260620 07:01:04.087651 1166 rpcz_store.cc:276] 0620 07:00:58.766593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.767097 (+ 504us) service_pool.cc:227] Handling call
0620 07:01:03.788918 (+5021821us) ts_tablet_manager.cc:1145] Deleting tablet 1f763b0e91544700bd672c2ef751b4d2
0620 07:01:03.788931 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:03.869028 (+ 80097us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:03.873479 (+ 4451us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.085994 (+212515us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5021597}
I20260620 07:01:04.089416 1166 tablet_replica.cc:330] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:04.089854 1170 ts_tablet_manager.cc:1428] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260620 07:01:04.090858 1166 raft_consensus.cc:2229] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:04.091150 1166 raft_consensus.cc:2258] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:04.093086 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_5716ccac487c4d4296da6cdd2d2ceeb0 [id=2abd0f99a3034a0e8824bcb0002c91bd]). Expected version 1 got 0
I20260620 07:01:04.094179 1166 ts_tablet_manager.cc:1905] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:04.094858 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet e14db4e3394046e49ecc69c9ca4dc840 (table default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]). Expected version 1 got 0
W20260620 07:01:04.095355 418 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet e14db4e3394046e49ecc69c9ca4dc840 (table default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e14db4e3394046e49ecc69c9ca4dc840 consensus state has no leader
I20260620 07:01:04.096493 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 1f763b0e91544700bd672c2ef751b4d2 (table default.Table_61741807e243431395868ee24844d1aa [id=31b071f3fa7547fb8a222ac6b8bffd6a]) successfully deleted
I20260620 07:01:04.097600 873 tablet_service.cc:1467] Processing CreateTablet for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 (DEFAULT_TABLE table=default.Table_12d9e4d1ff354d6e957774c34d5af410 [id=8df6203266a848c4ac04e73f2699f8df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.098326 866 tablet_service.cc:1467] Processing CreateTablet for tablet d08b4b09221d46b09dd97c0b7ef9b71d (DEFAULT_TABLE table=default.Table_b4bc05fef78b45329e64eb0cf441b4ff [id=614f9b15707b43dca46addde900a7289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.098778 1170 tablet_bootstrap.cc:492] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:04.099049 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 2057b7689b1c4c65901ed8ec04279568 (DEFAULT_TABLE table=default.Table_e87c138cdb1e4f0db439b552e8404b8d [id=a05bcb4cf42e4ccb88d53946397cd0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.099440 1168 tablet_bootstrap.cc:492] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:04.099473 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2057b7689b1c4c65901ed8ec04279568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.099598 1168 ts_tablet_manager.cc:1397] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.097s user 0.002s sys 0.002s
I20260620 07:01:04.100586 1170 tablet_bootstrap.cc:654] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.100464 1168 raft_consensus.cc:348] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.100733 1168 raft_consensus.cc:374] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.100821 1168 raft_consensus.cc:729] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.102720 1700 consensus_queue.cc:1035] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:04.103626 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 68066afde80c4a8daf042a52629fe6cd (DEFAULT_TABLE table=default.Table_4fbc5f8014db428194ff4b905ceb3bfd [id=1614ffd43f784a4d953bb98a1f47702e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.104053 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68066afde80c4a8daf042a52629fe6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.107129 998 tablet_service.cc:1467] Processing CreateTablet for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 (DEFAULT_TABLE table=default.Table_12d9e4d1ff354d6e957774c34d5af410 [id=8df6203266a848c4ac04e73f2699f8df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.107538 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1936a2b27a1f4fda9ceb295c9c00acf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.108963 720 tablet_service.cc:1467] Processing CreateTablet for tablet 494a2bc5b3b843c6b29f019974fa0a92 (DEFAULT_TABLE table=default.Table_7883c1fc8c5b4c998ab3e869467a79b4 [id=28eabd7db6d149c594279815f0ab8f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.109488 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 494a2bc5b3b843c6b29f019974fa0a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.109519 719 tablet_service.cc:1467] Processing CreateTablet for tablet 574371fb6915427687df660e733407df (DEFAULT_TABLE table=default.Table_93a86466c0d84a5d99d50bb785e28e32 [id=e1a967ce17d949c4a81e06e02ab454a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.109879 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574371fb6915427687df660e733407df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.111070 996 tablet_service.cc:1467] Processing CreateTablet for tablet d08b4b09221d46b09dd97c0b7ef9b71d (DEFAULT_TABLE table=default.Table_b4bc05fef78b45329e64eb0cf441b4ff [id=614f9b15707b43dca46addde900a7289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.111470 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d08b4b09221d46b09dd97c0b7ef9b71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.114589 420 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_155f286726eb4befbc18214b304e1db8 [id=156f143b869542dbac1e92fd120f0f36] alter complete (version 1)
I20260620 07:01:04.115195 733 tablet_service.cc:1467] Processing CreateTablet for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 (DEFAULT_TABLE table=default.Table_12d9e4d1ff354d6e957774c34d5af410 [id=8df6203266a848c4ac04e73f2699f8df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.115453 726 tablet_service.cc:1467] Processing CreateTablet for tablet f591ba26b91b47f9a8933878d478655d (DEFAULT_TABLE table=default.Table_542fe82ba52d4ad88f324849a55d8fcf [id=456781e03c7c43159836db6aa6cbf6ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.115675 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1936a2b27a1f4fda9ceb295c9c00acf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.115967 727 tablet_service.cc:1467] Processing CreateTablet for tablet d42118f181da4fa489a919a9b4c6664b (DEFAULT_TABLE table=default.Table_f30c54c24f5f4cf9a19e699edc793a12 [id=d79fe48235ef4ad4be5ffa8663fe9c12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.116310 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d42118f181da4fa489a919a9b4c6664b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.116470 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f655e04dd3f446debfb3219c289dcadb" } modify_external_catalogs: true
I20260620 07:01:04.116734 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f655e04dd3f446debfb3219c289dcadb" } modify_external_catalogs: true
I20260620 07:01:04.119176 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f591ba26b91b47f9a8933878d478655d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.119103 717 tablet_service.cc:1467] Processing CreateTablet for tablet b40e1ea4d1c74be2906381064c73f8c5 (DEFAULT_TABLE table=default.Table_aef745e818a14008a6e35cd29c256c42 [id=6c87a6a4fecd4a39b8e1c9a9d24b114a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.119413 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b40e1ea4d1c74be2906381064c73f8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.119558 1556 raft_consensus.cc:482] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.119699 1556 raft_consensus.cc:504] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.120373 1556 leader_election.cc:288] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.126737 1167 tablet_bootstrap.cc:492] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:04.126957 1167 ts_tablet_manager.cc:1397] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.114s user 0.004s sys 0.003s
I20260620 07:01:04.127333 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0bd72c17169f4beeab67a8556e097bd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:04.127604 715 tablet_service.cc:1467] Processing CreateTablet for tablet a043d035b0c84d6290041d1c7c03bc35 (DEFAULT_TABLE table=default.Table_6f6ace27f2824931a73aa8b2546c3db1 [id=7484c725195043378c662bc4573904c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.127981 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a043d035b0c84d6290041d1c7c03bc35. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:04.127977 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bd72c17169f4beeab67a8556e097bd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.127817 1167 raft_consensus.cc:348] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.128130 1167 raft_consensus.cc:374] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.128224 1167 raft_consensus.cc:729] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.128476 1167 consensus_queue.cc:260] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.129097 1167 ts_tablet_manager.cc:1428] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:04.129446 1167 tablet_bootstrap.cc:492] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:04.130780 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 60ce7d59a97544fda80a54f7124d1dba (DEFAULT_TABLE table=default.Table_1489f6b875284b46aa9ea05d1b2dfbd7 [id=d796beb9852f435ea31745e8c37c25b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.131197 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60ce7d59a97544fda80a54f7124d1dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.131507 732 tablet_service.cc:1467] Processing CreateTablet for tablet d08b4b09221d46b09dd97c0b7ef9b71d (DEFAULT_TABLE table=default.Table_b4bc05fef78b45329e64eb0cf441b4ff [id=614f9b15707b43dca46addde900a7289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.131850 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d08b4b09221d46b09dd97c0b7ef9b71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.132750 1165 ts_tablet_manager.cc:1918] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:04.133287 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet e14db4e3394046e49ecc69c9ca4dc840 (table default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]). Expected version 1 got 0
I20260620 07:01:04.134644 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_dadaa11698914f6bb6243fb3b922f23b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:04.134199 1168 consensus_queue.cc:260] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:04.135385 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dadaa11698914f6bb6243fb3b922f23b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.136013 1168 ts_tablet_manager.cc:1428] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260620 07:01:04.132887 1165 log.cc:1196] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/8b8d90f8d63e45ce990aead6166bcfb6
I20260620 07:01:04.115197 734 tablet_service.cc:1467] Processing CreateTablet for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf (DEFAULT_TABLE table=default.Table_f45dda87379a48449ff996a365bf8802 [id=4c59e2d54ce74e5a888ff6f649daa841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.136607 1165 ts_tablet_manager.cc:1939] T 8b8d90f8d63e45ce990aead6166bcfb6 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:04.136830 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.136986 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_63c1143c0e0d411591cb240b7750c572"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.137645 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63c1143c0e0d411591cb240b7750c572 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.138413 716 tablet_service.cc:1467] Processing CreateTablet for tablet 40c9d2d029434f37ba23d65f6662893b (DEFAULT_TABLE table=default.Table_3306fa38cf3a46f984a8fcde184d39a1 [id=be832445f1c84adc91ab41e94cb807b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.138779 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c9d2d029434f37ba23d65f6662893b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.142544 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_254d991dafd44638affdf98c4da87aa5" } new_table_name: "default.Table_4417e9fcb14240dcb3f962d49d0fb731" modify_external_catalogs: true
I20260620 07:01:04.142712 730 tablet_service.cc:1467] Processing CreateTablet for tablet 68066afde80c4a8daf042a52629fe6cd (DEFAULT_TABLE table=default.Table_4fbc5f8014db428194ff4b905ceb3bfd [id=1614ffd43f784a4d953bb98a1f47702e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.143432 994 tablet_service.cc:1467] Processing CreateTablet for tablet 494a2bc5b3b843c6b29f019974fa0a92 (DEFAULT_TABLE table=default.Table_7883c1fc8c5b4c998ab3e869467a79b4 [id=28eabd7db6d149c594279815f0ab8f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.143846 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 494a2bc5b3b843c6b29f019974fa0a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.144598 725 tablet_service.cc:1467] Processing CreateTablet for tablet 2057b7689b1c4c65901ed8ec04279568 (DEFAULT_TABLE table=default.Table_e87c138cdb1e4f0db439b552e8404b8d [id=a05bcb4cf42e4ccb88d53946397cd0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.144955 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2057b7689b1c4c65901ed8ec04279568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.145381 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d3fd7d3a8e7e4f609d7ea14c91a2329c" } new_table_name: "default.Table_9e96d0c1bbb4468b8017ab5c1cbdbd19" modify_external_catalogs: true
I20260620 07:01:04.145363 1168 tablet_bootstrap.cc:492] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:04.145602 721 tablet_service.cc:1467] Processing CreateTablet for tablet 60ce7d59a97544fda80a54f7124d1dba (DEFAULT_TABLE table=default.Table_1489f6b875284b46aa9ea05d1b2dfbd7 [id=d796beb9852f435ea31745e8c37c25b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.145944 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60ce7d59a97544fda80a54f7124d1dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.147015 1006 tablet_service.cc:1467] Processing CreateTablet for tablet a043d035b0c84d6290041d1c7c03bc35 (DEFAULT_TABLE table=default.Table_6f6ace27f2824931a73aa8b2546c3db1 [id=7484c725195043378c662bc4573904c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.147149 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a6a8125ccc7b4f2abf382c176f2f74db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:04.147369 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a043d035b0c84d6290041d1c7c03bc35. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:04.147727 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6a8125ccc7b4f2abf382c176f2f74db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.151481 1012 tablet_service.cc:1467] Processing CreateTablet for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf (DEFAULT_TABLE table=default.Table_f45dda87379a48449ff996a365bf8802 [id=4c59e2d54ce74e5a888ff6f649daa841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.151877 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.154027 720 tablet_service.cc:1467] Processing CreateTablet for tablet 883d1959ed484c58935db467aa2dc50a (DEFAULT_TABLE table=default.Table_1d413e8cd6774f26b9f2a394c5903495 [id=e4ea9f9e77f74312a2ead7c22390b268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.154978 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 883d1959ed484c58935db467aa2dc50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.155414 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d17c49eecec741cdbd592c94b7f84c67
I20260620 07:01:04.159168 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 216) took 5010 ms. Trace:
I20260620 07:01:04.159243 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1936a2b27a1f4fda9ceb295c9c00acf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.159432 1169 ts_tablet_manager.cc:1918] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:04.159582 1169 log.cc:1196] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/169b93c38e59435db218152f2d25bdfa
I20260620 07:01:04.159924 1169 ts_tablet_manager.cc:1939] T 169b93c38e59435db218152f2d25bdfa P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:04.159088 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e2b0faf91f2f469f9b06e17caa4709e4
I20260620 07:01:04.160540 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d08b4b09221d46b09dd97c0b7ef9b71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.161207 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0aab74c12cea49c395297cdc26ebf34d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.161825 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0aab74c12cea49c395297cdc26ebf34d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.161770 1713 tablet.cc:1722] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:04.163468 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 374) took 1243 ms. Trace:
I20260620 07:01:04.163599 1169 rpcz_store.cc:276] 0620 07:01:02.919757 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.919814 (+ 57us) service_pool.cc:227] Handling call
0620 07:01:04.039345 (+1119531us) ts_tablet_manager.cc:1145] Deleting tablet 169b93c38e59435db218152f2d25bdfa
0620 07:01:04.039359 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.075767 (+ 36408us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.159328 (+ 83561us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.163410 (+ 4082us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1119322}
I20260620 07:01:04.159276 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ed69a44c466047d298cf7653b2a2bb23
I20260620 07:01:04.164173 1169 tablet_replica.cc:330] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:04.164149 860 tablet_service.cc:1467] Processing CreateTablet for tablet 40c9d2d029434f37ba23d65f6662893b (DEFAULT_TABLE table=default.Table_3306fa38cf3a46f984a8fcde184d39a1 [id=be832445f1c84adc91ab41e94cb807b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.164623 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c9d2d029434f37ba23d65f6662893b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.164507 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b6601757419d4f4fbaa5591d3100a8f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:04.164950 1169 raft_consensus.cc:2229] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:04.165094 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6601757419d4f4fbaa5591d3100a8f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.165071 868 tablet_service.cc:1467] Processing CreateTablet for tablet 494a2bc5b3b843c6b29f019974fa0a92 (DEFAULT_TABLE table=default.Table_7883c1fc8c5b4c998ab3e869467a79b4 [id=28eabd7db6d149c594279815f0ab8f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.165230 1169 raft_consensus.cc:2258] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:04.165443 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 494a2bc5b3b843c6b29f019974fa0a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.166527 870 tablet_service.cc:1467] Processing CreateTablet for tablet 574371fb6915427687df660e733407df (DEFAULT_TABLE table=default.Table_93a86466c0d84a5d99d50bb785e28e32 [id=e1a967ce17d949c4a81e06e02ab454a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.166975 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574371fb6915427687df660e733407df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.158748 421 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_5716ccac487c4d4296da6cdd2d2ceeb0 [id=2abd0f99a3034a0e8824bcb0002c91bd]). Expected version 1 got 0
I20260620 07:01:04.168469 421 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:04.168759 1169 ts_tablet_manager.cc:1905] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:04.170068 871 tablet_service.cc:1467] Processing CreateTablet for tablet a043d035b0c84d6290041d1c7c03bc35 (DEFAULT_TABLE table=default.Table_6f6ace27f2824931a73aa8b2546c3db1 [id=7484c725195043378c662bc4573904c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.170511 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a043d035b0c84d6290041d1c7c03bc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.171164 864 tablet_service.cc:1467] Processing CreateTablet for tablet f591ba26b91b47f9a8933878d478655d (DEFAULT_TABLE table=default.Table_542fe82ba52d4ad88f324849a55d8fcf [id=456781e03c7c43159836db6aa6cbf6ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.171655 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f591ba26b91b47f9a8933878d478655d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.172772 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ca4ebce0835d49c8a8d69ee21c9cec32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.173370 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca4ebce0835d49c8a8d69ee21c9cec32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.173482 869 tablet_service.cc:1467] Processing CreateTablet for tablet b40e1ea4d1c74be2906381064c73f8c5 (DEFAULT_TABLE table=default.Table_aef745e818a14008a6e35cd29c256c42 [id=6c87a6a4fecd4a39b8e1c9a9d24b114a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.173862 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b40e1ea4d1c74be2906381064c73f8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.175122 858 tablet_service.cc:1467] Processing CreateTablet for tablet 883d1959ed484c58935db467aa2dc50a (DEFAULT_TABLE table=default.Table_1d413e8cd6774f26b9f2a394c5903495 [id=e4ea9f9e77f74312a2ead7c22390b268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.175542 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 883d1959ed484c58935db467aa2dc50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.176836 726 tablet_service.cc:1514] Processing DeleteTablet for tablet d17c49eecec741cdbd592c94b7f84c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.177313 726 tablet_service.cc:1514] Processing DeleteTablet for tablet e2b0faf91f2f469f9b06e17caa4709e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.177702 726 tablet_service.cc:1514] Processing DeleteTablet for tablet ed69a44c466047d298cf7653b2a2bb23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.177850 857 tablet_service.cc:1467] Processing CreateTablet for tablet d42118f181da4fa489a919a9b4c6664b (DEFAULT_TABLE table=default.Table_f30c54c24f5f4cf9a19e699edc793a12 [id=d79fe48235ef4ad4be5ffa8663fe9c12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.178272 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d42118f181da4fa489a919a9b4c6664b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.178943 865 tablet_service.cc:1514] Processing DeleteTablet for tablet d17c49eecec741cdbd592c94b7f84c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.181655 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 169b93c38e59435db218152f2d25bdfa (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]) successfully deleted
I20260620 07:01:04.182904 862 tablet_service.cc:1467] Processing CreateTablet for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf (DEFAULT_TABLE table=default.Table_f45dda87379a48449ff996a365bf8802 [id=4c59e2d54ce74e5a888ff6f649daa841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.183454 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.184038 859 tablet_service.cc:1467] Processing CreateTablet for tablet 60ce7d59a97544fda80a54f7124d1dba (DEFAULT_TABLE table=default.Table_1489f6b875284b46aa9ea05d1b2dfbd7 [id=d796beb9852f435ea31745e8c37c25b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.184478 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60ce7d59a97544fda80a54f7124d1dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.188241 872 tablet_service.cc:1514] Processing DeleteTablet for tablet ed69a44c466047d298cf7653b2a2bb23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.188685 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 369c205d7f7841598cb99f661b25736f
I20260620 07:01:04.189330 865 tablet_service.cc:1514] Processing DeleteTablet for tablet e2b0faf91f2f469f9b06e17caa4709e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:04.191795 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ad723586ff545049dad658221e6455b consensus state has no leader
I20260620 07:01:04.193578 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9df1d52393e47ce991b5295d03624e8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:04.194025 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 369c205d7f7841598cb99f661b25736f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:04.195111 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6dca84adc5940e5a5505378e7276731 consensus state has no leader
I20260620 07:01:04.195597 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1e9b65d54a164a3f811eb9afb9c090ff" } new_table_name: "default.Table_e66c7686856045a8b61d0a9a9ce510a6" modify_external_catalogs: true
I20260620 07:01:04.197042 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6f694d1dc105473b93ba18dc487d0d55" } modify_external_catalogs: true
I20260620 07:01:04.197248 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6f694d1dc105473b93ba18dc487d0d55" } modify_external_catalogs: true
W20260620 07:01:04.199628 683 leader_election.cc:341] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.206645 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 369c205d7f7841598cb99f661b25736f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.220045 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_16d8164f00f14ef5bfa42f210bf3aed7" } new_table_name: "default.Table_bc6c3b8048b94a4891efaaa7a063da1a" modify_external_catalogs: true
I20260620 07:01:04.222221 1165 rpcz_store.cc:276] 0620 07:00:59.148740 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.148799 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:03.950020 (+4801221us) ts_tablet_manager.cc:1145] Deleting tablet 8b8d90f8d63e45ce990aead6166bcfb6
0620 07:01:03.950046 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.009153 (+ 59107us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.132591 (+123438us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.159112 (+ 26521us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4695598}
I20260620 07:01:04.222856 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 221) took 4974 ms. Trace:
I20260620 07:01:04.222983 1165 rpcz_store.cc:276] 0620 07:00:59.247997 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.254461 (+ 6464us) service_pool.cc:227] Handling call
0620 07:01:04.222677 (+4968216us) ts_tablet_manager.cc:1145] Deleting tablet b6e36ffd69974ef897390a257f63a509
0620 07:01:04.222689 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.222822 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4968030}
I20260620 07:01:04.223176 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 8b8d90f8d63e45ce990aead6166bcfb6 (table default.Table_26f927ce5e714da5ae118310d32e42a3 [id=2c972f7177414e16be4a7133dc2dac9d]) successfully deleted
I20260620 07:01:04.223465 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 220) took 4976 ms. Trace:
I20260620 07:01:04.223613 1165 rpcz_store.cc:276] 0620 07:00:59.247145 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.249769 (+ 2624us) service_pool.cc:227] Handling call
0620 07:01:04.223340 (+4973571us) ts_tablet_manager.cc:1145] Deleting tablet f9df1d52393e47ce991b5295d03624e8
0620 07:01:04.223351 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.223436 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4967387}
I20260620 07:01:04.224082 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 214) took 5076 ms. Trace:
I20260620 07:01:04.224195 1165 rpcz_store.cc:276] 0620 07:00:59.148066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.149980 (+ 1914us) service_pool.cc:227] Handling call
0620 07:01:04.223965 (+5073985us) ts_tablet_manager.cc:1145] Deleting tablet eea1525b54cc42b78180ba6867957f76
0620 07:01:04.223975 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.224051 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4926941}
W20260620 07:01:04.224323 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f9df1d52393e47ce991b5295d03624e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9df1d52393e47ce991b5295d03624e8 already in progress: creating tablet
W20260620 07:01:04.224583 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet eea1525b54cc42b78180ba6867957f76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eea1525b54cc42b78180ba6867957f76 already in progress: creating tablet
I20260620 07:01:04.224639 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 219) took 5075 ms. Trace:
I20260620 07:01:04.224735 1165 rpcz_store.cc:276] 0620 07:00:59.149176 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.155015 (+ 5839us) service_pool.cc:227] Handling call
0620 07:01:04.224511 (+5069496us) ts_tablet_manager.cc:1145] Deleting tablet 82020156f3e44a1e84a9435d1f994124
0620 07:01:04.224521 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.224611 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4855282}
W20260620 07:01:04.225078 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 82020156f3e44a1e84a9435d1f994124 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82020156f3e44a1e84a9435d1f994124 already in progress: creating tablet
I20260620 07:01:04.225210 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 247) took 4638 ms. Trace:
I20260620 07:01:04.225319 1165 rpcz_store.cc:276] 0620 07:00:59.589511 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.187523 (+598012us) service_pool.cc:227] Handling call
0620 07:01:04.225070 (+4037547us) ts_tablet_manager.cc:1145] Deleting tablet 2ee94c1a799a47f997469f96005167dc
0620 07:01:04.225081 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.225182 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3938662}
W20260620 07:01:04.225665 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2ee94c1a799a47f997469f96005167dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ee94c1a799a47f997469f96005167dc already in progress: creating tablet
I20260620 07:01:04.226652 863 tablet_service.cc:1467] Processing CreateTablet for tablet 68066afde80c4a8daf042a52629fe6cd (DEFAULT_TABLE table=default.Table_4fbc5f8014db428194ff4b905ceb3bfd [id=1614ffd43f784a4d953bb98a1f47702e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.227401 995 tablet_service.cc:1467] Processing CreateTablet for tablet 574371fb6915427687df660e733407df (DEFAULT_TABLE table=default.Table_93a86466c0d84a5d99d50bb785e28e32 [id=e1a967ce17d949c4a81e06e02ab454a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.228394 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68066afde80c4a8daf042a52629fe6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.233865 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68066afde80c4a8daf042a52629fe6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.236721 861 tablet_service.cc:1467] Processing CreateTablet for tablet 2057b7689b1c4c65901ed8ec04279568 (DEFAULT_TABLE table=default.Table_e87c138cdb1e4f0db439b552e8404b8d [id=a05bcb4cf42e4ccb88d53946397cd0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.237301 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2057b7689b1c4c65901ed8ec04279568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.242226 1666 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: acquiring CA information for follower catalog manager: success
I20260620 07:01:04.243101 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 248) took 4428 ms. Trace:
I20260620 07:01:04.243937 1168 tablet_bootstrap.cc:654] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.244897 1165 rpcz_store.cc:276] 0620 07:00:59.823457 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.286467 (+463010us) service_pool.cc:227] Handling call
0620 07:01:04.242919 (+3956452us) ts_tablet_manager.cc:1145] Deleting tablet 46689d13712842bf9145ad2bc3fc2acf
0620 07:01:04.242931 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.243051 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3956214}
W20260620 07:01:04.245438 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 46689d13712842bf9145ad2bc3fc2acf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46689d13712842bf9145ad2bc3fc2acf already in progress: creating tablet
I20260620 07:01:04.246068 426 master_service.cc:946] ReplaceTablet: received request to replace tablet 3eda988492234d6aaeaee87f84f99d06 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:04.247270 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 249) took 4420 ms. Trace:
I20260620 07:01:04.247400 1165 rpcz_store.cc:276] 0620 07:00:59.826525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.286715 (+460190us) service_pool.cc:227] Handling call
0620 07:01:04.245212 (+3958497us) ts_tablet_manager.cc:1145] Deleting tablet 9a46df2909bf43f297b412c33f18a329
0620 07:01:04.245224 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.247219 (+ 1995us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3958299}
W20260620 07:01:04.247818 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9a46df2909bf43f297b412c33f18a329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a46df2909bf43f297b412c33f18a329 already in progress: creating tablet
I20260620 07:01:04.248497 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 251) took 4415 ms. Trace:
W20260620 07:01:04.249500 1711 log.cc:924] Time spent T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: Append to log took a long time: real 0.089s user 0.000s sys 0.000s
I20260620 07:01:04.260794 1169 ts_tablet_manager.cc:1918] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:04.260939 1169 log.cc:1196] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/6ff06bc5fc684b9195c719cbf39d34a6
I20260620 07:01:04.261276 1169 ts_tablet_manager.cc:1939] T 6ff06bc5fc684b9195c719cbf39d34a6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:04.261993 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 387) took 1103 ms. Trace:
I20260620 07:01:04.262111 1169 rpcz_store.cc:276] 0620 07:01:03.158325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.160176 (+ 1851us) service_pool.cc:227] Handling call
0620 07:01:04.164079 (+1003903us) ts_tablet_manager.cc:1145] Deleting tablet 6ff06bc5fc684b9195c719cbf39d34a6
0620 07:01:04.164091 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.171987 (+ 7896us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.260670 (+ 88683us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.261959 (+ 1289us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":995251}
I20260620 07:01:04.262807 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f793a91ab247408bbe4a9f7cb370fffe
I20260620 07:01:04.263674 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 6ff06bc5fc684b9195c719cbf39d34a6 (table default.Table_009386cbc364471099079c21ecb6c8e0 [id=74f991adb273483bb626c5939a2cc63c]) successfully deleted
W20260620 07:01:04.263917 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d15ea9529afe40b6b4a702035479aef3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d15ea9529afe40b6b4a702035479aef3 already in progress: creating tablet
W20260620 07:01:04.264124 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 864c95b908674e4f8425d765444c281b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 864c95b908674e4f8425d765444c281b already in progress: creating tablet
I20260620 07:01:04.265573 733 tablet_service.cc:1514] Processing DeleteTablet for tablet f793a91ab247408bbe4a9f7cb370fffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.269405 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f4c5c914ef464a4eada451dcb0cd53b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.270048 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4c5c914ef464a4eada451dcb0cd53b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.272607 418 master_service.cc:946] ReplaceTablet: received request to replace tablet a2d6f7f2b5b3473aa010b8982a03aa5e from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:04.275090 1169 tablet_replica.cc:330] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:04.275375 1169 raft_consensus.cc:2229] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:04.275555 1169 raft_consensus.cc:2258] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:04.276058 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e30fb1d050c4439bb72a21a0f2b13eb consensus state has no leader
I20260620 07:01:04.276098 1169 ts_tablet_manager.cc:1905] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:04.284301 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_324f5669c94c4bb3a55c0e0848c983a3" } new_table_name: "default.Table_b12b11dc5a904c46882ddf9974d89df7" modify_external_catalogs: true
I20260620 07:01:04.286979 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8b2c26c2c42645adadbac3a91a80a9fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.287674 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b2c26c2c42645adadbac3a91a80a9fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.289448 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_24e8f4526d06403e8926b271a78c025e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.290004 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24e8f4526d06403e8926b271a78c025e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.291761 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 40c9d2d029434f37ba23d65f6662893b (DEFAULT_TABLE table=default.Table_3306fa38cf3a46f984a8fcde184d39a1 [id=be832445f1c84adc91ab41e94cb807b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.291975 1201 raft_consensus.cc:482] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.293552 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 883d1959ed484c58935db467aa2dc50a (DEFAULT_TABLE table=default.Table_1d413e8cd6774f26b9f2a394c5903495 [id=e4ea9f9e77f74312a2ead7c22390b268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.294704 1201 raft_consensus.cc:504] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.295382 1201 leader_election.cc:288] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:04.295543 1169 ts_tablet_manager.cc:1918] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:04.295696 1169 log.cc:1196] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/b6e36ffd69974ef897390a257f63a509
I20260620 07:01:04.296056 1169 ts_tablet_manager.cc:1939] T b6e36ffd69974ef897390a257f63a509 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:04.296401 1700 raft_consensus.cc:482] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.298086 1011 tablet_service.cc:1467] Processing CreateTablet for tablet d42118f181da4fa489a919a9b4c6664b (DEFAULT_TABLE table=default.Table_f30c54c24f5f4cf9a19e699edc793a12 [id=d79fe48235ef4ad4be5ffa8663fe9c12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.298377 1165 rpcz_store.cc:276] 0620 07:00:59.832629 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.297453 (+464824us) service_pool.cc:227] Handling call
0620 07:01:04.248348 (+3950895us) ts_tablet_manager.cc:1145] Deleting tablet eeb082e189304f13909d115f7197c5a1
0620 07:01:04.248360 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.248445 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3912408}
W20260620 07:01:04.299034 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet eeb082e189304f13909d115f7197c5a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eeb082e189304f13909d115f7197c5a1 already in progress: creating tablet
I20260620 07:01:04.298660 1002 tablet_service.cc:1467] Processing CreateTablet for tablet f591ba26b91b47f9a8933878d478655d (DEFAULT_TABLE table=default.Table_542fe82ba52d4ad88f324849a55d8fcf [id=456781e03c7c43159836db6aa6cbf6ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.302472 1165 tablet_replica.cc:330] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:04.302948 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet d17c49eecec741cdbd592c94b7f84c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.303004 1165 raft_consensus.cc:2229] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:04.303094 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9d4ef3ba51e432f889fb927a6af8b49 consensus state has no leader
I20260620 07:01:04.303211 1165 raft_consensus.cc:2258] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:04.303499 997 tablet_service.cc:1514] Processing DeleteTablet for tablet e2b0faf91f2f469f9b06e17caa4709e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.304302 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet b6e36ffd69974ef897390a257f63a509 (table default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]) successfully deleted
I20260620 07:01:04.306548 1165 ts_tablet_manager.cc:1905] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:04.307092 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c9d2d029434f37ba23d65f6662893b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.307475 725 tablet_service.cc:1467] Processing CreateTablet for tablet a13a60f7f3e74f7dbf5204c974e0e346 (DEFAULT_TABLE table=default.Table_94105963fc7f435e8b8a16141f29f408 [id=50ba4ad9e0204929a0aa031759296a01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.307916 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a13a60f7f3e74f7dbf5204c974e0e346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.307940 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574371fb6915427687df660e733407df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.308538 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 883d1959ed484c58935db467aa2dc50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.311560 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3eda988492234d6aaeaee87f84f99d06
I20260620 07:01:04.312091 426 catalog_manager.cc:6565] ReplaceTablet: tablet 3eda988492234d6aaeaee87f84f99d06 deleted and replaced by tablet a590f553b9e041c4830234897dbbf09f
I20260620 07:01:04.312951 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eda988492234d6aaeaee87f84f99d06 with delete_type TABLET_DATA_DELETED (replaced by tablet a590f553b9e041c4830234897dbbf09f) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.313004 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eda988492234d6aaeaee87f84f99d06 with delete_type TABLET_DATA_DELETED (replaced by tablet a590f553b9e041c4830234897dbbf09f) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.306921 1008 tablet_service.cc:1467] Processing CreateTablet for tablet b40e1ea4d1c74be2906381064c73f8c5 (DEFAULT_TABLE table=default.Table_aef745e818a14008a6e35cd29c256c42 [id=6c87a6a4fecd4a39b8e1c9a9d24b114a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.319403 1639 consensus_queue.cc:1035] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 07:01:04.319491 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6102e0da4e42cd9f1d6e294bb372b2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:04.309437 1700 raft_consensus.cc:504] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.317112 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 369c205d7f7841598cb99f661b25736f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:04.324860 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f8b961698fe54e7f9c16f41b90058093 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8b961698fe54e7f9c16f41b90058093 already in progress: creating tablet
I20260620 07:01:04.325278 1169 tablet_replica.cc:330] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:04.325564 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet ed69a44c466047d298cf7653b2a2bb23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.326943 421 master_service.cc:946] ReplaceTablet: received request to replace tablet 125e8a5e20bf484cade408f0358489a1 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:04.326905 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet f793a91ab247408bbe4a9f7cb370fffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.329033 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f591ba26b91b47f9a8933878d478655d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.330752 1700 leader_election.cc:288] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:04.331724 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eda988492234d6aaeaee87f84f99d06 with delete_type TABLET_DATA_DELETED (replaced by tablet a590f553b9e041c4830234897dbbf09f) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.333618 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:04.333994 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b40e1ea4d1c74be2906381064c73f8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.337350 868 tablet_service.cc:1467] Processing CreateTablet for tablet 8b77b7ecb5cc47a88dac7181322a7a2b (DEFAULT_TABLE table=default.Table_064c212329924eecb592fc2ba757c492 [id=0922eff0872d47e78dee52533162e091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.337862 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b77b7ecb5cc47a88dac7181322a7a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.339946 730 tablet_service.cc:1467] Processing CreateTablet for tablet f5072c573ce54477881cafb63e18b030 (DEFAULT_TABLE table=default.Table_86b1f7775f464864a09df3e2246d8aa0 [id=76a4adf242d64590ab5e88f964c5f53b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.340565 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5072c573ce54477881cafb63e18b030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.344264 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:04.344745 717 tablet_service.cc:1467] Processing CreateTablet for tablet 3dba2e33592f43a7867756a8b93b3a75 (DEFAULT_TABLE table=default.Table_fd76eaeee815495cb78cdb3c70f5a57b [id=884365bae3b04a509968aa55e38b6335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.345221 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dba2e33592f43a7867756a8b93b3a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.346393 418 master_service.cc:946] ReplaceTablet: received request to replace tablet d0c41bf6a8a448ad809292d66ebf9c0e from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:04.346843 969 leader_election.cc:341] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.347790 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 125e8a5e20bf484cade408f0358489a1
I20260620 07:01:04.348562 421 catalog_manager.cc:6565] ReplaceTablet: tablet 125e8a5e20bf484cade408f0358489a1 deleted and replaced by tablet 48726d9a3aa745fca3bcd9b6e8807c49
I20260620 07:01:04.352059 1666 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 07:01:04.352823 733 tablet_service.cc:1467] Processing CreateTablet for tablet a1e10136a707406a8448d820713d9109 (DEFAULT_TABLE table=default.Table_b566163fb83b419c87d03b76fdaf2240 [id=c5be8229bd084dffa9fff70bb97c4a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.353562 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1e10136a707406a8448d820713d9109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.354334 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d42118f181da4fa489a919a9b4c6664b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.364002 720 tablet_service.cc:1467] Processing CreateTablet for tablet a5dc143142c04ae38b1076d09e3fdab6 (DEFAULT_TABLE table=default.Table_ebb8f77ba56a41a4932ba0a1147da851 [id=10a212f86db7423bbb347ab8540248a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.364461 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5dc143142c04ae38b1076d09e3fdab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.364544 1003 tablet_service.cc:1467] Processing CreateTablet for tablet a13a60f7f3e74f7dbf5204c974e0e346 (DEFAULT_TABLE table=default.Table_94105963fc7f435e8b8a16141f29f408 [id=50ba4ad9e0204929a0aa031759296a01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.364809 727 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8ddfba5500406eba8f184bd5039170 (DEFAULT_TABLE table=default.Table_55c10675b20148549679607191b74a20 [id=50f21efe55ce40a4999a4ad52b2ef926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.364969 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a13a60f7f3e74f7dbf5204c974e0e346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.365139 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8ddfba5500406eba8f184bd5039170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.367736 716 tablet_service.cc:1467] Processing CreateTablet for tablet f1083593cd8d4852a8e3a4a7c9180778 (DEFAULT_TABLE table=default.Table_25928fd276674c5e968f012013d868b6 [id=ca7b1e8dd7a4410fa9934663eb2b29a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.368319 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1083593cd8d4852a8e3a4a7c9180778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.367978 721 tablet_service.cc:1467] Processing CreateTablet for tablet a0bdb4b4ed324bee8f7c09341fdc73bb (DEFAULT_TABLE table=default.Table_ce08a8656d2a43969f4efb5cd09cc70d [id=ad5b44817ea145439044862c5a9d9156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.369164 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0bdb4b4ed324bee8f7c09341fdc73bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.370656 732 tablet_service.cc:1467] Processing CreateTablet for tablet 9b42347720fd49d8a2d0a3425cc6f185 (DEFAULT_TABLE table=default.Table_dee364706a7749e88746a0779bb44a36 [id=ee2c7d71ca5f41f5ae1e65fd2760cf37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.371117 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b42347720fd49d8a2d0a3425cc6f185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.371294 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 81704d3a3cf648d987d4b40a270f7508 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.372481 715 tablet_service.cc:1467] Processing CreateTablet for tablet 20fc99f79e7b4df2b74a79468656b6ab (DEFAULT_TABLE table=default.Table_22154b88a133429f981e2e3a4d1fd4aa [id=76b0e45d4d264794a80b3293898b6064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.372844 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20fc99f79e7b4df2b74a79468656b6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.374630 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 125e8a5e20bf484cade408f0358489a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 48726d9a3aa745fca3bcd9b6e8807c49) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.387519 1556 raft_consensus.cc:482] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.387709 1556 raft_consensus.cc:504] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.388972 1556 leader_election.cc:288] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.391618 1012 tablet_service.cc:1467] Processing CreateTablet for tablet f5072c573ce54477881cafb63e18b030 (DEFAULT_TABLE table=default.Table_86b1f7775f464864a09df3e2246d8aa0 [id=76a4adf242d64590ab5e88f964c5f53b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.393427 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 125e8a5e20bf484cade408f0358489a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 48726d9a3aa745fca3bcd9b6e8807c49) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.397557 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 3dba2e33592f43a7867756a8b93b3a75 (DEFAULT_TABLE table=default.Table_fd76eaeee815495cb78cdb3c70f5a57b [id=884365bae3b04a509968aa55e38b6335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.399549 1009 tablet_service.cc:1467] Processing CreateTablet for tablet a1e10136a707406a8448d820713d9109 (DEFAULT_TABLE table=default.Table_b566163fb83b419c87d03b76fdaf2240 [id=c5be8229bd084dffa9fff70bb97c4a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.401700 1713 tablet.cc:1722] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:04.402315 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e14db4e3394046e49ecc69c9ca4dc840" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:04.401505 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9df1d52393e47ce991b5295d03624e8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:04.410386 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5072c573ce54477881cafb63e18b030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.413535 1170 tablet_bootstrap.cc:492] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:04.413486 866 tablet_service.cc:1467] Processing CreateTablet for tablet f5072c573ce54477881cafb63e18b030 (DEFAULT_TABLE table=default.Table_86b1f7775f464864a09df3e2246d8aa0 [id=76a4adf242d64590ab5e88f964c5f53b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.413774 1170 ts_tablet_manager.cc:1397] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.315s user 0.022s sys 0.006s
I20260620 07:01:04.414043 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5072c573ce54477881cafb63e18b030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.414529 1170 raft_consensus.cc:348] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.414745 1170 raft_consensus.cc:374] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.414846 1170 raft_consensus.cc:729] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.415052 1170 consensus_queue.cc:260] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.415477 1170 ts_tablet_manager.cc:1428] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:04.415974 1170 tablet_bootstrap.cc:492] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:04.416360 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7d1e4719cd441dd8054b24861cbd8a2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:04.417752 1170 tablet_bootstrap.cc:654] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.425241 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7a520f90f9534374822183a6768a4d99" } modify_external_catalogs: true
I20260620 07:01:04.425490 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7a520f90f9534374822183a6768a4d99" } modify_external_catalogs: true
I20260620 07:01:04.426844 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9dd2793fba0e423ab605fac4be9fc8c9" } modify_external_catalogs: true
I20260620 07:01:04.427045 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9dd2793fba0e423ab605fac4be9fc8c9" } modify_external_catalogs: true
I20260620 07:01:04.427585 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e87c138cdb1e4f0db439b552e8404b8d" } modify_external_catalogs: true
I20260620 07:01:04.427779 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e87c138cdb1e4f0db439b552e8404b8d" } modify_external_catalogs: true
I20260620 07:01:04.428275 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_072aff5d28cf4c61bbecd2cadb3e58c3" } modify_external_catalogs: true
I20260620 07:01:04.428458 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_072aff5d28cf4c61bbecd2cadb3e58c3" } modify_external_catalogs: true
I20260620 07:01:04.429005 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_70afee11662b4e4bb57022351f45ee15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.429567 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70afee11662b4e4bb57022351f45ee15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.428511 998 tablet_service.cc:1467] Processing CreateTablet for tablet 8b77b7ecb5cc47a88dac7181322a7a2b (DEFAULT_TABLE table=default.Table_064c212329924eecb592fc2ba757c492 [id=0922eff0872d47e78dee52533162e091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.429956 725 tablet_service.cc:1467] Processing CreateTablet for tablet 8b77b7ecb5cc47a88dac7181322a7a2b (DEFAULT_TABLE table=default.Table_064c212329924eecb592fc2ba757c492 [id=0922eff0872d47e78dee52533162e091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.430533 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b77b7ecb5cc47a88dac7181322a7a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.430768 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_67488f79519b41489e04be38f88c163c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.431247 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67488f79519b41489e04be38f88c163c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.432492 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e66c7686856045a8b61d0a9a9ce510a6" } new_table_name: "default.Table_8695fa2e62c845d880e1a60f491b9e4d" modify_external_catalogs: true
I20260620 07:01:04.433689 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d04bb18f7b0c43d8aeeb6fbeba126279"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.434196 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d04bb18f7b0c43d8aeeb6fbeba126279 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:04.435074 681 leader_election.cc:341] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:04.435477 681 leader_election.cc:341] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.435607 681 leader_election.cc:302] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:04.435985 1556 raft_consensus.cc:2726] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:04.436321 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b2adb95fecb348c4a8a50e1630795dbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.436849 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2adb95fecb348c4a8a50e1630795dbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.437436 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 9b42347720fd49d8a2d0a3425cc6f185 (DEFAULT_TABLE table=default.Table_dee364706a7749e88746a0779bb44a36 [id=ee2c7d71ca5f41f5ae1e65fd2760cf37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.438359 996 tablet_service.cc:1467] Processing CreateTablet for tablet a0bdb4b4ed324bee8f7c09341fdc73bb (DEFAULT_TABLE table=default.Table_ce08a8656d2a43969f4efb5cd09cc70d [id=ad5b44817ea145439044862c5a9d9156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.438900 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 125e8a5e20bf484cade408f0358489a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 48726d9a3aa745fca3bcd9b6e8807c49) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.440533 864 tablet_service.cc:1467] Processing CreateTablet for tablet 3dba2e33592f43a7867756a8b93b3a75 (DEFAULT_TABLE table=default.Table_fd76eaeee815495cb78cdb3c70f5a57b [id=884365bae3b04a509968aa55e38b6335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.440934 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dba2e33592f43a7867756a8b93b3a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.444530 1169 raft_consensus.cc:2229] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:04.444738 1169 raft_consensus.cc:2258] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:04.445297 1169 ts_tablet_manager.cc:1905] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:04.450578 869 tablet_service.cc:1467] Processing CreateTablet for tablet a0bdb4b4ed324bee8f7c09341fdc73bb (DEFAULT_TABLE table=default.Table_ce08a8656d2a43969f4efb5cd09cc70d [id=ad5b44817ea145439044862c5a9d9156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.453493 857 tablet_service.cc:1467] Processing CreateTablet for tablet 20fc99f79e7b4df2b74a79468656b6ab (DEFAULT_TABLE table=default.Table_22154b88a133429f981e2e3a4d1fd4aa [id=76b0e45d4d264794a80b3293898b6064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.453660 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d0c41bf6a8a448ad809292d66ebf9c0e
I20260620 07:01:04.454152 418 catalog_manager.cc:6565] ReplaceTablet: tablet d0c41bf6a8a448ad809292d66ebf9c0e deleted and replaced by tablet 74eaa712962245b4bb14d17e4cdd8485
I20260620 07:01:04.454162 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e14db4e3394046e49ecc69c9ca4dc840" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:04.454490 871 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8ddfba5500406eba8f184bd5039170 (DEFAULT_TABLE table=default.Table_55c10675b20148549679607191b74a20 [id=50f21efe55ce40a4999a4ad52b2ef926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.454658 858 tablet_service.cc:1467] Processing CreateTablet for tablet f1083593cd8d4852a8e3a4a7c9180778 (DEFAULT_TABLE table=default.Table_25928fd276674c5e968f012013d868b6 [id=ca7b1e8dd7a4410fa9934663eb2b29a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.454896 733 tablet_service.cc:1514] Processing DeleteTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e with delete_type TABLET_DATA_DELETED (replaced by tablet 74eaa712962245b4bb14d17e4cdd8485) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.455032 862 tablet_service.cc:1467] Processing CreateTablet for tablet a5dc143142c04ae38b1076d09e3fdab6 (DEFAULT_TABLE table=default.Table_ebb8f77ba56a41a4932ba0a1147da851 [id=10a212f86db7423bbb347ab8540248a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.455145 1170 tablet_bootstrap.cc:492] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:01:04.455493 683 leader_election.cc:341] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.455696 683 leader_election.cc:302] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:04.456010 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0aab74c12cea49c395297cdc26ebf34d" } new_table_name: "default.Table_8e3e8ef7f6ba41e886e5a8b8f81bb59b" modify_external_catalogs: true
I20260620 07:01:04.456492 1556 raft_consensus.cc:2726] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:04.455472 1170 ts_tablet_manager.cc:1397] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20260620 07:01:04.458218 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d53c90eff33044479838ff67dea93057
I20260620 07:01:04.458297 1170 raft_consensus.cc:348] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.458696 1170 raft_consensus.cc:374] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.458884 1170 raft_consensus.cc:729] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.458990 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b614a5e33a1044439547e886f07c85bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:04.459206 873 tablet_service.cc:1514] Processing DeleteTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e with delete_type TABLET_DATA_DELETED (replaced by tablet 74eaa712962245b4bb14d17e4cdd8485) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.459262 1169 ts_tablet_manager.cc:1918] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:04.459383 1169 log.cc:1196] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/bea895c735c847f59794ab8c3282447d
W20260620 07:01:04.459601 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b614a5e33a1044439547e886f07c85bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.460018 1170 consensus_queue.cc:260] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.462107 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0bdb4b4ed324bee8f7c09341fdc73bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.464741 870 tablet_service.cc:1467] Processing CreateTablet for tablet 9b42347720fd49d8a2d0a3425cc6f185 (DEFAULT_TABLE table=default.Table_dee364706a7749e88746a0779bb44a36 [id=ee2c7d71ca5f41f5ae1e65fd2760cf37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.465914 873 tablet_service.cc:1514] Processing DeleteTablet for tablet d53c90eff33044479838ff67dea93057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.466238 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8ddfba5500406eba8f184bd5039170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.468151 859 tablet_service.cc:1514] Processing DeleteTablet for tablet f793a91ab247408bbe4a9f7cb370fffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.469909 1170 ts_tablet_manager.cc:1428] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.013s user 0.001s sys 0.002s
I20260620 07:01:04.470515 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b42347720fd49d8a2d0a3425cc6f185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.472760 1006 tablet_service.cc:1467] Processing CreateTablet for tablet a5dc143142c04ae38b1076d09e3fdab6 (DEFAULT_TABLE table=default.Table_ebb8f77ba56a41a4932ba0a1147da851 [id=10a212f86db7423bbb347ab8540248a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.475572 1170 tablet_bootstrap.cc:492] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:04.478613 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5dc143142c04ae38b1076d09e3fdab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.479418 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_489099e333304b76a22a77be828f6e46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:04.479550 1169 ts_tablet_manager.cc:1939] T bea895c735c847f59794ab8c3282447d P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:01:04.480044 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_489099e333304b76a22a77be828f6e46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.481828 1170 tablet_bootstrap.cc:654] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.482127 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_43fba6bd19564f6d998a9d73c9b5448a" } new_table_name: "default.Table_34eaeb05ad0243cb9f083eb279a8ba73" modify_external_catalogs: true
I20260620 07:01:04.483641 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 405) took 1055 ms. Trace:
I20260620 07:01:04.483661 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1bd4d2f168f442b9bddf8bdd67509bd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:04.484155 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1083593cd8d4852a8e3a4a7c9180778. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:04.484194 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bd4d2f168f442b9bddf8bdd67509bd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.484900 1169 rpcz_store.cc:276] 0620 07:01:03.427757 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.429830 (+ 2073us) service_pool.cc:227] Handling call
0620 07:01:04.325155 (+895325us) ts_tablet_manager.cc:1145] Deleting tablet bea895c735c847f59794ab8c3282447d
0620 07:01:04.325168 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.455583 (+130415us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.459135 (+ 3552us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.483448 (+ 24313us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":870697}
I20260620 07:01:04.485960 717 tablet_service.cc:1514] Processing DeleteTablet for tablet d53c90eff33044479838ff67dea93057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.486119 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_690ab28d5a40472ebf9dfa50126f6c42" } modify_external_catalogs: true
I20260620 07:01:04.486146 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 407) took 1023 ms. Trace:
I20260620 07:01:04.486337 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_690ab28d5a40472ebf9dfa50126f6c42" } modify_external_catalogs: true
I20260620 07:01:04.484833 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 203ba3933d3a4fb2a4978b29cad614e6 with delete_type TABLET_DATA_DELETED (replaced by tablet f690e150839a4d23860932712f61e7c8) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.486363 1169 rpcz_store.cc:276] 0620 07:01:03.462725 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.462882 (+ 157us) service_pool.cc:227] Handling call
0620 07:01:04.485471 (+1022589us) ts_tablet_manager.cc:1145] Deleting tablet 9da80903ac124d1aae937c2329f9b13e
0620 07:01:04.485482 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.486086 (+ 604us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1004207}
I20260620 07:01:04.487181 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 392) took 1081 ms. Trace:
I20260620 07:01:04.487432 1169 rpcz_store.cc:276] 0620 07:01:03.405274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.409220 (+ 3946us) service_pool.cc:227] Handling call
0620 07:01:04.486943 (+1077723us) ts_tablet_manager.cc:1145] Deleting tablet 485ce059be9b4900adb1dbc3268efb55
0620 07:01:04.486956 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.487112 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":994124}
I20260620 07:01:04.488073 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 408) took 1019 ms. Trace:
I20260620 07:01:04.488265 1169 rpcz_store.cc:276] 0620 07:01:03.468350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.472680 (+ 4330us) service_pool.cc:227] Handling call
0620 07:01:04.487829 (+1015149us) ts_tablet_manager.cc:1145] Deleting tablet 25b878def9344cbdae65b209cac4067f
0620 07:01:04.487838 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.488013 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":985759}
I20260620 07:01:04.488744 1169 tablet_replica.cc:330] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:04.488999 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20fc99f79e7b4df2b74a79468656b6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.489133 1169 raft_consensus.cc:2229] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:04.489452 1169 raft_consensus.cc:2258] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:04.490388 1169 ts_tablet_manager.cc:1905] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:04.491081 1168 tablet_bootstrap.cc:492] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:04.491246 1168 ts_tablet_manager.cc:1397] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.346s user 0.003s sys 0.007s
I20260620 07:01:04.493058 1168 raft_consensus.cc:348] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.493290 1168 raft_consensus.cc:374] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.493908 1168 raft_consensus.cc:729] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.494155 1168 consensus_queue.cc:260] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.497656 1168 ts_tablet_manager.cc:1428] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:04.498466 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet bea895c735c847f59794ab8c3282447d (table default.Table_53d54ae0843e43bbaa814c4fdd23d530 [id=42744b614d6e4bd7900ea2fc51d30fa4]) successfully deleted
W20260620 07:01:04.499464 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 9da80903ac124d1aae937c2329f9b13e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9da80903ac124d1aae937c2329f9b13e already in progress: creating tablet
W20260620 07:01:04.500532 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 485ce059be9b4900adb1dbc3268efb55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 485ce059be9b4900adb1dbc3268efb55 already in progress: creating tablet
W20260620 07:01:04.502396 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 25b878def9344cbdae65b209cac4067f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25b878def9344cbdae65b209cac4067f already in progress: creating tablet
I20260620 07:01:04.509387 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f4c5c914ef464a4eada451dcb0cd53b1" } new_table_name: "default.Table_f8e5e036e6ba464fb31b06fd5c1ed9e7" modify_external_catalogs: true
I20260620 07:01:04.510908 1170 tablet_bootstrap.cc:492] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:01:04.510943 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d69ca4ae7434ca5b647e9135b5108ee has no consensus state
I20260620 07:01:04.511255 1170 ts_tablet_manager.cc:1397] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.004s
I20260620 07:01:04.511364 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fd8858b58d1247d18cfbf9919c0e4599"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.511967 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd8858b58d1247d18cfbf9919c0e4599 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.513091 1170 raft_consensus.cc:348] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.513590 1170 raft_consensus.cc:374] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.513821 1170 raft_consensus.cc:729] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.514293 1170 consensus_queue.cc:260] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.515544 1170 ts_tablet_manager.cc:1428] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 07:01:04.516103 859 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6102e0da4e42cd9f1d6e294bb372b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.518606 1170 tablet_bootstrap.cc:492] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:04.522730 1168 tablet_bootstrap.cc:492] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:04.525938 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b4ee5c79e2a6419ea3847cbebdeced79 consensus state has no leader
I20260620 07:01:04.526400 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_75ab289e7312420ab8ab0523df0aa16e" } new_table_name: "default.Table_9f21f8c0c60642fd97b87ce5e1befcaf" modify_external_catalogs: true
I20260620 07:01:04.527120 1556 raft_consensus.cc:482] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.527292 1556 raft_consensus.cc:504] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.527915 1556 leader_election.cc:288] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.528612 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_71e114b78b5540daa771e5ade0eacfa7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.529186 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71e114b78b5540daa771e5ade0eacfa7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.529932 1170 tablet_bootstrap.cc:654] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.530900 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2d068c58b71c4076a78a31fcade380a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.531491 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d068c58b71c4076a78a31fcade380a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.531800 1169 ts_tablet_manager.cc:1918] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:04.532586 1169 log.cc:1196] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f9df1d52393e47ce991b5295d03624e8
W20260620 07:01:04.533119 831 consensus_peers.cc:487] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 978f99d2a7d6448aba8dcd2611b75af3. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:04.534878 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad (table default.Table_b043963ee56e4494be5b5a95ea01d158 [id=1aa84262b2da494d8f47bd49a6348733]). Expected version 2 got 0
I20260620 07:01:04.535892 861 tablet_service.cc:1467] Processing CreateTablet for tablet a13a60f7f3e74f7dbf5204c974e0e346 (DEFAULT_TABLE table=default.Table_94105963fc7f435e8b8a16141f29f408 [id=50ba4ad9e0204929a0aa031759296a01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.535838 1169 ts_tablet_manager.cc:1939] T f9df1d52393e47ce991b5295d03624e8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:04.541409 725 tablet_service.cc:1467] Processing CreateTablet for tablet 5d69ca4ae7434ca5b647e9135b5108ee (DEFAULT_TABLE table=default.Table_8e3e8ef7f6ba41e886e5a8b8f81bb59b [id=656c9b399cec4770a2bc15d00d1ec9b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.541920 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d69ca4ae7434ca5b647e9135b5108ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.542053 733 tablet_service.cc:1467] Processing CreateTablet for tablet 26719543504847389de3c3102efcc9b2 (DEFAULT_TABLE table=default.Table_b6601757419d4f4fbaa5591d3100a8f7 [id=6c8239bdca734778a79f8d1c3b328ff3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.542464 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26719543504847389de3c3102efcc9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.544174 1005 tablet_service.cc:1467] Processing CreateTablet for tablet f1083593cd8d4852a8e3a4a7c9180778 (DEFAULT_TABLE table=default.Table_25928fd276674c5e968f012013d868b6 [id=ca7b1e8dd7a4410fa9934663eb2b29a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.550823 717 tablet_service.cc:1467] Processing CreateTablet for tablet a4389d34724e4e299bbe8391cbbe9296 (DEFAULT_TABLE table=default.Table_a6a8125ccc7b4f2abf382c176f2f74db [id=0a8a07ae68bb46e295ef7e86f6811dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.541217 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 406) took 1079 ms. Trace:
I20260620 07:01:04.551290 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4389d34724e4e299bbe8391cbbe9296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.552911 1169 rpcz_store.cc:276] 0620 07:01:03.461718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.461901 (+ 183us) service_pool.cc:227] Handling call
0620 07:01:04.488628 (+1026727us) ts_tablet_manager.cc:1145] Deleting tablet f9df1d52393e47ce991b5295d03624e8
0620 07:01:04.488665 (+ 37us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.509459 (+ 20794us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.531247 (+ 21788us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.540835 (+ 9588us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":985543}
I20260620 07:01:04.551951 716 tablet_service.cc:1467] Processing CreateTablet for tablet 9c12345051f24d669554fbc8c1ef5f5b (DEFAULT_TABLE table=default.Table_8b2c26c2c42645adadbac3a91a80a9fd [id=91d658a14cfa4745a44aa04b9635faf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.552532 730 tablet_service.cc:1467] Processing CreateTablet for tablet b54ee547016d41d9abeb94ea26d0960f (DEFAULT_TABLE table=default.Table_dadaa11698914f6bb6243fb3b922f23b [id=fd6f24da5f4e41eeb651510137682aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.560928 732 tablet_service.cc:1467] Processing CreateTablet for tablet 3d81d05b4b1646b4b1fa6577c149a7ad (DEFAULT_TABLE table=default.Table_63c1143c0e0d411591cb240b7750c572 [id=43c8cbb5323d47bdb3f136d660b157d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.561412 727 tablet_service.cc:1467] Processing CreateTablet for tablet 18d08c30bf7e4c04b01368b9b4a6273c (DEFAULT_TABLE table=default.Table_f4c5c914ef464a4eada451dcb0cd53b1 [id=f6c59d8ad5054eb58ecda6750e987921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.562080 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b54ee547016d41d9abeb94ea26d0960f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.565876 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18d08c30bf7e4c04b01368b9b4a6273c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.566488 1699 raft_consensus.cc:482] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.571708 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad (table default.Table_b043963ee56e4494be5b5a95ea01d158 [id=1aa84262b2da494d8f47bd49a6348733]). Expected version 2 got 0
I20260620 07:01:04.572431 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1e10136a707406a8448d820713d9109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.574565 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 20fc99f79e7b4df2b74a79468656b6ab (DEFAULT_TABLE table=default.Table_22154b88a133429f981e2e3a4d1fd4aa [id=76b0e45d4d264794a80b3293898b6064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.575687 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f9df1d52393e47ce991b5295d03624e8 (table default.Table_ca5b5e6066a343a59aeaf1e58f8a8a67 [id=a7902aafbaad4905a6b5b03ad669eeae]) successfully deleted
W20260620 07:01:04.576610 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a2d6f7f2b5b3473aa010b8982a03aa5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2d6f7f2b5b3473aa010b8982a03aa5e already in progress: creating tablet
W20260620 07:01:04.577041 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18d08c30bf7e4c04b01368b9b4a6273c consensus state has no leader
W20260620 07:01:04.577593 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7b781d0578834708ae64b24419959cca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b781d0578834708ae64b24419959cca already in progress: creating tablet
I20260620 07:01:04.566690 1699 raft_consensus.cc:504] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:04.578559 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c06bf6c4d1af40479c81bd1d85e2848f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c06bf6c4d1af40479c81bd1d85e2848f already in progress: creating tablet
W20260620 07:01:04.579391 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d0f7e6245c074c82a5a72be79ab1987f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0f7e6245c074c82a5a72be79ab1987f already in progress: creating tablet
I20260620 07:01:04.579838 997 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8ddfba5500406eba8f184bd5039170 (DEFAULT_TABLE table=default.Table_55c10675b20148549679607191b74a20 [id=50f21efe55ce40a4999a4ad52b2ef926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.580559 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b77b7ecb5cc47a88dac7181322a7a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.580835 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c12345051f24d669554fbc8c1ef5f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.550830 725 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3868f92cd244e4b0321a0761f51c3f (DEFAULT_TABLE table=default.Table_0bd72c17169f4beeab67a8556e097bd4 [id=f7d54a88f3d04fceb7a42452e5769498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.582535 1699 leader_election.cc:288] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:04.582862 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8ddfba5500406eba8f184bd5039170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.584748 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20fc99f79e7b4df2b74a79468656b6ab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:04.585423 969 leader_election.cc:341] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.585695 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d81d05b4b1646b4b1fa6577c149a7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.587723 860 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3868f92cd244e4b0321a0761f51c3f (DEFAULT_TABLE table=default.Table_0bd72c17169f4beeab67a8556e097bd4 [id=f7d54a88f3d04fceb7a42452e5769498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.588150 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b42347720fd49d8a2d0a3425cc6f185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.588358 875 tablet_service.cc:1467] Processing CreateTablet for tablet 18d08c30bf7e4c04b01368b9b4a6273c (DEFAULT_TABLE table=default.Table_f4c5c914ef464a4eada451dcb0cd53b1 [id=f6c59d8ad5054eb58ecda6750e987921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.589257 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 5d69ca4ae7434ca5b647e9135b5108ee (DEFAULT_TABLE table=default.Table_8e3e8ef7f6ba41e886e5a8b8f81bb59b [id=656c9b399cec4770a2bc15d00d1ec9b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.589735 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d69ca4ae7434ca5b647e9135b5108ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.590770 874 tablet_service.cc:1467] Processing CreateTablet for tablet b54ee547016d41d9abeb94ea26d0960f (DEFAULT_TABLE table=default.Table_dadaa11698914f6bb6243fb3b922f23b [id=fd6f24da5f4e41eeb651510137682aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.590973 994 tablet_service.cc:1514] Processing DeleteTablet for tablet d53c90eff33044479838ff67dea93057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.591317 867 tablet_service.cc:1467] Processing CreateTablet for tablet 3d81d05b4b1646b4b1fa6577c149a7ad (DEFAULT_TABLE table=default.Table_63c1143c0e0d411591cb240b7750c572 [id=43c8cbb5323d47bdb3f136d660b157d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.591965 873 tablet_service.cc:1467] Processing CreateTablet for tablet 26719543504847389de3c3102efcc9b2 (DEFAULT_TABLE table=default.Table_b6601757419d4f4fbaa5591d3100a8f7 [id=6c8239bdca734778a79f8d1c3b328ff3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.597754 1169 tablet_replica.cc:330] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:04.604066 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add9e860802d4edebcfbc9fa3c4a6b24" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:04.605147 683 leader_election.cc:341] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.605345 733 tablet_service.cc:1467] Processing CreateTablet for tablet 48726d9a3aa745fca3bcd9b6e8807c49 (DEFAULT_TABLE table=default.Table_072aff5d28cf4c61bbecd2cadb3e58c3 [id=bb41cdc85465446193c33f0722351f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.605790 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48726d9a3aa745fca3bcd9b6e8807c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.612429 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d3868f92cd244e4b0321a0761f51c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.619138 1165 ts_tablet_manager.cc:1918] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:04.619122 995 tablet_service.cc:1514] Processing DeleteTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e with delete_type TABLET_DATA_DELETED (replaced by tablet 74eaa712962245b4bb14d17e4cdd8485) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.623538 872 tablet_service.cc:1467] Processing CreateTablet for tablet 9c12345051f24d669554fbc8c1ef5f5b (DEFAULT_TABLE table=default.Table_8b2c26c2c42645adadbac3a91a80a9fd [id=91d658a14cfa4745a44aa04b9635faf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.623644 994 tablet_service.cc:1467] Processing CreateTablet for tablet 26719543504847389de3c3102efcc9b2 (DEFAULT_TABLE table=default.Table_b6601757419d4f4fbaa5591d3100a8f7 [id=6c8239bdca734778a79f8d1c3b328ff3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.625053 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 9c12345051f24d669554fbc8c1ef5f5b (DEFAULT_TABLE table=default.Table_8b2c26c2c42645adadbac3a91a80a9fd [id=91d658a14cfa4745a44aa04b9635faf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.625398 995 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3868f92cd244e4b0321a0761f51c3f (DEFAULT_TABLE table=default.Table_0bd72c17169f4beeab67a8556e097bd4 [id=f7d54a88f3d04fceb7a42452e5769498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.626672 999 tablet_service.cc:1467] Processing CreateTablet for tablet 3d81d05b4b1646b4b1fa6577c149a7ad (DEFAULT_TABLE table=default.Table_63c1143c0e0d411591cb240b7750c572 [id=43c8cbb5323d47bdb3f136d660b157d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.626748 865 tablet_service.cc:1467] Processing CreateTablet for tablet a4389d34724e4e299bbe8391cbbe9296 (DEFAULT_TABLE table=default.Table_a6a8125ccc7b4f2abf382c176f2f74db [id=0a8a07ae68bb46e295ef7e86f6811dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.627663 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d3868f92cd244e4b0321a0761f51c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.627628 859 tablet_service.cc:1467] Processing CreateTablet for tablet 5d69ca4ae7434ca5b647e9135b5108ee (DEFAULT_TABLE table=default.Table_8e3e8ef7f6ba41e886e5a8b8f81bb59b [id=656c9b399cec4770a2bc15d00d1ec9b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.628213 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b54ee547016d41d9abeb94ea26d0960f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.629024 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26719543504847389de3c3102efcc9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.629285 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18d08c30bf7e4c04b01368b9b4a6273c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.629325 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1083593cd8d4852a8e3a4a7c9180778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.630168 876 tablet_service.cc:1467] Processing CreateTablet for tablet 48726d9a3aa745fca3bcd9b6e8807c49 (DEFAULT_TABLE table=default.Table_072aff5d28cf4c61bbecd2cadb3e58c3 [id=bb41cdc85465446193c33f0722351f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.634171 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26719543504847389de3c3102efcc9b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:04.639567 968 leader_election.cc:341] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ea6102e0da4e42cd9f1d6e294bb372b2
W20260620 07:01:04.636942 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 816218c726a9473e9849b7a97c820678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 816218c726a9473e9849b7a97c820678 already in progress: creating tablet
I20260620 07:01:04.637638 1169 raft_consensus.cc:2229] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:04.644950 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48726d9a3aa745fca3bcd9b6e8807c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.649022 1169 raft_consensus.cc:2258] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:04.650570 1169 ts_tablet_manager.cc:1905] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:04.651659 1170 tablet_bootstrap.cc:492] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:04.653478 1170 ts_tablet_manager.cc:1397] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.136s user 0.015s sys 0.011s
I20260620 07:01:04.654063 732 tablet_service.cc:1467] Processing CreateTablet for tablet a590f553b9e041c4830234897dbbf09f (DEFAULT_TABLE table=default.Table_06bc01b8cb5d447ea25fd376cc255a6d [id=188e640d71fa4d34ba29242cb1198020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.654480 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a590f553b9e041c4830234897dbbf09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.654913 733 tablet_service.cc:1467] Processing CreateTablet for tablet b8e2d451eb1f48ff81828d7070a20027 (DEFAULT_TABLE table=default.Table_ca4ebce0835d49c8a8d69ee21c9cec32 [id=d0bb6286e2fc4d8c84401028e0b2dc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.655301 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e2d451eb1f48ff81828d7070a20027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.658234 1556 raft_consensus.cc:482] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.658392 1556 raft_consensus.cc:504] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.659075 1556 leader_election.cc:288] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.654461 1170 raft_consensus.cc:348] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.660006 1170 raft_consensus.cc:374] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.660135 1170 raft_consensus.cc:729] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.660210 725 tablet_service.cc:1467] Processing CreateTablet for tablet d3823954542a4928a99c1602c4f01ee2 (DEFAULT_TABLE table=default.Table_24e8f4526d06403e8926b271a78c025e [id=2a90ad16128d4e05bacc8a273a0c2f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.662964 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3823954542a4928a99c1602c4f01ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.662848 1170 consensus_queue.cc:260] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.663487 1170 ts_tablet_manager.cc:1428] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260620 07:01:04.663825 1170 tablet_bootstrap.cc:492] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:04.678890 1556 raft_consensus.cc:482] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.679086 1556 raft_consensus.cc:504] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.679762 1556 leader_election.cc:288] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.680541 1170 tablet_bootstrap.cc:654] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.685879 863 tablet_service.cc:1467] Processing CreateTablet for tablet a1e10136a707406a8448d820713d9109 (DEFAULT_TABLE table=default.Table_b566163fb83b419c87d03b76fdaf2240 [id=c5be8229bd084dffa9fff70bb97c4a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.687214 1722 raft_consensus.cc:482] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fe29008ed9b430ea13d40e54e3ddfcc)
I20260620 07:01:04.687427 1722 raft_consensus.cc:504] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:01:04.689363 507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 387 } } ignore_live_leader: false dest_uuid: "2395d394cd84440ebae89d1ecfa13fb5" is_pre_election: true
I20260620 07:01:04.690145 436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f32c3995c70946c38ce1a3094aaaffb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 387 } } ignore_live_leader: false dest_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" is_pre_election: true
I20260620 07:01:04.692170 1165 log.cc:1196] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/7200877be18c4eaca57df88c25d30c01
I20260620 07:01:04.693131 1639 raft_consensus.cc:482] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.694463 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5c2cb157c156453ab32c75abc2ab6a09" } modify_external_catalogs: true
I20260620 07:01:04.694696 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5c2cb157c156453ab32c75abc2ab6a09" } modify_external_catalogs: true
I20260620 07:01:04.694563 871 tablet_service.cc:1467] Processing CreateTablet for tablet d3823954542a4928a99c1602c4f01ee2 (DEFAULT_TABLE table=default.Table_24e8f4526d06403e8926b271a78c025e [id=2a90ad16128d4e05bacc8a273a0c2f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.695542 427 master_service.cc:946] ReplaceTablet: received request to replace tablet f2426d52b8ff40f39887545e0341a91a from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:04.700199 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203ba3933d3a4fb2a4978b29cad614e6" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:04.700608 1639 raft_consensus.cc:504] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:04.700968 683 leader_election.cc:341] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.701278 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a13a60f7f3e74f7dbf5204c974e0e346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.703914 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d69ca4ae7434ca5b647e9135b5108ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.684109 1000 tablet_service.cc:1467] Processing CreateTablet for tablet a4389d34724e4e299bbe8391cbbe9296 (DEFAULT_TABLE table=default.Table_a6a8125ccc7b4f2abf382c176f2f74db [id=0a8a07ae68bb46e295ef7e86f6811dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.706687 1722 leader_election.cc:288] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fe29008ed9b430ea13d40e54e3ddfcc (127.0.97.62:36007), 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455)
I20260620 07:01:04.707444 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c12345051f24d669554fbc8c1ef5f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.702678 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d17c49eecec741cdbd592c94b7f84c67" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:04.717021 1165 ts_tablet_manager.cc:1939] T 7200877be18c4eaca57df88c25d30c01 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:04.718531 1004 tablet_service.cc:1467] Processing CreateTablet for tablet b54ee547016d41d9abeb94ea26d0960f (DEFAULT_TABLE table=default.Table_dadaa11698914f6bb6243fb3b922f23b [id=fd6f24da5f4e41eeb651510137682aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.727573 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5dc143142c04ae38b1076d09e3fdab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.733527 1170 tablet_bootstrap.cc:492] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:04.734246 1170 ts_tablet_manager.cc:1397] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.001s
I20260620 07:01:04.743731 968 leader_election.cc:302] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:04.747893 1556 raft_consensus.cc:482] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.748062 1556 raft_consensus.cc:504] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.748806 1556 leader_election.cc:288] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.748624 1002 tablet_service.cc:1467] Processing CreateTablet for tablet b8e2d451eb1f48ff81828d7070a20027 (DEFAULT_TABLE table=default.Table_ca4ebce0835d49c8a8d69ee21c9cec32 [id=d0bb6286e2fc4d8c84401028e0b2dc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.751983 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dba2e33592f43a7867756a8b93b3a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.760535 1168 tablet_bootstrap.cc:654] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.761153 1639 leader_election.cc:288] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.757305 864 tablet_service.cc:1467] Processing CreateTablet for tablet b8e2d451eb1f48ff81828d7070a20027 (DEFAULT_TABLE table=default.Table_ca4ebce0835d49c8a8d69ee21c9cec32 [id=d0bb6286e2fc4d8c84401028e0b2dc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.762046 1639 raft_consensus.cc:482] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:04.762084 831 leader_election.cc:341] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 81704d3a3cf648d987d4b40a270f7508
W20260620 07:01:04.763173 831 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 60268.6us
I20260620 07:01:04.763217 1639 raft_consensus.cc:504] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:04.763769 683 leader_election.cc:341] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.763875 1639 leader_election.cc:288] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.764459 868 tablet_service.cc:1467] Processing CreateTablet for tablet a590f553b9e041c4830234897dbbf09f (DEFAULT_TABLE table=default.Table_06bc01b8cb5d447ea25fd376cc255a6d [id=188e640d71fa4d34ba29242cb1198020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.764603 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b0faf91f2f469f9b06e17caa4709e4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:04.764827 753 raft_consensus.cc:2454] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:04.765312 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c2f865b06ca4b9c8fc9d8d0b4aa0dad" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:04.766389 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d81d05b4b1646b4b1fa6577c149a7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.765825 1723 raft_consensus.cc:482] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:04.770754 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a590f553b9e041c4830234897dbbf09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.771116 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4389d34724e4e299bbe8391cbbe9296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.775198 831 leader_election.cc:302] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:04.775547 1639 raft_consensus.cc:2781] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:04.775648 1639 raft_consensus.cc:482] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 07:01:04.775743 683 leader_election.cc:341] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.777411 1723 raft_consensus.cc:504] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.778390 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 258) took 4791 ms. Trace:
I20260620 07:01:04.780314 1639 raft_consensus.cc:3037] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:04.780929 1723 leader_election.cc:288] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.780928 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 18d08c30bf7e4c04b01368b9b4a6273c (DEFAULT_TABLE table=default.Table_f4c5c914ef464a4eada451dcb0cd53b1 [id=f6c59d8ad5054eb58ecda6750e987921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.781596 1699 raft_consensus.cc:482] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:04.781700 831 leader_election.cc:341] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ea6102e0da4e42cd9f1d6e294bb372b2
I20260620 07:01:04.782075 1165 rpcz_store.cc:276] 0620 07:00:59.927136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.582105 (+654969us) service_pool.cc:227] Handling call
0620 07:01:04.302405 (+3720300us) ts_tablet_manager.cc:1145] Deleting tablet 7200877be18c4eaca57df88c25d30c01
0620 07:01:04.302417 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.329651 (+ 27234us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.543443 (+213792us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.718983 (+175540us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3671119}
I20260620 07:01:04.782831 1699 raft_consensus.cc:504] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.783308 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c12345051f24d669554fbc8c1ef5f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.783952 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 262) took 4632 ms. Trace:
I20260620 07:01:04.784252 1165 rpcz_store.cc:276] 0620 07:01:00.151094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.631317 (+480223us) service_pool.cc:227] Handling call
0620 07:01:04.782991 (+4151674us) ts_tablet_manager.cc:1145] Deleting tablet 04db48e910514d46bb4deb9acf54f7c0
0620 07:01:04.783037 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.783805 (+ 768us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4151369}
I20260620 07:01:04.784580 1700 raft_consensus.cc:2726] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:04.784968 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 04db48e910514d46bb4deb9acf54f7c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04db48e910514d46bb4deb9acf54f7c0 already in progress: creating tablet
I20260620 07:01:04.785465 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 263) took 4634 ms. Trace:
I20260620 07:01:04.785753 1165 rpcz_store.cc:276] 0620 07:01:00.151196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.631634 (+480438us) service_pool.cc:227] Handling call
0620 07:01:04.784918 (+4153284us) ts_tablet_manager.cc:1145] Deleting tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2
0620 07:01:04.784931 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.785226 (+ 295us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4152985}
I20260620 07:01:04.786691 1699 leader_election.cc:288] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:04.786700 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 already in progress: creating tablet
I20260620 07:01:04.784256 1170 raft_consensus.cc:348] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.787051 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 264) took 4635 ms. Trace:
I20260620 07:01:04.787259 1165 rpcz_store.cc:276] 0620 07:01:00.151303 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.631992 (+480689us) service_pool.cc:227] Handling call
0620 07:01:04.786732 (+4154740us) ts_tablet_manager.cc:1145] Deleting tablet c38c628514c44c6fa5aff64928e515d9
0620 07:01:04.786743 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.786926 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4154429}
I20260620 07:01:04.787626 1011 tablet_service.cc:1467] Processing CreateTablet for tablet d3823954542a4928a99c1602c4f01ee2 (DEFAULT_TABLE table=default.Table_24e8f4526d06403e8926b271a78c025e [id=2a90ad16128d4e05bacc8a273a0c2f13]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:04.787892 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c38c628514c44c6fa5aff64928e515d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c38c628514c44c6fa5aff64928e515d9 already in progress: creating tablet
I20260620 07:01:04.788133 1170 raft_consensus.cc:374] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:04.789354 1165 tablet_replica.cc:330] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:04.789438 1170 raft_consensus.cc:729] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:04.783895 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 48726d9a3aa745fca3bcd9b6e8807c49 (DEFAULT_TABLE table=default.Table_072aff5d28cf4c61bbecd2cadb3e58c3 [id=bb41cdc85465446193c33f0722351f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.790328 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b54ee547016d41d9abeb94ea26d0960f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.790273 1165 raft_consensus.cc:2229] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:04.791769 1165 raft_consensus.cc:2258] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:04.792343 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81704d3a3cf648d987d4b40a270f7508" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:04.792621 893 raft_consensus.cc:2454] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:04.793251 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0bdb4b4ed324bee8f7c09341fdc73bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.796013 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e54f1185cd4c5c8e5d2ed289b61650" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:04.792184 1170 consensus_queue.cc:260] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.799084 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d81d05b4b1646b4b1fa6577c149a7ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:04.807704 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 347280us
I20260620 07:01:04.808127 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4389d34724e4e299bbe8391cbbe9296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.808337 1639 raft_consensus.cc:504] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.810701 1639 leader_election.cc:288] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:04.811837 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b0faf91f2f469f9b06e17caa4709e4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:04.812088 753 raft_consensus.cc:3037] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:04.815616 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 076926f7dffe4a7b80c25ea3c18e9958 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8cd4ec5619416a8983e1bc1b6b6a09) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.815862 1170 ts_tablet_manager.cc:1428] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.080s user 0.002s sys 0.002s
I20260620 07:01:04.818007 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_abf326e06bac4ac9a638a5a2e4c97619" } new_table_name: "default.Table_1049597486e048af84978e2f18e6e952" modify_external_catalogs: true
I20260620 07:01:04.818218 753 raft_consensus.cc:2454] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:04.818723 831 leader_election.cc:302] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
W20260620 07:01:04.819469 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0435678022914e6991c974e116d1a9f7 consensus state has no leader
I20260620 07:01:04.819938 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4c8103aba31e41f88c025b32b20b15a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.820513 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c8103aba31e41f88c025b32b20b15a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.820537 1723 raft_consensus.cc:2781] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:04.821952 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_550044437fae426dbb1eb8da5c11d8aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.822459 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_550044437fae426dbb1eb8da5c11d8aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.822968 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e2d451eb1f48ff81828d7070a20027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.823139 1170 tablet_bootstrap.cc:492] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:04.823906 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8b276cfc9d2142e7ad6a104d5bd40f82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.824484 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b276cfc9d2142e7ad6a104d5bd40f82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.825559 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2057b7689b1c4c65901ed8ec04279568
I20260620 07:01:04.830466 1329 leader_election.cc:302] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f32c3995c70946c38ce1a3094aaaffb1; no voters: 2395d394cd84440ebae89d1ecfa13fb5, 2fe29008ed9b430ea13d40e54e3ddfcc
I20260620 07:01:04.831322 1167 tablet_bootstrap.cc:654] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:04.832106 1722 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f32c3995c70946c38ce1a3094aaaffb1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 07:01:04.834179 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81704d3a3cf648d987d4b40a270f7508" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:04.835294 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_acc2e2a41f234841944aefbc998c1680"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:04.835916 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acc2e2a41f234841944aefbc998c1680 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.836468 997 tablet_service.cc:1467] Processing CreateTablet for tablet a590f553b9e041c4830234897dbbf09f (DEFAULT_TABLE table=default.Table_06bc01b8cb5d447ea25fd376cc255a6d [id=188e640d71fa4d34ba29242cb1198020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:04.837388 1165 ts_tablet_manager.cc:1905] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:04.840994 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7cf81c5c0d9744f5a8c3f0866a435ae3
I20260620 07:01:04.843047 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6a36a5319a044e9da7dc7b666484e257
I20260620 07:01:04.844751 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 48726d9a3aa745fca3bcd9b6e8807c49
I20260620 07:01:04.850976 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_02d02883b6c246c780aa0e2d912752f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:04.851186 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3823954542a4928a99c1602c4f01ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.851491 1030 raft_consensus.cc:2454] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
W20260620 07:01:04.851645 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02d02883b6c246c780aa0e2d912752f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:04.851783 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b0faf91f2f469f9b06e17caa4709e4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:04.851969 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 48726d9a3aa745fca3bcd9b6e8807c49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:04.852240 968 leader_election.cc:341] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e7d1e4719cd441dd8054b24861cbd8a2
I20260620 07:01:04.852694 968 leader_election.cc:302] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:04.853878 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7b68309da41f4767a4a2ac0898fa91c2" } new_table_name: "default.Table_b19a46e2d20e4f75a3d170cbb543ca71" modify_external_catalogs: true
I20260620 07:01:04.854084 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a36a5319a044e9da7dc7b666484e257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.855455 1723 raft_consensus.cc:686] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:04.856148 1723 consensus_queue.cc:237] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.858295 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1e10136a707406a8448d820713d9109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.859994 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e2d451eb1f48ff81828d7070a20027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.861302 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a590f553b9e041c4830234897dbbf09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.859373 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6102e0da4e42cd9f1d6e294bb372b2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:04.861696 1028 raft_consensus.cc:2454] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:04.861730 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b0faf91f2f469f9b06e17caa4709e4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:04.861701 1699 raft_consensus.cc:2726] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:04.862172 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_122650b95e6f401ca38b940863232ee4" } new_table_name: "default.Table_514f5506c81a4038ad87979a2e476fd0" modify_external_catalogs: true
I20260620 07:01:04.863849 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3823954542a4928a99c1602c4f01ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.865254 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18d08c30bf7e4c04b01368b9b4a6273c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.867040 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.857071 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 2057b7689b1c4c65901ed8ec04279568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:04.865464 969 leader_election.cc:302] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
W20260620 07:01:04.873059 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 43870.1us
I20260620 07:01:04.880893 1700 consensus_queue.cc:1035] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260620 07:01:04.881043 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e54f1185cd4c5c8e5d2ed289b61650" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:04.881297 751 raft_consensus.cc:2454] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:04.880927 1699 raft_consensus.cc:2781] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:04.882059 1699 raft_consensus.cc:482] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:04.882287 1699 raft_consensus.cc:3037] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:04.886266 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 2057b7689b1c4c65901ed8ec04279568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.891921 1170 tablet_bootstrap.cc:654] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:04.898524 969 leader_election.cc:341] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:04.905865 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d3868f92cd244e4b0321a0761f51c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:04.909554 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 2057b7689b1c4c65901ed8ec04279568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.910008 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 48726d9a3aa745fca3bcd9b6e8807c49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.911141 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48726d9a3aa745fca3bcd9b6e8807c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:03.036221 1446 rpcz_store.cc:276] 0620 07:01:00.640941 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.641131 (+ 190us) service_pool.cc:227] Handling call
0620 07:01:01.010649 (+369518us) raft_consensus.cc:1457] Updating replica for 360 ops
0620 07:01:01.216292 (+205643us) raft_consensus.cc:1520] Early marking committed up to index 0
0620 07:01:01.216477 (+ 185us) raft_consensus.cc:1525] Triggering prepare for 360 ops
0620 07:01:01.251715 (+ 35238us) write_op.cc:270] Start()
0620 07:01:01.255952 (+ 4237us) write_op.cc:276] Timestamp: P: 1781938854883191 usec, L: 0
0620 07:01:01.340719 (+ 84767us) write_op.cc:270] Start()
0620 07:01:01.340769 (+ 50us) write_op.cc:276] Timestamp: P: 1781938854884170 usec, L: 0
0620 07:01:01.341485 (+ 716us) write_op.cc:270] Start()
0620 07:01:01.341529 (+ 44us) write_op.cc:276] Timestamp: P: 1781938854884733 usec, L: 0
0620 07:01:01.342019 (+ 490us) write_op.cc:270] Start()
0620 07:01:01.342040 (+ 21us) write_op.cc:276] Timestamp: P: 1781938854885214 usec, L: 0
0620 07:01:01.342464 (+ 424us) write_op.cc:270] Start()
0620 07:01:01.342486 (+ 22us) write_op.cc:276] Timestamp: P: 1781938854885756 usec, L: 0
0620 07:01:01.343075 (+ 589us) write_op.cc:270] Start()
0620 07:01:01.343098 (+ 23us) write_op.cc:276] Timestamp: P: 1781938854886572 usec, L: 0
0620 07:01:01.343731 (+ 633us) write_op.cc:270] Start()
0620 07:01:01.343844 (+ 113us) write_op.cc:276] Timestamp: P: 1781938854887069 usec, L: 0
0620 07:01:01.344728 (+ 884us) write_op.cc:270] Start()
0620 07:01:01.344750 (+ 22us) write_op.cc:276] Timestamp: P: 1781938854887559 usec, L: 0
0620 07:01:01.345194 (+ 444us) write_op.cc:270] Start()
0620 07:01:01.345214 (+ 20us) write_op.cc:276] Timestamp: P: 1781938854888063 usec, L: 0
0620 07:01:01.345784 (+ 570us) write_op.cc:270] Start()
0620 07:01:01.345830 (+ 46us) write_op.cc:276] Timestamp: P: 1781938854888570 usec, L: 0
0620 07:01:01.346438 (+ 608us) write_op.cc:270] Start()
0620 07:01:01.346493 (+ 55us) write_op.cc:276] Timestamp: P: 1781938854902561 usec, L: 0
0620 07:01:01.406353 (+ 59860us) write_op.cc:270] Start()
0620 07:01:01.406417 (+ 64us) write_op.cc:276] Timestamp: P: 1781938854903821 usec, L: 0
0620 07:01:01.407855 (+ 1438us) write_op.cc:270] Start()
0620 07:01:01.407893 (+ 38us) write_op.cc:276] Timestamp: P: 1781938854905312 usec, L: 0
0620 07:01:01.408055 (+ 162us) write_op.cc:270] Start()
0620 07:01:01.408080 (+ 25us) write_op.cc:276] Timestamp: P: 1781938854906806 usec, L: 0
0620 07:01:01.408234 (+ 154us) write_op.cc:270] Start()
0620 07:01:01.408257 (+ 23us) write_op.cc:276] Timestamp: P: 1781938854911939 usec, L: 0
0620 07:01:01.408382 (+ 125us) write_op.cc:270] Start()
0620 07:01:01.408405 (+ 23us) write_op.cc:276] Timestamp: P: 1781938854914376 usec, L: 0
0620 07:01:01.408552 (+ 147us) write_op.cc:270] Start()
0620 07:01:01.408585 (+ 33us) write_op.cc:276] Timestamp: P: 1781938854916455 usec, L: 0
0620 07:01:01.408735 (+ 150us) write_op.cc:270] Start()
0620 07:01:01.408757 (+ 22us) write_op.cc:276] Timestamp: P: 1781938854918238 usec, L: 0
0620 07:01:01.408882 (+ 125us) write_op.cc:270] Start()
0620 07:01:01.408903 (+ 21us) write_op.cc:276] Timestamp: P: 1781938854920901 usec, L: 0
0620 07:01:01.409039 (+ 136us) write_op.cc:270] Start()
0620 07:01:01.409062 (+ 23us) write_op.cc:276] Timestamp: P: 1781938854921511 usec, L: 0
0620 07:01:01.409201 (+ 139us) write_op.cc:270] Start()
0620 07:01:01.409223 (+ 22us) write_op.cc:276] Timestamp: P: 1781938854922000 usec, L: 0
0620 07:01:01.409349 (+ 126us) write_op.cc:270] Start()
0620 07:01:01.409370 (+ 21us) write_op.cc:276] Timestamp: P: 1781938854957156 usec, L: 0
0620 07:01:01.409504 (+ 134us) write_op.cc:270] Start()
0620 07:01:01.409527 (+ 23us) write_op.cc:276] Timestamp: P: 1781938854993704 usec, L: 0
0620 07:01:01.409660 (+ 133us) write_op.cc:270] Start()
0620 07:01:01.409682 (+ 22us) write_op.cc:276] Timestamp: P: 1781938855102386 usec, L: 0
0620 07:01:01.409853 (+ 171us) write_op.cc:270] Start()
0620 07:01:01.409875 (+ 22us) write_op.cc:276] Timestamp: P: 1781938855103671 usec, L: 0
0620 07:01:01.410021 (+ 146us) write_op.cc:270] Start()
0620 07:01:01.410043 (+ 22us) write_op.cc:276] Timestamp: P: 1781938855119358 usec, L: 0
0620 07:01:01.410180 (+ 137us) write_op.cc:270] Start()
0620 07:01:01.410204 (+ 24us) write_op.cc:276] Timestamp: P: 1781938855120274 usec, L: 0
0620 07:01:01.410327 (+ 123us) write_op.cc:270] Start()
0620 07:01:01.410349 (+ 22us) write_op.cc:276] Timestamp: P: 1781938855151261 usec, L: 0
0620 07:01:01.410487 (+ 138us) write_op.cc:270] Start()
0620 07:01:01.410508 (+ 21us) write_op.cc:276] Timestamp: P: 1781938855151944 usec, L: 0
0620 07:01:01.410659 (+ 151us) write_op.cc:270] Start()
0620 07:01:01.410683 (+ 24us) write_op.cc:276] Timestamp: P: 1781938855153321 usec, L: 0
0620 07:01:01.509169 (+ 98486us) write_op.cc:270] Start()
0620 07:01:01.509236 (+ 67us) write_op.cc:276] Timestamp: P: 1781938855154526 usec, L: 0
0620 07:01:01.509504 (+ 268us) write_op.cc:270] Start()
0620 07:01:01.509540 (+ 36us) write_op.cc:276] Timestamp: P: 1781938855155914 usec, L: 0
0620 07:01:01.509680 (+ 140us) write_op.cc:270] Start()
0620 07:01:01.509700 (+ 20us) write_op.cc:276] Timestamp: P: 1781938855159593 usec, L: 0
0620 07:01:01.509831 (+ 131us) write_op.cc:270] Start()
0620 07:01:01.509850 (+ 19us) write_op.cc:276] Timestamp: P: 1781938855162274 usec, L: 0
0620 07:01:01.509980 (+ 130us) write_op.cc:270] Start()
0620 07:01:01.509999 (+ 19us) write_op.cc:276] Timestamp: P: 1781938855163828 usec, L: 0
0620 07:01:01.510104 (+ 105us) write_op.cc:270] Start()
0620 07:01:01.510120 (+ 16us) write_op.cc:276] Timestamp: P: 1781938855165906 usec, L: 0
0620 07:01:01.510220 (+ 100us) write_op.cc:270] Start()
0620 07:01:01.510249 (+ 29us) write_op.cc:276] Timestamp: P: 1781938855181458 usec, L: 0
0620 07:01:01.510353 (+ 104us) write_op.cc:270] Start()
0620 07:01:01.510368 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855185072 usec, L: 0
0620 07:01:01.510472 (+ 104us) write_op.cc:270] Start()
0620 07:01:01.510561 (+ 89us) write_op.cc:276] Timestamp: P: 1781938855185832 usec, L: 0
0620 07:01:01.510735 (+ 174us) write_op.cc:270] Start()
0620 07:01:01.510762 (+ 27us) write_op.cc:276] Timestamp: P: 1781938855196210 usec, L: 0
0620 07:01:01.532990 (+ 22228us) write_op.cc:270] Start()
0620 07:01:01.533034 (+ 44us) write_op.cc:276] Timestamp: P: 1781938855196830 usec, L: 0
0620 07:01:01.533215 (+ 181us) write_op.cc:270] Start()
0620 07:01:01.533237 (+ 22us) write_op.cc:276] Timestamp: P: 1781938855236431 usec, L: 0
0620 07:01:01.533353 (+ 116us) write_op.cc:270] Start()
0620 07:01:01.533371 (+ 18us) write_op.cc:276] Timestamp: P: 1781938855237185 usec, L: 0
0620 07:01:01.533468 (+ 97us) write_op.cc:270] Start()
0620 07:01:01.533484 (+ 16us) write_op.cc:276] Timestamp: P: 1781938855237753 usec, L: 0
0620 07:01:01.533595 (+ 111us) write_op.cc:270] Start()
0620 07:01:01.533612 (+ 17us) write_op.cc:276] Timestamp: P: 1781938855242498 usec, L: 0
0620 07:01:01.533752 (+ 140us) write_op.cc:270] Start()
0620 07:01:01.533775 (+ 23us) write_op.cc:276] Timestamp: P: 1781938855280454 usec, L: 0
0620 07:01:01.533924 (+ 149us) write_op.cc:270] Start()
0620 07:01:01.533944 (+ 20us) write_op.cc:276] Timestamp: P: 1781938855363190 usec, L: 0
0620 07:01:01.534075 (+ 131us) write_op.cc:270] Start()
0620 07:01:01.534093 (+ 18us) write_op.cc:276] Timestamp: P: 1781938855367870 usec, L: 0
0620 07:01:01.534200 (+ 107us) write_op.cc:270] Start()
0620 07:01:01.534252 (+ 52us) write_op.cc:276] Timestamp: P: 1781938855411576 usec, L: 0
0620 07:01:01.534405 (+ 153us) write_op.cc:270] Start()
0620 07:01:01.534427 (+ 22us) write_op.cc:276] Timestamp: P: 1781938855417443 usec, L: 0
0620 07:01:01.571664 (+ 37237us) write_op.cc:270] Start()
0620 07:01:01.572956 (+ 1292us) write_op.cc:276] Timestamp: P: 1781938855420912 usec, L: 0
0620 07:01:01.582443 (+ 9487us) write_op.cc:270] Start()
0620 07:01:01.584028 (+ 1585us) write_op.cc:276] Timestamp: P: 1781938855433987 usec, L: 0
0620 07:01:01.592890 (+ 8862us) write_op.cc:270] Start()
0620 07:01:01.592935 (+ 45us) write_op.cc:276] Timestamp: P: 1781938855439009 usec, L: 0
0620 07:01:01.600336 (+ 7401us) write_op.cc:270] Start()
0620 07:01:01.600962 (+ 626us) write_op.cc:276] Timestamp: P: 1781938855444362 usec, L: 0
0620 07:01:01.607766 (+ 6804us) write_op.cc:270] Start()
0620 07:01:01.609222 (+ 1456us) write_op.cc:276] Timestamp: P: 1781938855448215 usec, L: 0
0620 07:01:01.611991 (+ 2769us) write_op.cc:270] Start()
0620 07:01:01.612405 (+ 414us) write_op.cc:276] Timestamp: P: 1781938855452497 usec, L: 0
0620 07:01:01.617484 (+ 5079us) write_op.cc:270] Start()
0620 07:01:01.617852 (+ 368us) write_op.cc:276] Timestamp: P: 1781938855455915 usec, L: 0
0620 07:01:01.619332 (+ 1480us) write_op.cc:270] Start()
0620 07:01:01.619539 (+ 207us) write_op.cc:276] Timestamp: P: 1781938855495952 usec, L: 0
0620 07:01:01.621597 (+ 2058us) write_op.cc:270] Start()
0620 07:01:01.623099 (+ 1502us) write_op.cc:276] Timestamp: P: 1781938855499849 usec, L: 0
0620 07:01:01.624369 (+ 1270us) write_op.cc:270] Start()
0620 07:01:01.629378 (+ 5009us) write_op.cc:276] Timestamp: P: 1781938855500480 usec, L: 0
0620 07:01:01.637349 (+ 7971us) write_op.cc:270] Start()
0620 07:01:01.637754 (+ 405us) write_op.cc:276] Timestamp: P: 1781938855519344 usec, L: 0
0620 07:01:01.640320 (+ 2566us) write_op.cc:270] Start()
0620 07:01:01.640360 (+ 40us) write_op.cc:276] Timestamp: P: 1781938855520144 usec, L: 0
0620 07:01:01.640532 (+ 172us) write_op.cc:270] Start()
0620 07:01:01.640557 (+ 25us) write_op.cc:276] Timestamp: P: 1781938855522914 usec, L: 0
0620 07:01:01.640703 (+ 146us) write_op.cc:270] Start()
0620 07:01:01.640727 (+ 24us) write_op.cc:276] Timestamp: P: 1781938855547926 usec, L: 0
0620 07:01:01.662086 (+ 21359us) write_op.cc:270] Start()
0620 07:01:01.662144 (+ 58us) write_op.cc:276] Timestamp: P: 1781938855548745 usec, L: 0
0620 07:01:01.662407 (+ 263us) write_op.cc:270] Start()
0620 07:01:01.662438 (+ 31us) write_op.cc:276] Timestamp: P: 1781938855549351 usec, L: 0
0620 07:01:01.662580 (+ 142us) write_op.cc:270] Start()
0620 07:01:01.662603 (+ 23us) write_op.cc:276] Timestamp: P: 1781938855552578 usec, L: 0
0620 07:01:01.671776 (+ 9173us) write_op.cc:270] Start()
0620 07:01:01.671816 (+ 40us) write_op.cc:276] Timestamp: P: 1781938855564391 usec, L: 0
0620 07:01:01.672000 (+ 184us) write_op.cc:270] Start()
0620 07:01:01.672017 (+ 17us) write_op.cc:276] Timestamp: P: 1781938855607535 usec, L: 0
0620 07:01:01.672157 (+ 140us) write_op.cc:270] Start()
0620 07:01:01.672179 (+ 22us) write_op.cc:276] Timestamp: P: 1781938855624472 usec, L: 0
0620 07:01:01.672341 (+ 162us) write_op.cc:270] Start()
0620 07:01:01.672367 (+ 26us) write_op.cc:276] Timestamp: P: 1781938855698923 usec, L: 0
0620 07:01:01.704339 (+ 31972us) write_op.cc:270] Start()
0620 07:01:01.704389 (+ 50us) write_op.cc:276] Timestamp: P: 1781938855703228 usec, L: 0
0620 07:01:01.707037 (+ 2648us) write_op.cc:270] Start()
0620 07:01:01.707089 (+ 52us) write_op.cc:276] Timestamp: P: 1781938855715320 usec, L: 0
0620 07:01:01.707272 (+ 183us) write_op.cc:270] Start()
0620 07:01:01.707299 (+ 27us) write_op.cc:276] Timestamp: P: 1781938855724487 usec, L: 0
0620 07:01:01.707451 (+ 152us) write_op.cc:270] Start()
0620 07:01:01.707476 (+ 25us) write_op.cc:276] Timestamp: P: 1781938855725513 usec, L: 0
0620 07:01:01.707658 (+ 182us) write_op.cc:270] Start()
0620 07:01:01.707694 (+ 36us) write_op.cc:276] Timestamp: P: 1781938855726896 usec, L: 0
0620 07:01:01.707830 (+ 136us) write_op.cc:270] Start()
0620 07:01:01.707851 (+ 21us) write_op.cc:276] Timestamp: P: 1781938855727437 usec, L: 0
0620 07:01:01.707993 (+ 142us) write_op.cc:270] Start()
0620 07:01:01.708015 (+ 22us) write_op.cc:276] Timestamp: P: 1781938855728094 usec, L: 0
0620 07:01:01.708249 (+ 234us) write_op.cc:270] Start()
0620 07:01:01.708316 (+ 67us) write_op.cc:276] Timestamp: P: 1781938855730309 usec, L: 0
0620 07:01:01.708522 (+ 206us) write_op.cc:270] Start()
0620 07:01:01.708546 (+ 24us) write_op.cc:276] Timestamp: P: 1781938855730972 usec, L: 0
0620 07:01:01.737472 (+ 28926us) write_op.cc:270] Start()
0620 07:01:01.737509 (+ 37us) write_op.cc:276] Timestamp: P: 1781938855749646 usec, L: 0
0620 07:01:01.737659 (+ 150us) write_op.cc:270] Start()
0620 07:01:01.737689 (+ 30us) write_op.cc:276] Timestamp: P: 1781938855755513 usec, L: 0
0620 07:01:01.737803 (+ 114us) write_op.cc:270] Start()
0620 07:01:01.737819 (+ 16us) write_op.cc:276] Timestamp: P: 1781938855757637 usec, L: 0
0620 07:01:01.737920 (+ 101us) write_op.cc:270] Start()
0620 07:01:01.737935 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855773080 usec, L: 0
0620 07:01:01.738027 (+ 92us) write_op.cc:270] Start()
0620 07:01:01.738042 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855775219 usec, L: 0
0620 07:01:01.738152 (+ 110us) write_op.cc:270] Start()
0620 07:01:01.738167 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855776790 usec, L: 0
0620 07:01:01.738261 (+ 94us) write_op.cc:270] Start()
0620 07:01:01.738276 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855799582 usec, L: 0
0620 07:01:01.738361 (+ 85us) write_op.cc:270] Start()
0620 07:01:01.738389 (+ 28us) write_op.cc:276] Timestamp: P: 1781938855800625 usec, L: 0
0620 07:01:01.738488 (+ 99us) write_op.cc:270] Start()
0620 07:01:01.738503 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855801380 usec, L: 0
0620 07:01:01.738596 (+ 93us) write_op.cc:270] Start()
0620 07:01:01.738611 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855802247 usec, L: 0
0620 07:01:01.738715 (+ 104us) write_op.cc:270] Start()
0620 07:01:01.738739 (+ 24us) write_op.cc:276] Timestamp: P: 1781938855806162 usec, L: 0
0620 07:01:01.738886 (+ 147us) write_op.cc:270] Start()
0620 07:01:01.738903 (+ 17us) write_op.cc:276] Timestamp: P: 1781938855806863 usec, L: 0
0620 07:01:01.739009 (+ 106us) write_op.cc:270] Start()
0620 07:01:01.739025 (+ 16us) write_op.cc:276] Timestamp: P: 1781938855807499 usec, L: 0
0620 07:01:01.739138 (+ 113us) write_op.cc:270] Start()
0620 07:01:01.739155 (+ 17us) write_op.cc:276] Timestamp: P: 1781938855914208 usec, L: 0
0620 07:01:01.739261 (+ 106us) write_op.cc:270] Start()
0620 07:01:01.739280 (+ 19us) write_op.cc:276] Timestamp: P: 1781938855922669 usec, L: 0
0620 07:01:01.739425 (+ 145us) write_op.cc:270] Start()
0620 07:01:01.739449 (+ 24us) write_op.cc:276] Timestamp: P: 1781938855927096 usec, L: 0
0620 07:01:01.739560 (+ 111us) write_op.cc:270] Start()
0620 07:01:01.739575 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855951900 usec, L: 0
0620 07:01:01.739687 (+ 112us) write_op.cc:270] Start()
0620 07:01:01.739702 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855959516 usec, L: 0
0620 07:01:01.739791 (+ 89us) write_op.cc:270] Start()
0620 07:01:01.739805 (+ 14us) write_op.cc:276] Timestamp: P: 1781938855960079 usec, L: 0
0620 07:01:01.739929 (+ 124us) write_op.cc:270] Start()
0620 07:01:01.739944 (+ 15us) write_op.cc:276] Timestamp: P: 1781938855964332 usec, L: 0
0620 07:01:01.740060 (+ 116us) write_op.cc:270] Start()
0620 07:01:01.740076 (+ 16us) write_op.cc:276] Timestamp: P: 1781938855972587 usec, L: 0
0620 07:01:01.740263 (+ 187us) write_op.cc:270] Start()
0620 07:01:01.740318 (+ 55us) write_op.cc:276] Timestamp: P: 1781938855994197 usec, L: 0
0620 07:01:01.740518 (+ 200us) write_op.cc:270] Start()
0620 07:01:01.740544 (+ 26us) write_op.cc:276] Timestamp: P: 1781938856005109 usec, L: 0
0620 07:01:01.833982 (+ 93438us) write_op.cc:270] Start()
0620 07:01:01.834627 (+ 645us) write_op.cc:276] Timestamp: P: 1781938856032690 usec, L: 0
0620 07:01:01.860250 (+ 25623us) write_op.cc:270] Start()
0620 07:01:01.860311 (+ 61us) write_op.cc:276] Timestamp: P: 1781938856117429 usec, L: 0
0620 07:01:01.863645 (+ 3334us) write_op.cc:270] Start()
0620 07:01:01.863698 (+ 53us) write_op.cc:276] Timestamp: P: 1781938856139038 usec, L: 0
0620 07:01:01.863937 (+ 239us) write_op.cc:270] Start()
0620 07:01:01.863960 (+ 23us) write_op.cc:276] Timestamp: P: 1781938856152311 usec, L: 0
0620 07:01:01.864092 (+ 132us) write_op.cc:270] Start()
0620 07:01:01.864111 (+ 19us) write_op.cc:276] Timestamp: P: 1781938856164522 usec, L: 0
0620 07:01:01.873059 (+ 8948us) write_op.cc:270] Start()
0620 07:01:01.873101 (+ 42us) write_op.cc:276] Timestamp: P: 1781938856248276 usec, L: 0
0620 07:01:01.873247 (+ 146us) write_op.cc:270] Start()
0620 07:01:01.873266 (+ 19us) write_op.cc:276] Timestamp: P: 1781938856249499 usec, L: 0
0620 07:01:01.873382 (+ 116us) write_op.cc:270] Start()
0620 07:01:01.873398 (+ 16us) write_op.cc:276] Timestamp: P: 1781938856250665 usec, L: 0
0620 07:01:01.873498 (+ 100us) write_op.cc:270] Start()
0620 07:01:01.873513 (+ 15us) write_op.cc:276] Timestamp: P: 1781938856268122 usec, L: 0
0620 07:01:01.873604 (+ 91us) write_op.cc:270] Start()
0620 07:01:01.873618 (+ 14us) write_op.cc:276] Timestamp: P: 1781938856269246 usec, L: 0
0620 07:01:01.873751 (+ 133us) write_op.cc:270] Start()
0620 07:01:01.873776 (+ 25us) write_op.cc:276] Timestamp: P: 1781938856270145 usec, L: 0
0620 07:01:01.873906 (+ 130us) write_op.cc:270] Start()
0620 07:01:01.873924 (+ 18us) write_op.cc:276] Timestamp: P: 1781938856271043 usec, L: 0
0620 07:01:01.874061 (+ 137us) write_op.cc:270] Start()
0620 07:01:01.874091 (+ 30us) write_op.cc:276] Timestamp: P: 1781938856330605 usec, L: 0
0620 07:01:01.874246 (+ 155us) write_op.cc:270] Start()
0620 07:01:01.874264 (+ 18us) write_op.cc:276] Timestamp: P: 1781938856335023 usec, L: 0
0620 07:01:01.874382 (+ 118us) write_op.cc:270] Start()
0620 07:01:01.874399 (+ 17us) write_op.cc:276] Timestamp: P: 1781938856336445 usec, L: 0
0620 07:01:01.874524 (+ 125us) write_op.cc:270] Start()
0620 07:01:01.874546 (+ 22us) write_op.cc:276] Timestamp: P: 1781938856422243 usec, L: 0
0620 07:01:01.874721 (+ 175us) write_op.cc:270] Start()
0620 07:01:01.874746 (+ 25us) write_op.cc:276] Timestamp: P: 1781938856428071 usec, L: 0
0620 07:01:01.874921 (+ 175us) write_op.cc:270] Start()
0620 07:01:01.874945 (+ 24us) write_op.cc:276] Timestamp: P: 1781938856433620 usec, L: 0
0620 07:01:01.875089 (+ 144us) write_op.cc:270] Start()
0620 07:01:01.875112 (+ 23us) write_op.cc:276] Timestamp: P: 1781938856487838 usec, L: 0
0620 07:01:01.875254 (+ 142us) write_op.cc:270] Start()
0620 07:01:01.875292 (+ 38us) write_op.cc:276] Timestamp: P: 1781938856488692 usec, L: 0
0620 07:01:01.875422 (+ 130us) write_op.cc:270] Start()
0620 07:01:01.875436 (+ 14us) write_op.cc:276] Timestamp: P: 1781938856489463 usec, L: 0
0620 07:01:01.875530 (+ 94us) write_op.cc:270] Start()
0620 07:01:01.875553 (+ 23us) write_op.cc:276] Timestamp: P: 1781938856490157 usec, L: 0
0620 07:01:01.875705 (+ 152us) write_op.cc:270] Start()
0620 07:01:01.875730 (+ 25us) write_op.cc:276] Timestamp: P: 1781938856491981 usec, L: 0
0620 07:01:01.875911 (+ 181us) write_op.cc:270] Start()
0620 07:01:01.875932 (+ 21us) write_op.cc:276] Timestamp: P: 1781938856493380 usec, L: 0
0620 07:01:01.942964 (+ 67032us) write_op.cc:270] Start()
0620 07:01:01.943017 (+ 53us) write_op.cc:276] Timestamp: P: 1781938856506554 usec, L: 0
0620 07:01:01.948867 (+ 5850us) write_op.cc:270] Start()
0620 07:01:01.948925 (+ 58us) write_op.cc:276] Timestamp: P: 1781938856520219 usec, L: 0
0620 07:01:01.949205 (+ 280us) write_op.cc:270] Start()
0620 07:01:01.949235 (+ 30us) write_op.cc:276] Timestamp: P: 1781938856568039 usec, L: 0
0620 07:01:01.949905 (+ 670us) write_op.cc:270] Start()
0620 07:01:01.949965 (+ 60us) write_op.cc:276] Timestamp: P: 1781938856577010 usec, L: 0
0620 07:01:01.950117 (+ 152us) write_op.cc:270] Start()
0620 07:01:01.950139 (+ 22us) write_op.cc:276] Timestamp: P: 1781938856697931 usec, L: 0
0620 07:01:01.950288 (+ 149us) write_op.cc:270] Start()
0620 07:01:01.950313 (+ 25us) write_op.cc:276] Timestamp: P: 1781938856733650 usec, L: 0
0620 07:01:01.980660 (+ 30347us) write_op.cc:270] Start()
0620 07:01:01.981071 (+ 411us) write_op.cc:276] Timestamp: P: 1781938856749747 usec, L: 0
0620 07:01:01.984985 (+ 3914us) write_op.cc:270] Start()
0620 07:01:01.985468 (+ 483us) write_op.cc:276] Timestamp: P: 1781938856779284 usec, L: 0
0620 07:01:01.988974 (+ 3506us) write_op.cc:270] Start()
0620 07:01:01.989433 (+ 459us) write_op.cc:276] Timestamp: P: 1781938856803511 usec, L: 0
0620 07:01:02.009860 (+ 20427us) write_op.cc:270] Start()
0620 07:01:02.010269 (+ 409us) write_op.cc:276] Timestamp: P: 1781938856808439 usec, L: 0
0620 07:01:02.015423 (+ 5154us) write_op.cc:270] Start()
0620 07:01:02.015830 (+ 407us) write_op.cc:276] Timestamp: P: 1781938856819604 usec, L: 0
0620 07:01:02.017682 (+ 1852us) write_op.cc:270] Start()
0620 07:01:02.018460 (+ 778us) write_op.cc:276] Timestamp: P: 1781938856823432 usec, L: 0
0620 07:01:02.020324 (+ 1864us) write_op.cc:270] Start()
0620 07:01:02.020612 (+ 288us) write_op.cc:276] Timestamp: P: 1781938856847642 usec, L: 0
0620 07:01:02.025776 (+ 5164us) write_op.cc:270] Start()
0620 07:01:02.025984 (+ 208us) write_op.cc:276] Timestamp: P: 1781938856850198 usec, L: 0
0620 07:01:02.027281 (+ 1297us) write_op.cc:270] Start()
0620 07:01:02.027476 (+ 195us) write_op.cc:276] Timestamp: P: 1781938856863823 usec, L: 0
0620 07:01:02.029609 (+ 2133us) write_op.cc:270] Start()
0620 07:01:02.029811 (+ 202us) write_op.cc:276] Timestamp: P: 1781938856883769 usec, L: 0
0620 07:01:02.036282 (+ 6471us) write_op.cc:270] Start()
0620 07:01:02.036318 (+ 36us) write_op.cc:276] Timestamp: P: 1781938856887599 usec, L: 0
0620 07:01:02.036498 (+ 180us) write_op.cc:270] Start()
0620 07:01:02.036526 (+ 28us) write_op.cc:276] Timestamp: P: 1781938856918571 usec, L: 0
0620 07:01:02.036671 (+ 145us) write_op.cc:270] Start()
0620 07:01:02.036690 (+ 19us) write_op.cc:276] Timestamp: P: 1781938856933304 usec, L: 0
0620 07:01:02.036809 (+ 119us) write_op.cc:270] Start()
0620 07:01:02.036831 (+ 22us) write_op.cc:276] Timestamp: P: 1781938856983064 usec, L: 0
0620 07:01:02.036964 (+ 133us) write_op.cc:270] Start()
0620 07:01:02.036981 (+ 17us) write_op.cc:276] Timestamp: P: 1781938856987586 usec, L: 0
0620 07:01:02.037138 (+ 157us) write_op.cc:270] Start()
0620 07:01:02.037160 (+ 22us) write_op.cc:276] Timestamp: P: 1781938857001213 usec, L: 0
0620 07:01:02.037284 (+ 124us) write_op.cc:270] Start()
0620 07:01:02.037301 (+ 17us) write_op.cc:276] Timestamp: P: 1781938857019836 usec, L: 0
0620 07:01:02.037418 (+ 117us) write_op.cc:270] Start()
0620 07:01:02.037435 (+ 17us) write_op.cc:276] Timestamp: P: 1781938857021488 usec, L: 0
0620 07:01:02.037547 (+ 112us) write_op.cc:270] Start()
0620 07:01:02.037565 (+ 18us) write_op.cc:276] Timestamp: P: 1781938857023416 usec, L: 0
0620 07:01:02.037720 (+ 155us) write_op.cc:270] Start()
0620 07:01:02.037742 (+ 22us) write_op.cc:276] Timestamp: P: 1781938857096747 usec, L: 0
0620 07:01:02.037874 (+ 132us) write_op.cc:270] Start()
0620 07:01:02.037897 (+ 23us) write_op.cc:276] Timestamp: P: 1781938857140480 usec, L: 0
0620 07:01:02.038008 (+ 111us) write_op.cc:270] Start()
0620 07:01:02.038032 (+ 24us) write_op.cc:276] Timestamp: P: 1781938857143179 usec, L: 0
0620 07:01:02.038181 (+ 149us) write_op.cc:270] Start()
0620 07:01:02.038203 (+ 22us) write_op.cc:276] Timestamp: P: 1781938857145530 usec, L: 0
0620 07:01:02.038340 (+ 137us) write_op.cc:270] Start()
0620 07:01:02.038360 (+ 20us) write_op.cc:276] Timestamp: P: 1781938857153168 usec, L: 0
0620 07:01:02.038488 (+ 128us) write_op.cc:270] Start()
0620 07:01:02.038506 (+ 18us) write_op.cc:276] Timestamp: P: 1781938857154428 usec, L: 0
0620 07:01:02.038642 (+ 136us) write_op.cc:270] Start()
0620 07:01:02.038661 (+ 19us) write_op.cc:276] Timestamp: P: 1781938857155369 usec, L: 0
0620 07:01:02.038765 (+ 104us) write_op.cc:270] Start()
0620 07:01:02.038806 (+ 41us) write_op.cc:276] Timestamp: P: 1781938857156279 usec, L: 0
0620 07:01:02.038951 (+ 145us) write_op.cc:270] Start()
0620 07:01:02.038970 (+ 19us) write_op.cc:276] Timestamp: P: 1781938857157113 usec, L: 0
0620 07:01:02.039086 (+ 116us) write_op.cc:270] Start()
0620 07:01:02.039110 (+ 24us) write_op.cc:276] Timestamp: P: 1781938857157933 usec, L: 0
0620 07:01:02.039241 (+ 131us) write_op.cc:270] Start()
0620 07:01:02.039258 (+ 17us) write_op.cc:276] Timestamp: P: 1781938857320061 usec, L: 0
0620 07:01:02.039371 (+ 113us) write_op.cc:270] Start()
0620 07:01:02.039392 (+ 21us) write_op.cc:276] Timestamp: P: 1781938857337581 usec, L: 0
0620 07:01:02.118744 (+ 79352us) write_op.cc:270] Start()
0620 07:01:02.118809 (+ 65us) write_op.cc:276] Timestamp: P: 1781938857406706 usec, L: 0
0620 07:01:02.119035 (+ 226us) write_op.cc:270] Start()
0620 07:01:02.119062 (+ 27us) write_op.cc:276] Timestamp: P: 1781938857423518 usec, L: 0
0620 07:01:02.127398 (+ 8336us) write_op.cc:270] Start()
0620 07:01:02.127482 (+ 84us) write_op.cc:276] Timestamp: P: 1781938857436688 usec, L: 0
0620 07:01:02.127696 (+ 214us) write_op.cc:270] Start()
0620 07:01:02.127717 (+ 21us) write_op.cc:276] Timestamp: P: 1781938857439957 usec, L: 0
0620 07:01:02.127860 (+ 143us) write_op.cc:270] Start()
0620 07:01:02.127878 (+ 18us) write_op.cc:276] Timestamp: P: 1781938857440588 usec, L: 0
0620 07:01:02.128062 (+ 184us) write_op.cc:270] Start()
0620 07:01:02.128082 (+ 20us) write_op.cc:276] Timestamp: P: 1781938857441167 usec, L: 0
0620 07:01:02.128240 (+ 158us) write_op.cc:270] Start()
0620 07:01:02.128262 (+ 22us) write_op.cc:276] Timestamp: P: 1781938857442091 usec, L: 0
0620 07:01:02.128396 (+ 134us) write_op.cc:270] Start()
0620 07:01:02.128420 (+ 24us) write_op.cc:276] Timestamp: P: 1781938857453070 usec, L: 0
0620 07:01:02.128531 (+ 111us) write_op.cc:270] Start()
0620 07:01:02.128560 (+ 29us) write_op.cc:276] Timestamp: P: 1781938857540795 usec, L: 0
0620 07:01:02.128693 (+ 133us) write_op.cc:270] Start()
0620 07:01:02.128711 (+ 18us) write_op.cc:276] Timestamp: P: 1781938857598414 usec, L: 0
0620 07:01:02.128849 (+ 138us) write_op.cc:270] Start()
0620 07:01:02.128866 (+ 17us) write_op.cc:276] Timestamp: P: 1781938857599056 usec, L: 0
0620 07:01:02.128969 (+ 103us) write_op.cc:270] Start()
0620 07:01:02.128984 (+ 15us) write_op.cc:276] Timestamp: P: 1781938857601566 usec, L: 0
0620 07:01:02.129120 (+ 136us) write_op.cc:270] Start()
0620 07:01:02.129136 (+ 16us) write_op.cc:276] Timestamp: P: 1781938857607197 usec, L: 0
0620 07:01:02.129263 (+ 127us) write_op.cc:270] Start()
0620 07:01:02.129279 (+ 16us) write_op.cc:276] Timestamp: P: 1781938857607750 usec, L: 0
0620 07:01:02.129401 (+ 122us) write_op.cc:270] Start()
0620 07:01:02.129417 (+ 16us) write_op.cc:276] Timestamp: P: 1781938857612045 usec, L: 0
0620 07:01:02.129564 (+ 147us) write_op.cc:270] Start()
0620 07:01:02.129587 (+ 23us) write_op.cc:276] Timestamp: P: 1781938857640909 usec, L: 0
0620 07:01:02.129731 (+ 144us) write_op.cc:270] Start()
0620 07:01:02.129749 (+ 18us) write_op.cc:276] Timestamp: P: 1781938857642845 usec, L: 0
0620 07:01:02.129861 (+ 112us) write_op.cc:270] Start()
0620 07:01:02.129878 (+ 17us) write_op.cc:276] Timestamp: P: 1781938857652416 usec, L: 0
0620 07:01:02.130012 (+ 134us) write_op.cc:270] Start()
0620 07:01:02.130032 (+ 20us) write_op.cc:276] Timestamp: P: 1781938857656449 usec, L: 0
0620 07:01:02.130156 (+ 124us) write_op.cc:270] Start()
0620 07:01:02.130173 (+ 17us) write_op.cc:276] Timestamp: P: 1781938857662100 usec, L: 0
0620 07:01:02.130277 (+ 104us) write_op.cc:270] Start()
0620 07:01:02.130298 (+ 21us) write_op.cc:276] Timestamp: P: 1781938857666749 usec, L: 0
0620 07:01:02.130416 (+ 118us) write_op.cc:270] Start()
0620 07:01:02.130434 (+ 18us) write_op.cc:276] Timestamp: P: 1781938857698895 usec, L: 0
0620 07:01:02.130557 (+ 123us) write_op.cc:270] Start()
0620 07:01:02.130587 (+ 30us) write_op.cc:276] Timestamp: P: 1781938857699695 usec, L: 0
0620 07:01:02.130718 (+ 131us) write_op.cc:270] Start()
0620 07:01:02.130736 (+ 18us) write_op.cc:276] Timestamp: P: 1781938857770434 usec, L: 0
0620 07:01:02.200137 (+ 69401us) write_op.cc:270] Start()
0620 07:01:02.200542 (+ 405us) write_op.cc:276] Timestamp: P: 1781938857776175 usec, L: 0
0620 07:01:02.211424 (+ 10882us) write_op.cc:270] Start()
0620 07:01:02.211473 (+ 49us) write_op.cc:276] Timestamp: P: 1781938857879881 usec, L: 0
0620 07:01:02.211687 (+ 214us) write_op.cc:270] Start()
0620 07:01:02.211707 (+ 20us) write_op.cc:276] Timestamp: P: 1781938857895480 usec, L: 0
0620 07:01:02.217144 (+ 5437us) write_op.cc:270] Start()
0620 07:01:02.217188 (+ 44us) write_op.cc:276] Timestamp: P: 1781938857923539 usec, L: 0
0620 07:01:02.217379 (+ 191us) write_op.cc:270] Start()
0620 07:01:02.217398 (+ 19us) write_op.cc:276] Timestamp: P: 1781938857924326 usec, L: 0
0620 07:01:02.217499 (+ 101us) write_op.cc:270] Start()
0620 07:01:02.217515 (+ 16us) write_op.cc:276] Timestamp: P: 1781938857955446 usec, L: 0
0620 07:01:02.217660 (+ 145us) write_op.cc:270] Start()
0620 07:01:02.217676 (+ 16us) write_op.cc:276] Timestamp: P: 1781938857971667 usec, L: 0
0620 07:01:02.217796 (+ 120us) write_op.cc:270] Start()
0620 07:01:02.217813 (+ 17us) write_op.cc:276] Timestamp: P: 1781938857985412 usec, L: 0
0620 07:01:02.217944 (+ 131us) write_op.cc:270] Start()
0620 07:01:02.217960 (+ 16us) write_op.cc:276] Timestamp: P: 17819388
I20260620 07:01:04.922981 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:04.896945 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.898527 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a36a5319a044e9da7dc7b666484e257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.899245 1169 ts_tablet_manager.cc:1918] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:04.926858 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 48726d9a3aa745fca3bcd9b6e8807c49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.927810 1169 log.cc:1196] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/add9e860802d4edebcfbc9fa3c4a6b24
I20260620 07:01:04.928361 1169 ts_tablet_manager.cc:1939] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:04.929060 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 418) took 1195 ms. Trace:
I20260620 07:01:04.929684 1169 rpcz_store.cc:276] 0620 07:01:03.733272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.754158 (+ 20886us) service_pool.cc:227] Handling call
0620 07:01:04.568586 (+814428us) ts_tablet_manager.cc:1145] Deleting tablet add9e860802d4edebcfbc9fa3c4a6b24
0620 07:01:04.568773 (+ 187us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.792262 (+223489us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.899098 (+106836us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.929015 (+ 29917us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":749098}
I20260620 07:01:04.930755 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 419) took 1178 ms. Trace:
I20260620 07:01:04.930995 1169 rpcz_store.cc:276] 0620 07:01:03.752285 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.752612 (+ 327us) service_pool.cc:227] Handling call
0620 07:01:04.930526 (+1177914us) ts_tablet_manager.cc:1145] Deleting tablet 1d9d4b5a69484176a7b0f4fded010867
0620 07:01:04.930544 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.930724 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1063489}
I20260620 07:01:04.931617 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 420) took 1106 ms. Trace:
I20260620 07:01:04.931800 1169 rpcz_store.cc:276] 0620 07:01:03.825181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.851407 (+ 26226us) service_pool.cc:227] Handling call
0620 07:01:04.931474 (+1080067us) ts_tablet_manager.cc:1145] Deleting tablet 6229a52adf8d4b17bdf89347e01621ed
0620 07:01:04.931485 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.931585 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1053726}
I20260620 07:01:04.936297 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 422) took 1060 ms. Trace:
I20260620 07:01:04.936694 1495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:01:04.937098 1495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: LEADER
I20260620 07:01:04.937808 1169 rpcz_store.cc:276] 0620 07:01:03.875521 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.875610 (+ 89us) service_pool.cc:227] Handling call
0620 07:01:04.935640 (+1060030us) ts_tablet_manager.cc:1145] Deleting tablet c9d344f9e4b444e4b6018fdf0cf762fd
0620 07:01:04.935654 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.936257 (+ 603us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1054397}
I20260620 07:01:04.939113 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet add9e860802d4edebcfbc9fa3c4a6b24 (table default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]) successfully deleted
I20260620 07:01:04.941931 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 423) took 1065 ms. Trace:
W20260620 07:01:04.942499 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1d9d4b5a69484176a7b0f4fded010867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d9d4b5a69484176a7b0f4fded010867 already in progress: creating tablet
I20260620 07:01:04.942734 1169 rpcz_store.cc:276] 0620 07:01:03.876788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.877521 (+ 733us) service_pool.cc:227] Handling call
0620 07:01:04.939373 (+1061852us) ts_tablet_manager.cc:1145] Deleting tablet 5926946427294a5ca6fbc72d3e1b612d
0620 07:01:04.939394 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.941887 (+ 2493us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1057786}
I20260620 07:01:04.954456 1168 tablet_bootstrap.cc:492] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:04.955662 1168 ts_tablet_manager.cc:1397] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.448s user 0.007s sys 0.008s
W20260620 07:01:04.957309 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6229a52adf8d4b17bdf89347e01621ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6229a52adf8d4b17bdf89347e01621ed already in progress: creating tablet
W20260620 07:01:04.957633 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c9d344f9e4b444e4b6018fdf0cf762fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9d344f9e4b444e4b6018fdf0cf762fd already in progress: creating tablet
I20260620 07:01:04.958153 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 430) took 1053 ms. Trace:
I20260620 07:01:04.958292 1169 rpcz_store.cc:276] 0620 07:01:03.904705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.904770 (+ 65us) service_pool.cc:227] Handling call
0620 07:01:04.957992 (+1053222us) ts_tablet_manager.cc:1145] Deleting tablet 3651ef9790d342ec96f554134ae714dc
0620 07:01:04.958005 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.958118 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026602}
I20260620 07:01:04.958992 1169 tablet_replica.cc:330] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:04.959355 1169 raft_consensus.cc:2229] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:04.960533 1169 raft_consensus.cc:2258] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:04.965304 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5926946427294a5ca6fbc72d3e1b612d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5926946427294a5ca6fbc72d3e1b612d already in progress: creating tablet
W20260620 07:01:04.965853 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3651ef9790d342ec96f554134ae714dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3651ef9790d342ec96f554134ae714dc already in progress: creating tablet
W20260620 07:01:04.966281 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ab60101b34144f85b0afd2e8c4846e48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab60101b34144f85b0afd2e8c4846e48 already in progress: creating tablet
I20260620 07:01:04.966564 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a36a5319a044e9da7dc7b666484e257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:04.966777 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8d2c706414684bb1bacc6f9b870fc9c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d2c706414684bb1bacc6f9b870fc9c1 already in progress: creating tablet
I20260620 07:01:04.984429 1166 ts_tablet_manager.cc:1918] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:04.973975 1699 raft_consensus.cc:504] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:04.989465 1167 tablet_bootstrap.cc:492] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:04.989678 1167 ts_tablet_manager.cc:1397] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.860s user 0.002s sys 0.015s
I20260620 07:01:04.989928 1699 leader_election.cc:288] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:04.992838 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a6c7b3977b604cb69df671318fae1212
I20260620 07:01:04.994294 732 tablet_service.cc:1514] Processing DeleteTablet for tablet a6c7b3977b604cb69df671318fae1212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:04.995676 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f2426d52b8ff40f39887545e0341a91a
I20260620 07:01:04.996099 427 catalog_manager.cc:6565] ReplaceTablet: tablet f2426d52b8ff40f39887545e0341a91a deleted and replaced by tablet b9736d57fe0e4edea762508fe0a8d2a5
I20260620 07:01:04.997702 732 tablet_service.cc:1514] Processing DeleteTablet for tablet f2426d52b8ff40f39887545e0341a91a with delete_type TABLET_DATA_DELETED (replaced by tablet b9736d57fe0e4edea762508fe0a8d2a5) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.001726 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_30d48f35343d4017b5b3e6750c89d54e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.002486 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30d48f35343d4017b5b3e6750c89d54e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.004595 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5630d0cf800a45efb1b1bfeee6223c8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.005208 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5630d0cf800a45efb1b1bfeee6223c8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.005690 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.017119 1168 raft_consensus.cc:348] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.017822 1168 raft_consensus.cc:374] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.017944 1168 raft_consensus.cc:729] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.018699 1169 ts_tablet_manager.cc:1905] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:05.018924 874 tablet_service.cc:1514] Processing DeleteTablet for tablet f2426d52b8ff40f39887545e0341a91a with delete_type TABLET_DATA_DELETED (replaced by tablet b9736d57fe0e4edea762508fe0a8d2a5) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.019338 1168 consensus_queue.cc:260] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.021414 876 tablet_service.cc:1514] Processing DeleteTablet for tablet a6c7b3977b604cb69df671318fae1212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.024514 1556 raft_consensus.cc:482] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:05.024708 1556 raft_consensus.cc:504] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.025319 1556 leader_election.cc:288] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:05.026433 1168 ts_tablet_manager.cc:1428] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.071s user 0.001s sys 0.001s
W20260620 07:01:05.027091 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b17bbf2f844b4c01ad5d6dc36e096ee5 consensus state has no leader
I20260620 07:01:05.030310 1168 tablet_bootstrap.cc:492] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:05.033412 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 2c0bb50405d0446488272384523c2deb from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:05.032792 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95f9a6b2f2cb41e6b74715b2618d8a70" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:05.034646 683 leader_election.cc:341] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.034826 422 master_service.cc:946] ReplaceTablet: received request to replace tablet b5e08a38c42d4e3da20292343bf085b9 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:05.036033 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97e01aa120cc4c189017236ad57de811 consensus state has no leader
I20260620 07:01:05.036775 1170 tablet_bootstrap.cc:492] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:05.037012 1170 ts_tablet_manager.cc:1397] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.215s user 0.013s sys 0.001s
I20260620 07:01:05.037297 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add9e860802d4edebcfbc9fa3c4a6b24" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:05.038084 1168 tablet_bootstrap.cc:654] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:05.038089 1170 raft_consensus.cc:348] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.038561 1170 raft_consensus.cc:374] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.038887 1170 raft_consensus.cc:729] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.039307 1170 consensus_queue.cc:260] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.040167 1170 ts_tablet_manager.cc:1428] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:05.040721 1170 tablet_bootstrap.cc:492] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:05.042594 1170 tablet_bootstrap.cc:654] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:05.044184 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 777a6b981b7f43a4ba8978ba6f3971e1 consensus state has no leader
I20260620 07:01:05.045264 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203ba3933d3a4fb2a4978b29cad614e6" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:05.045464 1165 ts_tablet_manager.cc:1918] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:05.045614 1165 log.cc:1196] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/63dfade71c254d7e908e00acada93638
I20260620 07:01:05.046131 1165 ts_tablet_manager.cc:1939] T 63dfade71c254d7e908e00acada93638 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:05.046213 1166 log.cc:1196] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f90f1b2facc0415ab378fb81b60b0202
I20260620 07:01:05.051196 1167 raft_consensus.cc:348] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.051469 1167 raft_consensus.cc:374] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.051544 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d61cbca81442407483975e8c14052c7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.052139 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d61cbca81442407483975e8c14052c7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.053421 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ca5b5e6066a343a59aeaf1e58f8a8a67" } new_table_name: "default.Table_eb719a986c8b4e01a4a98f5e68582421" modify_external_catalogs: true
I20260620 07:01:05.053648 1167 raft_consensus.cc:729] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.055717 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 80a83948f0424b47889f4be7fee15706 (DEFAULT_TABLE table=default.Table_489099e333304b76a22a77be828f6e46 [id=744a6092eda64b01a0529ab0ba18a3a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.059571 733 tablet_service.cc:1467] Processing CreateTablet for tablet f96688ac7c91450cb34afd5f40b9826c (DEFAULT_TABLE table=default.Table_b2adb95fecb348c4a8a50e1630795dbb [id=afbb2ffa808a41c09eba55d693d6bbaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.060043 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f96688ac7c91450cb34afd5f40b9826c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.060600 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ea9e545f34d741778517df5391bca063" } new_table_name: "default.Table_2887bc68d41444e7a3da02fea7842d8d" modify_external_catalogs: true
I20260620 07:01:05.059576 732 tablet_service.cc:1467] Processing CreateTablet for tablet 80a83948f0424b47889f4be7fee15706 (DEFAULT_TABLE table=default.Table_489099e333304b76a22a77be828f6e46 [id=744a6092eda64b01a0529ab0ba18a3a2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:05.046962 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 145898us
I20260620 07:01:05.061513 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80a83948f0424b47889f4be7fee15706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.063449 725 tablet_service.cc:1467] Processing CreateTablet for tablet 1d09745353ef46b9b68397f48f391bcd (DEFAULT_TABLE table=default.Table_67488f79519b41489e04be38f88c163c [id=9b159928127d4f26a4c9f55d7128a2ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.063827 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d09745353ef46b9b68397f48f391bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.065203 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81704d3a3cf648d987d4b40a270f7508" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:05.065418 895 raft_consensus.cc:3037] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:05.067807 730 tablet_service.cc:1467] Processing CreateTablet for tablet 36f1fc6123cd40cb839d47de316502b3 (DEFAULT_TABLE table=default.Table_d04bb18f7b0c43d8aeeb6fbeba126279 [id=693764d5819246749406e8e2c07a38d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.068224 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36f1fc6123cd40cb839d47de316502b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.068300 895 raft_consensus.cc:2454] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:05.069365 872 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d1e4719cd441dd8054b24861cbd8a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:57 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.069679 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c7e0c2dc28504b13aeb390e85111eb8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:05.070036 865 tablet_service.cc:1467] Processing CreateTablet for tablet 74eaa712962245b4bb14d17e4cdd8485 (DEFAULT_TABLE table=default.Table_d980ceff63f447adbc0aaf600b24f40e [id=ea3947fe0a794502a317ef69c47c0444]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:05.070295 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7e0c2dc28504b13aeb390e85111eb8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.070459 830 leader_election.cc:302] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:05.070849 830 leader_election.cc:341] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.071134 830 leader_election.cc:302] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:05.071146 716 tablet_service.cc:1467] Processing CreateTablet for tablet 1252d1dd03bd4a27983eb89d489b09d3 (DEFAULT_TABLE table=default.Table_b614a5e33a1044439547e886f07c85bf [id=28089fcb80c34bd080d620866d0a450a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.071516 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1252d1dd03bd4a27983eb89d489b09d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.071544 859 tablet_service.cc:1467] Processing CreateTablet for tablet 7524821997e64917849656060aaa706f (DEFAULT_TABLE table=default.Table_70afee11662b4e4bb57022351f45ee15 [id=043166b13ad840c7bf87fc7125dbb4cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.072091 864 tablet_service.cc:1467] Processing CreateTablet for tablet f47c6b7062e648bd993fda56ffcc9035 (DEFAULT_TABLE table=default.Table_1bd4d2f168f442b9bddf8bdd67509bd5 [id=ce92a9a2cc0446f38664e2ebac1bf423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.072628 874 tablet_service.cc:1467] Processing CreateTablet for tablet 1252d1dd03bd4a27983eb89d489b09d3 (DEFAULT_TABLE table=default.Table_b614a5e33a1044439547e886f07c85bf [id=28089fcb80c34bd080d620866d0a450a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.073053 1723 raft_consensus.cc:2741] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260620 07:01:05.073223 1723 raft_consensus.cc:2781] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:05.073307 1723 raft_consensus.cc:482] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:05.073395 1723 raft_consensus.cc:3037] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:05.075107 727 tablet_service.cc:1467] Processing CreateTablet for tablet 7524821997e64917849656060aaa706f (DEFAULT_TABLE table=default.Table_70afee11662b4e4bb57022351f45ee15 [id=043166b13ad840c7bf87fc7125dbb4cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.075450 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7524821997e64917849656060aaa706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.076510 1723 raft_consensus.cc:504] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.077056 1723 leader_election.cc:288] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:05.078365 414 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 (table default.Table_1049597486e048af84978e2f18e6e952 [id=6f8cad1f8c064ec880389a6c890171dc], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b17bbf2f844b4c01ad5d6dc36e096ee5 consensus state has no leader
W20260620 07:01:05.078289 830 leader_election.cc:341] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.078352 717 tablet_service.cc:1467] Processing CreateTablet for tablet f47c6b7062e648bd993fda56ffcc9035 (DEFAULT_TABLE table=default.Table_1bd4d2f168f442b9bddf8bdd67509bd5 [id=ce92a9a2cc0446f38664e2ebac1bf423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.078711 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f47c6b7062e648bd993fda56ffcc9035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.079090 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c13cafc124f94c058d2948e4fe3c0181"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.079706 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c13cafc124f94c058d2948e4fe3c0181 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.048621 868 tablet_service.cc:1467] Processing CreateTablet for tablet 80a83948f0424b47889f4be7fee15706 (DEFAULT_TABLE table=default.Table_489099e333304b76a22a77be828f6e46 [id=744a6092eda64b01a0529ab0ba18a3a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.049803 863 tablet_service.cc:1467] Processing CreateTablet for tablet f96688ac7c91450cb34afd5f40b9826c (DEFAULT_TABLE table=default.Table_b2adb95fecb348c4a8a50e1630795dbb [id=afbb2ffa808a41c09eba55d693d6bbaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.050343 871 tablet_service.cc:1467] Processing CreateTablet for tablet 1d09745353ef46b9b68397f48f391bcd (DEFAULT_TABLE table=default.Table_67488f79519b41489e04be38f88c163c [id=9b159928127d4f26a4c9f55d7128a2ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.059244 876 tablet_service.cc:1467] Processing CreateTablet for tablet 36f1fc6123cd40cb839d47de316502b3 (DEFAULT_TABLE table=default.Table_d04bb18f7b0c43d8aeeb6fbeba126279 [id=693764d5819246749406e8e2c07a38d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.083123 721 tablet_service.cc:1467] Processing CreateTablet for tablet 74eaa712962245b4bb14d17e4cdd8485 (DEFAULT_TABLE table=default.Table_d980ceff63f447adbc0aaf600b24f40e [id=ea3947fe0a794502a317ef69c47c0444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.083500 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74eaa712962245b4bb14d17e4cdd8485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.084692 1170 tablet_bootstrap.cc:492] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:05.084844 1170 ts_tablet_manager.cc:1397] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.001s
I20260620 07:01:05.087996 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_514f5506c81a4038ad87979a2e476fd0" } modify_external_catalogs: true
I20260620 07:01:05.088240 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_514f5506c81a4038ad87979a2e476fd0" } modify_external_catalogs: true
I20260620 07:01:05.088660 1168 tablet_bootstrap.cc:492] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:05.091635 1556 raft_consensus.cc:482] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:05.091784 1556 raft_consensus.cc:504] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.092429 1556 leader_election.cc:288] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:05.093156 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "076926f7dffe4a7b80c25ea3c18e9958" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:05.094045 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74eaa712962245b4bb14d17e4cdd8485. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.094988 683 leader_election.cc:341] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.096354 725 tablet_service.cc:1514] Processing DeleteTablet for tablet d066c73ae0104cb3be792790b1dfb93d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.096197 1170 raft_consensus.cc:348] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.097289 1170 raft_consensus.cc:374] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.097390 1170 raft_consensus.cc:729] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.097612 1170 consensus_queue.cc:260] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.098367 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7524821997e64917849656060aaa706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.098346 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1c43b2d4813c4afa9752e8e55c232a42" } modify_external_catalogs: true
I20260620 07:01:05.098555 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1c43b2d4813c4afa9752e8e55c232a42" } modify_external_catalogs: true
I20260620 07:01:05.103935 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2c0bb50405d0446488272384523c2deb
I20260620 07:01:05.104377 425 catalog_manager.cc:6565] ReplaceTablet: tablet 2c0bb50405d0446488272384523c2deb deleted and replaced by tablet 98544574a8cd4a86a443284a421fa030
I20260620 07:01:05.105082 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c0bb50405d0446488272384523c2deb with delete_type TABLET_DATA_DELETED (replaced by tablet 98544574a8cd4a86a443284a421fa030) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.105461 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f47c6b7062e648bd993fda56ffcc9035. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.106969 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9a7fab4d1684604be1b81d4d4bbe560 consensus state has no leader
W20260620 07:01:05.107363 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6bae5090f81417cbcf4b4d598b438da consensus state has no leader
W20260620 07:01:05.107743 831 leader_election.cc:341] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ea6102e0da4e42cd9f1d6e294bb372b2
I20260620 07:01:05.108477 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 777a6b981b7f43a4ba8978ba6f3971e1
I20260620 07:01:05.109143 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 777a6b981b7f43a4ba8978ba6f3971e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.112821 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1252d1dd03bd4a27983eb89d489b09d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.113037 1170 ts_tablet_manager.cc:1428] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260620 07:01:05.114266 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 777a6b981b7f43a4ba8978ba6f3971e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.117146 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fbf912f51bfd4df0afe7aa28815a897e
I20260620 07:01:05.118131 872 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf912f51bfd4df0afe7aa28815a897e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.118377 1170 tablet_bootstrap.cc:492] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:05.118548 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36f1fc6123cd40cb839d47de316502b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.122947 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d09745353ef46b9b68397f48f391bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.122973 1169 ts_tablet_manager.cc:1918] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:05.125526 1169 log.cc:1196] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/d17c49eecec741cdbd592c94b7f84c67
I20260620 07:01:05.126181 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c0bb50405d0446488272384523c2deb with delete_type TABLET_DATA_DELETED (replaced by tablet 98544574a8cd4a86a443284a421fa030) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.128093 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ed11da599e5c4b44b63531233e52da80" } modify_external_catalogs: true
I20260620 07:01:05.128332 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ed11da599e5c4b44b63531233e52da80" } modify_external_catalogs: true
I20260620 07:01:05.129410 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f96688ac7c91450cb34afd5f40b9826c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.127810 1167 consensus_queue.cc:260] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.131893 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80a83948f0424b47889f4be7fee15706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.132957 1166 ts_tablet_manager.cc:1939] T f90f1b2facc0415ab378fb81b60b0202 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:05.133548 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_87c64053fbc3481390a21b3940acb5ab" } modify_external_catalogs: true
I20260620 07:01:05.133795 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_87c64053fbc3481390a21b3940acb5ab" } modify_external_catalogs: true
I20260620 07:01:05.134094 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80a83948f0424b47889f4be7fee15706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.143626 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ee90d961729b4088b0a312ec770d3cd0
I20260620 07:01:05.143953 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 1d09745353ef46b9b68397f48f391bcd (DEFAULT_TABLE table=default.Table_67488f79519b41489e04be38f88c163c [id=9b159928127d4f26a4c9f55d7128a2ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.145515 872 tablet_service.cc:1514] Processing DeleteTablet for tablet ee90d961729b4088b0a312ec770d3cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.146217 1168 ts_tablet_manager.cc:1397] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.120s user 0.005s sys 0.000s
I20260620 07:01:05.146726 1012 tablet_service.cc:1467] Processing CreateTablet for tablet f96688ac7c91450cb34afd5f40b9826c (DEFAULT_TABLE table=default.Table_b2adb95fecb348c4a8a50e1630795dbb [id=afbb2ffa808a41c09eba55d693d6bbaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.143860 996 tablet_service.cc:1467] Processing CreateTablet for tablet 1252d1dd03bd4a27983eb89d489b09d3 (DEFAULT_TABLE table=default.Table_b614a5e33a1044439547e886f07c85bf [id=28089fcb80c34bd080d620866d0a450a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.146641 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 259) took 5209 ms. Trace:
I20260620 07:01:05.153244 1165 rpcz_store.cc:276] 0620 07:01:00.016395 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.606139 (+589744us) service_pool.cc:227] Handling call
0620 07:01:04.787819 (+4181680us) ts_tablet_manager.cc:1145] Deleting tablet 63dfade71c254d7e908e00acada93638
0620 07:01:04.787830 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.023125 (+235295us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.045299 (+ 22174us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.146604 (+101305us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4152128}
I20260620 07:01:05.153716 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 63dfade71c254d7e908e00acada93638 (table default.Table_c1da229c30624077a49d8112967940c7 [id=7230178ddc264a3faaa90ddc66afffd1]) successfully deleted
I20260620 07:01:05.157560 998 tablet_service.cc:1467] Processing CreateTablet for tablet f47c6b7062e648bd993fda56ffcc9035 (DEFAULT_TABLE table=default.Table_1bd4d2f168f442b9bddf8bdd67509bd5 [id=ce92a9a2cc0446f38664e2ebac1bf423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.159631 1168 raft_consensus.cc:348] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.159957 1168 raft_consensus.cc:374] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.160074 1168 raft_consensus.cc:729] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.160329 1168 consensus_queue.cc:260] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.161144 1168 ts_tablet_manager.cc:1428] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260620 07:01:05.161823 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 7524821997e64917849656060aaa706f (DEFAULT_TABLE table=default.Table_70afee11662b4e4bb57022351f45ee15 [id=043166b13ad840c7bf87fc7125dbb4cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.163213 1168 tablet_bootstrap.cc:492] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:05.164903 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 261) took 5014 ms. Trace:
I20260620 07:01:05.165113 1165 rpcz_store.cc:276] 0620 07:01:00.150925 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.625909 (+474984us) service_pool.cc:227] Handling call
0620 07:01:05.164729 (+4538820us) ts_tablet_manager.cc:1145] Deleting tablet 95f9a6b2f2cb41e6b74715b2618d8a70
0620 07:01:05.164748 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.164866 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4521443}
W20260620 07:01:05.165764 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95f9a6b2f2cb41e6b74715b2618d8a70 already in progress: creating tablet
I20260620 07:01:05.165961 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 277) took 4844 ms. Trace:
I20260620 07:01:05.166186 1165 rpcz_store.cc:276] 0620 07:01:00.321194 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.953706 (+632512us) service_pool.cc:227] Handling call
0620 07:01:05.165669 (+4211963us) ts_tablet_manager.cc:1145] Deleting tablet 333eef8b98da4a279acceaead9405149
0620 07:01:05.165745 (+ 76us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.165844 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4207962}
W20260620 07:01:05.166663 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 333eef8b98da4a279acceaead9405149 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 333eef8b98da4a279acceaead9405149 already in progress: creating tablet
I20260620 07:01:05.166893 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 278) took 4838 ms. Trace:
I20260620 07:01:05.167062 1165 rpcz_store.cc:276] 0620 07:01:00.328147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.957758 (+629611us) service_pool.cc:227] Handling call
0620 07:01:05.166656 (+4208898us) ts_tablet_manager.cc:1145] Deleting tablet 704e8aaabe6d40138b6611bdc30abf16
0620 07:01:05.166667 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.166855 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4208711}
W20260620 07:01:05.167651 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 704e8aaabe6d40138b6611bdc30abf16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 704e8aaabe6d40138b6611bdc30abf16 already in progress: creating tablet
I20260620 07:01:05.167804 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 279) took 4833 ms. Trace:
I20260620 07:01:05.167969 1165 rpcz_store.cc:276] 0620 07:01:00.337810 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.957959 (+620149us) service_pool.cc:227] Handling call
0620 07:01:05.167608 (+4209649us) ts_tablet_manager.cc:1145] Deleting tablet 2910da33bbdb4410a4a90ff9747a7de1
0620 07:01:05.167619 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.167714 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4202183}
I20260620 07:01:05.168464 1165 tablet_replica.cc:330] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:05.168593 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2910da33bbdb4410a4a90ff9747a7de1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2910da33bbdb4410a4a90ff9747a7de1 already in progress: creating tablet
I20260620 07:01:05.168823 1165 raft_consensus.cc:2229] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:05.169240 1165 raft_consensus.cc:2258] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.178778 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 777a6b981b7f43a4ba8978ba6f3971e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.188303 426 master_service.cc:946] ReplaceTablet: received request to replace tablet 88c01c4e10f345fc84e3e253e8501aff from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:05.194173 1165 ts_tablet_manager.cc:1905] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:05.194983 1579 mvcc.cc:205] Tried to move back new op lower bound from 7298821571568668672 to 7298821549435371520. Current Snapshot: MvccSnapshot[applied={T|T < 7298821571568668672 or (T in {7298821571568668672})}]
I20260620 07:01:05.196218 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fa5e48ba0ba24f30a0212db6021bc618" } modify_external_catalogs: true
I20260620 07:01:05.196535 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fa5e48ba0ba24f30a0212db6021bc618" } modify_external_catalogs: true
I20260620 07:01:05.058725 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet a6c7b3977b604cb69df671318fae1212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.194778 1168 tablet_bootstrap.cc:654] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:05.213145 427 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_5716ccac487c4d4296da6cdd2d2ceeb0 [id=2abd0f99a3034a0e8824bcb0002c91bd]). Expected version 1 got 0
I20260620 07:01:05.215055 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
I20260620 07:01:05.215072 994 tablet_service.cc:1514] Processing DeleteTablet for tablet f2426d52b8ff40f39887545e0341a91a with delete_type TABLET_DATA_DELETED (replaced by tablet b9736d57fe0e4edea762508fe0a8d2a5) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.216037 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 36f1fc6123cd40cb839d47de316502b3 (DEFAULT_TABLE table=default.Table_d04bb18f7b0c43d8aeeb6fbeba126279 [id=693764d5819246749406e8e2c07a38d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.216931 1165 ts_tablet_manager.cc:1918] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260620 07:01:05.217489 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d09745353ef46b9b68397f48f391bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.219380 1167 ts_tablet_manager.cc:1428] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.152s user 0.001s sys 0.002s
I20260620 07:01:05.221236 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 175) took 6378 ms. Trace:
I20260620 07:01:05.225067 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c0bb50405d0446488272384523c2deb with delete_type TABLET_DATA_DELETED (replaced by tablet 98544574a8cd4a86a443284a421fa030) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.225291 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 74eaa712962245b4bb14d17e4cdd8485 (DEFAULT_TABLE table=default.Table_d980ceff63f447adbc0aaf600b24f40e [id=ea3947fe0a794502a317ef69c47c0444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.225823 1700 consensus_queue.cc:1035] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260620 07:01:05.226248 420 master_service.cc:946] ReplaceTablet: received request to replace tablet b4ee5c79e2a6419ea3847cbebdeced79 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:05.229140 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36f1fc6123cd40cb839d47de316502b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.229583 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8bee6b731503444fa747e3bad786e4ad" } new_table_name: "default.Table_fa1db4a654f54dee8b887dffc4d5a021" modify_external_catalogs: true
I20260620 07:01:05.229851 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet ee90d961729b4088b0a312ec770d3cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.211596 717 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf912f51bfd4df0afe7aa28815a897e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.230892 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cddcca7b8f8e497ab1dceca5e0526472"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.231417 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cddcca7b8f8e497ab1dceca5e0526472 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.233794 1167 tablet_bootstrap.cc:492] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:05.233680 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8f93b40f12a1469283e48666d1dd1899"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.234202 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f93b40f12a1469283e48666d1dd1899 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.217768 1168 tablet_bootstrap.cc:492] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:05.234483 1168 ts_tablet_manager.cc:1397] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.001s
I20260620 07:01:05.235095 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0a4bebaa8ed1431d8c775f4856a3d808
I20260620 07:01:05.223984 871 tablet_service.cc:1467] Processing CreateTablet for tablet f4f77b677ab34d9b8554de0da6564fb1 (DEFAULT_TABLE table=default.Table_30d48f35343d4017b5b3e6750c89d54e [id=fa021110da20405293f8488c41387d6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.224357 868 tablet_service.cc:1467] Processing CreateTablet for tablet 25adb514cb22461bbcbecad7d74e643c (DEFAULT_TABLE table=default.Table_5630d0cf800a45efb1b1bfeee6223c8c [id=4e2e330e40cb46e4808077e2218ddb33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.235545 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf912f51bfd4df0afe7aa28815a897e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.226310 863 tablet_service.cc:1467] Processing CreateTablet for tablet 2064ec0e35d645e3ae419e8e7c4e075b (DEFAULT_TABLE table=default.Table_8b276cfc9d2142e7ad6a104d5bd40f82 [id=097de6dee18b4e1598db3520f2af2eb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.231534 859 tablet_service.cc:1467] Processing CreateTablet for tablet ebd9df1a33ed4e7b997a386158460a9a (DEFAULT_TABLE table=default.Table_4c8103aba31e41f88c025b32b20b15a9 [id=4d639c68ca2d4fb88b4cfda6bd78b1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.236042 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74eaa712962245b4bb14d17e4cdd8485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.236841 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4bebaa8ed1431d8c775f4856a3d808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.236207 1168 raft_consensus.cc:348] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.237412 1168 raft_consensus.cc:374] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.237620 1168 raft_consensus.cc:729] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.237545 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1a6e98a083e841e1bd8235e1e5e41c13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:05.237689 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_693c3c64a7de410fb1d0dae423a1db82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.238108 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a6e98a083e841e1bd8235e1e5e41c13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:05.238214 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_693c3c64a7de410fb1d0dae423a1db82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.238194 1168 consensus_queue.cc:260] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.239833 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4c8103aba31e41f88c025b32b20b15a9" } new_table_name: "default.Table_f8464cf5d3234e4e9193a822df5bd7c2" modify_external_catalogs: true
I20260620 07:01:05.241191 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 88c01c4e10f345fc84e3e253e8501aff
I20260620 07:01:05.241662 426 catalog_manager.cc:6565] ReplaceTablet: tablet 88c01c4e10f345fc84e3e253e8501aff deleted and replaced by tablet 6363d1d9233d4938ba40abff452ed147
I20260620 07:01:05.242384 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c01c4e10f345fc84e3e253e8501aff with delete_type TABLET_DATA_DELETED (replaced by tablet 6363d1d9233d4938ba40abff452ed147) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.222856 1166 rpcz_store.cc:276] 0620 07:00:58.766802 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.767622 (+ 820us) service_pool.cc:227] Handling call
0620 07:01:04.089346 (+5321724us) ts_tablet_manager.cc:1145] Deleting tablet f90f1b2facc0415ab378fb81b60b0202
0620 07:01:04.089358 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:04.612038 (+522680us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:04.984297 (+372259us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.145323 (+161026us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5321548}
I20260620 07:01:05.243188 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f47c6b7062e648bd993fda56ffcc9035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.243338 1168 ts_tablet_manager.cc:1428] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20260620 07:01:05.244107 1168 tablet_bootstrap.cc:492] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:05.244534 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e37f336c01974ba79caeb25f4781667a
I20260620 07:01:05.244544 1165 log.cc:1196] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/2906fe0a195149d2844232cc8d83f6dd
I20260620 07:01:05.245720 865 tablet_service.cc:1514] Processing DeleteTablet for tablet e37f336c01974ba79caeb25f4781667a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.245950 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 360880717af145628606b5b9fb26e350 with delete_type TABLET_DATA_DELETED (replaced by tablet 2910da33bbdb4410a4a90ff9747a7de1) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.242595 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b405207e53ca410c8533a25dc80500c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.247666 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b405207e53ca410c8533a25dc80500c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.249396 864 tablet_service.cc:1467] Processing CreateTablet for tablet e6881c5b6560467c8b8e52777976b5da (DEFAULT_TABLE table=default.Table_71e114b78b5540daa771e5ade0eacfa7 [id=0e3333a9436d45598a6aa06202edb510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.249609 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1252d1dd03bd4a27983eb89d489b09d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.250746 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba189cfcef094a7bb45bc7d5f4ee5b71 consensus state has no leader
I20260620 07:01:05.251994 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f77b677ab34d9b8554de0da6564fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.252408 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7524821997e64917849656060aaa706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.252942 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6881c5b6560467c8b8e52777976b5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.255743 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b4ee5c79e2a6419ea3847cbebdeced79
I20260620 07:01:05.256206 420 catalog_manager.cc:6565] ReplaceTablet: tablet b4ee5c79e2a6419ea3847cbebdeced79 deleted and replaced by tablet 63525282e222490687713a92e5371a5c
I20260620 07:01:05.259078 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f96688ac7c91450cb34afd5f40b9826c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.259593 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ebd9df1a33ed4e7b997a386158460a9a consensus state has no leader
I20260620 07:01:05.259624 865 tablet_service.cc:1467] Processing CreateTablet for tablet 6801c84abfa54f6983fae4b66aca8fd0 (DEFAULT_TABLE table=default.Table_fd8858b58d1247d18cfbf9919c0e4599 [id=6cd4da45bfa24c749aa08a4d4ce7f7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.259774 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b2f703e512b443a1a6f0fa0ad1a613cd" } new_table_name: "default.Table_1b34f21beb944ba6a991b5bf4a8acecd" modify_external_catalogs: true
I20260620 07:01:05.260017 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6801c84abfa54f6983fae4b66aca8fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.261644 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bbe98e8af16648f59625ce1445554535"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.262584 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbe98e8af16648f59625ce1445554535 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.262650 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 169b93c38e59435db218152f2d25bdfa with delete_type TABLET_DATA_DELETED (replaced by tablet 5a4390225af348f89c934f0f179ddab5) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.262951 1166 tablet_replica.cc:330] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:05.262948 874 tablet_service.cc:1514] Processing DeleteTablet for tablet b4ee5c79e2a6419ea3847cbebdeced79 with delete_type TABLET_DATA_DELETED (replaced by tablet 63525282e222490687713a92e5371a5c) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.263460 876 tablet_service.cc:1467] Processing CreateTablet for tablet b9736d57fe0e4edea762508fe0a8d2a5 (DEFAULT_TABLE table=default.Table_8cec159b248a44ed97cd71cca66c5e9c [id=eaa024e7fc254777b8ed67fd19a9747f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.263890 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9736d57fe0e4edea762508fe0a8d2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.264420 1166 raft_consensus.cc:2229] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:05.264628 1166 raft_consensus.cc:2258] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.265396 1166 ts_tablet_manager.cc:1905] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:05.266284 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6102e0da4e42cd9f1d6e294bb372b2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:05.266569 1029 raft_consensus.cc:3037] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:05.267527 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_00e67719a51b46eaa7a48b31c052cd48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.268095 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00e67719a51b46eaa7a48b31c052cd48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.270298 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebd9df1a33ed4e7b997a386158460a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.272665 1167 tablet_bootstrap.cc:654] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:05.279284 874 tablet_service.cc:1467] Processing CreateTablet for tablet a4e8c06f3f8544ecafb63dd7d04fdf05 (DEFAULT_TABLE table=default.Table_acc2e2a41f234841944aefbc998c1680 [id=af10c4d2a07c4903b72cd142200e6ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.279726 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4e8c06f3f8544ecafb63dd7d04fdf05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.283347 872 tablet_service.cc:1467] Processing CreateTablet for tablet 60dc050958574863bae5e7c59acaa774 (DEFAULT_TABLE table=default.Table_2d068c58b71c4076a78a31fcade380a2 [id=16cff34b08004d66a232d6c916330c08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.283718 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60dc050958574863bae5e7c59acaa774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.287520 862 tablet_service.cc:1467] Processing CreateTablet for tablet 2584a6d508594c86a152889ab55197d8 (DEFAULT_TABLE table=default.Table_02d02883b6c246c780aa0e2d912752f2 [id=276b72804fd7409ea0795821889ea1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.287879 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2584a6d508594c86a152889ab55197d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.291524 861 tablet_service.cc:1467] Processing CreateTablet for tablet c9ad0680f1da4504b87d9d0d6bcbabcb (DEFAULT_TABLE table=default.Table_550044437fae426dbb1eb8da5c11d8aa [id=705e854b1bf64885a91d9d1e8d58311d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.291891 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9ad0680f1da4504b87d9d0d6bcbabcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.298200 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2064ec0e35d645e3ae419e8e7c4e075b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.298200 1170 tablet_bootstrap.cc:654] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:05.299991 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25adb514cb22461bbcbecad7d74e643c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.307801 730 tablet_service.cc:1514] Processing DeleteTablet for tablet ee90d961729b4088b0a312ec770d3cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.308274 1169 ts_tablet_manager.cc:1939] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:05.312038 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_35e279985d0c48b7b6580e1b957d3f39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:05.312083 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6dd60e60eca84824bb10e0a321dffea3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.312718 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35e279985d0c48b7b6580e1b957d3f39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.314086 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_542fe82ba52d4ad88f324849a55d8fcf" } new_table_name: "default.Table_0f5c2e042dec4b52aa9b18147d48ae6e" modify_external_catalogs: true
I20260620 07:01:05.315569 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8695fa2e62c845d880e1a60f491b9e4d" } new_table_name: "default.Table_5f9fe9ba01454a26b0b7344560204fbe" modify_external_catalogs: true
I20260620 07:01:05.318714 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4b7e17645fdf4c208b6835b845042836"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.319339 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b7e17645fdf4c208b6835b845042836 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.320779 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d61cbca81442407483975e8c14052c7c" } modify_external_catalogs: true
I20260620 07:01:05.320994 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d61cbca81442407483975e8c14052c7c" } modify_external_catalogs: true
I20260620 07:01:05.325613 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b6b971bcac4546f18c57e342e7f4c804" } modify_external_catalogs: true
I20260620 07:01:05.325881 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b6b971bcac4546f18c57e342e7f4c804" } modify_external_catalogs: true
W20260620 07:01:05.312721 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dd60e60eca84824bb10e0a321dffea3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.329433 730 tablet_service.cc:1467] Processing CreateTablet for tablet 2064ec0e35d645e3ae419e8e7c4e075b (DEFAULT_TABLE table=default.Table_8b276cfc9d2142e7ad6a104d5bd40f82 [id=097de6dee18b4e1598db3520f2af2eb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.329429 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 447) took 1132 ms. Trace:
I20260620 07:01:05.331254 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2064ec0e35d645e3ae419e8e7c4e075b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.333623 1169 rpcz_store.cc:276] 0620 07:01:04.176666 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.176728 (+ 62us) service_pool.cc:227] Handling call
0620 07:01:04.958933 (+782205us) ts_tablet_manager.cc:1145] Deleting tablet d17c49eecec741cdbd592c94b7f84c67
0620 07:01:04.958940 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.022356 (+ 63416us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.121276 (+ 98920us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.308797 (+187521us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":781963}
I20260620 07:01:05.347159 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5d2a4e7b8377498685861a195b5c2401" } modify_external_catalogs: true
I20260620 07:01:05.347456 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5d2a4e7b8377498685861a195b5c2401" } modify_external_catalogs: true
I20260620 07:01:05.353205 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d17c49eecec741cdbd592c94b7f84c67" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:05.360522 1168 tablet_bootstrap.cc:654] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:05.362058 1167 tablet_bootstrap.cc:492] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:05.362358 1167 ts_tablet_manager.cc:1397] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.142s user 0.001s sys 0.004s
I20260620 07:01:05.363688 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c2f865b06ca4b9c8fc9d8d0b4aa0dad" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:05.364770 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95f9a6b2f2cb41e6b74715b2618d8a70" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:05.380988 721 tablet_service.cc:1467] Processing CreateTablet for tablet ebd9df1a33ed4e7b997a386158460a9a (DEFAULT_TABLE table=default.Table_4c8103aba31e41f88c025b32b20b15a9 [id=4d639c68ca2d4fb88b4cfda6bd78b1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.381424 1165 ts_tablet_manager.cc:1939] T 2906fe0a195149d2844232cc8d83f6dd P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:05.381932 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 280) took 5013 ms. Trace:
I20260620 07:01:05.382143 1165 rpcz_store.cc:276] 0620 07:01:00.368361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:00.965528 (+597167us) service_pool.cc:227] Handling call
0620 07:01:05.168403 (+4202875us) ts_tablet_manager.cc:1145] Deleting tablet 2906fe0a195149d2844232cc8d83f6dd
0620 07:01:05.168415 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.197973 (+ 29558us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.216805 (+ 18832us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.381884 (+165079us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4202605}
I20260620 07:01:05.382983 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "076926f7dffe4a7b80c25ea3c18e9958" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:05.383711 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 2906fe0a195149d2844232cc8d83f6dd (table default.Table_06b2bcb778eb4444828c3050a4ed47ec [id=f12e60a2a8a341c8b574d0dc90fa315a]) successfully deleted
I20260620 07:01:05.383798 732 tablet_service.cc:1467] Processing CreateTablet for tablet f4f77b677ab34d9b8554de0da6564fb1 (DEFAULT_TABLE table=default.Table_30d48f35343d4017b5b3e6750c89d54e [id=fa021110da20405293f8488c41387d6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.384310 1169 tablet_replica.cc:330] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:05.384558 1169 raft_consensus.cc:2229] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:05.384749 1169 raft_consensus.cc:2258] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.385318 1169 ts_tablet_manager.cc:1905] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:05.386864 716 tablet_service.cc:1467] Processing CreateTablet for tablet e6881c5b6560467c8b8e52777976b5da (DEFAULT_TABLE table=default.Table_71e114b78b5540daa771e5ade0eacfa7 [id=0e3333a9436d45598a6aa06202edb510]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:05.387192 681 leader_election.cc:341] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.387356 681 leader_election.cc:302] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:05.387562 681 raft_consensus.cc:2670] T add9e860802d4edebcfbc9fa3c4a6b24 P 2b84cae646b24bc7bd424eb8434ad425: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:05.388242 681 leader_election.cc:341] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.388370 681 leader_election.cc:302] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:05.389142 1556 raft_consensus.cc:2726] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:05.390177 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4bebaa8ed1431d8c775f4856a3d808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.394855 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c01c4e10f345fc84e3e253e8501aff with delete_type TABLET_DATA_DELETED (replaced by tablet 6363d1d9233d4938ba40abff452ed147) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.395437 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f77b677ab34d9b8554de0da6564fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.398375 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebd9df1a33ed4e7b997a386158460a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.403388 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 286) took 4984 ms. Trace:
W20260620 07:01:05.404383 681 leader_election.cc:341] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.404608 681 leader_election.cc:302] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:05.404817 681 raft_consensus.cc:2670] T d17c49eecec741cdbd592c94b7f84c67 P 2b84cae646b24bc7bd424eb8434ad425: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:05.405881 681 leader_election.cc:341] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.406049 681 leader_election.cc:302] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:05.406323 1556 raft_consensus.cc:2726] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:05.406728 681 leader_election.cc:341] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.406920 681 leader_election.cc:302] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:05.407158 1556 raft_consensus.cc:2726] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:05.407539 1165 rpcz_store.cc:276] 0620 07:01:00.419279 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.487836 (+1068557us) service_pool.cc:227] Handling call
0620 07:01:05.403177 (+3915341us) ts_tablet_manager.cc:1145] Deleting tablet 261f0d97e1084e828b9562cb30ea422b
0620 07:01:05.403192 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.403330 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3891230}
I20260620 07:01:05.408283 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 287) took 4966 ms. Trace:
W20260620 07:01:05.409833 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f591ba26b91b47f9a8933878d478655d consensus state has no leader
I20260620 07:01:05.410998 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e14db4e3394046e49ecc69c9ca4dc840
W20260620 07:01:05.412358 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 261f0d97e1084e828b9562cb30ea422b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 261f0d97e1084e828b9562cb30ea422b already in progress: creating tablet
I20260620 07:01:05.412776 868 tablet_service.cc:1514] Processing DeleteTablet for tablet e14db4e3394046e49ecc69c9ca4dc840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.414134 1700 raft_consensus.cc:482] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 978f112862c64141b1009856bef3d624)
W20260620 07:01:05.414405 968 leader_election.cc:341] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 81704d3a3cf648d987d4b40a270f7508
I20260620 07:01:05.408439 1165 rpcz_store.cc:276] 0620 07:01:00.441484 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.511980 (+1070496us) service_pool.cc:227] Handling call
0620 07:01:05.408079 (+3896099us) ts_tablet_manager.cc:1145] Deleting tablet e5b6c578055d4f95b44c85eba8e92ac8
0620 07:01:05.408092 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.408212 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3895850}
I20260620 07:01:05.415714 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 288) took 4970 ms. Trace:
I20260620 07:01:05.415838 1165 rpcz_store.cc:276] 0620 07:01:00.445169 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.512243 (+1067074us) service_pool.cc:227] Handling call
0620 07:01:05.415495 (+3903252us) ts_tablet_manager.cc:1145] Deleting tablet b5e08a38c42d4e3da20292343bf085b9
0620 07:01:05.415508 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.415651 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3861886}
I20260620 07:01:05.416414 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 301) took 3741 ms. Trace:
I20260620 07:01:05.416536 1165 rpcz_store.cc:276] 0620 07:01:01.675171 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.690745 (+ 15574us) service_pool.cc:227] Handling call
0620 07:01:05.416227 (+3725482us) ts_tablet_manager.cc:1145] Deleting tablet 0c51ecf0f006400597f0e7f776698854
0620 07:01:05.416238 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.416362 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3679735}
I20260620 07:01:05.417042 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 302) took 3741 ms. Trace:
I20260620 07:01:05.417150 1165 rpcz_store.cc:276] 0620 07:01:01.675372 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.736030 (+ 60658us) service_pool.cc:227] Handling call
0620 07:01:05.416886 (+3680856us) ts_tablet_manager.cc:1145] Deleting tablet da1e30385ed44c7f8b7db868f2e2bc29
0620 07:01:05.416898 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.416987 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3673014}
I20260620 07:01:05.417582 1165 tablet_replica.cc:330] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:05.417834 1165 raft_consensus.cc:2229] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:05.418057 1165 raft_consensus.cc:2258] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.418727 1165 ts_tablet_manager.cc:1905] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:05.422655 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e5b6c578055d4f95b44c85eba8e92ac8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5b6c578055d4f95b44c85eba8e92ac8 already in progress: creating tablet
W20260620 07:01:05.424206 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b5e08a38c42d4e3da20292343bf085b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e08a38c42d4e3da20292343bf085b9 already in progress: creating tablet
W20260620 07:01:05.424443 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0c51ecf0f006400597f0e7f776698854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c51ecf0f006400597f0e7f776698854 already in progress: creating tablet
W20260620 07:01:05.424683 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet da1e30385ed44c7f8b7db868f2e2bc29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da1e30385ed44c7f8b7db868f2e2bc29 already in progress: creating tablet
I20260620 07:01:05.431318 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
I20260620 07:01:05.420663 717 tablet_service.cc:1467] Processing CreateTablet for tablet 25adb514cb22461bbcbecad7d74e643c (DEFAULT_TABLE table=default.Table_5630d0cf800a45efb1b1bfeee6223c8c [id=4e2e330e40cb46e4808077e2218ddb33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.438045 1740 raft_consensus.cc:482] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:05.438241 1740 raft_consensus.cc:504] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.439114 1740 leader_election.cc:288] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:05.439703 1167 raft_consensus.cc:348] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.440455 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_16bc98530ef6482fbf02e2aa78c0ea47" } modify_external_catalogs: true
I20260620 07:01:05.440716 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_16bc98530ef6482fbf02e2aa78c0ea47" } modify_external_catalogs: true
I20260620 07:01:05.441274 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6881c5b6560467c8b8e52777976b5da. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.442036 831 leader_election.cc:341] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e7d1e4719cd441dd8054b24861cbd8a2
I20260620 07:01:05.442619 865 tablet_service.cc:1467] Processing CreateTablet for tablet 7c761bb09032495c9a2f5d00e1b90902 (DEFAULT_TABLE table=default.Table_8f93b40f12a1469283e48666d1dd1899 [id=2e4563579e64448285b230bfb1507314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.443169 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c761bb09032495c9a2f5d00e1b90902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.444830 725 tablet_service.cc:1514] Processing DeleteTablet for tablet e37f336c01974ba79caeb25f4781667a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.445232 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8b8659e903084f15ac3d9ea8c4c0dc0f
I20260620 07:01:05.446233 871 tablet_service.cc:1467] Processing CreateTablet for tablet 366d713325f84c8b9b1c1f4296513a20 (DEFAULT_TABLE table=default.Table_1a6e98a083e841e1bd8235e1e5e41c13 [id=43135b18d0f9495db5027eb383f116ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.449200 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 366d713325f84c8b9b1c1f4296513a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.449023 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e700feb0fae94a1d9e1308852c2c3204"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.449653 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e700feb0fae94a1d9e1308852c2c3204 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.449705 1169 ts_tablet_manager.cc:1918] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:05.449869 1169 log.cc:1196] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/e2b0faf91f2f469f9b06e17caa4709e4
I20260620 07:01:05.450491 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25adb514cb22461bbcbecad7d74e643c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.450901 1169 ts_tablet_manager.cc:1939] T e2b0faf91f2f469f9b06e17caa4709e4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:05.450927 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d980ceff63f447adbc0aaf600b24f40e" } modify_external_catalogs: true
I20260620 07:01:05.451102 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d980ceff63f447adbc0aaf600b24f40e" } modify_external_catalogs: true
I20260620 07:01:05.452966 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.453155 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 448) took 1275 ms. Trace:
I20260620 07:01:05.453192 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_82f52a84b6a04edea83f64b1e1ac450f" } new_table_name: "default.Table_f6a689e10be0434aab6444ff3a1be58f" modify_external_catalogs: true
I20260620 07:01:05.453953 1169 rpcz_store.cc:276] 0620 07:01:04.177203 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.177253 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:05.334272 (+1157019us) ts_tablet_manager.cc:1145] Deleting tablet e2b0faf91f2f469f9b06e17caa4709e4
0620 07:01:05.334285 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.389019 (+ 54734us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.445199 (+ 56180us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.453108 (+ 7909us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1156842}
I20260620 07:01:05.454433 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 449) took 1276 ms. Trace:
I20260620 07:01:05.455124 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet af743ffd2eb2427caa3779c7fceb8f30
I20260620 07:01:05.454957 1169 rpcz_store.cc:276] 0620 07:01:04.177584 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.177628 (+ 44us) service_pool.cc:227] Handling call
0620 07:01:05.454272 (+1276644us) ts_tablet_manager.cc:1145] Deleting tablet ed69a44c466047d298cf7653b2a2bb23
0620 07:01:05.454283 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.454390 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1276470}
I20260620 07:01:05.457015 859 tablet_service.cc:1514] Processing DeleteTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.457602 863 tablet_service.cc:1467] Processing CreateTablet for tablet 94e5ddcaf596455289fab50876c27dce (DEFAULT_TABLE table=default.Table_693c3c64a7de410fb1d0dae423a1db82 [id=6265dba2499046b3adf58dd879a3ae94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.458098 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e5ddcaf596455289fab50876c27dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.460211 725 tablet_service.cc:1514] Processing DeleteTablet for tablet b4ee5c79e2a6419ea3847cbebdeced79 with delete_type TABLET_DATA_DELETED (replaced by tablet 63525282e222490687713a92e5371a5c) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.460695 1169 tablet_replica.cc:330] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:05.460634 733 tablet_service.cc:1467] Processing CreateTablet for tablet a4e8c06f3f8544ecafb63dd7d04fdf05 (DEFAULT_TABLE table=default.Table_acc2e2a41f234841944aefbc998c1680 [id=af10c4d2a07c4903b72cd142200e6ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.461741 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_18733b0223c04573a9214aa964d79868" } new_table_name: "default.Table_8623961b53aa4dadb03edf663b16790f" modify_external_catalogs: true
I20260620 07:01:05.462356 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4e8c06f3f8544ecafb63dd7d04fdf05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.463105 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8df661d9c23f459f8fb05bfa5f7455cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.463649 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8df661d9c23f459f8fb05bfa5f7455cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.464221 727 tablet_service.cc:1467] Processing CreateTablet for tablet b9736d57fe0e4edea762508fe0a8d2a5 (DEFAULT_TABLE table=default.Table_8cec159b248a44ed97cd71cca66c5e9c [id=eaa024e7fc254777b8ed67fd19a9747f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.464938 730 tablet_service.cc:1467] Processing CreateTablet for tablet 6801c84abfa54f6983fae4b66aca8fd0 (DEFAULT_TABLE table=default.Table_fd8858b58d1247d18cfbf9919c0e4599 [id=6cd4da45bfa24c749aa08a4d4ce7f7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.465163 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4308d1a5bec34588844920fa89a5db26
I20260620 07:01:05.465284 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9736d57fe0e4edea762508fe0a8d2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.465723 1169 raft_consensus.cc:2229] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:05.466619 1029 raft_consensus.cc:2454] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:05.461454 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_68c627af3b814440b64be782c7fbf9d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:05.466825 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 4308d1a5bec34588844920fa89a5db26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:05.467118 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68c627af3b814440b64be782c7fbf9d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.462059 1700 raft_consensus.cc:504] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.466102 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6801c84abfa54f6983fae4b66aca8fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.468730 725 tablet_service.cc:1467] Processing CreateTablet for tablet 60dc050958574863bae5e7c59acaa774 (DEFAULT_TABLE table=default.Table_2d068c58b71c4076a78a31fcade380a2 [id=16cff34b08004d66a232d6c916330c08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.471725 859 tablet_service.cc:1467] Processing CreateTablet for tablet 4308d1a5bec34588844920fa89a5db26 (DEFAULT_TABLE table=default.Table_d61cbca81442407483975e8c14052c7c [id=8c778abeddf84d769658851ce065ae6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.472165 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4308d1a5bec34588844920fa89a5db26. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.472148 968 consensus_peers.cc:487] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e643fb0890042ae891ea17f0bc03740. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:05.472470 1700 leader_election.cc:288] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:05.472580 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 57369.8us
I20260620 07:01:05.473079 968 leader_election.cc:302] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:05.473039 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7681a9fcfe6a48a5aa3028d8c9113a73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.473543 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7681a9fcfe6a48a5aa3028d8c9113a73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.474867 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7eed72568334415b993b78f401667ed1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.475330 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7eed72568334415b993b78f401667ed1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.477505 1169 raft_consensus.cc:2258] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.477525 862 tablet_service.cc:1467] Processing CreateTablet for tablet 98544574a8cd4a86a443284a421fa030 (DEFAULT_TABLE table=default.Table_429cabf4e04f4125b89d28e55eca678b [id=f31a91ff5fe241a1832414544e7a1e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.478003 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98544574a8cd4a86a443284a421fa030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.479518 1751 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:05.480325 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 74eaa712962245b4bb14d17e4cdd8485
I20260620 07:01:05.480515 1699 raft_consensus.cc:2781] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:05.480611 1699 raft_consensus.cc:482] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:05.481359 1699 raft_consensus.cc:3037] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:05.482044 864 tablet_service.cc:1467] Processing CreateTablet for tablet 0efec7113a5b44f296e756dde466b82f (DEFAULT_TABLE table=default.Table_c13cafc124f94c058d2948e4fe3c0181 [id=d11bf5ad91be4b09a15ba6209fadc0a1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:05.482461 968 consensus_peers.cc:487] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04d5d361a5404dcf99a89e93ac1f7dd8. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:05.482574 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0efec7113a5b44f296e756dde466b82f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.485508 968 leader_election.cc:341] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 81704d3a3cf648d987d4b40a270f7508
I20260620 07:01:05.487105 872 tablet_service.cc:1467] Processing CreateTablet for tablet 63525282e222490687713a92e5371a5c (DEFAULT_TABLE table=default.Table_34eaeb05ad0243cb9f083eb279a8ba73 [id=5a23c89228964939bd74b5079dd25881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.487567 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63525282e222490687713a92e5371a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.487468 1167 raft_consensus.cc:374] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.489739 1167 raft_consensus.cc:729] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.490450 1167 consensus_queue.cc:260] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.491811 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 74eaa712962245b4bb14d17e4cdd8485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.492391 861 tablet_service.cc:1467] Processing CreateTablet for tablet 3e9f0dba4466436f9cfc730d7d6b15fe (DEFAULT_TABLE table=default.Table_c7e0c2dc28504b13aeb390e85111eb8b [id=1f708b0c52784e3383504a658162e388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.492871 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e9f0dba4466436f9cfc730d7d6b15fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.495842 1167 ts_tablet_manager.cc:1428] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.133s user 0.001s sys 0.001s
I20260620 07:01:05.496691 876 tablet_service.cc:1467] Processing CreateTablet for tablet 6363d1d9233d4938ba40abff452ed147 (DEFAULT_TABLE table=default.Table_1e18ab4a35f347abb061df0a7db49226 [id=3234298ef6b649e78f3c7c7c61facd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.497237 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6363d1d9233d4938ba40abff452ed147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.499341 1167 tablet_bootstrap.cc:492] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:05.501163 1167 tablet_bootstrap.cc:654] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:05.504112 1699 raft_consensus.cc:504] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.506070 1699 leader_election.cc:288] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:05.506002 874 tablet_service.cc:1467] Processing CreateTablet for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 (DEFAULT_TABLE table=default.Table_cddcca7b8f8e497ab1dceca5e0526472 [id=3c2845d9079d44cfb032d8db71865d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.506453 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.511310 1751 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 435) took 1201 ms. Trace:
I20260620 07:01:05.511808 1751 rpcz_store.cc:276] 0620 07:01:04.309745 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.309857 (+ 112us) service_pool.cc:227] Handling call
0620 07:01:05.511271 (+1201414us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:04.324541 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:04.324657 (+ 116us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:04.324669 (+ 12us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:04.324678 (+ 9us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:04.324725 (+ 47us) alter_schema_op.cc:126] START. Timestamp: 1781938864324652
0620 07:01:04.324731 (+ 6us) op_driver.cc:331] REPLICATION: starting
0620 07:01:04.324942 (+ 211us) log.cc:842] Serialized 173 byte log entry
0620 07:01:05.169038 (+844096us) op_driver.cc:444] REPLICATION: finished
0620 07:01:05.478715 (+309677us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:05.480378 (+ 1663us) log.cc:842] Serialized 5 byte log entry
0620 07:01:05.510034 (+ 29656us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.510985 (+ 951us) log.cc:842] Serialized 14 byte log entry
0620 07:01:05.511230 (+ 245us) alter_schema_op.cc:71] Released schema lock
0620 07:01:05.511233 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":309612,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":18261,"prepare.run_wall_time_us":315747,"raft.queue_time_us":270,"raft.run_cpu_time_us":656,"raft.run_wall_time_us":39657,"replication_time_us":844282,"thread_start_us":315173,"threads_started":2,"wal-append.queue_time_us":395875}]]}
I20260620 07:01:05.513880 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60dc050958574863bae5e7c59acaa774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.517562 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4u_93S/build/asan/bin/kudu pid 466
I20260620 07:01:05.519352 868 tablet_service.cc:1467] Processing CreateTablet for tablet fa0b581de06149cf93b469a4a095573b (DEFAULT_TABLE table=default.Table_b405207e53ca410c8533a25dc80500c3 [id=c50f0d7c6505470e8b319c5f41bc25b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.519670 1170 tablet_bootstrap.cc:492] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:01:05.521804 968 leader_election.cc:341] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 33517843ce1d4d8786c91fd738d81ab2
I20260620 07:01:05.522075 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa0b581de06149cf93b469a4a095573b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.522188 681 leader_election.cc:341] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.523856 1166 ts_tablet_manager.cc:1918] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:05.523998 1166 log.cc:1196] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/e275d82068074370ba1e32b7ca5fdcc3
I20260620 07:01:05.524420 1166 ts_tablet_manager.cc:1939] T e275d82068074370ba1e32b7ca5fdcc3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:05.525362 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 176) took 6743 ms. Trace:
I20260620 07:01:05.525511 1166 rpcz_store.cc:276] 0620 07:00:58.781904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.782138 (+ 234us) service_pool.cc:227] Handling call
0620 07:01:05.242700 (+6460562us) ts_tablet_manager.cc:1145] Deleting tablet e275d82068074370ba1e32b7ca5fdcc3
0620 07:01:05.242711 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.438667 (+195956us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.523697 (+ 85030us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.525307 (+ 1610us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6460338}
I20260620 07:01:05.525969 1166 tablet_replica.cc:330] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:05.526279 1166 raft_consensus.cc:2229] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:05.526533 1166 raft_consensus.cc:2258] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.527313 1166 ts_tablet_manager.cc:1905] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:05.527678 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 305886us
I20260620 07:01:05.528141 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_50f2cabde77d417caa731bf4e56f48c8" } new_table_name: "default.Table_5fbe6fc81d864458b668001f7b6af936" modify_external_catalogs: true
I20260620 07:01:05.530099 721 tablet_service.cc:1467] Processing CreateTablet for tablet c9ad0680f1da4504b87d9d0d6bcbabcb (DEFAULT_TABLE table=default.Table_550044437fae426dbb1eb8da5c11d8aa [id=705e854b1bf64885a91d9d1e8d58311d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.530651 1169 ts_tablet_manager.cc:1905] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:05.531574 969 leader_election.cc:302] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:05.532078 1699 raft_consensus.cc:2781] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:05.532289 1699 raft_consensus.cc:686] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:05.532620 1699 consensus_queue.cc:237] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.534302 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_09c477fbf2554f3ab6ef8b993467e7a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.535069 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09c477fbf2554f3ab6ef8b993467e7a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:05.539407 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 967cc8f19ad64278910c86ffc4cb3ed2 consensus state has no leader
I20260620 07:01:05.543653 1170 ts_tablet_manager.cc:1397] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.406s user 0.002s sys 0.013s
I20260620 07:01:05.543742 715 tablet_service.cc:1467] Processing CreateTablet for tablet 2584a6d508594c86a152889ab55197d8 (DEFAULT_TABLE table=default.Table_02d02883b6c246c780aa0e2d912752f2 [id=276b72804fd7409ea0795821889ea1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.544142 1744 raft_consensus.cc:482] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:05.544322 1744 raft_consensus.cc:504] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.547322 1744 leader_election.cc:288] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:05.557776 426 master_service.cc:946] ReplaceTablet: received request to replace tablet 91f8c4955c164e6b9061ac607bbe081c from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:05.561673 1168 tablet_bootstrap.cc:492] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
W20260620 07:01:05.561827 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06fd96feb4a74b9f8d3243b7d774f388 consensus state has no leader
I20260620 07:01:05.561882 1168 ts_tablet_manager.cc:1397] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.318s user 0.002s sys 0.002s
I20260620 07:01:05.542809 681 leader_election.cc:302] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:05.542675 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e54f1185cd4c5c8e5d2ed289b61650" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:05.562762 1168 raft_consensus.cc:348] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.563303 1168 raft_consensus.cc:374] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.563400 1168 raft_consensus.cc:729] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.563450 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9ad0680f1da4504b87d9d0d6bcbabcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.563647 1168 consensus_queue.cc:260] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.566082 1168 ts_tablet_manager.cc:1428] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 07:01:05.566370 1168 tablet_bootstrap.cc:492] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:05.567986 1168 tablet_bootstrap.cc:654] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:05.573967 419 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 6 got 4
W20260620 07:01:05.575259 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 43755.3us
I20260620 07:01:05.588641 734 tablet_service.cc:1514] Processing DeleteTablet for tablet e14db4e3394046e49ecc69c9ca4dc840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.589774 753 raft_consensus.cc:3037] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:05.593333 393 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 48688us
I20260620 07:01:05.597723 876 tablet_service.cc:1467] Processing CreateTablet for tablet 61505e5cabdf4d7d9dcf1ccd79067e64 (DEFAULT_TABLE table=default.Table_4b7e17645fdf4c208b6835b845042836 [id=ee3bf018da6b42c2ae4f603c30a9a49e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.598506 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61505e5cabdf4d7d9dcf1ccd79067e64. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.599722 968 leader_election.cc:341] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 169b93c38e59435db218152f2d25bdfa
I20260620 07:01:05.599901 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2584a6d508594c86a152889ab55197d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.600414 872 tablet_service.cc:1467] Processing CreateTablet for tablet a594df0df6ad48cab77cc1deed22bff0 (DEFAULT_TABLE table=default.Table_35e279985d0c48b7b6580e1b957d3f39 [id=c62b4ce9d4bc4cd1b3d67bb7941b9490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.600829 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a594df0df6ad48cab77cc1deed22bff0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.601040 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 76655.5us
I20260620 07:01:05.605798 874 tablet_service.cc:1467] Processing CreateTablet for tablet 890aeebaed044b9c9a0a207be0b1f69d (DEFAULT_TABLE table=default.Table_6dd60e60eca84824bb10e0a321dffea3 [id=59ac6620df09427595736aa4e4254cdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.606456 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 890aeebaed044b9c9a0a207be0b1f69d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.610075 865 tablet_service.cc:1467] Processing CreateTablet for tablet 1d7cec62aea048d3bbe38ab2f83f7656 (DEFAULT_TABLE table=default.Table_00e67719a51b46eaa7a48b31c052cd48 [id=8fd0ee8e204148e091d4b9863f7a76b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.611024 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d7cec62aea048d3bbe38ab2f83f7656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.611766 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a1fa87d2ca544da28827f34c9879e744"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.612493 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1fa87d2ca544da28827f34c9879e744 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.614560 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5716ccac487c4d4296da6cdd2d2ceeb0" } new_table_name: "default.Table_20581d428c6345ce8216cc2467e7eeef" modify_external_catalogs: true
I20260620 07:01:05.616472 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_80e45984a0114ae6bbe50db3b07da598"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.617131 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80e45984a0114ae6bbe50db3b07da598 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.619771 528 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 07:01:05.620290 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_86b1f7775f464864a09df3e2246d8aa0" } new_table_name: "default.Table_8fedf097ca094cb29465c8f5f76f26bf" modify_external_catalogs: true
I20260620 07:01:05.625227 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8e3e8ef7f6ba41e886e5a8b8f81bb59b" } modify_external_catalogs: true
I20260620 07:01:05.625497 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8e3e8ef7f6ba41e886e5a8b8f81bb59b" } modify_external_catalogs: true
I20260620 07:01:05.626145 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cc17e206f1ef4964a639771377827a78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.626828 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc17e206f1ef4964a639771377827a78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.628675 871 tablet_service.cc:1467] Processing CreateTablet for tablet 588776a580144e679d8a9a240d4a04ea (DEFAULT_TABLE table=default.Table_bbe98e8af16648f59625ce1445554535 [id=ec7f36e983294fc7866a89ba5abbe13a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.631821 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 91f8c4955c164e6b9061ac607bbe081c
I20260620 07:01:05.632311 426 catalog_manager.cc:6565] ReplaceTablet: tablet 91f8c4955c164e6b9061ac607bbe081c deleted and replaced by tablet 0e864cac7431439b9eb18d0cd98a7755
I20260620 07:01:05.633498 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f8c4955c164e6b9061ac607bbe081c with delete_type TABLET_DATA_DELETED (replaced by tablet 0e864cac7431439b9eb18d0cd98a7755) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.634193 734 tablet_service.cc:1467] Processing CreateTablet for tablet 366d713325f84c8b9b1c1f4296513a20 (DEFAULT_TABLE table=default.Table_1a6e98a083e841e1bd8235e1e5e41c13 [id=43135b18d0f9495db5027eb383f116ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.635644 719 tablet_service.cc:1467] Processing CreateTablet for tablet 94e5ddcaf596455289fab50876c27dce (DEFAULT_TABLE table=default.Table_693c3c64a7de410fb1d0dae423a1db82 [id=6265dba2499046b3adf58dd879a3ae94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.635824 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 588776a580144e679d8a9a240d4a04ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.636663 1556 raft_consensus.cc:2726] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:05.639524 733 tablet_service.cc:1467] Processing CreateTablet for tablet 7c761bb09032495c9a2f5d00e1b90902 (DEFAULT_TABLE table=default.Table_8f93b40f12a1469283e48666d1dd1899 [id=2e4563579e64448285b230bfb1507314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.637986 726 tablet_service.cc:1467] Processing CreateTablet for tablet fa0b581de06149cf93b469a4a095573b (DEFAULT_TABLE table=default.Table_b405207e53ca410c8533a25dc80500c3 [id=c50f0d7c6505470e8b319c5f41bc25b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.641670 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.642083 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 366d713325f84c8b9b1c1f4296513a20. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.648317 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0e54f1185cd4c5c8e5d2ed289b61650 consensus state has no leader
I20260620 07:01:05.649132 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_09c477fbf2554f3ab6ef8b993467e7a3" } modify_external_catalogs: true
I20260620 07:01:05.649387 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_09c477fbf2554f3ab6ef8b993467e7a3" } modify_external_catalogs: true
W20260620 07:01:05.654074 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5072c573ce54477881cafb63e18b030 consensus state has no leader
I20260620 07:01:05.655159 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e5ddcaf596455289fab50876c27dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.656670 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0f5c2e042dec4b52aa9b18147d48ae6e" } modify_external_catalogs: true
I20260620 07:01:05.656886 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0f5c2e042dec4b52aa9b18147d48ae6e" } modify_external_catalogs: true
I20260620 07:01:05.637882 1758 raft_consensus.cc:482] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:05.651577 1170 raft_consensus.cc:348] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.641973 729 tablet_service.cc:1514] Processing DeleteTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.661326 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_68f462254d2f4d64a04f93bbfeb6204f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:05.662128 1165 ts_tablet_manager.cc:1918] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:05.662151 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68f462254d2f4d64a04f93bbfeb6204f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.662325 1170 raft_consensus.cc:374] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.662382 1165 log.cc:1196] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/8cb04a2e17f3417aaf0f89f0c7f78159
I20260620 07:01:05.662451 1170 raft_consensus.cc:729] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.665099 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 4308d1a5bec34588844920fa89a5db26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.666936 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b6601757419d4f4fbaa5591d3100a8f7" } modify_external_catalogs: true
I20260620 07:01:05.667212 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b6601757419d4f4fbaa5591d3100a8f7" } modify_external_catalogs: true
I20260620 07:01:05.669080 753 raft_consensus.cc:2454] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:05.656001 723 tablet_service.cc:1467] Processing CreateTablet for tablet 4308d1a5bec34588844920fa89a5db26 (DEFAULT_TABLE table=default.Table_d61cbca81442407483975e8c14052c7c [id=8c778abeddf84d769658851ce065ae6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.670548 968 leader_election.cc:302] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:05.670897 1750 raft_consensus.cc:2781] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:05.671041 1750 raft_consensus.cc:686] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:05.671350 1750 consensus_queue.cc:237] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.674235 1165 ts_tablet_manager.cc:1939] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:05.675393 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet d17c49eecec741cdbd592c94b7f84c67 (table default.Table_e21acc07ea2349cc9a821839ff680062 [id=f28fed67d2244a1694c6688535cc5213]) successfully deleted
I20260620 07:01:05.675846 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet e2b0faf91f2f469f9b06e17caa4709e4 (table default.Table_e31ff399ff5e4a309b29286a69aea7f0 [id=cfbc4dc349434379b3eaabd5dc948327]) successfully deleted
W20260620 07:01:05.676103 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ed69a44c466047d298cf7653b2a2bb23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed69a44c466047d298cf7653b2a2bb23 already in progress: creating tablet
I20260620 07:01:05.676481 728 tablet_service.cc:1467] Processing CreateTablet for tablet 6363d1d9233d4938ba40abff452ed147 (DEFAULT_TABLE table=default.Table_1e18ab4a35f347abb061df0a7db49226 [id=3234298ef6b649e78f3c7c7c61facd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.677173 724 tablet_service.cc:1467] Processing CreateTablet for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 (DEFAULT_TABLE table=default.Table_cddcca7b8f8e497ab1dceca5e0526472 [id=3c2845d9079d44cfb032d8db71865d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.680538 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c761bb09032495c9a2f5d00e1b90902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.681890 729 tablet_service.cc:1467] Processing CreateTablet for tablet 0efec7113a5b44f296e756dde466b82f (DEFAULT_TABLE table=default.Table_c13cafc124f94c058d2948e4fe3c0181 [id=d11bf5ad91be4b09a15ba6209fadc0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.682312 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0efec7113a5b44f296e756dde466b82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.683260 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 304) took 3952 ms. Trace:
I20260620 07:01:05.683290 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_693c3c64a7de410fb1d0dae423a1db82" } modify_external_catalogs: true
I20260620 07:01:05.683388 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 74eaa712962245b4bb14d17e4cdd8485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.683526 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_693c3c64a7de410fb1d0dae423a1db82" } modify_external_catalogs: true
I20260620 07:01:05.683749 731 tablet_service.cc:1467] Processing CreateTablet for tablet 61505e5cabdf4d7d9dcf1ccd79067e64 (DEFAULT_TABLE table=default.Table_4b7e17645fdf4c208b6835b845042836 [id=ee3bf018da6b42c2ae4f603c30a9a49e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.684016 1165 rpcz_store.cc:276] 0620 07:01:01.730814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.743895 (+ 13081us) service_pool.cc:227] Handling call
0620 07:01:05.417485 (+3673590us) ts_tablet_manager.cc:1145] Deleting tablet 8cb04a2e17f3417aaf0f89f0c7f78159
0620 07:01:05.417496 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.635239 (+217743us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.661621 (+ 26382us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.683226 (+ 21605us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3673258}
I20260620 07:01:05.684191 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61505e5cabdf4d7d9dcf1ccd79067e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.684523 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 8cb04a2e17f3417aaf0f89f0c7f78159 (table default.Table_c649dd8a94d74f428ec6a8c9b77288c2 [id=82c73c656d3148df95ac377dfe7f38fd]) successfully deleted
I20260620 07:01:05.684753 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 303) took 4009 ms. Trace:
I20260620 07:01:05.684928 1165 rpcz_store.cc:276] 0620 07:01:01.675513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.736516 (+ 61003us) service_pool.cc:227] Handling call
0620 07:01:05.684535 (+3948019us) ts_tablet_manager.cc:1145] Deleting tablet 35cb81ac0ebd4865b9d53259ed5787d1
0620 07:01:05.684545 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.684716 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3927696}
I20260620 07:01:05.684958 722 tablet_service.cc:1467] Processing CreateTablet for tablet 588776a580144e679d8a9a240d4a04ea (DEFAULT_TABLE table=default.Table_bbe98e8af16648f59625ce1445554535 [id=ec7f36e983294fc7866a89ba5abbe13a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.685381 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 588776a580144e679d8a9a240d4a04ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.685403 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 35cb81ac0ebd4865b9d53259ed5787d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35cb81ac0ebd4865b9d53259ed5787d1 already in progress: creating tablet
I20260620 07:01:05.685581 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 315) took 3891 ms. Trace:
I20260620 07:01:05.686132 718 tablet_service.cc:1467] Processing CreateTablet for tablet 63525282e222490687713a92e5371a5c (DEFAULT_TABLE table=default.Table_34eaeb05ad0243cb9f083eb279a8ba73 [id=5a23c89228964939bd74b5079dd25881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.686304 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8df661d9c23f459f8fb05bfa5f7455cf" } new_table_name: "default.Table_6ebacaa3bdcf4a4b8ffeccfb72d898f3" modify_external_catalogs: true
I20260620 07:01:05.686452 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63525282e222490687713a92e5371a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.686349 1165 rpcz_store.cc:276] 0620 07:01:01.794132 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.856187 (+ 62055us) service_pool.cc:227] Handling call
0620 07:01:05.685368 (+3829181us) ts_tablet_manager.cc:1145] Deleting tablet c2e38178b9244152915d4c0a9dcf59dc
0620 07:01:05.685379 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.685549 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3786091}
I20260620 07:01:05.687409 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.687896 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3ddd49ed6a384706b1b4548a74f18d04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:05.688182 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4308d1a5bec34588844920fa89a5db26. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.688426 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ddd49ed6a384706b1b4548a74f18d04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.688733 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa0b581de06149cf93b469a4a095573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.689589 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6363d1d9233d4938ba40abff452ed147. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.689635 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c2e38178b9244152915d4c0a9dcf59dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2e38178b9244152915d4c0a9dcf59dc already in progress: creating tablet
I20260620 07:01:05.690456 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 319) took 3895 ms. Trace:
I20260620 07:01:05.690757 732 tablet_service.cc:1467] Processing CreateTablet for tablet 3e9f0dba4466436f9cfc730d7d6b15fe (DEFAULT_TABLE table=default.Table_c7e0c2dc28504b13aeb390e85111eb8b [id=1f708b0c52784e3383504a658162e388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.691134 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e9f0dba4466436f9cfc730d7d6b15fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.691867 1165 rpcz_store.cc:276] 0620 07:01:01.794446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.899962 (+105516us) service_pool.cc:227] Handling call
0620 07:01:05.690292 (+3790330us) ts_tablet_manager.cc:1145] Deleting tablet a9daee42d5c748ceaed7dc94f551c0d1
0620 07:01:05.690304 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.690410 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3790134}
I20260620 07:01:05.669591 1758 raft_consensus.cc:504] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.692878 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 320) took 3898 ms. Trace:
W20260620 07:01:05.693156 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a9daee42d5c748ceaed7dc94f551c0d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9daee42d5c748ceaed7dc94f551c0d1 already in progress: creating tablet
I20260620 07:01:05.693344 1165 rpcz_store.cc:276] 0620 07:01:01.794666 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.900156 (+105490us) service_pool.cc:227] Handling call
0620 07:01:05.692757 (+3792601us) ts_tablet_manager.cc:1145] Deleting tablet 9e8cd4ec5619416a8983e1bc1b6b6a09
0620 07:01:05.692768 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.692850 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3792405}
I20260620 07:01:05.694679 1758 leader_election.cc:288] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:05.695338 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b98711dfb114a2985c5153e9b44147a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:05.695438 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 already in progress: creating tablet
I20260620 07:01:05.695722 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b98711dfb114a2985c5153e9b44147a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:05.696146 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 321) took 3895 ms. Trace:
I20260620 07:01:05.696672 1165 rpcz_store.cc:276] 0620 07:01:01.800390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.900360 (+ 99970us) service_pool.cc:227] Handling call
0620 07:01:05.696016 (+3795656us) ts_tablet_manager.cc:1145] Deleting tablet b5014cf5cc70466bafb6921c9d46ba72
0620 07:01:05.696026 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.696118 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3795516}
W20260620 07:01:05.697285 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b5014cf5cc70466bafb6921c9d46ba72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5014cf5cc70466bafb6921c9d46ba72 already in progress: creating tablet
I20260620 07:01:05.697369 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 322) took 3896 ms. Trace:
I20260620 07:01:05.697844 1165 rpcz_store.cc:276] 0620 07:01:01.806295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.900510 (+ 94215us) service_pool.cc:227] Handling call
0620 07:01:05.697262 (+3796752us) ts_tablet_manager.cc:1145] Deleting tablet cd75e318982a4fb9bf28cb35b030642f
0620 07:01:05.697271 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.697342 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3796614}
I20260620 07:01:05.697994 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 5208f3136bcd45579de49b8b10745122 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:05.700882 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 318) took 3906 ms. Trace:
I20260620 07:01:05.693832 1170 consensus_queue.cc:260] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.701476 1165 rpcz_store.cc:276] 0620 07:01:01.794386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.899305 (+104919us) service_pool.cc:227] Handling call
0620 07:01:05.700758 (+3801453us) ts_tablet_manager.cc:1145] Deleting tablet 9b2f0c28057b4534a8a400d1ca7f3991
0620 07:01:05.700768 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.700851 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3753660}
I20260620 07:01:05.702150 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 330) took 3820 ms. Trace:
I20260620 07:01:05.703248 725 tablet_service.cc:1467] Processing CreateTablet for tablet 98544574a8cd4a86a443284a421fa030 (DEFAULT_TABLE table=default.Table_429cabf4e04f4125b89d28e55eca678b [id=f31a91ff5fe241a1832414544e7a1e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.702268 1165 rpcz_store.cc:276] 0620 07:01:01.881383 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.988021 (+106638us) service_pool.cc:227] Handling call
0620 07:01:05.702043 (+3714022us) ts_tablet_manager.cc:1145] Deleting tablet 2bc3dd1306af4e49a9fec197b5740374
0620 07:01:05.702051 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.702120 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3713773}
I20260620 07:01:05.704048 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 331) took 3804 ms. Trace:
W20260620 07:01:05.704177 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet cd75e318982a4fb9bf28cb35b030642f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd75e318982a4fb9bf28cb35b030642f already in progress: creating tablet
W20260620 07:01:05.704425 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9b2f0c28057b4534a8a400d1ca7f3991 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b2f0c28057b4534a8a400d1ca7f3991 already in progress: creating tablet
I20260620 07:01:05.704583 1165 rpcz_store.cc:276] 0620 07:01:01.899506 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.988296 (+ 88790us) service_pool.cc:227] Handling call
0620 07:01:05.703922 (+3715626us) ts_tablet_manager.cc:1145] Deleting tablet 54bb495eea4c49b7ad7bf2300ad0e60a
0620 07:01:05.703931 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.704019 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3715450}
W20260620 07:01:05.704697 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2bc3dd1306af4e49a9fec197b5740374 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bc3dd1306af4e49a9fec197b5740374 already in progress: creating tablet
W20260620 07:01:05.705858 683 leader_election.cc:341] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:05.706019 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 54bb495eea4c49b7ad7bf2300ad0e60a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54bb495eea4c49b7ad7bf2300ad0e60a already in progress: creating tablet
W20260620 07:01:05.706233 681 leader_election.cc:341] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.706530 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 332) took 3790 ms. Trace:
I20260620 07:01:05.706852 1165 rpcz_store.cc:276] 0620 07:01:01.915640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.988493 (+ 72853us) service_pool.cc:227] Handling call
0620 07:01:05.706211 (+3717718us) ts_tablet_manager.cc:1145] Deleting tablet cfff2a14b1184d39bd7ac1091ef749c9
0620 07:01:05.706223 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.706496 (+ 273us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3717396}
I20260620 07:01:05.707448 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 7fc63351f767447c99b819fe7848d381 (table default.Table_e84e884648ed447c91e20b4a2be65197 [id=38f5978d6a7945c9aec7b78d789241ce]). Expected version 3 got 0
W20260620 07:01:05.708283 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet cfff2a14b1184d39bd7ac1091ef749c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfff2a14b1184d39bd7ac1091ef749c9 already in progress: creating tablet
I20260620 07:01:05.708578 1165 tablet_replica.cc:330] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:05.709033 1165 raft_consensus.cc:2229] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:05.710201 871 tablet_service.cc:1467] Processing CreateTablet for tablet d4988c5cbb3a4818bc024da7472b96ff (DEFAULT_TABLE table=default.Table_09c477fbf2554f3ab6ef8b993467e7a3 [id=9ac2668c105e4ef2bf4e90c16bc3a913]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.710749 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4988c5cbb3a4818bc024da7472b96ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.711599 1170 ts_tablet_manager.cc:1428] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.159s user 0.003s sys 0.000s
W20260620 07:01:05.712033 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d9da1b03aae4cd9976109291ea43b4e consensus state has no leader
I20260620 07:01:05.715314 681 leader_election.cc:302] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:05.716405 1165 raft_consensus.cc:2258] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.722385 1758 raft_consensus.cc:2726] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:05.722494 1165 ts_tablet_manager.cc:1905] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:05.728441 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f90f1b2facc0415ab378fb81b60b0202 (table default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]) successfully deleted
I20260620 07:01:05.733544 1170 tablet_bootstrap.cc:492] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:05.739053 426 master_service.cc:946] ReplaceTablet: received request to replace tablet b8e2d451eb1f48ff81828d7070a20027 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:05.743108 1165 ts_tablet_manager.cc:1918] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:05.747956 1165 log.cc:1196] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/978f99d2a7d6448aba8dcd2611b75af3
I20260620 07:01:05.748750 1165 ts_tablet_manager.cc:1939] T 978f99d2a7d6448aba8dcd2611b75af3 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:05.748889 830 leader_election.cc:302] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:05.750206 1740 raft_consensus.cc:2781] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:05.750100 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 25adb514cb22461bbcbecad7d74e643c (DEFAULT_TABLE table=default.Table_5630d0cf800a45efb1b1bfeee6223c8c [id=4e2e330e40cb46e4808077e2218ddb33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.750607 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25adb514cb22461bbcbecad7d74e643c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.751087 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e54f1185cd4c5c8e5d2ed289b61650" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:05.751295 890 raft_consensus.cc:3037] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:05.754045 890 raft_consensus.cc:2454] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:05.754376 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169b93c38e59435db218152f2d25bdfa" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:05.761041 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet e275d82068074370ba1e32b7ca5fdcc3 (table default.Table_89bf00306e9c44a0a0de2e0a7235f436 [id=24b0b6eb9f944dbb971530ee8f603c0e]) successfully deleted
I20260620 07:01:05.762602 871 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9da1b03aae4cd9976109291ea43b4e (DEFAULT_TABLE table=default.Table_8df661d9c23f459f8fb05bfa5f7455cf [id=4573ff60adda4e508c06e281746fb46a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.763298 876 tablet_service.cc:1467] Processing CreateTablet for tablet 490eb0893a4f4811b7574c445e483549 (DEFAULT_TABLE table=default.Table_7681a9fcfe6a48a5aa3028d8c9113a73 [id=f9c1a1058a5d476dacfe83d07e3eb39e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.763741 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 490eb0893a4f4811b7574c445e483549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.767567 872 tablet_service.cc:1467] Processing CreateTablet for tablet 31c56e80a73c442aa3cc65126a76c8be (DEFAULT_TABLE table=default.Table_7eed72568334415b993b78f401667ed1 [id=8732165b3c56492ea0bf9d3f3bdc38ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.768049 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31c56e80a73c442aa3cc65126a76c8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.773487 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 2064ec0e35d645e3ae419e8e7c4e075b (DEFAULT_TABLE table=default.Table_8b276cfc9d2142e7ad6a104d5bd40f82 [id=097de6dee18b4e1598db3520f2af2eb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.775336 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet e37f336c01974ba79caeb25f4781667a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.775465 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2064ec0e35d645e3ae419e8e7c4e075b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.773711 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c01c4e10f345fc84e3e253e8501aff with delete_type TABLET_DATA_DELETED (replaced by tablet 6363d1d9233d4938ba40abff452ed147) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.773895 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4bebaa8ed1431d8c775f4856a3d808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.781226 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d9da1b03aae4cd9976109291ea43b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.782125 1758 raft_consensus.cc:482] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:05.782321 1758 raft_consensus.cc:504] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.783986 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d066c73ae0104cb3be792790b1dfb93d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:05.772670 1167 tablet_bootstrap.cc:492] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:05.784993 1167 ts_tablet_manager.cc:1397] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.285s user 0.002s sys 0.002s
I20260620 07:01:05.787859 876 tablet_service.cc:1467] Processing CreateTablet for tablet 2004ff6f00a441578b8e702e8c7605fc (DEFAULT_TABLE table=default.Table_68c627af3b814440b64be782c7fbf9d4 [id=b877045cdf084d58a19ccb2a265f8fa0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:05.788535 681 leader_election.cc:341] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.788816 1758 leader_election.cc:288] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:05.789628 872 tablet_service.cc:1467] Processing CreateTablet for tablet a9251ca905654857b5f97406fe9544a8 (DEFAULT_TABLE table=default.Table_e700feb0fae94a1d9e1308852c2c3204 [id=513eb871096f4b39ae4bc8a30ca8694b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.790634 1167 raft_consensus.cc:348] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.790393 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2004ff6f00a441578b8e702e8c7605fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.793836 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9251ca905654857b5f97406fe9544a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.793184 996 tablet_service.cc:1467] Processing CreateTablet for tablet 6801c84abfa54f6983fae4b66aca8fd0 (DEFAULT_TABLE table=default.Table_fd8858b58d1247d18cfbf9919c0e4599 [id=6cd4da45bfa24c749aa08a4d4ce7f7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.795449 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6801c84abfa54f6983fae4b66aca8fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.794737 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d066c73ae0104cb3be792790b1dfb93d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:05.774458 1012 tablet_service.cc:1467] Processing CreateTablet for tablet f4f77b677ab34d9b8554de0da6564fb1 (DEFAULT_TABLE table=default.Table_30d48f35343d4017b5b3e6750c89d54e [id=fa021110da20405293f8488c41387d6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.794102 998 tablet_service.cc:1467] Processing CreateTablet for tablet b9736d57fe0e4edea762508fe0a8d2a5 (DEFAULT_TABLE table=default.Table_8cec159b248a44ed97cd71cca66c5e9c [id=eaa024e7fc254777b8ed67fd19a9747f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.774699 1004 tablet_service.cc:1467] Processing CreateTablet for tablet e6881c5b6560467c8b8e52777976b5da (DEFAULT_TABLE table=default.Table_71e114b78b5540daa771e5ade0eacfa7 [id=0e3333a9436d45598a6aa06202edb510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.799671 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f77b677ab34d9b8554de0da6564fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.773813 1009 tablet_service.cc:1467] Processing CreateTablet for tablet ebd9df1a33ed4e7b997a386158460a9a (DEFAULT_TABLE table=default.Table_4c8103aba31e41f88c025b32b20b15a9 [id=4d639c68ca2d4fb88b4cfda6bd78b1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.799988 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebd9df1a33ed4e7b997a386158460a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.802394 734 tablet_service.cc:1467] Processing CreateTablet for tablet 1d7cec62aea048d3bbe38ab2f83f7656 (DEFAULT_TABLE table=default.Table_00e67719a51b46eaa7a48b31c052cd48 [id=8fd0ee8e204148e091d4b9863f7a76b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.803558 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9736d57fe0e4edea762508fe0a8d2a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.805390 683 leader_election.cc:341] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.811946 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6881c5b6560467c8b8e52777976b5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.793653 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet b4ee5c79e2a6419ea3847cbebdeced79 with delete_type TABLET_DATA_DELETED (replaced by tablet 63525282e222490687713a92e5371a5c) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.816126 1772 raft_consensus.cc:482] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:05.816361 683 leader_election.cc:302] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:05.816414 1772 raft_consensus.cc:504] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.817541 1772 leader_election.cc:288] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:05.817992 1740 raft_consensus.cc:686] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:05.818310 1740 consensus_queue.cc:237] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.820709 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 333) took 3897 ms. Trace:
I20260620 07:01:05.820873 1165 rpcz_store.cc:276] 0620 07:01:01.922842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.988718 (+ 65876us) service_pool.cc:227] Handling call
0620 07:01:05.708519 (+3719801us) ts_tablet_manager.cc:1145] Deleting tablet 978f99d2a7d6448aba8dcd2611b75af3
0620 07:01:05.708528 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.739926 (+ 31398us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.742996 (+ 3070us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.820656 (+ 77660us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3719634}
I20260620 07:01:05.821682 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 334) took 3894 ms. Trace:
I20260620 07:01:05.821856 1165 rpcz_store.cc:276] 0620 07:01:01.927038 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.988902 (+ 61864us) service_pool.cc:227] Handling call
0620 07:01:05.821361 (+3832459us) ts_tablet_manager.cc:1145] Deleting tablet f6bdcd8cd2574acf867b7ec487559db2
0620 07:01:05.821373 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.821471 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3832277}
I20260620 07:01:05.822082 716 tablet_service.cc:1467] Processing CreateTablet for tablet 890aeebaed044b9c9a0a207be0b1f69d (DEFAULT_TABLE table=default.Table_6dd60e60eca84824bb10e0a321dffea3 [id=59ac6620df09427595736aa4e4254cdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.822381 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 343) took 3701 ms. Trace:
I20260620 07:01:05.822532 1165 rpcz_store.cc:276] 0620 07:01:02.120990 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.121741 (+ 751us) service_pool.cc:227] Handling call
0620 07:01:05.822246 (+3700505us) ts_tablet_manager.cc:1145] Deleting tablet 6fbd069552314f2c9ee010c054386644
0620 07:01:05.822256 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.822331 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3695701}
W20260620 07:01:05.823022 831 leader_election.cc:341] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 360880717af145628606b5b9fb26e350
I20260620 07:01:05.823556 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 978f99d2a7d6448aba8dcd2611b75af3 (table default.Table_407d8f13b4bd41fb8675708922430b28 [id=c6b286f7e44a496aa9f070c73a885062]) successfully deleted
W20260620 07:01:05.823858 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f6bdcd8cd2574acf867b7ec487559db2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6bdcd8cd2574acf867b7ec487559db2 already in progress: creating tablet
W20260620 07:01:05.824098 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6fbd069552314f2c9ee010c054386644 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fbd069552314f2c9ee010c054386644 already in progress: creating tablet
I20260620 07:01:05.825466 721 tablet_service.cc:1467] Processing CreateTablet for tablet d4988c5cbb3a4818bc024da7472b96ff (DEFAULT_TABLE table=default.Table_09c477fbf2554f3ab6ef8b993467e7a3 [id=9ac2668c105e4ef2bf4e90c16bc3a913]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.825876 1758 raft_consensus.cc:2726] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:05.828136 730 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9da1b03aae4cd9976109291ea43b4e (DEFAULT_TABLE table=default.Table_8df661d9c23f459f8fb05bfa5f7455cf [id=4573ff60adda4e508c06e281746fb46a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.828558 1165 tablet_replica.cc:330] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:05.828845 1165 raft_consensus.cc:2229] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:05.830350 1165 pending_rounds.cc:62] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:05.830578 1165 pending_rounds.cc:68] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821586192666624 op_type: NO_OP noop_request { }
I20260620 07:01:05.830950 1165 raft_consensus.cc:2866] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:05.831235 1165 raft_consensus.cc:2258] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.832274 1165 ts_tablet_manager.cc:1905] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:05.833094 1167 raft_consensus.cc:374] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.833330 1167 raft_consensus.cc:729] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.833626 1167 consensus_queue.cc:260] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.836282 719 tablet_service.cc:1467] Processing CreateTablet for tablet 490eb0893a4f4811b7574c445e483549 (DEFAULT_TABLE table=default.Table_7681a9fcfe6a48a5aa3028d8c9113a73 [id=f9c1a1058a5d476dacfe83d07e3eb39e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.838850 1004 tablet_service.cc:1467] Processing CreateTablet for tablet c9ad0680f1da4504b87d9d0d6bcbabcb (DEFAULT_TABLE table=default.Table_550044437fae426dbb1eb8da5c11d8aa [id=705e854b1bf64885a91d9d1e8d58311d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.843837 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98544574a8cd4a86a443284a421fa030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.844887 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1099ae03924f4f4b95324ddaac35f9cf" } new_table_name: "default.Table_dbcf6925600345658e340ad71565e073" modify_external_catalogs: true
I20260620 07:01:05.848709 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 26719543504847389de3c3102efcc9b2
I20260620 07:01:05.851025 1169 ts_tablet_manager.cc:1918] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:05.851120 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5d69ca4ae7434ca5b647e9135b5108ee
I20260620 07:01:05.851981 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4bf744af315a4874b0af6932c2d52e20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.852592 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bf744af315a4874b0af6932c2d52e20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.853842 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 94e5ddcaf596455289fab50876c27dce
I20260620 07:01:05.854528 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a6c684d6032a46a38cb35d8770b1ce44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.855067 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6c684d6032a46a38cb35d8770b1ce44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.856295 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d4988c5cbb3a4818bc024da7472b96ff
I20260620 07:01:05.857050 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f6260fcb4d6a4889a69e4d7a2538d20c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:05.857450 731 tablet_service.cc:1467] Processing CreateTablet for tablet 2004ff6f00a441578b8e702e8c7605fc (DEFAULT_TABLE table=default.Table_68c627af3b814440b64be782c7fbf9d4 [id=b877045cdf084d58a19ccb2a265f8fa0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:05.857661 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6260fcb4d6a4889a69e4d7a2538d20c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.858278 723 tablet_service.cc:1467] Processing CreateTablet for tablet a9251ca905654857b5f97406fe9544a8 (DEFAULT_TABLE table=default.Table_e700feb0fae94a1d9e1308852c2c3204 [id=513eb871096f4b39ae4bc8a30ca8694b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.858665 722 tablet_service.cc:1467] Processing CreateTablet for tablet 31c56e80a73c442aa3cc65126a76c8be (DEFAULT_TABLE table=default.Table_7eed72568334415b993b78f401667ed1 [id=8732165b3c56492ea0bf9d3f3bdc38ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.858911 726 tablet_service.cc:1467] Processing CreateTablet for tablet a594df0df6ad48cab77cc1deed22bff0 (DEFAULT_TABLE table=default.Table_35e279985d0c48b7b6580e1b957d3f39 [id=c62b4ce9d4bc4cd1b3d67bb7941b9490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.859752 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4988c5cbb3a4818bc024da7472b96ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.859856 1165 ts_tablet_manager.cc:1918] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:05.860014 1165 log.cc:1196] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/9e643fb0890042ae891ea17f0bc03740
I20260620 07:01:05.860858 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f591ba26b91b47f9a8933878d478655d
I20260620 07:01:05.860908 1165 ts_tablet_manager.cc:1939] T 9e643fb0890042ae891ea17f0bc03740 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:05.861780 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 346) took 3712 ms. Trace:
I20260620 07:01:05.861590 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6c1b78c4f39f4e09abafd1d51690766a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.862315 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c1b78c4f39f4e09abafd1d51690766a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.862552 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d9da1b03aae4cd9976109291ea43b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.861871 1165 rpcz_store.cc:276] 0620 07:01:02.149597 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.154995 (+ 5398us) service_pool.cc:227] Handling call
0620 07:01:05.828467 (+3673472us) ts_tablet_manager.cc:1145] Deleting tablet 9e643fb0890042ae891ea17f0bc03740
0620 07:01:05.828478 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.850136 (+ 21658us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.856930 (+ 6794us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.861715 (+ 4785us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3672756}
I20260620 07:01:05.862931 1169 log.cc:1196] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/369c205d7f7841598cb99f661b25736f
I20260620 07:01:05.863206 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 345) took 3721 ms. Trace:
I20260620 07:01:05.863322 1169 ts_tablet_manager.cc:1939] T 369c205d7f7841598cb99f661b25736f P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:05.864853 1165 rpcz_store.cc:276] 0620 07:01:02.145136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.145417 (+ 281us) service_pool.cc:227] Handling call
0620 07:01:05.863037 (+3717620us) ts_tablet_manager.cc:1145] Deleting tablet 6ff06bc5fc684b9195c719cbf39d34a6
0620 07:01:05.863050 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.863158 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3676545}
I20260620 07:01:05.865686 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 490eb0893a4f4811b7574c445e483549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.865972 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 344) took 3728 ms. Trace:
I20260620 07:01:05.866642 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_47155b1e4814476084ad3242145bf731" } new_table_name: "default.Table_8d4d5a67761c41e79e46f9bab18cb0e5" modify_external_catalogs: true
I20260620 07:01:05.866711 1165 rpcz_store.cc:276] 0620 07:01:02.138060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.138326 (+ 266us) service_pool.cc:227] Handling call
0620 07:01:05.865792 (+3727466us) ts_tablet_manager.cc:1145] Deleting tablet cb26f1d10f9a4978b41afbd8894f1102
0620 07:01:05.865805 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.865913 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3665604}
I20260620 07:01:05.867894 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 347) took 3477 ms. Trace:
I20260620 07:01:05.868489 1165 rpcz_store.cc:276] 0620 07:01:02.392832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.393482 (+ 650us) service_pool.cc:227] Handling call
0620 07:01:05.867562 (+3474080us) ts_tablet_manager.cc:1145] Deleting tablet 877a71e8db5f4bf689df39f83735f326
0620 07:01:05.867702 (+ 140us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.867822 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3473774}
I20260620 07:01:05.868652 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 7fc63351f767447c99b819fe7848d381 (table default.Table_e84e884648ed447c91e20b4a2be65197 [id=38f5978d6a7945c9aec7b78d789241ce]). Expected version 3 got 0
I20260620 07:01:05.869364 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 359) took 3272 ms. Trace:
I20260620 07:01:05.869812 1165 rpcz_store.cc:276] 0620 07:01:02.596664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.596743 (+ 79us) service_pool.cc:227] Handling call
0620 07:01:05.869208 (+3272465us) ts_tablet_manager.cc:1145] Deleting tablet 3456cf91d65a4413a35efe94513c723d
0620 07:01:05.869218 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.869314 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3272148}
I20260620 07:01:05.869925 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9251ca905654857b5f97406fe9544a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.870591 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 360) took 3268 ms. Trace:
I20260620 07:01:05.871008 1165 rpcz_store.cc:276] 0620 07:01:02.602397 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.602461 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:05.870458 (+3267997us) ts_tablet_manager.cc:1145] Deleting tablet 95a109e7871241ec9467858dca467bbe
0620 07:01:05.870467 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.870543 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3267761}
I20260620 07:01:05.871189 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_43035e837b724041adc0d9be08280f83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:05.871800 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43035e837b724041adc0d9be08280f83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.871830 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 361) took 3264 ms. Trace:
I20260620 07:01:05.872259 1165 rpcz_store.cc:276] 0620 07:01:02.607381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.607430 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:05.871689 (+3264259us) ts_tablet_manager.cc:1145] Deleting tablet f690e150839a4d23860932712f61e7c8
0620 07:01:05.871698 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.871785 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3264039}
I20260620 07:01:05.872949 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 362) took 3179 ms. Trace:
I20260620 07:01:05.873436 1165 rpcz_store.cc:276] 0620 07:01:02.693949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.693996 (+ 47us) service_pool.cc:227] Handling call
0620 07:01:05.872810 (+3178814us) ts_tablet_manager.cc:1145] Deleting tablet c8f81fa4e88945f1a392fbacfd031392
0620 07:01:05.872820 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.872903 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3178564}
I20260620 07:01:05.874187 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 9e643fb0890042ae891ea17f0bc03740 (table default.Table_ddfa02b01d2248a188748eda117387da [id=65b5bbb9004b4c28b8233868e05c293a]) successfully deleted
W20260620 07:01:05.874539 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6ff06bc5fc684b9195c719cbf39d34a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ff06bc5fc684b9195c719cbf39d34a6 already in progress: creating tablet
W20260620 07:01:05.874898 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet cb26f1d10f9a4978b41afbd8894f1102 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb26f1d10f9a4978b41afbd8894f1102 already in progress: creating tablet
I20260620 07:01:05.874392 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 26719543504847389de3c3102efcc9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.874531 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d69ca4ae7434ca5b647e9135b5108ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.874658 871 tablet_service.cc:1514] Processing DeleteTablet for tablet 94e5ddcaf596455289fab50876c27dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:05.875176 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 877a71e8db5f4bf689df39f83735f326 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 877a71e8db5f4bf689df39f83735f326 already in progress: creating tablet
I20260620 07:01:05.874766 874 tablet_service.cc:1514] Processing DeleteTablet for tablet d4988c5cbb3a4818bc024da7472b96ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.874897 865 tablet_service.cc:1514] Processing DeleteTablet for tablet f591ba26b91b47f9a8933878d478655d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:05.875389 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3456cf91d65a4413a35efe94513c723d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3456cf91d65a4413a35efe94513c723d already in progress: creating tablet
W20260620 07:01:05.875603 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 95a109e7871241ec9467858dca467bbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95a109e7871241ec9467858dca467bbe already in progress: creating tablet
W20260620 07:01:05.875818 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f690e150839a4d23860932712f61e7c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f690e150839a4d23860932712f61e7c8 already in progress: creating tablet
W20260620 07:01:05.876034 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c8f81fa4e88945f1a392fbacfd031392 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8f81fa4e88945f1a392fbacfd031392 already in progress: creating tablet
I20260620 07:01:05.876238 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 363) took 3124 ms. Trace:
I20260620 07:01:05.876441 1165 rpcz_store.cc:276] 0620 07:01:02.751603 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.751924 (+ 321us) service_pool.cc:227] Handling call
0620 07:01:05.875792 (+3123868us) ts_tablet_manager.cc:1145] Deleting tablet b39e682e71ed4776a786f7d30158e7e0
0620 07:01:05.875810 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.876072 (+ 262us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3122097}
I20260620 07:01:05.877331 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 364) took 3124 ms. Trace:
I20260620 07:01:05.877506 419 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]). Expected version 1 got 0
I20260620 07:01:05.877784 717 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f8c4955c164e6b9061ac607bbe081c with delete_type TABLET_DATA_DELETED (replaced by tablet 0e864cac7431439b9eb18d0cd98a7755) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.877782 1165 rpcz_store.cc:276] 0620 07:01:02.752845 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.753290 (+ 445us) service_pool.cc:227] Handling call
0620 07:01:05.877187 (+3123897us) ts_tablet_manager.cc:1145] Deleting tablet 4655d289c94c4bce9707be375fc4b850
0620 07:01:05.877198 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.877277 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3100024}
I20260620 07:01:05.878341 1165 tablet_replica.cc:330] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:05.878382 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bc6c3b8048b94a4891efaaa7a063da1a" } new_table_name: "default.Table_b802d24491d343c693974cfbd8da495e" modify_external_catalogs: true
I20260620 07:01:05.879201 1165 raft_consensus.cc:2229] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:05.880139 1165 pending_rounds.cc:62] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:05.880441 1165 pending_rounds.cc:68] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821586107670528 op_type: NO_OP noop_request { }
W20260620 07:01:05.880522 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b39e682e71ed4776a786f7d30158e7e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b39e682e71ed4776a786f7d30158e7e0 already in progress: creating tablet
I20260620 07:01:05.880848 1165 raft_consensus.cc:2866] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260620 07:01:05.880968 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 4655d289c94c4bce9707be375fc4b850 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4655d289c94c4bce9707be375fc4b850 already in progress: creating tablet
I20260620 07:01:05.881192 1165 raft_consensus.cc:2258] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.883560 1165 ts_tablet_manager.cc:1905] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:05.886636 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9ad0680f1da4504b87d9d0d6bcbabcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.888060 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 2584a6d508594c86a152889ab55197d8 (DEFAULT_TABLE table=default.Table_02d02883b6c246c780aa0e2d912752f2 [id=276b72804fd7409ea0795821889ea1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.888994 996 tablet_service.cc:1467] Processing CreateTablet for tablet 60dc050958574863bae5e7c59acaa774 (DEFAULT_TABLE table=default.Table_2d068c58b71c4076a78a31fcade380a2 [id=16cff34b08004d66a232d6c916330c08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.889971 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a594df0df6ad48cab77cc1deed22bff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.893537 1166 ts_tablet_manager.cc:1918] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:05.894955 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet e14db4e3394046e49ecc69c9ca4dc840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.895248 1167 ts_tablet_manager.cc:1428] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.096s user 0.001s sys 0.001s
I20260620 07:01:05.896955 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 450) took 1683 ms. Trace:
I20260620 07:01:05.897569 1167 tablet_bootstrap.cc:492] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:05.897320 1169 rpcz_store.cc:276] 0620 07:01:04.206483 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.206548 (+ 65us) service_pool.cc:227] Handling call
0620 07:01:05.456940 (+1250392us) ts_tablet_manager.cc:1145] Deleting tablet 369c205d7f7841598cb99f661b25736f
0620 07:01:05.456952 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.654426 (+197474us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.843529 (+189103us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.871596 (+ 28067us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x618000005118. stack: 00007fa60e27666e 00007fa60e276430 00007fa60d2fd5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa60e26c0fd 00007fa60e26d16e 00007fa6211c1cfd 00007fa62113f883 00007fa61d3e1752 00007fa61d413404 00007fa61d3f4870 00007fa61d3f45fd 00000000009edb7c 00007fa60e2bc344
0620 07:01:05.889887 (+ 18291us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18005760,"tablet-delete.queue_time_us":1250153}
I20260620 07:01:05.890775 1165 ts_tablet_manager.cc:1918] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:05.897807 1165 log.cc:1196] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/04d5d361a5404dcf99a89e93ac1f7dd8
I20260620 07:01:05.897800 998 tablet_service.cc:1467] Processing CreateTablet for tablet a4e8c06f3f8544ecafb63dd7d04fdf05 (DEFAULT_TABLE table=default.Table_acc2e2a41f234841944aefbc998c1680 [id=af10c4d2a07c4903b72cd142200e6ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.898288 1165 ts_tablet_manager.cc:1939] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:05.898443 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 369c205d7f7841598cb99f661b25736f (table default.Table_f655e04dd3f446debfb3219c289dcadb [id=6654082b40084682b5bf224e82c955df]) successfully deleted
I20260620 07:01:05.899469 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 366) took 2995 ms. Trace:
I20260620 07:01:05.900156 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2584a6d508594c86a152889ab55197d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.900055 1165 rpcz_store.cc:276] 0620 07:01:02.904430 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.904480 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:05.878269 (+2973789us) ts_tablet_manager.cc:1145] Deleting tablet 04d5d361a5404dcf99a89e93ac1f7dd8
0620 07:01:05.878278 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.887525 (+ 9247us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.890659 (+ 3134us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.899411 (+ 8752us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2947357}
I20260620 07:01:05.900847 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 365) took 2996 ms. Trace:
I20260620 07:01:05.901291 1165 rpcz_store.cc:276] 0620 07:01:02.904274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.904780 (+ 506us) service_pool.cc:227] Handling call
0620 07:01:05.900700 (+2995920us) ts_tablet_manager.cc:1145] Deleting tablet 1f763b0e91544700bd672c2ef751b4d2
0620 07:01:05.900713 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.900793 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2969712}
I20260620 07:01:05.902065 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 367) took 2990 ms. Trace:
I20260620 07:01:05.902482 1165 rpcz_store.cc:276] 0620 07:01:02.911374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.911543 (+ 169us) service_pool.cc:227] Handling call
0620 07:01:05.901926 (+2990383us) ts_tablet_manager.cc:1145] Deleting tablet f8ec1e179a704e5480f3deaf856156e7
0620 07:01:05.901936 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.902014 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2970892}
I20260620 07:01:05.902951 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4e8c06f3f8544ecafb63dd7d04fdf05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.903254 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 380) took 2654 ms. Trace:
I20260620 07:01:05.904084 1165 rpcz_store.cc:276] 0620 07:01:03.248462 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.248605 (+ 143us) service_pool.cc:227] Handling call
0620 07:01:05.903105 (+2654500us) ts_tablet_manager.cc:1145] Deleting tablet 864c95b908674e4f8425d765444c281b
0620 07:01:05.903115 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.903193 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2654257}
I20260620 07:01:05.905488 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 381) took 2656 ms. Trace:
I20260620 07:01:05.905902 1165 rpcz_store.cc:276] 0620 07:01:03.248562 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.248881 (+ 319us) service_pool.cc:227] Handling call
0620 07:01:05.905334 (+2656453us) ts_tablet_manager.cc:1145] Deleting tablet d15ea9529afe40b6b4a702035479aef3
0620 07:01:05.905343 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.905435 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2656320}
I20260620 07:01:05.906605 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 382) took 2645 ms. Trace:
I20260620 07:01:05.906947 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60dc050958574863bae5e7c59acaa774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.907006 1165 rpcz_store.cc:276] 0620 07:01:03.260933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.260996 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:05.906461 (+2645465us) ts_tablet_manager.cc:1145] Deleting tablet f8b961698fe54e7f9c16f41b90058093
0620 07:01:05.906470 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.906542 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2644853}
I20260620 07:01:05.911253 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 04d5d361a5404dcf99a89e93ac1f7dd8 (table default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]) successfully deleted
W20260620 07:01:05.911633 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1f763b0e91544700bd672c2ef751b4d2 because the tablet was not found. No further retry: Not found: Tablet not found: 1f763b0e91544700bd672c2ef751b4d2
W20260620 07:01:05.912030 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f8ec1e179a704e5480f3deaf856156e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8ec1e179a704e5480f3deaf856156e7 already in progress: creating tablet
W20260620 07:01:05.912345 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 864c95b908674e4f8425d765444c281b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 864c95b908674e4f8425d765444c281b already in progress: creating tablet
I20260620 07:01:05.912420 717 tablet_service.cc:1514] Processing DeleteTablet for tablet 26719543504847389de3c3102efcc9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:05.912636 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d15ea9529afe40b6b4a702035479aef3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d15ea9529afe40b6b4a702035479aef3 already in progress: creating tablet
W20260620 07:01:05.912925 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f8b961698fe54e7f9c16f41b90058093 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8b961698fe54e7f9c16f41b90058093 already in progress: creating tablet
I20260620 07:01:05.915943 1005 tablet_service.cc:1467] Processing CreateTablet for tablet fa0b581de06149cf93b469a4a095573b (DEFAULT_TABLE table=default.Table_b405207e53ca410c8533a25dc80500c3 [id=c50f0d7c6505470e8b319c5f41bc25b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.916505 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa0b581de06149cf93b469a4a095573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.922914 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 383) took 2638 ms. Trace:
I20260620 07:01:05.923084 1165 rpcz_store.cc:276] 0620 07:01:03.268848 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.274341 (+ 5493us) service_pool.cc:227] Handling call
0620 07:01:05.907488 (+2633147us) ts_tablet_manager.cc:1145] Deleting tablet 485ce059be9b4900adb1dbc3268efb55
0620 07:01:05.907497 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.907566 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2632893}
I20260620 07:01:05.924005 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 384) took 2644 ms. Trace:
I20260620 07:01:05.924124 1165 rpcz_store.cc:276] 0620 07:01:03.279502 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.279774 (+ 272us) service_pool.cc:227] Handling call
0620 07:01:05.923358 (+2643584us) ts_tablet_manager.cc:1145] Deleting tablet 33517843ce1d4d8786c91fd738d81ab2
0620 07:01:05.923370 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.923464 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2643343}
I20260620 07:01:05.924779 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 397) took 2489 ms. Trace:
I20260620 07:01:05.924868 1165 rpcz_store.cc:276] 0620 07:01:03.435059 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.435115 (+ 56us) service_pool.cc:227] Handling call
0620 07:01:05.924373 (+2489258us) ts_tablet_manager.cc:1145] Deleting tablet 9da80903ac124d1aae937c2329f9b13e
0620 07:01:05.924385 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.924484 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2482555}
I20260620 07:01:05.926021 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 366d713325f84c8b9b1c1f4296513a20 (DEFAULT_TABLE table=default.Table_1a6e98a083e841e1bd8235e1e5e41c13 [id=43135b18d0f9495db5027eb383f116ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.926566 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 366d713325f84c8b9b1c1f4296513a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.928586 717 tablet_service.cc:1514] Processing DeleteTablet for tablet 94e5ddcaf596455289fab50876c27dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.931183 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 94e5ddcaf596455289fab50876c27dce (DEFAULT_TABLE table=default.Table_693c3c64a7de410fb1d0dae423a1db82 [id=6265dba2499046b3adf58dd879a3ae94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.931491 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 398) took 2475 ms. Trace:
I20260620 07:01:05.931739 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e5ddcaf596455289fab50876c27dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.931645 1165 rpcz_store.cc:276] 0620 07:01:03.449648 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.449775 (+ 127us) service_pool.cc:227] Handling call
0620 07:01:05.925070 (+2475295us) ts_tablet_manager.cc:1145] Deleting tablet 25b878def9344cbdae65b209cac4067f
0620 07:01:05.925078 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.925159 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2459167}
I20260620 07:01:05.932314 1165 tablet_replica.cc:330] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:05.932519 1165 raft_consensus.cc:2229] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:05.932937 1165 raft_consensus.cc:2258] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:05.933918 728 tablet_service.cc:1514] Processing DeleteTablet for tablet d4988c5cbb3a4818bc024da7472b96ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.934401 1165 ts_tablet_manager.cc:1905] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:05.935547 715 tablet_service.cc:1514] Processing DeleteTablet for tablet f591ba26b91b47f9a8933878d478655d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.936168 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d69ca4ae7434ca5b647e9135b5108ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.939145 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2004ff6f00a441578b8e702e8c7605fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.941907 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 451) took 1662 ms. Trace:
I20260620 07:01:05.942092 1169 rpcz_store.cc:276] 0620 07:01:04.265445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.265493 (+ 48us) service_pool.cc:227] Handling call
0620 07:01:05.920058 (+1654565us) ts_tablet_manager.cc:1145] Deleting tablet f793a91ab247408bbe4a9f7cb370fffe
0620 07:01:05.920073 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.928345 (+ 8272us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1654271}
W20260620 07:01:05.943111 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f793a91ab247408bbe4a9f7cb370fffe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f793a91ab247408bbe4a9f7cb370fffe already in progress: creating tablet
I20260620 07:01:05.943506 1764 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:05.944661 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 453) took 1630 ms. Trace:
I20260620 07:01:05.944924 1169 rpcz_store.cc:276] 0620 07:01:04.312598 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.312824 (+ 226us) service_pool.cc:227] Handling call
0620 07:01:05.942594 (+1629770us) ts_tablet_manager.cc:1145] Deleting tablet 3eda988492234d6aaeaee87f84f99d06
0620 07:01:05.942606 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.942720 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1629494}
I20260620 07:01:05.945183 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5208f3136bcd45579de49b8b10745122
I20260620 07:01:05.945645 425 catalog_manager.cc:6565] ReplaceTablet: tablet 5208f3136bcd45579de49b8b10745122 deleted and replaced by tablet 40d9875dde7b4455b24b053781993234
W20260620 07:01:05.945904 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3eda988492234d6aaeaee87f84f99d06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eda988492234d6aaeaee87f84f99d06 already in progress: creating tablet
I20260620 07:01:05.947575 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 5208f3136bcd45579de49b8b10745122 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d9875dde7b4455b24b053781993234) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:05.948014 1165 ts_tablet_manager.cc:1918] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:05.947853 425 catalog_manager.cc:5495] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:05.948318 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_20581d428c6345ce8216cc2467e7eeef [id=2abd0f99a3034a0e8824bcb0002c91bd]). Expected version 2 got 0
I20260620 07:01:05.952682 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31c56e80a73c442aa3cc65126a76c8be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:05.953961 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 033c8b817757441ea7ebc2dbf77aa2dd consensus state has no leader
I20260620 07:01:05.954018 1165 log.cc:1196] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/21f51aeb329e42359cfaf7de2a039d13
I20260620 07:01:05.954453 1165 ts_tablet_manager.cc:1939] T 21f51aeb329e42359cfaf7de2a039d13 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:05.954493 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_608fa7fe9add4c14b2705f68900223d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:05.954820 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 402) took 2418 ms. Trace:
W20260620 07:01:05.955129 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_608fa7fe9add4c14b2705f68900223d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:05.956880 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f6a689e10be0434aab6444ff3a1be58f" } new_table_name: "default.Table_dcd39517a9e640af985a7a77e18673e3" modify_external_catalogs: true
I20260620 07:01:05.959633 1165 rpcz_store.cc:276] 0620 07:01:03.536751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.537412 (+ 661us) service_pool.cc:227] Handling call
0620 07:01:05.931895 (+2394483us) ts_tablet_manager.cc:1145] Deleting tablet 21f51aeb329e42359cfaf7de2a039d13
0620 07:01:05.931907 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.944430 (+ 12523us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.947889 (+ 3459us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.954767 (+ 6878us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2338997}
I20260620 07:01:05.960949 1758 raft_consensus.cc:482] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:05.961117 1758 raft_consensus.cc:504] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.961815 1758 leader_election.cc:288] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:05.962509 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fc63351f767447c99b819fe7848d381" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:05.962905 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fc63351f767447c99b819fe7848d381" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:05.963165 683 leader_election.cc:341] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.961786 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 407) took 2357 ms. Trace:
W20260620 07:01:05.963478 681 leader_election.cc:341] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:05.963593 681 leader_election.cc:302] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:05.963590 1165 rpcz_store.cc:276] 0620 07:01:03.604577 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.604627 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:05.961627 (+2357000us) ts_tablet_manager.cc:1145] Deleting tablet d0f7e6245c074c82a5a72be79ab1987f
0620 07:01:05.961638 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.961753 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2356769}
I20260620 07:01:05.961028 1168 tablet_bootstrap.cc:492] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:05.964052 1168 ts_tablet_manager.cc:1397] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.398s user 0.042s sys 0.031s
I20260620 07:01:05.964141 1758 raft_consensus.cc:2726] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:05.964392 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d7cec62aea048d3bbe38ab2f83f7656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.964754 1168 raft_consensus.cc:348] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:05.964988 1168 raft_consensus.cc:374] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:05.965305 1168 raft_consensus.cc:729] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:05.965910 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 406) took 2361 ms. Trace:
I20260620 07:01:05.966356 1165 rpcz_store.cc:276] 0620 07:01:03.604465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.604638 (+ 173us) service_pool.cc:227] Handling call
0620 07:01:05.965770 (+2361132us) ts_tablet_manager.cc:1145] Deleting tablet c06bf6c4d1af40479c81bd1d85e2848f
0620 07:01:05.965782 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.965875 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2357282}
I20260620 07:01:05.967170 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 404) took 2362 ms. Trace:
I20260620 07:01:05.967069 1762 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:05.967828 1165 rpcz_store.cc:276] 0620 07:01:03.604262 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.604914 (+ 652us) service_pool.cc:227] Handling call
0620 07:01:05.967045 (+2362131us) ts_tablet_manager.cc:1145] Deleting tablet a2d6f7f2b5b3473aa010b8982a03aa5e
0620 07:01:05.967056 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.967141 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2320520}
I20260620 07:01:05.968640 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 405) took 2364 ms. Trace:
I20260620 07:01:05.969436 1165 rpcz_store.cc:276] 0620 07:01:03.604362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.606227 (+ 1865us) service_pool.cc:227] Handling call
0620 07:01:05.968509 (+2362282us) ts_tablet_manager.cc:1145] Deleting tablet 7b781d0578834708ae64b24419959cca
0620 07:01:05.968520 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.968611 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2309397}
W20260620 07:01:05.970261 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 485ce059be9b4900adb1dbc3268efb55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 485ce059be9b4900adb1dbc3268efb55 already in progress: creating tablet
I20260620 07:01:05.970351 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 5208f3136bcd45579de49b8b10745122 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d9875dde7b4455b24b053781993234) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:05.968976 1168 consensus_queue.cc:260] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:05.970613 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 33517843ce1d4d8786c91fd738d81ab2 because the tablet was not found. No further retry: Not found: Tablet not found: 33517843ce1d4d8786c91fd738d81ab2
W20260620 07:01:05.970963 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9da80903ac124d1aae937c2329f9b13e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9da80903ac124d1aae937c2329f9b13e already in progress: creating tablet
I20260620 07:01:05.971189 1168 ts_tablet_manager.cc:1428] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20260620 07:01:05.971365 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 25b878def9344cbdae65b209cac4067f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25b878def9344cbdae65b209cac4067f already in progress: creating tablet
I20260620 07:01:05.971628 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 21f51aeb329e42359cfaf7de2a039d13 (table default.Table_066c84335e324028aaab00d42e0e5aec [id=bbf8c2959d834ddc8bb8b9790c6fcd89]) successfully deleted
W20260620 07:01:05.971874 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d0f7e6245c074c82a5a72be79ab1987f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0f7e6245c074c82a5a72be79ab1987f already in progress: creating tablet
W20260620 07:01:05.972186 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c06bf6c4d1af40479c81bd1d85e2848f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c06bf6c4d1af40479c81bd1d85e2848f already in progress: creating tablet
W20260620 07:01:05.972492 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a2d6f7f2b5b3473aa010b8982a03aa5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2d6f7f2b5b3473aa010b8982a03aa5e already in progress: creating tablet
W20260620 07:01:05.972870 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7b781d0578834708ae64b24419959cca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b781d0578834708ae64b24419959cca already in progress: creating tablet
I20260620 07:01:05.975215 1167 tablet_bootstrap.cc:654] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:05.975627 1168 tablet_bootstrap.cc:492] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:05.978948 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.979429 997 tablet_service.cc:1467] Processing CreateTablet for tablet 61505e5cabdf4d7d9dcf1ccd79067e64 (DEFAULT_TABLE table=default.Table_4b7e17645fdf4c208b6835b845042836 [id=ee3bf018da6b42c2ae4f603c30a9a49e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.979878 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61505e5cabdf4d7d9dcf1ccd79067e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.982946 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.983392 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 1d7cec62aea048d3bbe38ab2f83f7656 (DEFAULT_TABLE table=default.Table_00e67719a51b46eaa7a48b31c052cd48 [id=8fd0ee8e204148e091d4b9863f7a76b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.983806 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d7cec62aea048d3bbe38ab2f83f7656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.987118 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 4308d1a5bec34588844920fa89a5db26 (DEFAULT_TABLE table=default.Table_d61cbca81442407483975e8c14052c7c [id=8c778abeddf84d769658851ce065ae6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.987233 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 4308d1a5bec34588844920fa89a5db26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.987521 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4308d1a5bec34588844920fa89a5db26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.987609 999 tablet_service.cc:1467] Processing CreateTablet for tablet 890aeebaed044b9c9a0a207be0b1f69d (DEFAULT_TABLE table=default.Table_6dd60e60eca84824bb10e0a321dffea3 [id=59ac6620df09427595736aa4e4254cdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.987946 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 890aeebaed044b9c9a0a207be0b1f69d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:05.991103 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 0efec7113a5b44f296e756dde466b82f (DEFAULT_TABLE table=default.Table_c13cafc124f94c058d2948e4fe3c0181 [id=d11bf5ad91be4b09a15ba6209fadc0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.991670 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 98544574a8cd4a86a443284a421fa030 (DEFAULT_TABLE table=default.Table_429cabf4e04f4125b89d28e55eca678b [id=f31a91ff5fe241a1832414544e7a1e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.992129 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 63525282e222490687713a92e5371a5c (DEFAULT_TABLE table=default.Table_34eaeb05ad0243cb9f083eb279a8ba73 [id=5a23c89228964939bd74b5079dd25881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.992553 995 tablet_service.cc:1467] Processing CreateTablet for tablet 3e9f0dba4466436f9cfc730d7d6b15fe (DEFAULT_TABLE table=default.Table_c7e0c2dc28504b13aeb390e85111eb8b [id=1f708b0c52784e3383504a658162e388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.992976 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 6363d1d9233d4938ba40abff452ed147 (DEFAULT_TABLE table=default.Table_1e18ab4a35f347abb061df0a7db49226 [id=3234298ef6b649e78f3c7c7c61facd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.993415 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 (DEFAULT_TABLE table=default.Table_cddcca7b8f8e497ab1dceca5e0526472 [id=3c2845d9079d44cfb032d8db71865d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.993742 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 74eaa712962245b4bb14d17e4cdd8485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.993827 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f8c4955c164e6b9061ac607bbe081c with delete_type TABLET_DATA_DELETED (replaced by tablet 0e864cac7431439b9eb18d0cd98a7755) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:05.994072 1000 tablet_service.cc:1467] Processing CreateTablet for tablet d4988c5cbb3a4818bc024da7472b96ff (DEFAULT_TABLE table=default.Table_09c477fbf2554f3ab6ef8b993467e7a3 [id=9ac2668c105e4ef2bf4e90c16bc3a913]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.994074 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9da1b03aae4cd9976109291ea43b4e (DEFAULT_TABLE table=default.Table_6ebacaa3bdcf4a4b8ffeccfb72d898f3 [id=4573ff60adda4e508c06e281746fb46a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.994910 994 tablet_service.cc:1467] Processing CreateTablet for tablet 588776a580144e679d8a9a240d4a04ea (DEFAULT_TABLE table=default.Table_bbe98e8af16648f59625ce1445554535 [id=ec7f36e983294fc7866a89ba5abbe13a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:05.998142 996 tablet_service.cc:1467] Processing CreateTablet for tablet 490eb0893a4f4811b7574c445e483549 (DEFAULT_TABLE table=default.Table_7681a9fcfe6a48a5aa3028d8c9113a73 [id=f9c1a1058a5d476dacfe83d07e3eb39e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:06.000967 831 consensus_peers.cc:487] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2b0faf91f2f469f9b06e17caa4709e4. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:06.003836 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 408) took 2339 ms. Trace:
I20260620 07:01:06.004065 1165 rpcz_store.cc:276] 0620 07:01:03.664434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.667200 (+ 2766us) service_pool.cc:227] Handling call
0620 07:01:05.971470 (+2304270us) ts_tablet_manager.cc:1145] Deleting tablet 816218c726a9473e9849b7a97c820678
0620 07:01:06.003643 (+ 32173us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.003798 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2250631}
I20260620 07:01:06.005200 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 409) took 2263 ms. Trace:
I20260620 07:01:06.005686 1165 rpcz_store.cc:276] 0620 07:01:03.741388 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.741447 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:06.005072 (+2263625us) ts_tablet_manager.cc:1145] Deleting tablet 1d9d4b5a69484176a7b0f4fded010867
0620 07:01:06.005083 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.005168 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2263405}
I20260620 07:01:06.009687 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a391507b63124713a988e71f923eb059"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:06.010496 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a391507b63124713a988e71f923eb059 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.014098 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 410) took 2215 ms. Trace:
W20260620 07:01:06.014577 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 816218c726a9473e9849b7a97c820678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 816218c726a9473e9849b7a97c820678 already in progress: creating tablet
W20260620 07:01:06.015134 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1d9d4b5a69484176a7b0f4fded010867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d9d4b5a69484176a7b0f4fded010867 already in progress: creating tablet
I20260620 07:01:06.016705 1165 rpcz_store.cc:276] 0620 07:01:03.798526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.798597 (+ 71us) service_pool.cc:227] Handling call
0620 07:01:06.013699 (+2215102us) ts_tablet_manager.cc:1145] Deleting tablet 6229a52adf8d4b17bdf89347e01621ed
0620 07:01:06.013937 (+ 238us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.014060 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2214201}
I20260620 07:01:06.017683 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 412) took 2185 ms. Trace:
I20260620 07:01:06.018050 1165 rpcz_store.cc:276] 0620 07:01:03.831970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.832033 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:06.017533 (+2185500us) ts_tablet_manager.cc:1145] Deleting tablet c9d344f9e4b444e4b6018fdf0cf762fd
0620 07:01:06.017545 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.017652 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2185272}
I20260620 07:01:06.018692 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 413) took 2182 ms. Trace:
I20260620 07:01:06.018908 1165 rpcz_store.cc:276] 0620 07:01:03.836370 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.836482 (+ 112us) service_pool.cc:227] Handling call
0620 07:01:06.018518 (+2182036us) ts_tablet_manager.cc:1145] Deleting tablet 5926946427294a5ca6fbc72d3e1b612d
0620 07:01:06.018529 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.018652 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2181807}
I20260620 07:01:06.034377 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_18876e6e27824db091fa7c0fe3188bda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:06.035143 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18876e6e27824db091fa7c0fe3188bda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.016327 1168 tablet_bootstrap.cc:654] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.042528 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_00e67719a51b46eaa7a48b31c052cd48" } new_table_name: "default.Table_1e69a691960c4df38749120eed30b12e" modify_external_catalogs: true
I20260620 07:01:06.044126 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 419) took 2129 ms. Trace:
I20260620 07:01:06.044325 1165 rpcz_store.cc:276] 0620 07:01:03.910981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.911973 (+ 992us) service_pool.cc:227] Handling call
0620 07:01:06.039038 (+2127065us) ts_tablet_manager.cc:1145] Deleting tablet 3651ef9790d342ec96f554134ae714dc
0620 07:01:06.039051 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.040296 (+ 1245us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2126833}
W20260620 07:01:06.044811 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6229a52adf8d4b17bdf89347e01621ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6229a52adf8d4b17bdf89347e01621ed already in progress: creating tablet
I20260620 07:01:06.044832 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 421) took 2077 ms. Trace:
I20260620 07:01:06.044960 1165 rpcz_store.cc:276] 0620 07:01:03.967695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.973648 (+ 5953us) service_pool.cc:227] Handling call
0620 07:01:06.044657 (+2071009us) ts_tablet_manager.cc:1145] Deleting tablet ab60101b34144f85b0afd2e8c4846e48
0620 07:01:06.044672 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.044788 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2056261}
W20260620 07:01:06.045059 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c9d344f9e4b444e4b6018fdf0cf762fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9d344f9e4b444e4b6018fdf0cf762fd already in progress: creating tablet
W20260620 07:01:06.045249 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5926946427294a5ca6fbc72d3e1b612d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5926946427294a5ca6fbc72d3e1b612d already in progress: creating tablet
I20260620 07:01:06.045413 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 422) took 2077 ms. Trace:
I20260620 07:01:06.045535 1165 rpcz_store.cc:276] 0620 07:01:03.968300 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.981124 (+ 12824us) service_pool.cc:227] Handling call
0620 07:01:06.045214 (+2064090us) ts_tablet_manager.cc:1145] Deleting tablet 8d2c706414684bb1bacc6f9b870fc9c1
0620 07:01:06.045244 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.045372 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2056753}
I20260620 07:01:06.045843 1165 tablet_replica.cc:330] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.046113 1165 raft_consensus.cc:2229] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.046365 1165 raft_consensus.cc:2258] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.047825 1165 ts_tablet_manager.cc:1905] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:06.048355 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3651ef9790d342ec96f554134ae714dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3651ef9790d342ec96f554134ae714dc already in progress: creating tablet
W20260620 07:01:06.048593 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ab60101b34144f85b0afd2e8c4846e48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab60101b34144f85b0afd2e8c4846e48 already in progress: creating tablet
W20260620 07:01:06.048794 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8d2c706414684bb1bacc6f9b870fc9c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d2c706414684bb1bacc6f9b870fc9c1 already in progress: creating tablet
I20260620 07:01:06.055034 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b8e2d451eb1f48ff81828d7070a20027
I20260620 07:01:06.055550 426 catalog_manager.cc:6565] ReplaceTablet: tablet b8e2d451eb1f48ff81828d7070a20027 deleted and replaced by tablet b37f2c150b314b7298f32c3d414ff43d
W20260620 07:01:06.056340 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e0891d6911d4bf8887f7e88a605aed5 consensus state has no leader
I20260620 07:01:06.057229 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_062abd8a0a3344059126bc3026945142"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:06.058301 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_062abd8a0a3344059126bc3026945142 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.059939 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fd8c2ecfd1974bc5b245d954dff52f99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:06.060573 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd8c2ecfd1974bc5b245d954dff52f99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.064728 1165 ts_tablet_manager.cc:1918] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:06.000365 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0efec7113a5b44f296e756dde466b82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.074963 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.074987 865 tablet_service.cc:1514] Processing DeleteTablet for tablet b8e2d451eb1f48ff81828d7070a20027 with delete_type TABLET_DATA_DELETED (replaced by tablet b37f2c150b314b7298f32c3d414ff43d) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.076333 1165 log.cc:1196] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/81704d3a3cf648d987d4b40a270f7508
I20260620 07:01:06.076826 1165 ts_tablet_manager.cc:1939] T 81704d3a3cf648d987d4b40a270f7508 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.001359 998 tablet_service.cc:1467] Processing CreateTablet for tablet 31c56e80a73c442aa3cc65126a76c8be (DEFAULT_TABLE table=default.Table_7eed72568334415b993b78f401667ed1 [id=8732165b3c56492ea0bf9d3f3bdc38ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.077787 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 423) took 2074 ms. Trace:
I20260620 07:01:06.079420 1165 rpcz_store.cc:276] 0620 07:01:04.003323 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.005545 (+ 2222us) service_pool.cc:227] Handling call
0620 07:01:06.045767 (+2040222us) ts_tablet_manager.cc:1145] Deleting tablet 81704d3a3cf648d987d4b40a270f7508
0620 07:01:06.045779 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.056729 (+ 10950us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.064578 (+ 7849us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.077720 (+ 13142us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2039937}
I20260620 07:01:06.080242 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 438) took 1915 ms. Trace:
I20260620 07:01:06.002966 1166 log.cc:1196] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/33517843ce1d4d8786c91fd738d81ab2
I20260620 07:01:06.083508 1166 ts_tablet_manager.cc:1939] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:06.031926 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 7c761bb09032495c9a2f5d00e1b90902 (DEFAULT_TABLE table=default.Table_8f93b40f12a1469283e48666d1dd1899 [id=2e4563579e64448285b230bfb1507314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.046181 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7d1e4719cd441dd8054b24861cbd8a2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:06.046721 1028 raft_consensus.cc:3037] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:06.084028 1029 raft_consensus.cc:2454] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:06.046761 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360880717af145628606b5b9fb26e350" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:05.987111 1006 tablet_service.cc:1467] Processing CreateTablet for tablet a594df0df6ad48cab77cc1deed22bff0 (DEFAULT_TABLE table=default.Table_35e279985d0c48b7b6580e1b957d3f39 [id=c62b4ce9d4bc4cd1b3d67bb7941b9490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.048074 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 2004ff6f00a441578b8e702e8c7605fc (DEFAULT_TABLE table=default.Table_68c627af3b814440b64be782c7fbf9d4 [id=b877045cdf084d58a19ccb2a265f8fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.086023 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 81704d3a3cf648d987d4b40a270f7508 (table default.Table_90ae8d7513c948f8b7840964f5601249 [id=e7c8a5a3411f485abeddf596a8584e99]) successfully deleted
W20260620 07:01:06.053032 969 consensus_peers.cc:487] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63dfade71c254d7e908e00acada93638. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:06.086730 969 leader_election.cc:341] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 33517843ce1d4d8786c91fd738d81ab2
I20260620 07:01:06.068949 997 tablet_service.cc:1467] Processing CreateTablet for tablet a9251ca905654857b5f97406fe9544a8 (DEFAULT_TABLE table=default.Table_e700feb0fae94a1d9e1308852c2c3204 [id=513eb871096f4b39ae4bc8a30ca8694b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.087240 1165 rpcz_store.cc:276] 0620 07:01:04.164516 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.178861 (+ 14345us) service_pool.cc:227] Handling call
0620 07:01:06.079743 (+1900882us) ts_tablet_manager.cc:1145] Deleting tablet d17c49eecec741cdbd592c94b7f84c67
0620 07:01:06.079757 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.079869 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1900660}
I20260620 07:01:06.074044 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 26719543504847389de3c3102efcc9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.078956 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63525282e222490687713a92e5371a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.088740 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 440) took 1899 ms. Trace:
I20260620 07:01:06.088876 1165 rpcz_store.cc:276] 0620 07:01:04.188122 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.188171 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:06.087580 (+1899409us) ts_tablet_manager.cc:1145] Deleting tablet ed69a44c466047d298cf7653b2a2bb23
0620 07:01:06.087592 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.087775 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1899187}
W20260620 07:01:06.089361 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d17c49eecec741cdbd592c94b7f84c67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d17c49eecec741cdbd592c94b7f84c67 already in progress: creating tablet
I20260620 07:01:06.089809 1168 tablet_bootstrap.cc:492] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
W20260620 07:01:06.089912 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ed69a44c466047d298cf7653b2a2bb23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed69a44c466047d298cf7653b2a2bb23 already in progress: creating tablet
I20260620 07:01:06.089977 1168 ts_tablet_manager.cc:1397] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.114s user 0.005s sys 0.009s
I20260620 07:01:06.090967 1168 raft_consensus.cc:348] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.091269 1168 raft_consensus.cc:374] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.091378 1168 raft_consensus.cc:729] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:06.100602 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 777a6b981b7f43a4ba8978ba6f3971e1 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:06.101193 423 master_service.cc:946] ReplaceTablet: received request to replace tablet c38c628514c44c6fa5aff64928e515d9 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:06.101640 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 0efec7113a5b44f296e756dde466b82f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:06.102598 969 leader_election.cc:302] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:06.102857 1165 tablet_replica.cc:330] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.103071 1165 raft_consensus.cc:2229] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
W20260620 07:01:06.103044 969 raft_consensus.cc:2670] T 33517843ce1d4d8786c91fd738d81ab2 P 06a32ef63b2b495a9ade1de48c024ae9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:06.103374 1165 pending_rounds.cc:62] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:06.103440 1165 pending_rounds.cc:68] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821590479814656 op_type: NO_OP noop_request { }
I20260620 07:01:06.103616 1165 raft_consensus.cc:2866] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:06.103734 1165 raft_consensus.cc:2258] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.104354 1165 ts_tablet_manager.cc:1905] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.104250 1168 consensus_queue.cc:260] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.104889 1168 ts_tablet_manager.cc:1428] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260620 07:01:06.104801 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1a6e98a083e841e1bd8235e1e5e41c13" } modify_external_catalogs: true
W20260620 07:01:06.104883 969 leader_election.cc:341] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:06.105031 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1a6e98a083e841e1bd8235e1e5e41c13" } modify_external_catalogs: true
I20260620 07:01:06.105187 1168 tablet_bootstrap.cc:492] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:06.105115 969 leader_election.cc:302] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:06.105731 1699 raft_consensus.cc:2726] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:06.106069 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d69ca4ae7434ca5b647e9135b5108ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.106473 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 94e5ddcaf596455289fab50876c27dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:06.106799 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e30fb1d050c4439bb72a21a0f2b13eb consensus state has no leader
I20260620 07:01:06.106947 1168 tablet_bootstrap.cc:654] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.106900 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet d4988c5cbb3a4818bc024da7472b96ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.107185 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2aa5bfb35aed447f8788be438410abc7" } modify_external_catalogs: true
I20260620 07:01:06.107292 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet f591ba26b91b47f9a8933878d478655d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.107445 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2aa5bfb35aed447f8788be438410abc7" } modify_external_catalogs: true
I20260620 07:01:06.107632 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 5208f3136bcd45579de49b8b10745122 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d9875dde7b4455b24b053781993234) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.111168 1165 ts_tablet_manager.cc:1918] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:06.111323 1165 log.cc:1196] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/e2b0faf91f2f469f9b06e17caa4709e4
I20260620 07:01:06.112157 1165 ts_tablet_manager.cc:1939] T e2b0faf91f2f469f9b06e17caa4709e4 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.112317 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 169b93c38e59435db218152f2d25bdfa with delete_type TABLET_DATA_DELETED (replaced by tablet 5a4390225af348f89c934f0f179ddab5) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.112962 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 439) took 1924 ms. Trace:
I20260620 07:01:06.113075 1165 rpcz_store.cc:276] 0620 07:01:04.187993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.189233 (+ 1240us) service_pool.cc:227] Handling call
0620 07:01:06.089159 (+1899926us) ts_tablet_manager.cc:1145] Deleting tablet e2b0faf91f2f469f9b06e17caa4709e4
0620 07:01:06.102747 (+ 13588us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.107899 (+ 5152us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.111052 (+ 3153us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.112903 (+ 1851us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1899700}
I20260620 07:01:06.113443 1165 tablet_replica.cc:330] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.113620 1165 raft_consensus.cc:2229] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.113803 1165 raft_consensus.cc:2258] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.113776 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet e2b0faf91f2f469f9b06e17caa4709e4 (table default.Table_e31ff399ff5e4a309b29286a69aea7f0 [id=cfbc4dc349434379b3eaabd5dc948327]) successfully deleted
I20260620 07:01:06.114336 1165 ts_tablet_manager.cc:1905] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:06.120831 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2e0891d6911d4bf8887f7e88a605aed5 consensus state has no leader
I20260620 07:01:06.128861 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4bf744af315a4874b0af6932c2d52e20" } modify_external_catalogs: true
W20260620 07:01:06.110913 969 consensus_peers.cc:487] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e643fb0890042ae891ea17f0bc03740. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:06.129145 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4bf744af315a4874b0af6932c2d52e20" } modify_external_catalogs: true
I20260620 07:01:06.110935 1167 tablet_bootstrap.cc:492] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:06.131063 1167 ts_tablet_manager.cc:1397] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.234s user 0.001s sys 0.003s
I20260620 07:01:06.111649 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c761bb09032495c9a2f5d00e1b90902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.133201 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9251ca905654857b5f97406fe9544a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.134009 1165 ts_tablet_manager.cc:1918] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:06.134128 1165 log.cc:1196] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/369c205d7f7841598cb99f661b25736f
I20260620 07:01:06.134536 1165 ts_tablet_manager.cc:1939] T 369c205d7f7841598cb99f661b25736f P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.135572 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 441) took 1941 ms. Trace:
I20260620 07:01:06.135756 1165 rpcz_store.cc:276] 0620 07:01:04.193705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.193891 (+ 186us) service_pool.cc:227] Handling call
0620 07:01:06.113348 (+1919457us) ts_tablet_manager.cc:1145] Deleting tablet 369c205d7f7841598cb99f661b25736f
0620 07:01:06.113357 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.130695 (+ 17338us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.133882 (+ 3187us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.135513 (+ 1631us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1919137}
I20260620 07:01:06.136435 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 369c205d7f7841598cb99f661b25736f (table default.Table_f655e04dd3f446debfb3219c289dcadb [id=6654082b40084682b5bf224e82c955df]) successfully deleted
I20260620 07:01:06.136590 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31c56e80a73c442aa3cc65126a76c8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.139089 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 444) took 1826 ms. Trace:
I20260620 07:01:06.139294 1165 rpcz_store.cc:276] 0620 07:01:04.312867 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.312922 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:06.138913 (+1825991us) ts_tablet_manager.cc:1145] Deleting tablet 3eda988492234d6aaeaee87f84f99d06
0620 07:01:06.138925 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.139044 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1825773}
I20260620 07:01:06.139443 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4988c5cbb3a4818bc024da7472b96ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.139624 1167 raft_consensus.cc:348] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:06.139923 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3eda988492234d6aaeaee87f84f99d06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eda988492234d6aaeaee87f84f99d06 already in progress: creating tablet
I20260620 07:01:06.140213 1167 raft_consensus.cc:374] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.141040 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 449) took 1722 ms. Trace:
I20260620 07:01:06.141242 1165 rpcz_store.cc:276] 0620 07:01:04.418027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.418095 (+ 68us) service_pool.cc:227] Handling call
0620 07:01:06.140206 (+1722111us) ts_tablet_manager.cc:1145] Deleting tablet 125e8a5e20bf484cade408f0358489a1
0620 07:01:06.140217 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.140506 (+ 289us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1701161}
I20260620 07:01:06.142392 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 456) took 1683 ms. Trace:
I20260620 07:01:06.143553 1167 raft_consensus.cc:729] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:06.143831 1165 rpcz_store.cc:276] 0620 07:01:04.459043 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.459132 (+ 89us) service_pool.cc:227] Handling call
0620 07:01:06.142235 (+1683103us) ts_tablet_manager.cc:1145] Deleting tablet d0c41bf6a8a448ad809292d66ebf9c0e
0620 07:01:06.142246 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.142354 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1682906}
I20260620 07:01:06.144781 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 457) took 1679 ms. Trace:
I20260620 07:01:06.144959 1165 rpcz_store.cc:276] 0620 07:01:04.465261 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.465319 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:06.144649 (+1679330us) ts_tablet_manager.cc:1145] Deleting tablet d53c90eff33044479838ff67dea93057
0620 07:01:06.144660 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.144750 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1678599}
I20260620 07:01:06.145315 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 490eb0893a4f4811b7574c445e483549. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:06.145704 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d53c90eff33044479838ff67dea93057 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d53c90eff33044479838ff67dea93057 already in progress: creating tablet
I20260620 07:01:06.146121 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 442) took 1876 ms. Trace:
I20260620 07:01:06.146885 1165 rpcz_store.cc:276] 0620 07:01:04.269831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.274510 (+ 4679us) service_pool.cc:227] Handling call
0620 07:01:06.145995 (+1871485us) ts_tablet_manager.cc:1145] Deleting tablet f793a91ab247408bbe4a9f7cb370fffe
0620 07:01:06.146006 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.146090 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1677647}
I20260620 07:01:06.147365 1008 tablet_service.cc:1514] Processing DeleteTablet for tablet b8e2d451eb1f48ff81828d7070a20027 with delete_type TABLET_DATA_DELETED (replaced by tablet b37f2c150b314b7298f32c3d414ff43d) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:06.147555 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f793a91ab247408bbe4a9f7cb370fffe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f793a91ab247408bbe4a9f7cb370fffe already in progress: creating tablet
I20260620 07:01:06.146018 1167 consensus_queue.cc:260] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.152626 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 177) took 7364 ms. Trace:
I20260620 07:01:06.152889 1165 tablet_replica.cc:330] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.153199 1165 raft_consensus.cc:2229] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:06.153352 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a594df0df6ad48cab77cc1deed22bff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.154203 1170 tablet_bootstrap.cc:654] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.155754 1168 tablet_bootstrap.cc:492] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:06.156169 1168 ts_tablet_manager.cc:1397] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.012s
I20260620 07:01:06.157449 1168 raft_consensus.cc:348] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.157739 1168 raft_consensus.cc:374] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.157896 1168 raft_consensus.cc:729] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:06.158427 1168 consensus_queue.cc:260] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.159241 1168 ts_tablet_manager.cc:1428] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:06.159626 1168 tablet_bootstrap.cc:492] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:06.161372 1168 tablet_bootstrap.cc:654] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.163130 1165 pending_rounds.cc:62] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:06.170271 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 890aeebaed044b9c9a0a207be0b1f69d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.177111 1165 pending_rounds.cc:68] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821594396401664 op_type: NO_OP noop_request { }
I20260620 07:01:06.177325 1165 raft_consensus.cc:2866] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:06.177456 1165 raft_consensus.cc:2258] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.178640 1165 ts_tablet_manager.cc:1905] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.181561 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6cfbc068f51142a59236d86d8e246da5" } modify_external_catalogs: true
I20260620 07:01:06.181888 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6cfbc068f51142a59236d86d8e246da5" } modify_external_catalogs: true
I20260620 07:01:06.185241 1166 rpcz_store.cc:276] 0620 07:00:58.782068 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.782420 (+ 352us) service_pool.cc:227] Handling call
0620 07:01:05.525888 (+6743468us) ts_tablet_manager.cc:1145] Deleting tablet 33517843ce1d4d8786c91fd738d81ab2
0620 07:01:05.525902 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:05.540774 (+ 14872us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:05.893377 (+352603us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.146416 (+253039us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6743272}
I20260620 07:01:06.188835 1165 ts_tablet_manager.cc:1918] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:06.188966 1167 ts_tablet_manager.cc:1428] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260620 07:01:06.190804 1165 log.cc:1196] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ea6102e0da4e42cd9f1d6e294bb372b2
I20260620 07:01:06.191999 1165 ts_tablet_manager.cc:1939] T ea6102e0da4e42cd9f1d6e294bb372b2 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.193380 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 458) took 1681 ms. Trace:
I20260620 07:01:06.193580 1165 rpcz_store.cc:276] 0620 07:01:04.511887 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.513495 (+ 1608us) service_pool.cc:227] Handling call
0620 07:01:06.152290 (+1638795us) ts_tablet_manager.cc:1145] Deleting tablet ea6102e0da4e42cd9f1d6e294bb372b2
0620 07:01:06.152814 (+ 524us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.183428 (+ 30614us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.188659 (+ 5231us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.193336 (+ 4677us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1636055}
I20260620 07:01:06.194694 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 474) took 1343 ms. Trace:
I20260620 07:01:06.195569 1166 tablet_replica.cc:330] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:06.195845 1166 raft_consensus.cc:2229] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:06.196487 747 thread.cc:636] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.547s user 0.000s sys 0.013s
I20260620 07:01:06.198343 1165 rpcz_store.cc:276] 0620 07:01:04.851688 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.851876 (+ 188us) service_pool.cc:227] Handling call
0620 07:01:06.194461 (+1342585us) ts_tablet_manager.cc:1145] Deleting tablet 48726d9a3aa745fca3bcd9b6e8807c49
0620 07:01:06.194524 (+ 63us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.194663 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1342345}
I20260620 07:01:06.198442 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 458) took 1800 ms. Trace:
I20260620 07:01:06.198913 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ea6102e0da4e42cd9f1d6e294bb372b2 (table default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]) successfully deleted
I20260620 07:01:06.198669 1169 rpcz_store.cc:276] 0620 07:01:04.362834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.363713 (+ 879us) service_pool.cc:227] Handling call
0620 07:01:06.163209 (+1799496us) ts_tablet_manager.cc:1145] Deleting tablet 125e8a5e20bf484cade408f0358489a1
0620 07:01:06.163334 (+ 125us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.163686 (+ 352us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1787704}
I20260620 07:01:06.201144 1166 raft_consensus.cc:2258] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.201799 1166 ts_tablet_manager.cc:1905] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.203717 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e9f0dba4466436f9cfc730d7d6b15fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.203835 727 tablet_service.cc:1514] Processing DeleteTablet for tablet b8e2d451eb1f48ff81828d7070a20027 with delete_type TABLET_DATA_DELETED (replaced by tablet b37f2c150b314b7298f32c3d414ff43d) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:06.206173 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 48726d9a3aa745fca3bcd9b6e8807c49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48726d9a3aa745fca3bcd9b6e8807c49 already in progress: creating tablet
I20260620 07:01:06.206764 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 473) took 1355 ms. Trace:
I20260620 07:01:06.207373 1165 rpcz_store.cc:276] 0620 07:01:04.851595 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.853998 (+ 2403us) service_pool.cc:227] Handling call
0620 07:01:06.206592 (+1352594us) ts_tablet_manager.cc:1145] Deleting tablet 6a36a5319a044e9da7dc7b666484e257
0620 07:01:06.206608 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.206726 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1352367}
W20260620 07:01:06.208312 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6a36a5319a044e9da7dc7b666484e257 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a36a5319a044e9da7dc7b666484e257 already in progress: creating tablet
I20260620 07:01:06.208905 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 472) took 1357 ms. Trace:
I20260620 07:01:06.209432 1165 rpcz_store.cc:276] 0620 07:01:04.851462 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.854850 (+ 3388us) service_pool.cc:227] Handling call
0620 07:01:06.208730 (+1353880us) ts_tablet_manager.cc:1145] Deleting tablet 7cf81c5c0d9744f5a8c3f0866a435ae3
0620 07:01:06.208744 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.208868 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1341474}
W20260620 07:01:06.210865 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 already in progress: creating tablet
I20260620 07:01:06.211455 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 471) took 1360 ms. Trace:
I20260620 07:01:06.211934 1167 tablet_bootstrap.cc:492] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:06.211967 1165 rpcz_store.cc:276] 0620 07:01:04.851344 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.856949 (+ 5605us) service_pool.cc:227] Handling call
0620 07:01:06.211300 (+1354351us) ts_tablet_manager.cc:1145] Deleting tablet 2057b7689b1c4c65901ed8ec04279568
0620 07:01:06.211314 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.211419 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1343897}
W20260620 07:01:06.212872 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2057b7689b1c4c65901ed8ec04279568 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2057b7689b1c4c65901ed8ec04279568 already in progress: creating tablet
I20260620 07:01:06.213538 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 476) took 1216 ms. Trace:
I20260620 07:01:06.214046 1165 rpcz_store.cc:276] 0620 07:01:04.996972 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.018281 (+ 21309us) service_pool.cc:227] Handling call
0620 07:01:06.213361 (+1195080us) ts_tablet_manager.cc:1145] Deleting tablet f2426d52b8ff40f39887545e0341a91a
0620 07:01:06.213375 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.213502 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1194207}
W20260620 07:01:06.214867 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f2426d52b8ff40f39887545e0341a91a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2426d52b8ff40f39887545e0341a91a already in progress: creating tablet
I20260620 07:01:06.215328 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 475) took 1219 ms. Trace:
I20260620 07:01:06.215731 1165 rpcz_store.cc:276] 0620 07:01:04.995669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.010952 (+ 15283us) service_pool.cc:227] Handling call
0620 07:01:06.215204 (+1204252us) ts_tablet_manager.cc:1145] Deleting tablet a6c7b3977b604cb69df671318fae1212
0620 07:01:06.215214 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.215295 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1193602}
W20260620 07:01:06.216356 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a6c7b3977b604cb69df671318fae1212 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6c7b3977b604cb69df671318fae1212 already in progress: creating tablet
I20260620 07:01:06.216717 1165 tablet_replica.cc:330] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.217136 1165 raft_consensus.cc:2229] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.217586 1165 raft_consensus.cc:2258] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.220494 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 33517843ce1d4d8786c91fd738d81ab2 (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]) successfully deleted
I20260620 07:01:06.217824 830 leader_election.cc:302] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:06.224064 830 leader_election.cc:341] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:06.224237 830 leader_election.cc:302] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:06.226356 1773 raft_consensus.cc:2726] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:06.227150 1740 raft_consensus.cc:2684] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Received pre-election callback for term 1 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260620 07:01:06.227532 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6363d1d9233d4938ba40abff452ed147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.228284 1165 ts_tablet_manager.cc:1905] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:06.229803 720 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s user 0.000s sys 0.013s
I20260620 07:01:06.236374 1740 raft_consensus.cc:482] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:06.236555 1740 raft_consensus.cc:504] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.237226 1740 leader_election.cc:288] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:06.241775 720 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.697s user 0.000s sys 0.013s
W20260620 07:01:06.242502 747 thread.cc:602] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.603s user 0.000s sys 0.013s
I20260620 07:01:06.243732 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2004ff6f00a441578b8e702e8c7605fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.247321 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 465) took 1786 ms. Trace:
W20260620 07:01:06.252859 831 leader_election.cc:341] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: add9e860802d4edebcfbc9fa3c4a6b24
I20260620 07:01:06.254774 1165 ts_tablet_manager.cc:1918] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:06.257036 1165 log.cc:1196] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/e7d1e4719cd441dd8054b24861cbd8a2
I20260620 07:01:06.258249 1165 ts_tablet_manager.cc:1939] T e7d1e4719cd441dd8054b24861cbd8a2 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:06.258245 749 thread.cc:636] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.562s user 0.002s sys 0.012s
W20260620 07:01:06.258409 749 thread.cc:602] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.600s user 0.002s sys 0.013s
I20260620 07:01:06.262643 1168 tablet_bootstrap.cc:492] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:06.263054 1168 ts_tablet_manager.cc:1397] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.104s user 0.016s sys 0.009s
I20260620 07:01:06.256984 1169 rpcz_store.cc:276] 0620 07:01:04.454605 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.454766 (+ 161us) service_pool.cc:227] Handling call
0620 07:01:06.199318 (+1744552us) ts_tablet_manager.cc:1145] Deleting tablet d0c41bf6a8a448ad809292d66ebf9c0e
0620 07:01:06.199332 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.241246 (+ 41914us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1744260}
I20260620 07:01:06.264344 1168 raft_consensus.cc:348] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.264760 1168 raft_consensus.cc:374] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.264899 1168 raft_consensus.cc:729] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:06.265229 1168 consensus_queue.cc:260] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.265892 1168 ts_tablet_manager.cc:1428] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:06.269146 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 6 got 4
I20260620 07:01:06.271273 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_550044437fae426dbb1eb8da5c11d8aa" } modify_external_catalogs: true
I20260620 07:01:06.271534 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_550044437fae426dbb1eb8da5c11d8aa" } modify_external_catalogs: true
I20260620 07:01:06.271996 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 203ba3933d3a4fb2a4978b29cad614e6 with delete_type TABLET_DATA_DELETED (replaced by tablet f690e150839a4d23860932712f61e7c8) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:06.272222 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d7cec62aea048d3bbe38ab2f83f7656 consensus state has no leader
I20260620 07:01:06.272221 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 485) took 1203 ms. Trace:
I20260620 07:01:06.272339 874 tablet_service.cc:1514] Processing DeleteTablet for tablet add9e860802d4edebcfbc9fa3c4a6b24 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a46df2909bf43f297b412c33f18a329) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.272069 1168 tablet_bootstrap.cc:492] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:06.272661 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8f962786c05b4ad2931bf26dab569bea" } new_table_name: "default.Table_411089a06f704215ae2532a11925490c" modify_external_catalogs: true
I20260620 07:01:06.274412 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_468069c87bb943f1b56bd44a93568e3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:06.275002 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_468069c87bb943f1b56bd44a93568e3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.272334 1165 rpcz_store.cc:276] 0620 07:01:05.069190 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.069269 (+ 79us) service_pool.cc:227] Handling call
0620 07:01:06.216657 (+1147388us) ts_tablet_manager.cc:1145] Deleting tablet e7d1e4719cd441dd8054b24861cbd8a2
0620 07:01:06.216667 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.232385 (+ 15718us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.254603 (+ 22218us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.272156 (+ 17553us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1147154}
I20260620 07:01:06.276507 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet e7d1e4719cd441dd8054b24861cbd8a2 (table default.Table_705dc245b225442eb3ba5fc4731c8e12 [id=b9301ede677241efa94753841070351a]) successfully deleted
I20260620 07:01:06.276547 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 40c9d2d029434f37ba23d65f6662893b from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:06.277199 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 486) took 1172 ms. Trace:
I20260620 07:01:06.277344 421 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet ce85caa98ef74515b90d362acd614f8e
I20260620 07:01:06.277303 1165 rpcz_store.cc:276] 0620 07:01:05.104943 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.105004 (+ 61us) service_pool.cc:227] Handling call
0620 07:01:06.276771 (+1171767us) ts_tablet_manager.cc:1145] Deleting tablet 2c0bb50405d0446488272384523c2deb
0620 07:01:06.276782 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.276885 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1171544}
W20260620 07:01:06.277729 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2c0bb50405d0446488272384523c2deb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c0bb50405d0446488272384523c2deb already in progress: creating tablet
I20260620 07:01:06.278271 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 487) took 1169 ms. Trace:
I20260620 07:01:06.278357 1165 rpcz_store.cc:276] 0620 07:01:05.108935 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.108990 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:06.278128 (+1169138us) ts_tablet_manager.cc:1145] Deleting tablet 777a6b981b7f43a4ba8978ba6f3971e1
0620 07:01:06.278138 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.278223 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168853}
W20260620 07:01:06.278728 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 777a6b981b7f43a4ba8978ba6f3971e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 777a6b981b7f43a4ba8978ba6f3971e1 already in progress: creating tablet
I20260620 07:01:06.279596 1168 tablet_bootstrap.cc:654] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.280618 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 488) took 1162 ms. Trace:
I20260620 07:01:06.280726 1165 rpcz_store.cc:276] 0620 07:01:05.117979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.118034 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:06.280478 (+1162444us) ts_tablet_manager.cc:1145] Deleting tablet fbf912f51bfd4df0afe7aa28815a897e
0620 07:01:06.280487 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.280571 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1162205}
I20260620 07:01:06.280913 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 467) took 1798 ms. Trace:
I20260620 07:01:06.281054 1169 rpcz_store.cc:276] 0620 07:01:04.469774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.471060 (+ 1286us) service_pool.cc:227] Handling call
0620 07:01:06.263637 (+1792577us) ts_tablet_manager.cc:1145] Deleting tablet d53c90eff33044479838ff67dea93057
0620 07:01:06.263653 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.267804 (+ 4151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1777245}
W20260620 07:01:06.281167 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fbf912f51bfd4df0afe7aa28815a897e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbf912f51bfd4df0afe7aa28815a897e already in progress: creating tablet
I20260620 07:01:06.281587 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 489) took 1136 ms. Trace:
I20260620 07:01:06.281620 1169 tablet_replica.cc:330] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:06.281672 1165 rpcz_store.cc:276] 0620 07:01:05.145236 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.145410 (+ 174us) service_pool.cc:227] Handling call
0620 07:01:06.281411 (+1136001us) ts_tablet_manager.cc:1145] Deleting tablet ee90d961729b4088b0a312ec770d3cd0
0620 07:01:06.281420 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.281540 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1135650}
I20260620 07:01:06.281841 1169 raft_consensus.cc:2229] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.282058 1169 raft_consensus.cc:2258] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:06.282080 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ee90d961729b4088b0a312ec770d3cd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee90d961729b4088b0a312ec770d3cd0 already in progress: creating tablet
I20260620 07:01:06.282436 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 494) took 1045 ms. Trace:
I20260620 07:01:06.282536 1165 rpcz_store.cc:276] 0620 07:01:05.236690 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.236750 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:06.282297 (+1045547us) ts_tablet_manager.cc:1145] Deleting tablet 0a4bebaa8ed1431d8c775f4856a3d808
0620 07:01:06.282306 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.282385 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1045340}
I20260620 07:01:06.282733 1169 ts_tablet_manager.cc:1905] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:06.282975 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0a4bebaa8ed1431d8c775f4856a3d808 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a4bebaa8ed1431d8c775f4856a3d808 already in progress: creating tablet
I20260620 07:01:06.284564 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 495) took 1042 ms. Trace:
I20260620 07:01:06.284686 1165 rpcz_store.cc:276] 0620 07:01:05.242263 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.242317 (+ 54us) service_pool.cc:227] Handling call
0620 07:01:06.284367 (+1042050us) ts_tablet_manager.cc:1145] Deleting tablet 88c01c4e10f345fc84e3e253e8501aff
0620 07:01:06.284379 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.284511 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1041850}
W20260620 07:01:06.285184 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 88c01c4e10f345fc84e3e253e8501aff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88c01c4e10f345fc84e3e253e8501aff already in progress: creating tablet
W20260620 07:01:06.286363 969 consensus_peers.cc:487] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04d5d361a5404dcf99a89e93ac1f7dd8. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:06.286690 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add9e860802d4edebcfbc9fa3c4a6b24" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:06.286856 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 497) took 1041 ms. Trace:
I20260620 07:01:06.286952 1165 rpcz_store.cc:276] 0620 07:01:05.245570 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.245619 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:06.286670 (+1041051us) ts_tablet_manager.cc:1145] Deleting tablet e37f336c01974ba79caeb25f4781667a
0620 07:01:06.286683 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.286780 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1040827}
W20260620 07:01:06.287319 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e37f336c01974ba79caeb25f4781667a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e37f336c01974ba79caeb25f4781667a already in progress: creating tablet
I20260620 07:01:06.291770 1165 tablet_replica.cc:330] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:06.292923 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d53c90eff33044479838ff67dea93057 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d53c90eff33044479838ff67dea93057 already in progress: creating tablet
I20260620 07:01:06.293162 1165 raft_consensus.cc:2229] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.293383 1165 raft_consensus.cc:2258] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.293613 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_23b632bb60cf401e8b3ecafcb4065636"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:06.293991 1165 ts_tablet_manager.cc:1905] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:06.294255 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23b632bb60cf401e8b3ecafcb4065636 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.300185 1764 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260620 07:01:06.298703 830 leader_election.cc:341] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:06.304986 830 leader_election.cc:302] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:06.305326 1740 raft_consensus.cc:2726] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:06.313006 1740 raft_consensus.cc:482] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:06.313308 1740 raft_consensus.cc:504] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.314195 1740 leader_election.cc:288] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:06.318442 874 tablet_service.cc:1514] Processing DeleteTablet for tablet b6e36ffd69974ef897390a257f63a509 with delete_type TABLET_DATA_DELETED (replaced by tablet 54bb495eea4c49b7ad7bf2300ad0e60a) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.320712 1165 ts_tablet_manager.cc:1918] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:06.322327 831 leader_election.cc:341] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 169b93c38e59435db218152f2d25bdfa
I20260620 07:01:06.331748 1165 log.cc:1196] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/360880717af145628606b5b9fb26e350
I20260620 07:01:06.332185 1165 ts_tablet_manager.cc:1939] T 360880717af145628606b5b9fb26e350 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.332530 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 496) took 1087 ms. Trace:
I20260620 07:01:06.332660 1165 rpcz_store.cc:276] 0620 07:01:05.245431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.245870 (+ 439us) service_pool.cc:227] Handling call
0620 07:01:06.291687 (+1045817us) ts_tablet_manager.cc:1145] Deleting tablet 360880717af145628606b5b9fb26e350
0620 07:01:06.291696 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.297513 (+ 5817us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.320581 (+ 23068us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.332498 (+ 11917us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1045633}
I20260620 07:01:06.333110 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 500) took 1073 ms. Trace:
I20260620 07:01:06.333173 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 360880717af145628606b5b9fb26e350 (table default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]) successfully deleted
I20260620 07:01:06.333230 1165 rpcz_store.cc:276] 0620 07:01:05.259175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.262857 (+ 3682us) service_pool.cc:227] Handling call
0620 07:01:06.332957 (+1070100us) ts_tablet_manager.cc:1145] Deleting tablet b4ee5c79e2a6419ea3847cbebdeced79
0620 07:01:06.332967 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.333071 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1069877}
W20260620 07:01:06.333623 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b4ee5c79e2a6419ea3847cbebdeced79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ee5c79e2a6419ea3847cbebdeced79 already in progress: creating tablet
W20260620 07:01:06.333925 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e14db4e3394046e49ecc69c9ca4dc840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e14db4e3394046e49ecc69c9ca4dc840 already in progress: creating tablet
W20260620 07:01:06.334173 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b8659e903084f15ac3d9ea8c4c0dc0f already in progress: creating tablet
W20260620 07:01:06.334430 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet af743ffd2eb2427caa3779c7fceb8f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af743ffd2eb2427caa3779c7fceb8f30 already in progress: creating tablet
W20260620 07:01:06.334661 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 4308d1a5bec34588844920fa89a5db26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4308d1a5bec34588844920fa89a5db26 already in progress: creating tablet
W20260620 07:01:06.334928 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 74eaa712962245b4bb14d17e4cdd8485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74eaa712962245b4bb14d17e4cdd8485 already in progress: creating tablet
W20260620 07:01:06.335171 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 91f8c4955c164e6b9061ac607bbe081c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91f8c4955c164e6b9061ac607bbe081c already in progress: creating tablet
W20260620 07:01:06.335402 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 26719543504847389de3c3102efcc9b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26719543504847389de3c3102efcc9b2 already in progress: creating tablet
W20260620 07:01:06.335616 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5d69ca4ae7434ca5b647e9135b5108ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d69ca4ae7434ca5b647e9135b5108ee already in progress: creating tablet
W20260620 07:01:06.335830 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 94e5ddcaf596455289fab50876c27dce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94e5ddcaf596455289fab50876c27dce already in progress: creating tablet
W20260620 07:01:06.336071 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d4988c5cbb3a4818bc024da7472b96ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4988c5cbb3a4818bc024da7472b96ff already in progress: creating tablet
W20260620 07:01:06.343111 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f591ba26b91b47f9a8933878d478655d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f591ba26b91b47f9a8933878d478655d already in progress: creating tablet
I20260620 07:01:06.343900 1165 tablet_replica.cc:330] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.344125 1165 raft_consensus.cc:2229] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.344313 1165 raft_consensus.cc:2258] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:06.344451 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5208f3136bcd45579de49b8b10745122 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5208f3136bcd45579de49b8b10745122 already in progress: creating tablet
W20260620 07:01:06.345173 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b8e2d451eb1f48ff81828d7070a20027 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8e2d451eb1f48ff81828d7070a20027 already in progress: creating tablet
I20260620 07:01:06.353461 1165 ts_tablet_manager.cc:1905] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.356159 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98544574a8cd4a86a443284a421fa030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.364975 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 6 got 5
I20260620 07:01:06.366078 1165 ts_tablet_manager.cc:1918] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:06.366334 1165 log.cc:1196] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/169b93c38e59435db218152f2d25bdfa
I20260620 07:01:06.366847 1165 ts_tablet_manager.cc:1939] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.367492 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 169b93c38e59435db218152f2d25bdfa (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]) successfully deleted
I20260620 07:01:06.367605 1165 tablet_replica.cc:330] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.367971 1165 raft_consensus.cc:2229] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.368264 1165 raft_consensus.cc:2258] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.371604 1165 ts_tablet_manager.cc:1905] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.389616 1165 ts_tablet_manager.cc:1918] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:06.389897 1165 log.cc:1196] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/203ba3933d3a4fb2a4978b29cad614e6
I20260620 07:01:06.390410 1165 ts_tablet_manager.cc:1939] T 203ba3933d3a4fb2a4978b29cad614e6 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.391184 1165 tablet_replica.cc:330] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.391851 1170 tablet_bootstrap.cc:492] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:06.395560 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 203ba3933d3a4fb2a4978b29cad614e6 (table default.Table_52bd8cf613ad458b8436906e69e4cbd8 [id=72036a5a731244a4a1f797ec8663aef8]) successfully deleted
I20260620 07:01:06.395931 1762 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260620 07:01:06.397485 1170 ts_tablet_manager.cc:1397] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.680s user 0.007s sys 0.004s
I20260620 07:01:06.400924 1165 raft_consensus.cc:2229] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.401278 1165 raft_consensus.cc:2258] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.407455 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 588776a580144e679d8a9a240d4a04ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.405507 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169b93c38e59435db218152f2d25bdfa" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:06.410588 1165 ts_tablet_manager.cc:1905] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.421242 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 6 got 4
I20260620 07:01:06.421337 1170 raft_consensus.cc:348] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.421603 1170 raft_consensus.cc:374] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.421747 1170 raft_consensus.cc:729] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:06.422039 1170 consensus_queue.cc:260] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.422834 1170 ts_tablet_manager.cc:1428] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260620 07:01:06.441170 1762 tablet.cc:1722] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:06.442065 1764 tablet.cc:1722] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:06.443856 1165 ts_tablet_manager.cc:1918] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:06.449797 1170 tablet_bootstrap.cc:492] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:06.451769 1170 tablet_bootstrap.cc:654] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.462983 1165 log.cc:1196] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/add9e860802d4edebcfbc9fa3c4a6b24
I20260620 07:01:06.463676 1165 ts_tablet_manager.cc:1939] T add9e860802d4edebcfbc9fa3c4a6b24 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:06.464501 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4444360e8ade484f958816c5b80dca7e consensus state has no leader
I20260620 07:01:06.466684 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9b931e3e87534341b6bb5d0edd6e7dca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:06.468158 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1cf8ede352db4fbabbad8bf73d525087"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:06.480579 874 tablet_service.cc:1467] Processing CreateTablet for tablet 9dbfd0959737438e8508b96777afb8e1 (DEFAULT_TABLE table=default.Table_3ddd49ed6a384706b1b4548a74f18d04 [id=12048e9dd9204beba16542fe67618456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.482281 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dbfd0959737438e8508b96777afb8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.483129 865 tablet_service.cc:1467] Processing CreateTablet for tablet 030b90899c3c4c7e82807a61234f223e (DEFAULT_TABLE table=default.Table_68f462254d2f4d64a04f93bbfeb6204f [id=7b62ce7bdae2483ba9d818ff3e4b2ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.483589 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 030b90899c3c4c7e82807a61234f223e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.490444 1165 tablet_replica.cc:330] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.490756 1165 raft_consensus.cc:2229] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.491035 1165 raft_consensus.cc:2258] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.491400 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet add9e860802d4edebcfbc9fa3c4a6b24 (table default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]) successfully deleted
I20260620 07:01:06.491943 1165 ts_tablet_manager.cc:1905] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.493238 1169 ts_tablet_manager.cc:1918] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:06.494180 969 consensus_peers.cc:487] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81704d3a3cf648d987d4b40a270f7508. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:06.494892 1169 log.cc:1196] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/203ba3933d3a4fb2a4978b29cad614e6
I20260620 07:01:06.495748 716 tablet_service.cc:1467] Processing CreateTablet for tablet 9dbfd0959737438e8508b96777afb8e1 (DEFAULT_TABLE table=default.Table_3ddd49ed6a384706b1b4548a74f18d04 [id=12048e9dd9204beba16542fe67618456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.496287 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dbfd0959737438e8508b96777afb8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.498137 1165 ts_tablet_manager.cc:1918] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:06.498391 1165 log.cc:1196] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/b6e36ffd69974ef897390a257f63a509
I20260620 07:01:06.499819 1165 ts_tablet_manager.cc:1939] T b6e36ffd69974ef897390a257f63a509 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.500140 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c9ad0680f1da4504b87d9d0d6bcbabcb
I20260620 07:01:06.500240 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8088fadabff64c35aa96a1ede17318c3
I20260620 07:01:06.500931 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b24a25dee4d246e28df4d574ec737953" } new_table_name: "default.Table_9016cc3335c9474492924d45cbc4dcea" modify_external_catalogs: true
I20260620 07:01:06.500999 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fa0592a238ee4a3cb3150301dbb13135"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:06.502199 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 366d713325f84c8b9b1c1f4296513a20
I20260620 07:01:06.502749 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b614a5e33a1044439547e886f07c85bf" } new_table_name: "default.Table_8da43d7e15014c0086f338f67303bc34" modify_external_catalogs: true
I20260620 07:01:06.503068 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 09886cbd967549118d3b1ba116f7834f
I20260620 07:01:06.503855 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_47d0fc88515d40168f24f17a58c66098"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:06.505499 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0efec7113a5b44f296e756dde466b82f
I20260620 07:01:06.505921 423 catalog_manager.cc:6565] ReplaceTablet: tablet 0efec7113a5b44f296e756dde466b82f deleted and replaced by tablet 9b69d0b1d57d41b284a103a6128e5256
I20260620 07:01:06.506309 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f0ce8fdcfe2e4b7ab9659cfbb3fdf49b" } new_table_name: "default.Table_a7132339336c4cde8e1bf9740c940062" modify_external_catalogs: true
I20260620 07:01:06.505138 1169 ts_tablet_manager.cc:1939] T 203ba3933d3a4fb2a4978b29cad614e6 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:06.507961 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 40c9d2d029434f37ba23d65f6662893b
I20260620 07:01:06.508459 424 catalog_manager.cc:6565] ReplaceTablet: tablet 40c9d2d029434f37ba23d65f6662893b deleted and replaced by tablet 8aa5c040d5e84006935e9f06424a34b4
I20260620 07:01:06.508702 424 master_service.cc:946] ReplaceTablet: received request to replace tablet a5757e05e9a2403a86ca98f455e11754 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:06.509236 424 master_service.cc:946] ReplaceTablet: received request to replace tablet d3823954542a4928a99c1602c4f01ee2 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:06.515079 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 09886cbd967549118d3b1ba116f7834f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.515307 874 tablet_service.cc:1514] Processing DeleteTablet for tablet c9ad0680f1da4504b87d9d0d6bcbabcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.515425 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 0efec7113a5b44f296e756dde466b82f with delete_type TABLET_DATA_DELETED (replaced by tablet 9b69d0b1d57d41b284a103a6128e5256) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.515545 871 tablet_service.cc:1514] Processing DeleteTablet for tablet 8088fadabff64c35aa96a1ede17318c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.515692 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c9d2d029434f37ba23d65f6662893b with delete_type TABLET_DATA_DELETED (replaced by tablet 8aa5c040d5e84006935e9f06424a34b4) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.515733 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 366d713325f84c8b9b1c1f4296513a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.516081 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet b6e36ffd69974ef897390a257f63a509 (table default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]) successfully deleted
I20260620 07:01:06.517068 726 tablet_service.cc:1467] Processing CreateTablet for tablet 030b90899c3c4c7e82807a61234f223e (DEFAULT_TABLE table=default.Table_68f462254d2f4d64a04f93bbfeb6204f [id=7b62ce7bdae2483ba9d818ff3e4b2ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.517578 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 030b90899c3c4c7e82807a61234f223e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:06.518462 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 09886cbd967549118d3b1ba116f7834f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09886cbd967549118d3b1ba116f7834f already in progress: creating tablet
I20260620 07:01:06.519048 872 tablet_service.cc:1467] Processing CreateTablet for tablet 5580a1cada4b453aa5bff8ea4ab6088b (DEFAULT_TABLE table=default.Table_80e45984a0114ae6bbe50db3b07da598 [id=ecd951623a834f488e4b620de58e41f3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:06.519285 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c9ad0680f1da4504b87d9d0d6bcbabcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9ad0680f1da4504b87d9d0d6bcbabcb already in progress: creating tablet
I20260620 07:01:06.519495 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5580a1cada4b453aa5bff8ea4ab6088b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:06.519618 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0efec7113a5b44f296e756dde466b82f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0efec7113a5b44f296e756dde466b82f already in progress: creating tablet
W20260620 07:01:06.519892 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8088fadabff64c35aa96a1ede17318c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8088fadabff64c35aa96a1ede17318c3 already in progress: creating tablet
W20260620 07:01:06.520138 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 40c9d2d029434f37ba23d65f6662893b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40c9d2d029434f37ba23d65f6662893b already in progress: creating tablet
W20260620 07:01:06.520429 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 366d713325f84c8b9b1c1f4296513a20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 366d713325f84c8b9b1c1f4296513a20 already in progress: creating tablet
W20260620 07:01:06.520884 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 960fca9c94764f3d8d2daae20a0f8388 consensus state has no leader
W20260620 07:01:06.521574 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb0f7d4b6fa14811a1f02456418f95a4 consensus state has no leader
W20260620 07:01:06.522082 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1252d1dd03bd4a27983eb89d489b09d3 consensus state has no leader
I20260620 07:01:06.522255 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d3823954542a4928a99c1602c4f01ee2
I20260620 07:01:06.522694 424 catalog_manager.cc:6565] ReplaceTablet: tablet d3823954542a4928a99c1602c4f01ee2 deleted and replaced by tablet e3d9c37e2e2842b7b5eb3ed57d186305
I20260620 07:01:06.523208 722 tablet_service.cc:1514] Processing DeleteTablet for tablet c9ad0680f1da4504b87d9d0d6bcbabcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:06.524204 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 8088fadabff64c35aa96a1ede17318c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:06.525699 872 tablet_service.cc:1514] Processing DeleteTablet for tablet d3823954542a4928a99c1602c4f01ee2 with delete_type TABLET_DATA_DELETED (replaced by tablet e3d9c37e2e2842b7b5eb3ed57d186305) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.526052 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 466) took 2065 ms. Trace:
I20260620 07:01:06.526175 1169 rpcz_store.cc:276] 0620 07:01:04.460315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.461610 (+ 1295us) service_pool.cc:227] Handling call
0620 07:01:06.281520 (+1819910us) ts_tablet_manager.cc:1145] Deleting tablet 203ba3933d3a4fb2a4978b29cad614e6
0620 07:01:06.281536 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.459893 (+178357us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.492405 (+ 32512us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.526007 (+ 33602us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1794829}
I20260620 07:01:06.526357 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 366d713325f84c8b9b1c1f4296513a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:06.526770 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d3823954542a4928a99c1602c4f01ee2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3823954542a4928a99c1602c4f01ee2 already in progress: creating tablet
I20260620 07:01:06.526923 865 tablet_service.cc:1467] Processing CreateTablet for tablet 36a5dde9352f48a19f7a379dc40cf491 (DEFAULT_TABLE table=default.Table_a1fa87d2ca544da28827f34c9879e744 [id=3c0fe45f7132421ca2348b19a84abf91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.527482 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36a5dde9352f48a19f7a379dc40cf491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.528204 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 09886cbd967549118d3b1ba116f7834f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:06.529609 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 0efec7113a5b44f296e756dde466b82f with delete_type TABLET_DATA_DELETED (replaced by tablet 9b69d0b1d57d41b284a103a6128e5256) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:06.530954 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c9d2d029434f37ba23d65f6662893b with delete_type TABLET_DATA_DELETED (replaced by tablet 8aa5c040d5e84006935e9f06424a34b4) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:06.531320 1169 tablet_replica.cc:330] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:06.532927 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d9da1b03aae4cd9976109291ea43b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.533279 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 203ba3933d3a4fb2a4978b29cad614e6 (table default.Table_52bd8cf613ad458b8436906e69e4cbd8 [id=72036a5a731244a4a1f797ec8663aef8]) successfully deleted
W20260620 07:01:06.533535 1770 log.cc:924] Time spent T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20260620 07:01:06.535557 872 tablet_service.cc:1467] Processing CreateTablet for tablet 45027f6eb0ef4fa68d76dc7cb7c63f85 (DEFAULT_TABLE table=default.Table_cc17e206f1ef4964a639771377827a78 [id=ce859d47421144ce9a38762748d4d157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.536091 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45027f6eb0ef4fa68d76dc7cb7c63f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.538189 1794 raft_consensus.cc:482] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:06.538364 1794 raft_consensus.cc:504] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.539111 1794 leader_election.cc:288] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:06.539824 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7b70534507514814b1c557a5432f221b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:06.541536 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_55ffe770776d4251afe1898a2e765988"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:06.541611 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_70afee11662b4e4bb57022351f45ee15" } new_table_name: "default.Table_8c10f6a7df9345d09b270af387afc32d" modify_external_catalogs: true
W20260620 07:01:06.549780 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7524821997e64917849656060aaa706f consensus state has no leader
I20260620 07:01:06.564214 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e84e884648ed447c91e20b4a2be65197" } modify_external_catalogs: true
I20260620 07:01:06.564168 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fecf267dd00c407eaf57602a2584181b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:06.565442 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e84e884648ed447c91e20b4a2be65197" } modify_external_catalogs: true
I20260620 07:01:06.567209 1033 raft_consensus.cc:2454] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
W20260620 07:01:06.568588 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 132169us
I20260620 07:01:06.569691 830 leader_election.cc:302] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:06.569909 830 raft_consensus.cc:2670] T 169b93c38e59435db218152f2d25bdfa P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:06.575574 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 6 got 5
W20260620 07:01:06.577278 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55ffe770776d4251afe1898a2e765988 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.577407 1700 raft_consensus.cc:482] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:06.577587 1700 raft_consensus.cc:504] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.578212 1700 leader_election.cc:288] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:06.578613 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cf8ede352db4fbabbad8bf73d525087 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:06.579797 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b931e3e87534341b6bb5d0edd6e7dca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.580422 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 9dbfd0959737438e8508b96777afb8e1 (DEFAULT_TABLE table=default.Table_3ddd49ed6a384706b1b4548a74f18d04 [id=12048e9dd9204beba16542fe67618456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.580479 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet c9ad0680f1da4504b87d9d0d6bcbabcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:06.580967 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47d0fc88515d40168f24f17a58c66098 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.581100 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 8088fadabff64c35aa96a1ede17318c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.581642 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 366d713325f84c8b9b1c1f4296513a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:06.582175 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fecf267dd00c407eaf57602a2584181b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.582300 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 09886cbd967549118d3b1ba116f7834f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:06.582528 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa0592a238ee4a3cb3150301dbb13135 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.582782 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 0efec7113a5b44f296e756dde466b82f with delete_type TABLET_DATA_DELETED (replaced by tablet 9b69d0b1d57d41b284a103a6128e5256) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.583338 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c9d2d029434f37ba23d65f6662893b with delete_type TABLET_DATA_DELETED (replaced by tablet 8aa5c040d5e84006935e9f06424a34b4) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:06.583549 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b70534507514814b1c557a5432f221b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.584239 998 tablet_service.cc:1467] Processing CreateTablet for tablet 030b90899c3c4c7e82807a61234f223e (DEFAULT_TABLE table=default.Table_68f462254d2f4d64a04f93bbfeb6204f [id=7b62ce7bdae2483ba9d818ff3e4b2ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.585045 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 36a5dde9352f48a19f7a379dc40cf491 (DEFAULT_TABLE table=default.Table_a1fa87d2ca544da28827f34c9879e744 [id=3c0fe45f7132421ca2348b19a84abf91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.585681 997 tablet_service.cc:1514] Processing DeleteTablet for tablet d3823954542a4928a99c1602c4f01ee2 with delete_type TABLET_DATA_DELETED (replaced by tablet e3d9c37e2e2842b7b5eb3ed57d186305) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.586448 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 5580a1cada4b453aa5bff8ea4ab6088b (DEFAULT_TABLE table=default.Table_80e45984a0114ae6bbe50db3b07da598 [id=ecd951623a834f488e4b620de58e41f3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:06.588886 1013 consensus_meta.cc:287] T 8b2a9d1b793f4cb0a1ff7298e10c3162 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent flushing consensus metadata: real 0.510s user 0.002s sys 0.003s
I20260620 07:01:06.591904 872 tablet_service.cc:1467] Processing CreateTablet for tablet 0e864cac7431439b9eb18d0cd98a7755 (DEFAULT_TABLE table=default.Table_128623186307486c86826727c2978537 [id=ceb3d35427694e1099764949625fac6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.592516 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e864cac7431439b9eb18d0cd98a7755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.595623 865 tablet_service.cc:1467] Processing CreateTablet for tablet 40d9875dde7b4455b24b053781993234 (DEFAULT_TABLE table=default.Table_6559046a0e474633ad24c9215e23b506 [id=47d63992f58d45c3aef24a7a606ce4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.596112 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d9875dde7b4455b24b053781993234. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:06.600165 388 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4u_93S/build/asan/bin/kudu pid 466: Timed out: CheckLeaks RPC to 127.0.97.61:33455 timed out after 1.000s (SENT)
I20260620 07:01:06.600345 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4u_93S/build/asan/bin/kudu with pid 466
I20260620 07:01:06.603984 1764 tablet.cc:1722] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:06.622483 422 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_1b34f21beb944ba6a991b5bf4a8acecd [id=bce36d2915e7478ebbfcf02633f64563] alter complete (version 1)
I20260620 07:01:06.592171 722 tablet_service.cc:1467] Processing CreateTablet for tablet 36a5dde9352f48a19f7a379dc40cf491 (DEFAULT_TABLE table=default.Table_a1fa87d2ca544da28827f34c9879e744 [id=3c0fe45f7132421ca2348b19a84abf91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.593088 734 tablet_service.cc:1467] Processing CreateTablet for tablet 5580a1cada4b453aa5bff8ea4ab6088b (DEFAULT_TABLE table=default.Table_80e45984a0114ae6bbe50db3b07da598 [id=ecd951623a834f488e4b620de58e41f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.625468 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5580a1cada4b453aa5bff8ea4ab6088b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.594751 719 tablet_service.cc:1514] Processing DeleteTablet for tablet d3823954542a4928a99c1602c4f01ee2 with delete_type TABLET_DATA_DELETED (replaced by tablet e3d9c37e2e2842b7b5eb3ed57d186305) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:06.595645 721 tablet_service.cc:1467] Processing CreateTablet for tablet 45027f6eb0ef4fa68d76dc7cb7c63f85 (DEFAULT_TABLE table=default.Table_cc17e206f1ef4964a639771377827a78 [id=ce859d47421144ce9a38762748d4d157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.627453 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45027f6eb0ef4fa68d76dc7cb7c63f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.596588 723 tablet_service.cc:1514] Processing DeleteTablet for tablet ca380134173e42f6b562b56375f2ccad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:06.597352 731 tablet_service.cc:1467] Processing CreateTablet for tablet 0e864cac7431439b9eb18d0cd98a7755 (DEFAULT_TABLE table=default.Table_128623186307486c86826727c2978537 [id=ceb3d35427694e1099764949625fac6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.632501 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e864cac7431439b9eb18d0cd98a7755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.597945 720 tablet_service.cc:1467] Processing CreateTablet for tablet 40d9875dde7b4455b24b053781993234 (DEFAULT_TABLE table=default.Table_6559046a0e474633ad24c9215e23b506 [id=47d63992f58d45c3aef24a7a606ce4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.635118 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d9875dde7b4455b24b053781993234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.643555 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36a5dde9352f48a19f7a379dc40cf491. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:06.658376 831 connection.cc:535] client connection to 127.0.97.61:33455 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 07:01:06.589370 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 45027f6eb0ef4fa68d76dc7cb7c63f85 (DEFAULT_TABLE table=default.Table_cc17e206f1ef4964a639771377827a78 [id=ce859d47421144ce9a38762748d4d157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.601960 999 tablet_service.cc:1467] Processing CreateTablet for tablet 0e864cac7431439b9eb18d0cd98a7755 (DEFAULT_TABLE table=default.Table_128623186307486c86826727c2978537 [id=ceb3d35427694e1099764949625fac6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:06.602618 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 40d9875dde7b4455b24b053781993234 (DEFAULT_TABLE table=default.Table_6559046a0e474633ad24c9215e23b506 [id=47d63992f58d45c3aef24a7a606ce4bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:06.603045 969 leader_election.cc:341] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e2b0faf91f2f469f9b06e17caa4709e4
I20260620 07:01:06.612080 1167 tablet_bootstrap.cc:654] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.616880 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 030b90899c3c4c7e82807a61234f223e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.676592 895 raft_consensus.cc:1261] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Refusing update from remote peer 06a32ef63b2b495a9ade1de48c024ae9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:01:06.684489 1811 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260620 07:01:06.696166 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e864cac7431439b9eb18d0cd98a7755. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:06.697124 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 70825.4us
W20260620 07:01:06.698925 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 255685us
I20260620 07:01:06.685448 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d89e389b5c644055882085d52e4d1195"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:06.709079 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d89e389b5c644055882085d52e4d1195 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.721482 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dbfd0959737438e8508b96777afb8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.726475 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_128623186307486c86826727c2978537" } new_table_name: "default.Table_c3dc76e516e64345bd515e7d786b93a8" modify_external_catalogs: true
I20260620 07:01:06.741585 1700 raft_consensus.cc:482] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:06.746441 413 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.97.61:33455 (error 108) [suppressed 7 similar messages]
I20260620 07:01:06.750923 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5580a1cada4b453aa5bff8ea4ab6088b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.754944 1169 raft_consensus.cc:2229] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.755334 1169 raft_consensus.cc:2258] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.756022 1169 ts_tablet_manager.cc:1905] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.767220 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7fc63351f767447c99b819fe7848d381
I20260620 07:01:06.767647 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_19c484fd2214414ca2f3f07207342be4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:06.768317 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_209bda59817e4eaeadbd831379bfe659"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:06.769049 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19c484fd2214414ca2f3f07207342be4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.769471 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45027f6eb0ef4fa68d76dc7cb7c63f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.769654 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b043963ee56e4494be5b5a95ea01d158" } modify_external_catalogs: true
W20260620 07:01:06.769084 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_209bda59817e4eaeadbd831379bfe659 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:06.770023 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b043963ee56e4494be5b5a95ea01d158" } modify_external_catalogs: true
I20260620 07:01:06.770426 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d9875dde7b4455b24b053781993234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.770427 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8fedf097ca094cb29465c8f5f76f26bf" } modify_external_catalogs: true
I20260620 07:01:06.770666 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8fedf097ca094cb29465c8f5f76f26bf" } modify_external_catalogs: true
I20260620 07:01:06.772804 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6265551265c24c08b658f79709b7887d" } modify_external_catalogs: true
I20260620 07:01:06.772986 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6265551265c24c08b658f79709b7887d" } modify_external_catalogs: true
I20260620 07:01:06.769783 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1b34f21beb944ba6a991b5bf4a8acecd" } modify_external_catalogs: true
I20260620 07:01:06.773897 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1b34f21beb944ba6a991b5bf4a8acecd" } modify_external_catalogs: true
I20260620 07:01:06.779179 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad
W20260620 07:01:06.785921 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e864cac7431439b9eb18d0cd98a7755 consensus state has no leader
I20260620 07:01:06.788661 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f5072c573ce54477881cafb63e18b030
I20260620 07:01:06.772060 1700 raft_consensus.cc:504] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.792336 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3f53f0302d1a4fb3a0fe3e1d98583550
I20260620 07:01:06.797744 1170 tablet_bootstrap.cc:492] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:06.798039 1170 ts_tablet_manager.cc:1397] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.349s user 0.000s sys 0.008s
I20260620 07:01:06.799074 1170 raft_consensus.cc:348] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.799508 1170 raft_consensus.cc:374] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.799647 1170 raft_consensus.cc:729] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
W20260620 07:01:06.799952 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 313000us
W20260620 07:01:06.800647 1168 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.520s user 0.077s sys 0.157s
W20260620 07:01:06.800868 1168 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.520s user 0.077s sys 0.157s
I20260620 07:01:06.813815 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fc63351f767447c99b819fe7848d381 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.814041 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f53f0302d1a4fb3a0fe3e1d98583550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.814110 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.814572 1165 tablet_replica.cc:330] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.814848 1165 raft_consensus.cc:2229] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:06.814883 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7fc63351f767447c99b819fe7848d381 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fc63351f767447c99b819fe7848d381 already in progress: creating tablet
I20260620 07:01:06.814904 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca380134173e42f6b562b56375f2ccad" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:06.815068 1165 raft_consensus.cc:2258] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.815598 865 tablet_service.cc:1514] Processing DeleteTablet for tablet f5072c573ce54477881cafb63e18b030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.816434 1165 ts_tablet_manager.cc:1905] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.769320 1812 consensus_queue.cc:1035] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.076s
I20260620 07:01:06.823094 1168 tablet_bootstrap.cc:492] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:06.823518 1168 ts_tablet_manager.cc:1397] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.552s user 0.079s sys 0.157s
I20260620 07:01:06.824506 1168 raft_consensus.cc:348] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.824862 1168 raft_consensus.cc:374] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.824980 1168 raft_consensus.cc:729] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:06.825315 1168 consensus_queue.cc:260] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.826339 1168 ts_tablet_manager.cc:1428] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:06.830691 1168 tablet_bootstrap.cc:492] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:06.832532 1168 tablet_bootstrap.cc:654] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.832589 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36a5dde9352f48a19f7a379dc40cf491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:06.834522 1170 consensus_queue.cc:260] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.799808 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fc63351f767447c99b819fe7848d381 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:06.800822 749 raft_consensus.cc:1261] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Refusing update from remote peer 06a32ef63b2b495a9ade1de48c024ae9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:01:06.813282 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:06.815459 683 leader_election.cc:341] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:06.833654 1165 ts_tablet_manager.cc:1918] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:06.840338 1165 log.cc:1196] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/3f53f0302d1a4fb3a0fe3e1d98583550
I20260620 07:01:06.840960 1165 ts_tablet_manager.cc:1939] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.849458 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 3f53f0302d1a4fb3a0fe3e1d98583550 (table default.Table_1b34f21beb944ba6a991b5bf4a8acecd [id=bce36d2915e7478ebbfcf02633f64563]) successfully deleted
W20260620 07:01:06.849792 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad already in progress: creating tablet
W20260620 07:01:06.850368 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f5072c573ce54477881cafb63e18b030 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5072c573ce54477881cafb63e18b030 already in progress: creating tablet
I20260620 07:01:06.853611 1170 ts_tablet_manager.cc:1428] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.055s user 0.000s sys 0.002s
I20260620 07:01:06.854406 1170 tablet_bootstrap.cc:492] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:06.861824 1168 tablet_bootstrap.cc:492] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:06.862033 1168 ts_tablet_manager.cc:1397] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.002s
I20260620 07:01:06.862973 1168 raft_consensus.cc:348] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.863246 1168 raft_consensus.cc:374] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.863338 1168 raft_consensus.cc:729] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:06.863554 1168 consensus_queue.cc:260] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.864068 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_dcd39517a9e640af985a7a77e18673e3 [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 5 got 4
I20260620 07:01:06.864208 1168 ts_tablet_manager.cc:1428] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:06.865316 1168 tablet_bootstrap.cc:492] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:06.867209 1169 ts_tablet_manager.cc:1918] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:06.870110 1699 raft_consensus.cc:482] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:06.872035 1700 leader_election.cc:288] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:06.874046 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fc63351f767447c99b819fe7848d381 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.874396 1699 raft_consensus.cc:504] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:06.874966 413 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc -> Peer 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455): Couldn't send request to peer 2395d394cd84440ebae89d1ecfa13fb5. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:06.875108 1699 leader_election.cc:288] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:06.875602 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca380134173e42f6b562b56375f2ccad" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:06.876154 1168 tablet_bootstrap.cc:654] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.771963 1792 tablet.cc:1722] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:06.880973 1741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:01:06.881349 1741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: LEADER
I20260620 07:01:06.884478 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.889340 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f53f0302d1a4fb3a0fe3e1d98583550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.893250 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fd76eaeee815495cb78cdb3c70f5a57b" } new_table_name: "default.Table_27f50fad45334e6aa34ab5e49c99e182" modify_external_catalogs: true
I20260620 07:01:06.893342 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d33f4bd9d2ad4555b2a76128e5d3f234" } new_table_name: "default.Table_83d56d1245704fd3935391f2558b3e89" modify_external_catalogs: true
I20260620 07:01:06.893316 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a391507b63124713a988e71f923eb059" } new_table_name: "default.Table_fcf0a9375d5a47feb43a24d647b72f8c" modify_external_catalogs: true
I20260620 07:01:06.898959 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8f58e36dcf944fb2906f6ded391b7ce7" } new_table_name: "default.Table_cf36f7d3d2ac457e8097e25c5b39730b" modify_external_catalogs: true
W20260620 07:01:06.901998 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3dba2e33592f43a7867756a8b93b3a75 consensus state has no leader
W20260620 07:01:06.902769 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 168fb1666e2c41358213240d34ef9572 consensus state has no leader
I20260620 07:01:06.903347 1168 tablet_bootstrap.cc:492] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:06.903625 1168 ts_tablet_manager.cc:1397] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.003s
I20260620 07:01:06.904950 1168 raft_consensus.cc:348] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.905402 1168 raft_consensus.cc:374] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.905534 1168 raft_consensus.cc:729] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:06.906162 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 3d9da1b03aae4cd9976109291ea43b4e from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:06.905956 1168 consensus_queue.cc:260] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.906613 426 master_service.cc:946] ReplaceTablet: received request to replace tablet 74eaa712962245b4bb14d17e4cdd8485 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:06.909478 1168 ts_tablet_manager.cc:1428] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:06.912807 1168 tablet_bootstrap.cc:492] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:06.913527 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ff06bc5fc684b9195c719cbf39d34a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.913828 863 tablet_service.cc:1514] Processing DeleteTablet for tablet f9df1d52393e47ce991b5295d03624e8 with delete_type TABLET_DATA_DELETED (replaced by tablet b39e682e71ed4776a786f7d30158e7e0) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.913955 1165 tablet_replica.cc:330] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.914150 1165 raft_consensus.cc:2229] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.914345 1165 raft_consensus.cc:2258] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.913829 872 tablet_service.cc:1514] Processing DeleteTablet for tablet e14db4e3394046e49ecc69c9ca4dc840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:06.915695 1165 ts_tablet_manager.cc:1905] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.917829 996 tablet_service.cc:1514] Processing DeleteTablet for tablet f5072c573ce54477881cafb63e18b030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:06.922853 1168 tablet_bootstrap.cc:654] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:06.943722 968 consensus_peers.cc:487] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81704d3a3cf648d987d4b40a270f7508. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:06.945751 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5883a8466d0c4e45aba3b4095ced91a4 has no consensus state
I20260620 07:01:06.947166 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 602f6d47f23e4d7f80f372a6a507d095 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:06.952944 968 leader_election.cc:341] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e2b0faf91f2f469f9b06e17caa4709e4
I20260620 07:01:06.953225 968 leader_election.cc:302] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:06.953500 1168 tablet_bootstrap.cc:492] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:06.953685 1168 ts_tablet_manager.cc:1397] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.005s
I20260620 07:01:06.954631 1168 raft_consensus.cc:348] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.954927 1168 raft_consensus.cc:374] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.955042 1168 raft_consensus.cc:729] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:06.955302 1168 consensus_queue.cc:260] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:06.955981 1168 ts_tablet_manager.cc:1428] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260620 07:01:06.956301 1168 tablet_bootstrap.cc:492] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:06.958070 1699 raft_consensus.cc:482] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:06.959671 969 leader_election.cc:341] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b6e36ffd69974ef897390a257f63a509
I20260620 07:01:06.960181 1168 tablet_bootstrap.cc:654] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:06.962245 1165 ts_tablet_manager.cc:1918] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:06.963977 1165 log.cc:1196] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/6ff06bc5fc684b9195c719cbf39d34a6
I20260620 07:01:06.969905 1165 ts_tablet_manager.cc:1939] T 6ff06bc5fc684b9195c719cbf39d34a6 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:06.977475 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 6ff06bc5fc684b9195c719cbf39d34a6 (table default.Table_009386cbc364471099079c21ecb6c8e0 [id=74f991adb273483bb626c5939a2cc63c]) successfully deleted
I20260620 07:01:06.978979 1165 tablet_replica.cc:330] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:06.980438 1165 raft_consensus.cc:2229] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:06.981703 1165 raft_consensus.cc:2258] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:06.985141 1165 ts_tablet_manager.cc:1905] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:06.985203 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 18d08c30bf7e4c04b01368b9b4a6273c from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:06.991041 969 leader_election.cc:341] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7200877be18c4eaca57df88c25d30c01
W20260620 07:01:07.007248 968 leader_election.cc:341] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: b6e36ffd69974ef897390a257f63a509
I20260620 07:01:07.007507 1168 tablet_bootstrap.cc:492] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:07.007791 1168 ts_tablet_manager.cc:1397] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.004s
I20260620 07:01:07.008104 968 leader_election.cc:302] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.009150 1750 raft_consensus.cc:2726] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:07.009653 1168 raft_consensus.cc:348] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.010106 1168 raft_consensus.cc:374] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.010241 1168 raft_consensus.cc:729] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.010813 1168 consensus_queue.cc:260] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.012682 1792 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 518) took 1034 ms. Trace:
I20260620 07:01:07.012526 1168 ts_tablet_manager.cc:1428] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260620 07:01:07.012871 1792 rpcz_store.cc:276] 0620 07:01:05.978356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.994119 (+ 15763us) service_pool.cc:227] Handling call
0620 07:01:07.012514 (+1018395us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:06.138318 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:06.153387 (+ 15069us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:06.153398 (+ 11us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:06.153407 (+ 9us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:06.153513 (+ 106us) alter_schema_op.cc:126] START. Timestamp: 1781938866153458
0620 07:01:06.153516 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:06.174467 (+ 20951us) log.cc:842] Serialized 173 byte log entry
0620 07:01:06.590407 (+415940us) op_driver.cc:444] REPLICATION: finished
0620 07:01:06.768161 (+177754us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:06.885302 (+117141us) log.cc:842] Serialized 5 byte log entry
0620 07:01:06.982760 (+ 97458us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.983091 (+ 331us) log.cc:842] Serialized 14 byte log entry
0620 07:01:06.983352 (+ 261us) alter_schema_op.cc:71] Released schema lock
0620 07:01:06.983356 (+ 4us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":177668,"prepare.queue_time_us":143092,"prepare.run_cpu_time_us":8654,"prepare.run_wall_time_us":333760,"replication_time_us":436859,"thread_start_us":869665,"threads_started":3,"wal-append.queue_time_us":393474}]]}
I20260620 07:01:07.014146 1792 tablet.cc:1717] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Skipping requested alter to schema version 4, tablet already version 4
I20260620 07:01:07.014762 1792 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 537) took 1034 ms. Trace:
I20260620 07:01:07.014530 1168 tablet_bootstrap.cc:492] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:07.021070 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f53f0302d1a4fb3a0fe3e1d98583550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.021669 1169 log.cc:1196] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/076926f7dffe4a7b80c25ea3c18e9958
W20260620 07:01:07.023422 681 leader_election.cc:341] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:07.023576 681 leader_election.cc:302] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.024204 1758 raft_consensus.cc:2726] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:07.024561 1169 ts_tablet_manager.cc:1939] T 076926f7dffe4a7b80c25ea3c18e9958 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:07.024850 1168 tablet_bootstrap.cc:654] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.025444 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 480) took 2209 ms. Trace:
I20260620 07:01:07.025475 1165 ts_tablet_manager.cc:1918] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.025588 1169 rpcz_store.cc:276] 0620 07:01:04.815427 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.815506 (+ 79us) service_pool.cc:227] Handling call
0620 07:01:06.530472 (+1714966us) ts_tablet_manager.cc:1145] Deleting tablet 076926f7dffe4a7b80c25ea3c18e9958
0620 07:01:06.530666 (+ 194us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.806236 (+275570us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.867023 (+ 60787us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.025276 (+158253us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1714522}
I20260620 07:01:07.025897 722 tablet_service.cc:1514] Processing DeleteTablet for tablet f5072c573ce54477881cafb63e18b030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.026081 1165 log.cc:1196] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f9df1d52393e47ce991b5295d03624e8
I20260620 07:01:07.026327 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 481) took 2140 ms. Trace:
I20260620 07:01:07.026423 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 076926f7dffe4a7b80c25ea3c18e9958 (table default.Table_2411c7dd68274c07a75cd0b3ae3e2d32 [id=804a023058a643b189246bf7c6a98af6]) successfully deleted
I20260620 07:01:07.026419 1169 rpcz_store.cc:276] 0620 07:01:04.886085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.886156 (+ 71us) service_pool.cc:227] Handling call
0620 07:01:07.025898 (+2139742us) ts_tablet_manager.cc:1145] Deleting tablet 2057b7689b1c4c65901ed8ec04279568
0620 07:01:07.025909 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.025992 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2139466}
I20260620 07:01:07.026868 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 482) took 2130 ms. Trace:
I20260620 07:01:07.026964 1169 rpcz_store.cc:276] 0620 07:01:04.896788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.896844 (+ 56us) service_pool.cc:227] Handling call
0620 07:01:07.026641 (+2129797us) ts_tablet_manager.cc:1145] Deleting tablet 7cf81c5c0d9744f5a8c3f0866a435ae3
0620 07:01:07.026654 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.026741 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2099555}
W20260620 07:01:07.027077 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2057b7689b1c4c65901ed8ec04279568 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2057b7689b1c4c65901ed8ec04279568 already in progress: creating tablet
I20260620 07:01:07.027522 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 483) took 2129 ms. Trace:
I20260620 07:01:07.027618 1169 rpcz_store.cc:276] 0620 07:01:04.898365 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.898418 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:07.027220 (+2128802us) ts_tablet_manager.cc:1145] Deleting tablet 6a36a5319a044e9da7dc7b666484e257
0620 07:01:07.027230 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.027320 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2100048}
W20260620 07:01:07.027693 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 already in progress: creating tablet
I20260620 07:01:07.028023 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 484) took 2101 ms. Trace:
W20260620 07:01:07.028190 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6a36a5319a044e9da7dc7b666484e257 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a36a5319a044e9da7dc7b666484e257 already in progress: creating tablet
I20260620 07:01:07.028116 1169 rpcz_store.cc:276] 0620 07:01:04.926606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.926683 (+ 77us) service_pool.cc:227] Handling call
0620 07:01:07.027838 (+2101155us) ts_tablet_manager.cc:1145] Deleting tablet 48726d9a3aa745fca3bcd9b6e8807c49
0620 07:01:07.027850 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.027933 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2100209}
W20260620 07:01:07.028867 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 48726d9a3aa745fca3bcd9b6e8807c49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48726d9a3aa745fca3bcd9b6e8807c49 already in progress: creating tablet
I20260620 07:01:07.029122 1165 ts_tablet_manager.cc:1939] T f9df1d52393e47ce991b5295d03624e8 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:07.025658 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f53f0302d1a4fb3a0fe3e1d98583550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.031499 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f9df1d52393e47ce991b5295d03624e8 (table default.Table_eb719a986c8b4e01a4a98f5e68582421 [id=a7902aafbaad4905a6b5b03ad669eeae]) successfully deleted
I20260620 07:01:07.032244 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 485) took 2034 ms. Trace:
I20260620 07:01:07.032361 1165 tablet_replica.cc:330] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:07.033002 1165 raft_consensus.cc:2229] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.033391 1169 rpcz_store.cc:276] 0620 07:01:04.994132 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.994198 (+ 66us) service_pool.cc:227] Handling call
0620 07:01:07.028347 (+2034149us) ts_tablet_manager.cc:1145] Deleting tablet a6c7b3977b604cb69df671318fae1212
0620 07:01:07.028360 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.028437 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2033887}
I20260620 07:01:07.033681 1165 raft_consensus.cc:2258] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.034173 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 486) took 2036 ms. Trace:
W20260620 07:01:07.034217 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a6c7b3977b604cb69df671318fae1212 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6c7b3977b604cb69df671318fae1212 already in progress: creating tablet
I20260620 07:01:07.034780 1169 rpcz_store.cc:276] 0620 07:01:04.997527 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.997585 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:07.033976 (+2036391us) ts_tablet_manager.cc:1145] Deleting tablet f2426d52b8ff40f39887545e0341a91a
0620 07:01:07.033989 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.034110 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2036117}
I20260620 07:01:07.038147 1165 ts_tablet_manager.cc:1905] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:07.039288 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f2426d52b8ff40f39887545e0341a91a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2426d52b8ff40f39887545e0341a91a already in progress: creating tablet
I20260620 07:01:07.039450 1169 tablet_replica.cc:330] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:07.039916 1169 raft_consensus.cc:2229] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.040491 1169 raft_consensus.cc:2258] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.041321 1169 ts_tablet_manager.cc:1905] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.035526 1170 tablet_bootstrap.cc:654] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.056795 1168 tablet_bootstrap.cc:492] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:07.057075 1168 ts_tablet_manager.cc:1397] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.006s
I20260620 07:01:06.958233 1699 raft_consensus.cc:504] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.057860 1792 rpcz_store.cc:276] 0620 07:01:05.980202 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.107847 (+127645us) service_pool.cc:227] Handling call
0620 07:01:07.014711 (+906864us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:06.614879 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:06.617842 (+ 2963us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:06.983382 (+365540us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:06.983395 (+ 13us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:06.983449 (+ 54us) alter_schema_op.cc:126] START. Timestamp: 1781938866983420
0620 07:01:06.983453 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:06.983763 (+ 310us) log.cc:842] Serialized 173 byte log entry
0620 07:01:06.994531 (+ 10768us) op_driver.cc:444] REPLICATION: finished
0620 07:01:07.014085 (+ 19554us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:07.014427 (+ 342us) log.cc:842] Serialized 94 byte log entry
0620 07:01:07.014673 (+ 246us) alter_schema_op.cc:71] Released schema lock
0620 07:01:07.014677 (+ 4us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":19500,"prepare.queue_time_us":506456,"prepare.run_cpu_time_us":34331,"prepare.run_wall_time_us":369437,"raft.queue_time_us":377,"raft.run_cpu_time_us":686,"raft.run_wall_time_us":684,"replication_time_us":11050,"thread_start_us":62119,"threads_started":1}]]}
I20260620 07:01:07.058614 1699 leader_election.cc:288] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:07.058452 1168 raft_consensus.cc:348] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.058902 1168 raft_consensus.cc:374] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:06.973153 1736 raft_consensus.cc:2726] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:07.059055 1168 raft_consensus.cc:729] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.059485 1168 consensus_queue.cc:260] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.061226 1168 ts_tablet_manager.cc:1428] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 07:01:06.973325 1700 consensus_queue.cc:1035] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:07.062363 1168 tablet_bootstrap.cc:492] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:06.974958 1811 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.223s user 0.000s sys 0.008s
I20260620 07:01:06.975591 1805 raft_consensus.cc:482] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 978f112862c64141b1009856bef3d624)
I20260620 07:01:07.063827 1805 raft_consensus.cc:504] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:07.064734 1805 leader_election.cc:288] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:06.979514 1810 raft_consensus.cc:482] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:07.065047 1810 raft_consensus.cc:504] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.065536 1168 tablet_bootstrap.cc:654] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.065795 1810 leader_election.cc:288] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:06.984210 1167 tablet_bootstrap.cc:492] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:07.067091 1167 ts_tablet_manager.cc:1397] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.865s user 0.011s sys 0.007s
I20260620 07:01:07.067956 1167 raft_consensus.cc:348] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.068280 1167 raft_consensus.cc:374] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.068467 1167 raft_consensus.cc:729] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.068903 1167 consensus_queue.cc:260] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.069900 1167 ts_tablet_manager.cc:1428] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:07.070304 1167 tablet_bootstrap.cc:492] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:07.070614 1168 tablet_bootstrap.cc:492] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:07.070958 1168 ts_tablet_manager.cc:1397] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
W20260620 07:01:07.053169 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 59084.5us
I20260620 07:01:06.964380 1166 ts_tablet_manager.cc:1918] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.071746 1166 log.cc:1196] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/17590c6a1a96414f84632a8b0e0a795b
I20260620 07:01:07.072266 1166 ts_tablet_manager.cc:1939] T 17590c6a1a96414f84632a8b0e0a795b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:07.072696 1811 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 453) took 2484 ms. Trace:
I20260620 07:01:07.073087 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 178) took 8289 ms. Trace:
I20260620 07:01:07.073226 1166 rpcz_store.cc:276] 0620 07:00:58.784037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.784087 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:06.185633 (+7401546us) ts_tablet_manager.cc:1145] Deleting tablet 17590c6a1a96414f84632a8b0e0a795b
0620 07:01:06.187689 (+ 2056us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:06.626438 (+438749us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:06.964229 (+337791us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.073036 (+108807us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7401345}
I20260620 07:01:07.072508 1168 raft_consensus.cc:348] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.073678 1168 raft_consensus.cc:374] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.073736 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 179) took 8282 ms. Trace:
I20260620 07:01:07.073788 1168 raft_consensus.cc:729] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.073849 1166 rpcz_store.cc:276] 0620 07:00:58.791080 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.791133 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:07.073564 (+8282431us) ts_tablet_manager.cc:1145] Deleting tablet 581573cafab14ac79ff7ad19da0580b4
0620 07:01:07.073578 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.073697 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8282222}
W20260620 07:01:07.055958 968 leader_election.cc:341] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 7200877be18c4eaca57df88c25d30c01
I20260620 07:01:07.074054 1168 consensus_queue.cc:260] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.074213 968 leader_election.cc:302] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.056803 1829 tablet.cc:1722] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:07.075292 1168 ts_tablet_manager.cc:1428] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:01:07.075585 1168 tablet_bootstrap.cc:492] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:07.076156 1166 tablet_replica.cc:330] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:07.077548 1810 raft_consensus.cc:2726] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:07.078531 1168 tablet_bootstrap.cc:654] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.082921 1829 tablet.cc:1722] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:07.089340 1166 raft_consensus.cc:2229] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.089556 1166 raft_consensus.cc:2258] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.090157 1166 ts_tablet_manager.cc:1905] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.091150 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_68f462254d2f4d64a04f93bbfeb6204f" } modify_external_catalogs: true
I20260620 07:01:07.091241 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c8b01cca92cd4368b795c93728945929"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.091759 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 27da98f96a2245c5b4210b7cf084886d consensus state has no leader
W20260620 07:01:07.091930 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8b01cca92cd4368b795c93728945929 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.093581 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5712ee2764bf41dcbd0cc6bd497d6e42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:07.093811 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bf7c7b64562940fc8dc4ba352deea46c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.094239 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5712ee2764bf41dcbd0cc6bd497d6e42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:07.094370 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf7c7b64562940fc8dc4ba352deea46c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.096397 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_20581d428c6345ce8216cc2467e7eeef [id=2abd0f99a3034a0e8824bcb0002c91bd]). Expected version 2 got 0
I20260620 07:01:07.097389 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e72d9c9be46441e4b73ae53afe9ed50c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:07.097754 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9b219ed56eea4d9db45cb8c22f772b5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.097992 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e72d9c9be46441e4b73ae53afe9ed50c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:07.098272 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b219ed56eea4d9db45cb8c22f772b5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.091373 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_68f462254d2f4d64a04f93bbfeb6204f" } modify_external_catalogs: true
I20260620 07:01:07.104954 1740 raft_consensus.cc:482] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:07.105208 1740 raft_consensus.cc:504] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.106069 1740 leader_election.cc:288] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:07.108144 872 tablet_service.cc:1467] Processing CreateTablet for tablet 71977c69b29143eebfcc8ece39daf78e (DEFAULT_TABLE table=default.Table_23b632bb60cf401e8b3ecafcb4065636 [id=a1a1d4ae99064fa79fc5cccb974c2a11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.108604 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71977c69b29143eebfcc8ece39daf78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.108758 863 tablet_service.cc:1467] Processing CreateTablet for tablet 2dd62b0f22f44b26a7602dc23e698a63 (DEFAULT_TABLE table=default.Table_468069c87bb943f1b56bd44a93568e3b [id=9856b92d7aeb4a86b3dbf80416b10639]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.109086 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dd62b0f22f44b26a7602dc23e698a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.111092 865 tablet_service.cc:1467] Processing CreateTablet for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 (DEFAULT_TABLE table=default.Table_fd8c2ecfd1974bc5b245d954dff52f99 [id=3142d4c0958c4af9bfa1ca98a7c8e62e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:07.111842 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 581573cafab14ac79ff7ad19da0580b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 581573cafab14ac79ff7ad19da0580b4 already in progress: creating tablet
I20260620 07:01:07.111963 1166 ts_tablet_manager.cc:1918] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:07.112109 1166 log.cc:1196] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/b8799f2a2aed4688aa4e6e590dc83a4e
I20260620 07:01:07.112571 1166 ts_tablet_manager.cc:1939] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:07.113091 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 180) took 8298 ms. Trace:
I20260620 07:01:07.113191 1166 rpcz_store.cc:276] 0620 07:00:58.814216 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:58.814349 (+ 133us) service_pool.cc:227] Handling call
0620 07:01:07.074094 (+8259745us) ts_tablet_manager.cc:1145] Deleting tablet b8799f2a2aed4688aa4e6e590dc83a4e
0620 07:01:07.076078 (+ 1984us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.093507 (+ 17429us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.111841 (+ 18334us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.113035 (+ 1194us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12917,"tablet-delete.queue_time_us":8259483}
I20260620 07:01:07.113708 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 200) took 7968 ms. Trace:
I20260620 07:01:07.113801 1166 rpcz_store.cc:276] 0620 07:00:59.145197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.147781 (+ 2584us) service_pool.cc:227] Handling call
0620 07:01:07.113499 (+7965718us) ts_tablet_manager.cc:1145] Deleting tablet eea1525b54cc42b78180ba6867957f76
0620 07:01:07.113510 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.113656 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7963279}
I20260620 07:01:07.114084 1166 tablet_replica.cc:330] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:07.114279 1166 raft_consensus.cc:2229] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:07.114598 1166 pending_rounds.cc:62] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:07.114673 1166 pending_rounds.cc:68] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821582601875456 op_type: NO_OP noop_request { }
I20260620 07:01:07.116513 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.118072 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet b8799f2a2aed4688aa4e6e590dc83a4e (table default.Table_551c55403131424c87aee4c019ca1466 [id=fc9d4751547b40ae866b1c82804da11a]) successfully deleted
W20260620 07:01:07.118350 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet eea1525b54cc42b78180ba6867957f76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eea1525b54cc42b78180ba6867957f76 already in progress: creating tablet
I20260620 07:01:07.115042 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c2f865b06ca4b9c8fc9d8d0b4aa0dad" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:07.115895 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 71977c69b29143eebfcc8ece39daf78e (DEFAULT_TABLE table=default.Table_23b632bb60cf401e8b3ecafcb4065636 [id=a1a1d4ae99064fa79fc5cccb974c2a11]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:07.121061 414 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 5883a8466d0c4e45aba3b4095ced91a4 (table default.Table_fcf0a9375d5a47feb43a24d647b72f8c [id=ee78ec53e76e47b59d13e402a37dacf8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5883a8466d0c4e45aba3b4095ced91a4 consensus state has no leader
I20260620 07:01:07.121210 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71977c69b29143eebfcc8ece39daf78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.072798 1811 rpcz_store.cc:276] 0620 07:01:04.588038 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.592854 (+ 4816us) service_pool.cc:227] Handling call
0620 07:01:07.072633 (+2479779us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:04.640328 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:04.640423 (+ 95us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:05.511548 (+871125us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:05.511559 (+ 11us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:05.511600 (+ 41us) alter_schema_op.cc:126] START. Timestamp: 1781938865511566
0620 07:01:05.511603 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:05.568311 (+ 56708us) log.cc:842] Serialized 173 byte log entry
0620 07:01:05.568480 (+ 169us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x6150000ea224. stack: 00007f5f3ef5866e 00007f5f3ef58430 00007f5f3dfdf5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f5f4a466d02 00007f5f4b7997f1 00007f5f4b798359 00007f5f4b7a01bb 00007f5f4b7a0038 00000000009edb7c 00007f5f3ef9e344 00007f5f3efa191b 00007f5f3efa1798 00000000009edb7c
0620 07:01:06.287923 (+719443us) op_driver.cc:444] REPLICATION: finished
0620 07:01:06.684405 (+396482us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:06.753521 (+ 69116us) log.cc:842] Serialized 5 byte log entry
0620 07:01:07.072136 (+318615us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.072537 (+ 401us) log.cc:842] Serialized 14 byte log entry
0620 07:01:07.072586 (+ 49us) alter_schema_op.cc:71] Released schema lock
0620 07:01:07.072589 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":396379,"prepare.queue_time_us":27549,"prepare.run_cpu_time_us":54362,"prepare.run_wall_time_us":928178,"replication_time_us":776271,"spinlock_wait_cycles":129903360,"thread_start_us":699001,"threads_started":2,"wal-append.queue_time_us":208213}]]}
I20260620 07:01:07.116465 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 2dd62b0f22f44b26a7602dc23e698a63 (DEFAULT_TABLE table=default.Table_468069c87bb943f1b56bd44a93568e3b [id=9856b92d7aeb4a86b3dbf80416b10639]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.123092 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dd62b0f22f44b26a7602dc23e698a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.116979 1009 tablet_service.cc:1467] Processing CreateTablet for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 (DEFAULT_TABLE table=default.Table_fd8c2ecfd1974bc5b245d954dff52f99 [id=3142d4c0958c4af9bfa1ca98a7c8e62e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.127365 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.131698 874 tablet_service.cc:1467] Processing CreateTablet for tablet b678a77d34f34718836fba62b81412c9 (DEFAULT_TABLE table=default.Table_a6c684d6032a46a38cb35d8770b1ce44 [id=6397f53da85d411a8abd3fbc6544ed0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.117550 1008 tablet_service.cc:1467] Processing CreateTablet for tablet d66cbf08f57c41609818ca5af7514f22 (DEFAULT_TABLE table=default.Table_18876e6e27824db091fa7c0fe3188bda [id=5001181813bf4278ad65bf904e0be218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.143298 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d66cbf08f57c41609818ca5af7514f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.118645 1000 tablet_service.cc:1467] Processing CreateTablet for tablet b678a77d34f34718836fba62b81412c9 (DEFAULT_TABLE table=default.Table_a6c684d6032a46a38cb35d8770b1ce44 [id=6397f53da85d411a8abd3fbc6544ed0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.144757 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b678a77d34f34718836fba62b81412c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.151257 876 tablet_service.cc:1467] Processing CreateTablet for tablet 6336d57f20ba4d59b9b01949f23922d1 (DEFAULT_TABLE table=default.Table_062abd8a0a3344059126bc3026945142 [id=6da0a6d3c625442797211b4dc89ecaf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.156067 868 tablet_service.cc:1467] Processing CreateTablet for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 (DEFAULT_TABLE table=default.Table_f6260fcb4d6a4889a69e4d7a2538d20c [id=8638d76dcacc49faaa655f532b7db8ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.157404 871 tablet_service.cc:1467] Processing CreateTablet for tablet d66cbf08f57c41609818ca5af7514f22 (DEFAULT_TABLE table=default.Table_18876e6e27824db091fa7c0fe3188bda [id=5001181813bf4278ad65bf904e0be218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.158094 1006 tablet_service.cc:1467] Processing CreateTablet for tablet b37f2c150b314b7298f32c3d414ff43d (DEFAULT_TABLE table=default.Table_ca4ebce0835d49c8a8d69ee21c9cec32 [id=d0bb6286e2fc4d8c84401028e0b2dc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.159116 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b37f2c150b314b7298f32c3d414ff43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.159735 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c2f865b06ca4b9c8fc9d8d0b4aa0dad" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:07.160473 751 raft_consensus.cc:2454] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:07.158998 1764 tablet.cc:1722] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:07.165638 726 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b961698fe54e7f9c16f41b90058093 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.167078 1169 ts_tablet_manager.cc:1918] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.167213 1169 log.cc:1196] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/95f9a6b2f2cb41e6b74715b2618d8a70
I20260620 07:01:07.167644 1169 ts_tablet_manager.cc:1939] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:07.168233 1165 ts_tablet_manager.cc:1918] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.168382 1165 log.cc:1196] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/e14db4e3394046e49ecc69c9ca4dc840
I20260620 07:01:07.168533 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 487) took 2163 ms. Trace:
I20260620 07:01:07.168658 1169 rpcz_store.cc:276] 0620 07:01:05.005544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.005608 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:07.039359 (+2033751us) ts_tablet_manager.cc:1145] Deleting tablet 95f9a6b2f2cb41e6b74715b2618d8a70
0620 07:01:07.039375 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.045398 (+ 6023us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.166939 (+121541us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.168485 (+ 1546us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2033527}
I20260620 07:01:07.169216 862 tablet_service.cc:1467] Processing CreateTablet for tablet 9b69d0b1d57d41b284a103a6128e5256 (DEFAULT_TABLE table=default.Table_c13cafc124f94c058d2948e4fe3c0181 [id=d11bf5ad91be4b09a15ba6209fadc0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.170570 1165 ts_tablet_manager.cc:1939] T e14db4e3394046e49ecc69c9ca4dc840 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:07.171191 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b678a77d34f34718836fba62b81412c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.171938 861 tablet_service.cc:1467] Processing CreateTablet for tablet e3d9c37e2e2842b7b5eb3ed57d186305 (DEFAULT_TABLE table=default.Table_24e8f4526d06403e8926b271a78c025e [id=2a90ad16128d4e05bacc8a273a0c2f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.173266 726 tablet_service.cc:1467] Processing CreateTablet for tablet 71977c69b29143eebfcc8ece39daf78e (DEFAULT_TABLE table=default.Table_23b632bb60cf401e8b3ecafcb4065636 [id=a1a1d4ae99064fa79fc5cccb974c2a11]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:07.173585 830 leader_election.cc:341] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:07.174548 734 tablet_service.cc:1467] Processing CreateTablet for tablet d66cbf08f57c41609818ca5af7514f22 (DEFAULT_TABLE table=default.Table_18876e6e27824db091fa7c0fe3188bda [id=5001181813bf4278ad65bf904e0be218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.175045 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet e14db4e3394046e49ecc69c9ca4dc840 (table default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]) successfully deleted
I20260620 07:01:07.176254 731 tablet_service.cc:1467] Processing CreateTablet for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 (DEFAULT_TABLE table=default.Table_f6260fcb4d6a4889a69e4d7a2538d20c [id=8638d76dcacc49faaa655f532b7db8ad]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:07.176882 968 leader_election.cc:341] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 369c205d7f7841598cb99f661b25736f
I20260620 07:01:07.177037 721 tablet_service.cc:1467] Processing CreateTablet for tablet 6336d57f20ba4d59b9b01949f23922d1 (DEFAULT_TABLE table=default.Table_062abd8a0a3344059126bc3026945142 [id=6da0a6d3c625442797211b4dc89ecaf8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:07.177389 968 leader_election.cc:341] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 8cb04a2e17f3417aaf0f89f0c7f78159
I20260620 07:01:07.177857 719 tablet_service.cc:1467] Processing CreateTablet for tablet e3d9c37e2e2842b7b5eb3ed57d186305 (DEFAULT_TABLE table=default.Table_24e8f4526d06403e8926b271a78c025e [id=2a90ad16128d4e05bacc8a273a0c2f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.178346 730 tablet_service.cc:1467] Processing CreateTablet for tablet 9b69d0b1d57d41b284a103a6128e5256 (DEFAULT_TABLE table=default.Table_c13cafc124f94c058d2948e4fe3c0181 [id=d11bf5ad91be4b09a15ba6209fadc0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.178829 1811 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260620 07:01:07.179134 725 tablet_service.cc:1467] Processing CreateTablet for tablet 5db9a7df42e04949934b6962c9253196 (DEFAULT_TABLE table=default.Table_608fa7fe9add4c14b2705f68900223d3 [id=015a91e5966740859f4cd6a00214671f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.179687 733 tablet_service.cc:1467] Processing CreateTablet for tablet 73359f7d59e54f0fb7781114ced2914f (DEFAULT_TABLE table=default.Table_43035e837b724041adc0d9be08280f83 [id=e1ef9fc9ca4046d3826dc3b8a80b0a84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.179620 1010 tablet_service.cc:1467] Processing CreateTablet for tablet e3d9c37e2e2842b7b5eb3ed57d186305 (DEFAULT_TABLE table=default.Table_24e8f4526d06403e8926b271a78c025e [id=2a90ad16128d4e05bacc8a273a0c2f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.179275 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 9b69d0b1d57d41b284a103a6128e5256 (DEFAULT_TABLE table=default.Table_c13cafc124f94c058d2948e4fe3c0181 [id=d11bf5ad91be4b09a15ba6209fadc0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.180992 716 tablet_service.cc:1467] Processing CreateTablet for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 (DEFAULT_TABLE table=default.Table_fd8c2ecfd1974bc5b245d954dff52f99 [id=3142d4c0958c4af9bfa1ca98a7c8e62e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.181350 722 tablet_service.cc:1467] Processing CreateTablet for tablet 2dd62b0f22f44b26a7602dc23e698a63 (DEFAULT_TABLE table=default.Table_468069c87bb943f1b56bd44a93568e3b [id=9856b92d7aeb4a86b3dbf80416b10639]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.183470 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 95f9a6b2f2cb41e6b74715b2618d8a70 (table default.Table_6641e445a3014a60a287541bee6f57e2 [id=08b49e7b2cb8468e97d459fb1ab36211]) successfully deleted
I20260620 07:01:07.185055 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3d9c37e2e2842b7b5eb3ed57d186305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.186328 727 tablet_service.cc:1467] Processing CreateTablet for tablet b37f2c150b314b7298f32c3d414ff43d (DEFAULT_TABLE table=default.Table_ca4ebce0835d49c8a8d69ee21c9cec32 [id=d0bb6286e2fc4d8c84401028e0b2dc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.186865 720 tablet_service.cc:1467] Processing CreateTablet for tablet b678a77d34f34718836fba62b81412c9 (DEFAULT_TABLE table=default.Table_a6c684d6032a46a38cb35d8770b1ce44 [id=6397f53da85d411a8abd3fbc6544ed0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.187256 1811 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 501) took 1304 ms. Trace:
I20260620 07:01:07.187546 1811 rpcz_store.cc:276] 0620 07:01:05.882109 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.882196 (+ 87us) service_pool.cc:227] Handling call
0620 07:01:07.186593 (+1304397us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:05.885961 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:05.886066 (+ 105us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:07.072633 (+1186567us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:07.072642 (+ 9us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:07.072690 (+ 48us) alter_schema_op.cc:126] START. Timestamp: 1781938867072653
0620 07:01:07.072694 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:07.072894 (+ 200us) log.cc:842] Serialized 173 byte log entry
0620 07:01:07.178561 (+105667us) op_driver.cc:444] REPLICATION: finished
0620 07:01:07.178727 (+ 166us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:07.179286 (+ 559us) log.cc:842] Serialized 5 byte log entry
0620 07:01:07.183584 (+ 4298us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.186406 (+ 2822us) log.cc:842] Serialized 14 byte log entry
0620 07:01:07.186482 (+ 76us) alter_schema_op.cc:71] Released schema lock
0620 07:01:07.186485 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":67,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":65054,"prepare.run_wall_time_us":1187041,"raft.queue_time_us":413,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":363,"replication_time_us":105811}]]}
I20260620 07:01:07.186766 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b69d0b1d57d41b284a103a6128e5256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.189543 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa5c040d5e84006935e9f06424a34b4 (DEFAULT_TABLE table=default.Table_3306fa38cf3a46f984a8fcde184d39a1 [id=be832445f1c84adc91ab41e94cb807b7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:07.191346 968 leader_election.cc:341] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: b8799f2a2aed4688aa4e6e590dc83a4e
I20260620 07:01:07.194468 732 tablet_service.cc:1467] Processing CreateTablet for tablet 1b81bd1cb0e2498a8cec55e7ca761d72 (DEFAULT_TABLE table=default.Table_6c1b78c4f39f4e09abafd1d51690766a [id=86c6305d20c04570ab46d060739f93bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.198318 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 030b90899c3c4c7e82807a61234f223e
I20260620 07:01:07.197451 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa5c040d5e84006935e9f06424a34b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.120267 1167 tablet_bootstrap.cc:654] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.120555 999 tablet_service.cc:1467] Processing CreateTablet for tablet 6336d57f20ba4d59b9b01949f23922d1 (DEFAULT_TABLE table=default.Table_062abd8a0a3344059126bc3026945142 [id=6da0a6d3c625442797211b4dc89ecaf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.199422 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 602f6d47f23e4d7f80f372a6a507d095
I20260620 07:01:07.117900 998 tablet_service.cc:1467] Processing CreateTablet for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 (DEFAULT_TABLE table=default.Table_f6260fcb4d6a4889a69e4d7a2538d20c [id=8638d76dcacc49faaa655f532b7db8ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.199824 427 catalog_manager.cc:6565] ReplaceTablet: tablet 602f6d47f23e4d7f80f372a6a507d095 deleted and replaced by tablet a54ea2c027bb4d4b82fcdb8aa6eb1475
I20260620 07:01:07.200114 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 168fb1666e2c41358213240d34ef9572 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:07.200722 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.202677 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6d2275d5f69744859ef7115f74c45781"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.203382 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d2275d5f69744859ef7115f74c45781 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.204610 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_67488f79519b41489e04be38f88c163c" } modify_external_catalogs: true
I20260620 07:01:07.204880 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_67488f79519b41489e04be38f88c163c" } modify_external_catalogs: true
I20260620 07:01:07.207173 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
I20260620 07:01:07.209666 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2bca6ccd0c6948739cd05c66a2a958ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:07.210216 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6336d57f20ba4d59b9b01949f23922d1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:07.210299 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bca6ccd0c6948739cd05c66a2a958ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.222021 419 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_dcd39517a9e640af985a7a77e18673e3 [id=04c170b69f3b43eb88b51e1654ec86df]). Expected version 5 got 4
I20260620 07:01:07.222342 419 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e]). Expected version 6 got 5
W20260620 07:01:07.219946 969 leader_election.cc:341] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 369c205d7f7841598cb99f661b25736f
I20260620 07:01:07.223364 1166 raft_consensus.cc:2866] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:07.226740 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 08ec769f903c4438bc1186d5fc1c5108
I20260620 07:01:07.227625 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_305a2709be0040bda9f3552349b9ce3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.228312 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_305a2709be0040bda9f3552349b9ce3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.227696 1166 raft_consensus.cc:2258] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.227110 969 leader_election.cc:302] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.231210 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 18d08c30bf7e4c04b01368b9b4a6273c
I20260620 07:01:07.231683 422 catalog_manager.cc:6565] ReplaceTablet: tablet 18d08c30bf7e4c04b01368b9b4a6273c deleted and replaced by tablet bc96c62b938c4a36b17c008d3503ca31
I20260620 07:01:07.232191 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_aea9387e12a14d08bc7ad7def05993a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.232824 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aea9387e12a14d08bc7ad7def05993a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.234462 1812 raft_consensus.cc:2726] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:07.237279 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7eed72568334415b993b78f401667ed1" } new_table_name: "default.Table_be27fd7716994cc5abc227788b648db5" modify_external_catalogs: true
W20260620 07:01:07.246203 969 leader_election.cc:341] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b8799f2a2aed4688aa4e6e590dc83a4e
I20260620 07:01:07.251767 864 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa5c040d5e84006935e9f06424a34b4 (DEFAULT_TABLE table=default.Table_3306fa38cf3a46f984a8fcde184d39a1 [id=be832445f1c84adc91ab41e94cb807b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.253895 1740 raft_consensus.cc:482] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:07.251426 1166 ts_tablet_manager.cc:1905] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.256026 969 leader_election.cc:302] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.257817 867 tablet_service.cc:1467] Processing CreateTablet for tablet 5db9a7df42e04949934b6962c9253196 (DEFAULT_TABLE table=default.Table_608fa7fe9add4c14b2705f68900223d3 [id=015a91e5966740859f4cd6a00214671f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.262077 858 tablet_service.cc:1467] Processing CreateTablet for tablet 73359f7d59e54f0fb7781114ced2914f (DEFAULT_TABLE table=default.Table_43035e837b724041adc0d9be08280f83 [id=e1ef9fc9ca4046d3826dc3b8a80b0a84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.262666 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d66cbf08f57c41609818ca5af7514f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.257716 875 tablet_service.cc:1467] Processing CreateTablet for tablet 1b81bd1cb0e2498a8cec55e7ca761d72 (DEFAULT_TABLE table=default.Table_6c1b78c4f39f4e09abafd1d51690766a [id=86c6305d20c04570ab46d060739f93bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.263301 859 tablet_service.cc:1467] Processing CreateTablet for tablet b37f2c150b314b7298f32c3d414ff43d (DEFAULT_TABLE table=default.Table_ca4ebce0835d49c8a8d69ee21c9cec32 [id=d0bb6286e2fc4d8c84401028e0b2dc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.263868 723 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa5c040d5e84006935e9f06424a34b4 (DEFAULT_TABLE table=default.Table_3306fa38cf3a46f984a8fcde184d39a1 [id=be832445f1c84adc91ab41e94cb807b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.264708 1740 raft_consensus.cc:504] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.265432 1740 leader_election.cc:288] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:07.265544 831 leader_election.cc:302] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:07.267131 857 tablet_service.cc:1467] Processing CreateTablet for tablet 5883a8466d0c4e45aba3b4095ced91a4 (DEFAULT_TABLE table=default.Table_fcf0a9375d5a47feb43a24d647b72f8c [id=ee78ec53e76e47b59d13e402a37dacf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.271063 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b81bd1cb0e2498a8cec55e7ca761d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.272804 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa5c040d5e84006935e9f06424a34b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:07.274343 831 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 100050us
I20260620 07:01:07.276762 873 tablet_service.cc:1514] Processing DeleteTablet for tablet bea895c735c847f59794ab8c3282447d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.276928 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.277681 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 18d08c30bf7e4c04b01368b9b4a6273c with delete_type TABLET_DATA_DELETED (replaced by tablet bc96c62b938c4a36b17c008d3503ca31) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.277952 1168 tablet_bootstrap.cc:492] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:07.278331 1168 ts_tablet_manager.cc:1397] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.203s user 0.015s sys 0.059s
I20260620 07:01:07.279377 870 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fc63351f767447c99b819fe7848d381 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.280795 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 030b90899c3c4c7e82807a61234f223e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.280987 1165 tablet_replica.cc:330] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:07.281036 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ec769f903c4438bc1186d5fc1c5108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.281219 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.281665 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73359f7d59e54f0fb7781114ced2914f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.282159 1740 raft_consensus.cc:2781] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:07.282729 1165 raft_consensus.cc:2229] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.283476 1165 raft_consensus.cc:2258] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.285298 1740 raft_consensus.cc:482] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:07.285763 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b69d0b1d57d41b284a103a6128e5256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.291419 1740 raft_consensus.cc:3037] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:07.290303 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 602f6d47f23e4d7f80f372a6a507d095 with delete_type TABLET_DATA_DELETED (replaced by tablet a54ea2c027bb4d4b82fcdb8aa6eb1475) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.294001 1165 ts_tablet_manager.cc:1905] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.294363 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db9a7df42e04949934b6962c9253196. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:07.272672 969 raft_consensus.cc:2670] T b8799f2a2aed4688aa4e6e590dc83a4e P 06a32ef63b2b495a9ade1de48c024ae9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:07.296494 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b37f2c150b314b7298f32c3d414ff43d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:07.296751 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 51453.1us
I20260620 07:01:07.297606 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6336d57f20ba4d59b9b01949f23922d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.298431 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5883a8466d0c4e45aba3b4095ced91a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:07.298327 969 leader_election.cc:341] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8cb04a2e17f3417aaf0f89f0c7f78159
I20260620 07:01:07.299387 969 leader_election.cc:302] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.299765 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3d9c37e2e2842b7b5eb3ed57d186305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.320590 1840 tablet.cc:1717] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Skipping requested alter to schema version 4, tablet already version 4
I20260620 07:01:07.327832 1740 raft_consensus.cc:504] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.318451 1168 raft_consensus.cc:348] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.333204 1812 raft_consensus.cc:2726] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:07.333503 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3d9da1b03aae4cd9976109291ea43b4e
I20260620 07:01:07.334077 418 catalog_manager.cc:6565] ReplaceTablet: tablet 3d9da1b03aae4cd9976109291ea43b4e deleted and replaced by tablet 140696dbd9e44a0cbe5d4639110aa580
I20260620 07:01:07.336109 1811 tablet.cc:1722] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:07.341884 1811 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 538) took 1212 ms. Trace:
I20260620 07:01:07.341997 1811 rpcz_store.cc:276] 0620 07:01:06.129989 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.131338 (+ 1349us) service_pool.cc:227] Handling call
0620 07:01:07.341822 (+1210484us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:06.437427 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:06.437677 (+ 250us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:06.437688 (+ 11us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:06.437696 (+ 8us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:06.437753 (+ 57us) alter_schema_op.cc:126] START. Timestamp: 1781938866437670
0620 07:01:06.437757 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:06.543747 (+105990us) log.cc:842] Serialized 173 byte log entry
0620 07:01:07.335957 (+792210us) op_driver.cc:444] REPLICATION: finished
0620 07:01:07.336065 (+ 108us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:07.336513 (+ 448us) log.cc:842] Serialized 5 byte log entry
0620 07:01:07.341187 (+ 4674us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.341542 (+ 355us) log.cc:842] Serialized 14 byte log entry
0620 07:01:07.341779 (+ 237us) alter_schema_op.cc:71] Released schema lock
0620 07:01:07.341782 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":62,"mutex_wait_us":7064,"prepare.queue_time_us":305693,"prepare.run_cpu_time_us":14135,"prepare.run_wall_time_us":537364,"replication_time_us":898157,"thread_start_us":823854,"threads_started":2,"wal-append.queue_time_us":346906}]]}
I20260620 07:01:07.343457 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 5db9a7df42e04949934b6962c9253196 (DEFAULT_TABLE table=default.Table_608fa7fe9add4c14b2705f68900223d3 [id=015a91e5966740859f4cd6a00214671f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.344604 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 030b90899c3c4c7e82807a61234f223e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.344955 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 602f6d47f23e4d7f80f372a6a507d095 with delete_type TABLET_DATA_DELETED (replaced by tablet a54ea2c027bb4d4b82fcdb8aa6eb1475) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.345469 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ec769f903c4438bc1186d5fc1c5108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.345999 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 73359f7d59e54f0fb7781114ced2914f (DEFAULT_TABLE table=default.Table_43035e837b724041adc0d9be08280f83 [id=e1ef9fc9ca4046d3826dc3b8a80b0a84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.348029 1169 tablet_replica.cc:330] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:07.348968 729 tablet_service.cc:1467] Processing CreateTablet for tablet 5883a8466d0c4e45aba3b4095ced91a4 (DEFAULT_TABLE table=default.Table_fcf0a9375d5a47feb43a24d647b72f8c [id=ee78ec53e76e47b59d13e402a37dacf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.354215 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 030b90899c3c4c7e82807a61234f223e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.354266 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c2f865b06ca4b9c8fc9d8d0b4aa0dad" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:07.354511 752 raft_consensus.cc:3037] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:07.354303 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71977c69b29143eebfcc8ece39daf78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.355084 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 602f6d47f23e4d7f80f372a6a507d095 with delete_type TABLET_DATA_DELETED (replaced by tablet a54ea2c027bb4d4b82fcdb8aa6eb1475) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.328552 1740 leader_election.cc:288] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:07.330435 1168 raft_consensus.cc:374] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.347842 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d9da1b03aae4cd9976109291ea43b4e with delete_type TABLET_DATA_DELETED (replaced by tablet 140696dbd9e44a0cbe5d4639110aa580) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.358219 1168 raft_consensus.cc:729] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.358534 1168 consensus_queue.cc:260] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.361635 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db9a7df42e04949934b6962c9253196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.361971 1168 ts_tablet_manager.cc:1428] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.081s user 0.000s sys 0.004s
I20260620 07:01:07.362298 1168 tablet_bootstrap.cc:492] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:07.377491 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 18d08c30bf7e4c04b01368b9b4a6273c with delete_type TABLET_DATA_DELETED (replaced by tablet bc96c62b938c4a36b17c008d3503ca31) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.377784 1169 raft_consensus.cc:2229] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.378178 1169 raft_consensus.cc:2258] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.379288 1845 tablet.cc:1722] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:07.379751 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ec769f903c4438bc1186d5fc1c5108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.381425 1740 raft_consensus.cc:482] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:07.386662 1740 raft_consensus.cc:504] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.387406 1740 leader_election.cc:288] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:07.388800 1840 tablet.cc:1722] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:07.392966 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 5883a8466d0c4e45aba3b4095ced91a4 (DEFAULT_TABLE table=default.Table_fcf0a9375d5a47feb43a24d647b72f8c [id=ee78ec53e76e47b59d13e402a37dacf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.360091 1843 raft_consensus.cc:482] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:07.394639 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d9da1b03aae4cd9976109291ea43b4e with delete_type TABLET_DATA_DELETED (replaced by tablet 140696dbd9e44a0cbe5d4639110aa580) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.395226 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73359f7d59e54f0fb7781114ced2914f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.395382 1165 ts_tablet_manager.cc:1918] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.395963 1165 log.cc:1196] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/bea895c735c847f59794ab8c3282447d
I20260620 07:01:07.396843 1165 ts_tablet_manager.cc:1939] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:07.396971 1764 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260620 07:01:07.401446 1165 tablet_replica.cc:330] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:07.401665 1165 raft_consensus.cc:2229] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.401901 1165 raft_consensus.cc:2258] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.403323 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5883a8466d0c4e45aba3b4095ced91a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.406759 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 18d08c30bf7e4c04b01368b9b4a6273c with delete_type TABLET_DATA_DELETED (replaced by tablet bc96c62b938c4a36b17c008d3503ca31) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.408209 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bea895c735c847f59794ab8c3282447d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:07.408614 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1d09745353ef46b9b68397f48f391bcd
I20260620 07:01:07.410491 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c2f865b06ca4b9c8fc9d8d0b4aa0dad" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:07.411993 1843 raft_consensus.cc:504] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.415454 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 1b81bd1cb0e2498a8cec55e7ca761d72 (DEFAULT_TABLE table=default.Table_6c1b78c4f39f4e09abafd1d51690766a [id=86c6305d20c04570ab46d060739f93bd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:07.417655 830 leader_election.cc:341] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:07.418262 830 leader_election.cc:341] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:07.418497 1168 tablet_bootstrap.cc:654] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.419556 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "076926f7dffe4a7b80c25ea3c18e9958" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:07.423681 1843 leader_election.cc:288] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:07.430367 1165 ts_tablet_manager.cc:1905] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:07.433004 830 leader_election.cc:341] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:07.434703 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d9da1b03aae4cd9976109291ea43b4e with delete_type TABLET_DATA_DELETED (replaced by tablet 140696dbd9e44a0cbe5d4639110aa580) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.437462 1167 tablet_bootstrap.cc:492] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:07.438027 1166 ts_tablet_manager.cc:1918] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:07.438966 1170 tablet_bootstrap.cc:492] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:07.439188 1170 ts_tablet_manager.cc:1397] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.585s user 0.009s sys 0.013s
I20260620 07:01:07.439477 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d09745353ef46b9b68397f48f391bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.439841 1840 tablet.cc:1722] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260620 07:01:07.440038 1800 raft_consensus.cc:482] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:07.440237 1800 raft_consensus.cc:504] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.441020 1800 leader_election.cc:288] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:07.440735 1847 tablet.cc:1722] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260620 07:01:07.442759 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet bea895c735c847f59794ab8c3282447d (table default.Table_53d54ae0843e43bbaa814c4fdd23d530 [id=42744b614d6e4bd7900ea2fc51d30fa4]) successfully deleted
W20260620 07:01:07.443086 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 18d08c30bf7e4c04b01368b9b4a6273c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18d08c30bf7e4c04b01368b9b4a6273c already in progress: creating tablet
I20260620 07:01:07.452982 1169 ts_tablet_manager.cc:1905] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.453220 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b961698fe54e7f9c16f41b90058093" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:07.453294 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d09745353ef46b9b68397f48f391bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:07.458045 831 leader_election.cc:341] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: bea895c735c847f59794ab8c3282447d
I20260620 07:01:07.458295 831 leader_election.cc:302] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:07.458719 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3d9c37e2e2842b7b5eb3ed57d186305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.459030 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5883a8466d0c4e45aba3b4095ced91a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.458995 752 raft_consensus.cc:2454] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:07.461210 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ec98cedea527437ebc2237e75dcc45ec" } modify_external_catalogs: true
I20260620 07:01:07.461489 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ec98cedea527437ebc2237e75dcc45ec" } modify_external_catalogs: true
I20260620 07:01:07.461644 1811 tablet.cc:1722] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260620 07:01:07.462100 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d09745353ef46b9b68397f48f391bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.463518 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1254e74518114bba933f842f6e7c7bac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:07.463727 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b81bd1cb0e2498a8cec55e7ca761d72. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:07.464112 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1254e74518114bba933f842f6e7c7bac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.466344 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 168fb1666e2c41358213240d34ef9572
I20260620 07:01:07.466780 427 catalog_manager.cc:6565] ReplaceTablet: tablet 168fb1666e2c41358213240d34ef9572 deleted and replaced by tablet 8dad7e6437ab4328b9b88d5e6febe8a0
I20260620 07:01:07.467099 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1d413e8cd6774f26b9f2a394c5903495" } new_table_name: "default.Table_7eafc8e838624e3e9873bc01998b5daa" modify_external_catalogs: true
I20260620 07:01:07.467661 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b961698fe54e7f9c16f41b90058093" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:07.468334 1167 ts_tablet_manager.cc:1397] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.368s user 0.005s sys 0.006s
I20260620 07:01:07.471719 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1e18ab4a35f347abb061df0a7db49226" } modify_external_catalogs: true
I20260620 07:01:07.471937 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1e18ab4a35f347abb061df0a7db49226" } modify_external_catalogs: true
I20260620 07:01:07.472185 1167 raft_consensus.cc:348] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.472718 1167 raft_consensus.cc:374] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.472870 1167 raft_consensus.cc:729] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.473241 1811 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41218 (request call id 540) took 1251 ms. Trace:
I20260620 07:01:07.473884 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_27f50fad45334e6aa34ab5e49c99e182" } new_table_name: "default.Table_80461b90cd2b4ddb863570b10b593012" modify_external_catalogs: true
I20260620 07:01:07.473380 1811 rpcz_store.cc:276] 0620 07:01:06.222101 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.222194 (+ 93us) service_pool.cc:227] Handling call
0620 07:01:07.473201 (+1251007us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:06.984448 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0620 07:01:06.984572 (+ 124us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0620 07:01:07.018490 (+ 33918us) alter_schema_op.cc:65] Acquired schema lock
0620 07:01:07.018501 (+ 11us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0620 07:01:07.018550 (+ 49us) alter_schema_op.cc:126] START. Timestamp: 1781938867018523
0620 07:01:07.018554 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:07.057212 (+ 38658us) log.cc:842] Serialized 173 byte log entry
0620 07:01:07.057425 (+ 213us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x6150002010a4. stack: 00007f5f3ef5866e 00007f5f3ef58430 00007f5f3dfdf5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f5f4a466d02 00007f5f4b7997f1 00007f5f4b798359 00007f5f4b7a01bb 00007f5f4b7a0038 00000000009edb7c 00007f5f3ef9e344 00007f5f3efa191b 00007f5f3efa1798 00000000009edb7c
0620 07:01:07.431231 (+373806us) op_driver.cc:444] REPLICATION: finished
0620 07:01:07.431328 (+ 97us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0620 07:01:07.464072 (+ 32744us) log.cc:842] Serialized 5 byte log entry
0620 07:01:07.470748 (+ 6676us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.472822 (+ 2074us) log.cc:842] Serialized 14 byte log entry
0620 07:01:07.473122 (+ 300us) alter_schema_op.cc:71] Released schema lock
0620 07:01:07.473164 (+ 42us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":52,"prepare.queue_time_us":638703,"prepare.run_cpu_time_us":6550,"prepare.run_wall_time_us":73010,"replication_time_us":412649,"spinlock_wait_cycles":88371072}]]}
I20260620 07:01:07.474607 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b98711dfb114a2985c5153e9b44147a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:07.476460 1166 log.cc:1196] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/8b8d90f8d63e45ce990aead6166bcfb6
I20260620 07:01:07.476941 1166 ts_tablet_manager.cc:1939] T 8b8d90f8d63e45ce990aead6166bcfb6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:07.478699 830 leader_election.cc:341] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:07.482175 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fa1db4a654f54dee8b887dffc4d5a021" } new_table_name: "default.Table_c121378eeebe452b9a4278fd21fba088" modify_external_catalogs: true
I20260620 07:01:07.486402 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4u_93S/build/asan/bin/kudu
/tmp/dist-test-task4u_93S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:33455
--webserver_interface=127.0.97.61
--webserver_port=38159
--builtin_ntp_servers=127.0.97.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 07:01:07.481102 831 raft_consensus.cc:2670] T bea895c735c847f59794ab8c3282447d P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:07.492900 831 leader_election.cc:341] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 076926f7dffe4a7b80c25ea3c18e9958
I20260620 07:01:07.493139 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 168fb1666e2c41358213240d34ef9572 with delete_type TABLET_DATA_DELETED (replaced by tablet 8dad7e6437ab4328b9b88d5e6febe8a0) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.493316 831 leader_election.cc:302] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:07.493579 1846 raft_consensus.cc:2726] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:07.493938 831 leader_election.cc:302] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:07.494230 1846 raft_consensus.cc:2781] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:07.494410 1846 raft_consensus.cc:686] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:07.494819 1846 consensus_queue.cc:237] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.499047 1165 ts_tablet_manager.cc:1918] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.499424 1165 log.cc:1196] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/7fc63351f767447c99b819fe7848d381
I20260620 07:01:07.500028 1165 ts_tablet_manager.cc:1939] T 7fc63351f767447c99b819fe7848d381 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:07.501408 1165 tablet_replica.cc:330] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:07.501835 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 7fc63351f767447c99b819fe7848d381 (table default.Table_e84e884648ed447c91e20b4a2be65197 [id=38f5978d6a7945c9aec7b78d789241ce]) successfully deleted
W20260620 07:01:07.502213 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 030b90899c3c4c7e82807a61234f223e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 030b90899c3c4c7e82807a61234f223e already in progress: creating tablet
W20260620 07:01:07.502454 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 08ec769f903c4438bc1186d5fc1c5108 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08ec769f903c4438bc1186d5fc1c5108 already in progress: creating tablet
I20260620 07:01:07.504988 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c1da229c30624077a49d8112967940c7" } new_table_name: "default.Table_39a2812476a64b64bdff8924d31a88c3" modify_external_catalogs: true
W20260620 07:01:07.516037 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31c56e80a73c442aa3cc65126a76c8be consensus state has no leader
I20260620 07:01:07.516554 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9a1f7fd6373b4013982e2a16179901fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.517174 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a1f7fd6373b4013982e2a16179901fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.518179 1165 raft_consensus.cc:2229] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:07.518419 1165 pending_rounds.cc:62] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:07.518496 1165 pending_rounds.cc:68] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821601261780992 op_type: NO_OP noop_request { }
I20260620 07:01:07.518646 1165 raft_consensus.cc:2866] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:07.518829 1165 raft_consensus.cc:2258] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.527446 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 168fb1666e2c41358213240d34ef9572 with delete_type TABLET_DATA_DELETED (replaced by tablet 8dad7e6437ab4328b9b88d5e6febe8a0) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.527372 1167 consensus_queue.cc:260] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.532578 1831 tablet.cc:1722] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:07.533138 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db9a7df42e04949934b6962c9253196. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:07.533178 681 leader_election.cc:341] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:07.533326 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 65022.8us
I20260620 07:01:07.533427 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.533668 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b37f2c150b314b7298f32c3d414ff43d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:07.533746 683 leader_election.cc:341] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:07.534145 683 leader_election.cc:302] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.534579 1800 raft_consensus.cc:2726] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:07.536020 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.539021 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa5c040d5e84006935e9f06424a34b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.539839 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dd62b0f22f44b26a7602dc23e698a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.543715 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 168fb1666e2c41358213240d34ef9572 with delete_type TABLET_DATA_DELETED (replaced by tablet 8dad7e6437ab4328b9b88d5e6febe8a0) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.529939 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b98711dfb114a2985c5153e9b44147a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:07.546442 1168 tablet_bootstrap.cc:492] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:07.546931 1168 ts_tablet_manager.cc:1397] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.185s user 0.017s sys 0.003s
I20260620 07:01:07.547792 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 202) took 8376 ms. Trace:
I20260620 07:01:07.547971 1166 rpcz_store.cc:276] 0620 07:00:59.150423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.153087 (+ 2664us) service_pool.cc:227] Handling call
0620 07:01:07.114009 (+7960922us) ts_tablet_manager.cc:1145] Deleting tablet 8b8d90f8d63e45ce990aead6166bcfb6
0620 07:01:07.114018 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.303861 (+189843us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.423536 (+119675us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.527113 (+103577us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7950672}
I20260620 07:01:07.549034 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 203) took 8397 ms. Trace:
I20260620 07:01:07.549198 1166 rpcz_store.cc:276] 0620 07:00:59.150568 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.151180 (+ 612us) service_pool.cc:227] Handling call
0620 07:01:07.548381 (+8397201us) ts_tablet_manager.cc:1145] Deleting tablet a292d66ee14a48959c1f6a63e0a0f492
0620 07:01:07.548392 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.548501 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8381343}
I20260620 07:01:07.549984 419 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_20581d428c6345ce8216cc2467e7eeef [id=2abd0f99a3034a0e8824bcb0002c91bd] alter complete (version 2)
I20260620 07:01:07.550067 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 205) took 8398 ms. Trace:
I20260620 07:01:07.550275 1166 rpcz_store.cc:276] 0620 07:00:59.150832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.151230 (+ 398us) service_pool.cc:227] Handling call
0620 07:01:07.549488 (+8398258us) ts_tablet_manager.cc:1145] Deleting tablet 82020156f3e44a1e84a9435d1f994124
0620 07:01:07.549499 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.549631 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8366038}
I20260620 07:01:07.551002 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_03892f83a5e34559bbbe72bbb8bcd8c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:07.551334 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1d3a2c1e3d244fe9b0a92d28995c3440"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.551645 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03892f83a5e34559bbbe72bbb8bcd8c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.551833 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 206) took 8399 ms. Trace:
W20260620 07:01:07.551898 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d3a2c1e3d244fe9b0a92d28995c3440 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.552023 1166 rpcz_store.cc:276] 0620 07:00:59.150953 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.151313 (+ 360us) service_pool.cc:227] Handling call
0620 07:01:07.550756 (+8399443us) ts_tablet_manager.cc:1145] Deleting tablet f9df1d52393e47ce991b5295d03624e8
0620 07:01:07.550767 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.550872 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8366542}
I20260620 07:01:07.552687 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 204) took 8401 ms. Trace:
I20260620 07:01:07.552848 1166 rpcz_store.cc:276] 0620 07:00:59.150686 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.151281 (+ 595us) service_pool.cc:227] Handling call
0620 07:01:07.552354 (+8401073us) ts_tablet_manager.cc:1145] Deleting tablet d066c73ae0104cb3be792790b1dfb93d
0620 07:01:07.552365 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.552444 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8367509}
I20260620 07:01:07.553300 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 201) took 8403 ms. Trace:
I20260620 07:01:07.553435 1166 rpcz_store.cc:276] 0620 07:00:59.150262 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.151278 (+ 1016us) service_pool.cc:227] Handling call
0620 07:01:07.553153 (+8401875us) ts_tablet_manager.cc:1145] Deleting tablet a5757e05e9a2403a86ca98f455e11754
0620 07:01:07.553164 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.553244 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8357171}
I20260620 07:01:07.553810 1166 tablet_replica.cc:330] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:07.554030 1166 raft_consensus.cc:2229] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.554219 1166 raft_consensus.cc:2258] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.554916 1166 ts_tablet_manager.cc:1905] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.557209 1168 raft_consensus.cc:348] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.558001 1168 raft_consensus.cc:374] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.558575 1168 raft_consensus.cc:729] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:07.558445 1852 consensus_queue.cc:1159] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "978f112862c64141b1009856bef3d624" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260620 07:01:07.560474 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b678a77d34f34718836fba62b81412c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.560530 1165 ts_tablet_manager.cc:1905] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.561019 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 8b8d90f8d63e45ce990aead6166bcfb6 (table default.Table_26f927ce5e714da5ae118310d32e42a3 [id=2c972f7177414e16be4a7133dc2dac9d]) successfully deleted
W20260620 07:01:07.561400 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a292d66ee14a48959c1f6a63e0a0f492 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a292d66ee14a48959c1f6a63e0a0f492 already in progress: creating tablet
W20260620 07:01:07.561957 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 82020156f3e44a1e84a9435d1f994124 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82020156f3e44a1e84a9435d1f994124 already in progress: creating tablet
W20260620 07:01:07.562506 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f9df1d52393e47ce991b5295d03624e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9df1d52393e47ce991b5295d03624e8 already in progress: creating tablet
W20260620 07:01:07.563117 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d066c73ae0104cb3be792790b1dfb93d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d066c73ae0104cb3be792790b1dfb93d already in progress: creating tablet
I20260620 07:01:07.565097 1167 ts_tablet_manager.cc:1428] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.097s user 0.001s sys 0.002s
I20260620 07:01:07.565454 1167 tablet_bootstrap.cc:492] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:07.566519 1750 raft_consensus.cc:482] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:07.566664 1750 raft_consensus.cc:504] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.566758 1831 tablet.cc:1722] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:07.567289 1750 leader_election.cc:288] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:07.568485 683 consensus_peers.cc:487] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f53f0302d1a4fb3a0fe3e1d98583550. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:07.569345 1167 tablet_bootstrap.cc:654] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.574118 1165 ts_tablet_manager.cc:1918] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:07.574434 1165 log.cc:1196] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/3c2f865b06ca4b9c8fc9d8d0b4aa0dad
I20260620 07:01:07.575248 1165 ts_tablet_manager.cc:1939] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:07.559356 1168 consensus_queue.cc:260] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.577324 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad (table default.Table_b043963ee56e4494be5b5a95ea01d158 [id=1aa84262b2da494d8f47bd49a6348733]) successfully deleted
I20260620 07:01:07.580017 1168 ts_tablet_manager.cc:1428] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.032s user 0.004s sys 0.000s
I20260620 07:01:07.581426 1168 tablet_bootstrap.cc:492] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:07.581725 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 602f6d47f23e4d7f80f372a6a507d095 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 602f6d47f23e4d7f80f372a6a507d095 already in progress: creating tablet
W20260620 07:01:07.582504 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3d9da1b03aae4cd9976109291ea43b4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d9da1b03aae4cd9976109291ea43b4e already in progress: creating tablet
I20260620 07:01:07.583580 749 raft_consensus.cc:2454] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
W20260620 07:01:07.583922 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1d09745353ef46b9b68397f48f391bcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d09745353ef46b9b68397f48f391bcd already in progress: creating tablet
I20260620 07:01:07.584156 831 leader_election.cc:302] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:07.584616 1846 raft_consensus.cc:2781] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:07.584729 1846 raft_consensus.cc:482] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:07.584843 1846 raft_consensus.cc:3037] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:07.587497 1168 tablet_bootstrap.cc:654] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.587983 1846 raft_consensus.cc:504] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:07.590124 969 leader_election.cc:341] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 203ba3933d3a4fb2a4978b29cad614e6
I20260620 07:01:07.590241 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b98711dfb114a2985c5153e9b44147a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:07.592309 830 leader_election.cc:341] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:07.592948 1846 leader_election.cc:288] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:07.593475 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 168fb1666e2c41358213240d34ef9572 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 168fb1666e2c41358213240d34ef9572 already in progress: creating tablet
W20260620 07:01:07.599431 968 leader_election.cc:341] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 203ba3933d3a4fb2a4978b29cad614e6
I20260620 07:01:07.599622 968 leader_election.cc:302] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.600112 1750 raft_consensus.cc:2726] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:07.600450 1170 raft_consensus.cc:348] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.601522 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d66cbf08f57c41609818ca5af7514f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.607568 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fe3b70b1674e43768b29dea84b09a1a0
I20260620 07:01:07.609843 1170 raft_consensus.cc:374] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.611171 858 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:07.612026 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fe3b70b1674e43768b29dea84b09a1a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe3b70b1674e43768b29dea84b09a1a0 already in progress: creating tablet
I20260620 07:01:07.612633 1168 tablet_bootstrap.cc:492] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:07.612974 1168 ts_tablet_manager.cc:1397] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.008s
I20260620 07:01:07.615185 1168 raft_consensus.cc:348] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.615758 1168 raft_consensus.cc:374] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260620 07:01:07.616333 1841 log.cc:924] Time spent T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Append to log took a long time: real 0.110s user 0.000s sys 0.000s
I20260620 07:01:07.616631 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.618485 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b98711dfb114a2985c5153e9b44147a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
W20260620 07:01:07.625537 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 883d1959ed484c58935db467aa2dc50a consensus state has no leader
I20260620 07:01:07.627573 1167 tablet_bootstrap.cc:492] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:07.627671 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6363d1d9233d4938ba40abff452ed147
I20260620 07:01:07.627947 1167 ts_tablet_manager.cc:1397] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.003s
W20260620 07:01:07.628685 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3dba2e33592f43a7867756a8b93b3a75 consensus state has no leader
I20260620 07:01:07.628688 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 6363d1d9233d4938ba40abff452ed147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.629596 1167 raft_consensus.cc:348] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.629956 1167 raft_consensus.cc:374] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.630101 1167 raft_consensus.cc:729] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.629846 1168 raft_consensus.cc:729] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.630435 1167 consensus_queue.cc:260] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.633154 1167 ts_tablet_manager.cc:1428] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260620 07:01:07.633522 1167 tablet_bootstrap.cc:492] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:07.632066 1168 consensus_queue.cc:260] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.626754 1166 ts_tablet_manager.cc:1918] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.637212 1166 log.cc:1196] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/b6e36ffd69974ef897390a257f63a509
I20260620 07:01:07.637679 1166 ts_tablet_manager.cc:1939] T b6e36ffd69974ef897390a257f63a509 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:07.638387 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 6363d1d9233d4938ba40abff452ed147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.637095 1167 tablet_bootstrap.cc:654] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.639075 1168 ts_tablet_manager.cc:1428] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.026s user 0.004s sys 0.000s
I20260620 07:01:07.639689 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 207) took 8488 ms. Trace:
I20260620 07:01:07.639878 1166 rpcz_store.cc:276] 0620 07:00:59.151090 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.158048 (+ 6958us) service_pool.cc:227] Handling call
0620 07:01:07.553705 (+8395657us) ts_tablet_manager.cc:1145] Deleting tablet b6e36ffd69974ef897390a257f63a509
0620 07:01:07.553715 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.607869 (+ 54154us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.618530 (+ 10661us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.639648 (+ 21118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8357246}
W20260620 07:01:07.640151 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba189cfcef094a7bb45bc7d5f4ee5b71 consensus state has no leader
I20260620 07:01:07.640486 425 master_service.cc:946] ReplaceTablet: received request to replace tablet eeb082e189304f13909d115f7197c5a1 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:07.641409 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6d6ee060896c4d3ab31d9cefe862ef44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.642028 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d6ee060896c4d3ab31d9cefe862ef44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.643667 1168 tablet_bootstrap.cc:492] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:07.644656 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_01ee97109ccf4626922b6e3ec22f9423" } modify_external_catalogs: true
I20260620 07:01:07.644870 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_01ee97109ccf4626922b6e3ec22f9423" } modify_external_catalogs: true
I20260620 07:01:07.645743 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_186656f8bbdd43ad8e66efcc62300631"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.646286 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_186656f8bbdd43ad8e66efcc62300631 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.647678 1168 tablet_bootstrap.cc:654] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.649808 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8da43d7e15014c0086f338f67303bc34" } modify_external_catalogs: true
I20260620 07:01:07.650000 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8da43d7e15014c0086f338f67303bc34" } modify_external_catalogs: true
I20260620 07:01:07.650409 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 232) took 8041 ms. Trace:
W20260620 07:01:07.650470 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6363d1d9233d4938ba40abff452ed147 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6363d1d9233d4938ba40abff452ed147 already in progress: creating tablet
I20260620 07:01:07.650611 1166 rpcz_store.cc:276] 0620 07:00:59.609314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.738670 (+129356us) service_pool.cc:227] Handling call
0620 07:01:07.650236 (+7911566us) ts_tablet_manager.cc:1145] Deleting tablet 2ee94c1a799a47f997469f96005167dc
0620 07:01:07.650250 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.650368 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7906906}
W20260620 07:01:07.651273 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2ee94c1a799a47f997469f96005167dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ee94c1a799a47f997469f96005167dc already in progress: creating tablet
I20260620 07:01:07.651918 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 236) took 8020 ms. Trace:
I20260620 07:01:07.652372 1166 rpcz_store.cc:276] 0620 07:00:59.630974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.747471 (+116497us) service_pool.cc:227] Handling call
0620 07:01:07.651726 (+7904255us) ts_tablet_manager.cc:1145] Deleting tablet eeb082e189304f13909d115f7197c5a1
0620 07:01:07.651754 (+ 28us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.651875 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7903931}
W20260620 07:01:07.653174 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet eeb082e189304f13909d115f7197c5a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eeb082e189304f13909d115f7197c5a1 already in progress: creating tablet
W20260620 07:01:07.654330 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dac4a1434751433488eb2913b1ddfd23 consensus state has no leader
I20260620 07:01:07.654819 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_83260c708b85456995a000801fb7aa87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.655483 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83260c708b85456995a000801fb7aa87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.657078 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dbcf6925600345658e340ad71565e073" } modify_external_catalogs: true
I20260620 07:01:07.657313 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dbcf6925600345658e340ad71565e073" } modify_external_catalogs: true
I20260620 07:01:07.667470 1166 tablet_replica.cc:330] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:07.670868 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bc6f45b50d5647928a19eb8b0b789fd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.671561 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc6f45b50d5647928a19eb8b0b789fd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.671674 1750 raft_consensus.cc:482] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 978f112862c64141b1009856bef3d624)
I20260620 07:01:07.671859 1750 raft_consensus.cc:504] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:07.672542 1750 leader_election.cc:288] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:07.673858 969 leader_election.cc:341] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 2906fe0a195149d2844232cc8d83f6dd
I20260620 07:01:07.674425 1166 raft_consensus.cc:2229] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.674667 1166 raft_consensus.cc:2258] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.675346 1166 ts_tablet_manager.cc:1905] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.676280 1170 raft_consensus.cc:729] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.676657 1170 consensus_queue.cc:260] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.680004 426 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_dcd39517a9e640af985a7a77e18673e3 [id=04c170b69f3b43eb88b51e1654ec86df] alter complete (version 5)
I20260620 07:01:07.680533 1167 tablet_bootstrap.cc:492] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:07.680711 1167 ts_tablet_manager.cc:1397] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.000s
I20260620 07:01:07.681516 1167 raft_consensus.cc:348] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:07.681715 968 leader_election.cc:341] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 2906fe0a195149d2844232cc8d83f6dd
I20260620 07:01:07.681898 968 leader_election.cc:302] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.682090 716 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.682257 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73359f7d59e54f0fb7781114ced2914f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.682312 1750 raft_consensus.cc:2726] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:07.682605 1167 raft_consensus.cc:374] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.682734 1167 raft_consensus.cc:729] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.683146 1167 consensus_queue.cc:260] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.686990 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3d9c38c934dc4976829baa74050e095b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.687669 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d9c38c934dc4976829baa74050e095b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.688349 1167 ts_tablet_manager.cc:1428] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260620 07:01:07.688756 1167 tablet_bootstrap.cc:492] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:07.699260 423 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3] alter complete (version 1)
I20260620 07:01:07.706014 749 raft_consensus.cc:3037] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:07.708309 1167 tablet_bootstrap.cc:654] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.713016 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b69d0b1d57d41b284a103a6128e5256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.715001 1750 raft_consensus.cc:482] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:07.715219 1750 raft_consensus.cc:504] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.716152 1750 leader_election.cc:288] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:07.717862 969 leader_election.cc:341] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 6ff06bc5fc684b9195c719cbf39d34a6
I20260620 07:01:07.721710 749 raft_consensus.cc:2454] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
W20260620 07:01:07.723546 968 leader_election.cc:341] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 6ff06bc5fc684b9195c719cbf39d34a6
I20260620 07:01:07.723729 968 leader_election.cc:302] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:07.724347 1750 raft_consensus.cc:2726] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:07.722034 1170 ts_tablet_manager.cc:1428] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.254s user 0.001s sys 0.001s
I20260620 07:01:07.723209 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 6363d1d9233d4938ba40abff452ed147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.726071 831 leader_election.cc:302] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:07.726583 1846 raft_consensus.cc:2781] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:07.726811 1846 raft_consensus.cc:686] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:07.727174 1846 consensus_queue.cc:237] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.734197 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b81bd1cb0e2498a8cec55e7ca761d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.752450 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 3d9da1b03aae4cd9976109291ea43b4e from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:07.755486 1170 tablet_bootstrap.cc:492] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:07.755686 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6336d57f20ba4d59b9b01949f23922d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.757898 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_20581d428c6345ce8216cc2467e7eeef [id=2abd0f99a3034a0e8824bcb0002c91bd]). Expected version 2 got 0
I20260620 07:01:07.767123 1168 tablet_bootstrap.cc:492] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:07.767362 1168 ts_tablet_manager.cc:1397] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.124s user 0.014s sys 0.010s
I20260620 07:01:07.768783 1169 ts_tablet_manager.cc:1918] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.769078 1169 log.cc:1196] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/d066c73ae0104cb3be792790b1dfb93d
I20260620 07:01:07.770364 1169 ts_tablet_manager.cc:1939] T d066c73ae0104cb3be792790b1dfb93d P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:07.770548 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_961fb7cc2ac24b8198709c9465361979"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:07.771409 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_961fb7cc2ac24b8198709c9465361979 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.773164 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6ebacaa3bdcf4a4b8ffeccfb72d898f3" } new_table_name: "default.Table_2c6ec989fb644883b60b35937533a489" modify_external_catalogs: true
I20260620 07:01:07.774982 1168 raft_consensus.cc:348] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.775251 1168 raft_consensus.cc:374] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.775332 1168 raft_consensus.cc:729] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.775590 1168 consensus_queue.cc:260] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.776211 1168 ts_tablet_manager.cc:1428] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20260620 07:01:07.776523 1168 tablet_bootstrap.cc:492] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:07.801714 1168 tablet_bootstrap.cc:654] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.803030 1845 tablet.cc:1717] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Skipping requested alter to schema version 4, tablet already version 4
I20260620 07:01:07.804275 1166 ts_tablet_manager.cc:1918] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.805414 1166 log.cc:1196] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/7200877be18c4eaca57df88c25d30c01
I20260620 07:01:07.806013 1166 ts_tablet_manager.cc:1939] T 7200877be18c4eaca57df88c25d30c01 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:07.807245 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 243) took 8022 ms. Trace:
I20260620 07:01:07.808308 1170 tablet_bootstrap.cc:654] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.809049 720 tablet_service.cc:1514] Processing DeleteTablet for tablet cb26f1d10f9a4978b41afbd8894f1102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.810871 1166 rpcz_store.cc:276] 0620 07:00:59.784834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.891483 (+106649us) service_pool.cc:227] Handling call
0620 07:01:07.667364 (+7775881us) ts_tablet_manager.cc:1145] Deleting tablet 7200877be18c4eaca57df88c25d30c01
0620 07:01:07.667382 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.765505 (+ 98123us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.804158 (+ 38653us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.807197 (+ 3039us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7711674}
I20260620 07:01:07.812316 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 234) took 8184 ms. Trace:
I20260620 07:01:07.813184 1166 rpcz_store.cc:276] 0620 07:00:59.628338 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.743481 (+115143us) service_pool.cc:227] Handling call
0620 07:01:07.812134 (+8068653us) ts_tablet_manager.cc:1145] Deleting tablet 46689d13712842bf9145ad2bc3fc2acf
0620 07:01:07.812146 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.812263 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7847086}
W20260620 07:01:07.814216 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 46689d13712842bf9145ad2bc3fc2acf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46689d13712842bf9145ad2bc3fc2acf already in progress: creating tablet
I20260620 07:01:07.815292 1166 tablet_replica.cc:330] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:07.815567 1166 raft_consensus.cc:2229] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:07.816004 1166 raft_consensus.cc:2258] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.813459 1845 tablet.cc:1722] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260620 07:01:07.817541 1166 ts_tablet_manager.cc:1905] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.830969 1168 tablet_bootstrap.cc:492] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:07.831228 1168 ts_tablet_manager.cc:1397] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.002s
I20260620 07:01:07.832032 1168 raft_consensus.cc:348] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.832355 1168 raft_consensus.cc:374] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.832491 1168 raft_consensus.cc:729] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.832770 1168 consensus_queue.cc:260] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.833427 1168 ts_tablet_manager.cc:1428] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:07.833766 1168 tablet_bootstrap.cc:492] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:07.838711 1168 tablet_bootstrap.cc:654] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.840739 1166 ts_tablet_manager.cc:1918] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:07.840955 1166 log.cc:1196] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/63dfade71c254d7e908e00acada93638
I20260620 07:01:07.841420 1166 ts_tablet_manager.cc:1939] T 63dfade71c254d7e908e00acada93638 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:07.847226 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 244) took 8040 ms. Trace:
I20260620 07:01:07.848546 1166 rpcz_store.cc:276] 0620 07:00:59.806596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.955714 (+149118us) service_pool.cc:227] Handling call
0620 07:01:07.815207 (+7859493us) ts_tablet_manager.cc:1145] Deleting tablet 63dfade71c254d7e908e00acada93638
0620 07:01:07.815220 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.836142 (+ 20922us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.840606 (+ 4464us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.847179 (+ 6573us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7841968}
I20260620 07:01:07.849390 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 63dfade71c254d7e908e00acada93638 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]) successfully deleted
I20260620 07:01:07.849436 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 247) took 7961 ms. Trace:
I20260620 07:01:07.849555 1166 rpcz_store.cc:276] 0620 07:00:59.888341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.973265 (+ 84924us) service_pool.cc:227] Handling call
0620 07:01:07.849287 (+7876022us) ts_tablet_manager.cc:1145] Deleting tablet 04db48e910514d46bb4deb9acf54f7c0
0620 07:01:07.849298 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.849404 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7875773}
W20260620 07:01:07.849995 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 04db48e910514d46bb4deb9acf54f7c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04db48e910514d46bb4deb9acf54f7c0 already in progress: creating tablet
I20260620 07:01:07.850152 1806 raft_consensus.cc:482] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 978f112862c64141b1009856bef3d624)
I20260620 07:01:07.850495 1806 raft_consensus.cc:504] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.851011 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 248) took 7955 ms. Trace:
I20260620 07:01:07.851648 1166 rpcz_store.cc:276] 0620 07:00:59.896076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.973526 (+ 77450us) service_pool.cc:227] Handling call
0620 07:01:07.850859 (+7877333us) ts_tablet_manager.cc:1145] Deleting tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2
0620 07:01:07.850870 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.850970 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7877140}
W20260620 07:01:07.852365 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 already in progress: creating tablet
I20260620 07:01:07.852826 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 249) took 7953 ms. Trace:
I20260620 07:01:07.853232 1166 rpcz_store.cc:276] 0620 07:00:59.899599 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.973733 (+ 74134us) service_pool.cc:227] Handling call
0620 07:01:07.852698 (+7878965us) ts_tablet_manager.cc:1145] Deleting tablet c38c628514c44c6fa5aff64928e515d9
0620 07:01:07.852708 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.852798 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7878811}
W20260620 07:01:07.853848 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c38c628514c44c6fa5aff64928e515d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c38c628514c44c6fa5aff64928e515d9 already in progress: creating tablet
I20260620 07:01:07.854315 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 235) took 8223 ms. Trace:
I20260620 07:01:07.854777 1166 rpcz_store.cc:276] 0620 07:00:59.630865 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.745894 (+115029us) service_pool.cc:227] Handling call
0620 07:01:07.854194 (+8108300us) ts_tablet_manager.cc:1145] Deleting tablet 9a46df2909bf43f297b412c33f18a329
0620 07:01:07.854204 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.854284 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7875044}
I20260620 07:01:07.851509 1806 leader_election.cc:288] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:07.855603 969 leader_election.cc:341] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 978f99d2a7d6448aba8dcd2611b75af3
W20260620 07:01:07.856135 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9a46df2909bf43f297b412c33f18a329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a46df2909bf43f297b412c33f18a329 already in progress: creating tablet
I20260620 07:01:07.856736 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 246) took 7996 ms. Trace:
W20260620 07:01:07.859469 968 leader_election.cc:341] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 978f99d2a7d6448aba8dcd2611b75af3
I20260620 07:01:07.859470 1166 rpcz_store.cc:276] 0620 07:00:59.860440 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:00:59.965075 (+104635us) service_pool.cc:227] Handling call
0620 07:01:07.856612 (+7891537us) ts_tablet_manager.cc:1145] Deleting tablet 95f9a6b2f2cb41e6b74715b2618d8a70
0620 07:01:07.856622 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.856704 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7876755}
I20260620 07:01:07.859645 968 leader_election.cc:302] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:07.859993 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95f9a6b2f2cb41e6b74715b2618d8a70 already in progress: creating tablet
I20260620 07:01:07.860211 1806 raft_consensus.cc:2726] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:07.860574 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 264) took 7248 ms. Trace:
I20260620 07:01:07.861024 1166 rpcz_store.cc:276] 0620 07:01:00.615433 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.045501 (+430068us) service_pool.cc:227] Handling call
0620 07:01:07.860433 (+6814932us) ts_tablet_manager.cc:1145] Deleting tablet 2910da33bbdb4410a4a90ff9747a7de1
0620 07:01:07.860444 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.860544 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6814715}
I20260620 07:01:07.861538 418 master_service.cc:946] ReplaceTablet: received request to replace tablet a4e8c06f3f8544ecafb63dd7d04fdf05 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:07.861861 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2910da33bbdb4410a4a90ff9747a7de1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2910da33bbdb4410a4a90ff9747a7de1 already in progress: creating tablet
I20260620 07:01:07.862229 1166 tablet_replica.cc:330] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:07.862681 1166 raft_consensus.cc:2229] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.862775 423 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e] alter complete (version 6)
I20260620 07:01:07.863248 1166 raft_consensus.cc:2258] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.864121 1166 ts_tablet_manager.cc:1905] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.871459 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6f28a009320146f2bf9ad40968c837d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:07.871847 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 496) took 2775 ms. Trace:
W20260620 07:01:07.872206 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f28a009320146f2bf9ad40968c837d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:07.872044 1169 rpcz_store.cc:276] 0620 07:01:05.096191 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.096239 (+ 48us) service_pool.cc:227] Handling call
0620 07:01:07.209670 (+2113431us) ts_tablet_manager.cc:1145] Deleting tablet d066c73ae0104cb3be792790b1dfb93d
0620 07:01:07.209690 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.685162 (+475472us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.768597 (+ 83435us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.871651 (+103054us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5770,"tablet-delete.queue_time_us":2112580}
W20260620 07:01:07.873669 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 140696dbd9e44a0cbe5d4639110aa580 has no consensus state
I20260620 07:01:07.874169 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9b219ed56eea4d9db45cb8c22f772b5b" } new_table_name: "default.Table_c718b2278f3a4d398487bd0ece7c67d6" modify_external_catalogs: true
I20260620 07:01:07.877389 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 54871462333d4249bbd9da7e21035980 (DEFAULT_TABLE table=default.Table_9b219ed56eea4d9db45cb8c22f772b5b [id=df85c008467846469db557268713876d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.877597 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fd8858b58d1247d18cfbf9919c0e4599" } modify_external_catalogs: true
I20260620 07:01:07.877861 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54871462333d4249bbd9da7e21035980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.877794 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fd8858b58d1247d18cfbf9919c0e4599" } modify_external_catalogs: true
I20260620 07:01:07.880945 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_827793c101e141e5a8bac046d9985a22" } new_table_name: "default.Table_7e1bd0d27961486986559381614efd38" modify_external_catalogs: true
I20260620 07:01:07.881330 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 2614cc40931e4c308a5a7208f2e8c400 (DEFAULT_TABLE table=default.Table_e72d9c9be46441e4b73ae53afe9ed50c [id=0e804808214c4e4ba1a52fee023efa15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.881783 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2614cc40931e4c308a5a7208f2e8c400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.882578 426 master_service.cc:946] ReplaceTablet: received request to replace tablet cd75e318982a4fb9bf28cb35b030642f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:07.883142 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_aea9387e12a14d08bc7ad7def05993a3" } new_table_name: "default.Table_8aa7864d15a54ee5bb36deaf2d452309" modify_external_catalogs: true
I20260620 07:01:07.883688 1166 ts_tablet_manager.cc:1918] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260620 07:01:07.883882 1166 log.cc:1196] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/2906fe0a195149d2844232cc8d83f6dd
I20260620 07:01:07.884286 1166 ts_tablet_manager.cc:1939] T 2906fe0a195149d2844232cc8d83f6dd P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:07.885017 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 0147ed61f6904914b04433b8db049b7a (DEFAULT_TABLE table=default.Table_c8b01cca92cd4368b795c93728945929 [id=98050f19dcab4925843c69174cc94af7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.885457 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0147ed61f6904914b04433b8db049b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.885593 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 076926f7dffe4a7b80c25ea3c18e9958 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8cd4ec5619416a8983e1bc1b6b6a09) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.885915 1165 tablet_replica.cc:330] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:07.886160 1165 raft_consensus.cc:2229] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.886188 857 tablet_service.cc:1467] Processing CreateTablet for tablet 2614cc40931e4c308a5a7208f2e8c400 (DEFAULT_TABLE table=default.Table_e72d9c9be46441e4b73ae53afe9ed50c [id=0e804808214c4e4ba1a52fee023efa15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.886355 1165 raft_consensus.cc:2258] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.886587 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2614cc40931e4c308a5a7208f2e8c400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.887001 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.887075 859 tablet_service.cc:1467] Processing CreateTablet for tablet 2e266291f3b84aa7b7bf7e38d09a9acc (DEFAULT_TABLE table=default.Table_55ffe770776d4251afe1898a2e765988 [id=a44863e7f4b344dd83382b80746785fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.887439 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e266291f3b84aa7b7bf7e38d09a9acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.887531 872 tablet_service.cc:1467] Processing CreateTablet for tablet d28b8e8db31a49838bf47c79856bec41 (DEFAULT_TABLE table=default.Table_209bda59817e4eaeadbd831379bfe659 [id=809a8dce302c44b5b1b8247fba4833e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.887892 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d28b8e8db31a49838bf47c79856bec41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.891091 862 tablet_service.cc:1467] Processing CreateTablet for tablet 17c337e52ace48f99316960e655dd264 (DEFAULT_TABLE table=default.Table_47d0fc88515d40168f24f17a58c66098 [id=7c7f093d29e343078ca7584c27bdb162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.891111 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 3de447b04fc944688d6034db69fe2907 (DEFAULT_TABLE table=default.Table_d89e389b5c644055882085d52e4d1195 [id=f6d5ddd86fec4ec2bc1cbe4e1b910016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.891469 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c337e52ace48f99316960e655dd264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.891601 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3de447b04fc944688d6034db69fe2907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.891568 996 tablet_service.cc:1467] Processing CreateTablet for tablet bc96c62b938c4a36b17c008d3503ca31 (DEFAULT_TABLE table=default.Table_f8e5e036e6ba464fb31b06fd5c1ed9e7 [id=f6c59d8ad5054eb58ecda6750e987921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.891969 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc96c62b938c4a36b17c008d3503ca31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.893885 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 498) took 2779 ms. Trace:
I20260620 07:01:07.893986 1169 rpcz_store.cc:276] 0620 07:01:05.114077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.114134 (+ 57us) service_pool.cc:227] Handling call
0620 07:01:07.893699 (+2779565us) ts_tablet_manager.cc:1145] Deleting tablet 777a6b981b7f43a4ba8978ba6f3971e1
0620 07:01:07.893709 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.893836 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2779267}
I20260620 07:01:07.894379 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 497) took 2787 ms. Trace:
I20260620 07:01:07.894460 1169 rpcz_store.cc:276] 0620 07:01:05.106469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.121669 (+ 15200us) service_pool.cc:227] Handling call
0620 07:01:07.894216 (+2772547us) ts_tablet_manager.cc:1145] Deleting tablet 2c0bb50405d0446488272384523c2deb
0620 07:01:07.894227 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.894328 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2767854}
I20260620 07:01:07.894829 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 499) took 2776 ms. Trace:
I20260620 07:01:07.894920 1169 rpcz_store.cc:276] 0620 07:01:05.118645 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.121613 (+ 2968us) service_pool.cc:227] Handling call
0620 07:01:07.894665 (+2773052us) ts_tablet_manager.cc:1145] Deleting tablet fbf912f51bfd4df0afe7aa28815a897e
0620 07:01:07.894674 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.894760 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2664159}
I20260620 07:01:07.895112 861 tablet_service.cc:1467] Processing CreateTablet for tablet 2de8ddbab4c6462999b074d9b375b3f6 (DEFAULT_TABLE table=default.Table_19c484fd2214414ca2f3f07207342be4 [id=24bd02bfb1b5486a8cc6b4272c74d2e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.895156 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 2e266291f3b84aa7b7bf7e38d09a9acc (DEFAULT_TABLE table=default.Table_55ffe770776d4251afe1898a2e765988 [id=a44863e7f4b344dd83382b80746785fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.895246 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 500) took 2683 ms. Trace:
I20260620 07:01:07.895334 1169 rpcz_store.cc:276] 0620 07:01:05.211445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.213932 (+ 2487us) service_pool.cc:227] Handling call
0620 07:01:07.895119 (+2681187us) ts_tablet_manager.cc:1145] Deleting tablet ee90d961729b4088b0a312ec770d3cd0
0620 07:01:07.895130 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.895200 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2587143}
I20260620 07:01:07.895440 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2de8ddbab4c6462999b074d9b375b3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.895509 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e266291f3b84aa7b7bf7e38d09a9acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.895648 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 506) took 2519 ms. Trace:
I20260620 07:01:07.895736 1169 rpcz_store.cc:276] 0620 07:01:05.376172 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.376284 (+ 112us) service_pool.cc:227] Handling call
0620 07:01:07.895522 (+2519238us) ts_tablet_manager.cc:1145] Deleting tablet 0a4bebaa8ed1431d8c775f4856a3d808
0620 07:01:07.895530 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.895598 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2504981}
I20260620 07:01:07.896070 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 507) took 2512 ms. Trace:
I20260620 07:01:07.896144 1169 rpcz_store.cc:276] 0620 07:01:05.383681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.384017 (+ 336us) service_pool.cc:227] Handling call
0620 07:01:07.895935 (+2511918us) ts_tablet_manager.cc:1145] Deleting tablet 88c01c4e10f345fc84e3e253e8501aff
0620 07:01:07.895944 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.896022 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2500907}
I20260620 07:01:07.896482 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 508) took 2452 ms. Trace:
I20260620 07:01:07.896559 1169 rpcz_store.cc:276] 0620 07:01:05.443740 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.444711 (+ 971us) service_pool.cc:227] Handling call
0620 07:01:07.896368 (+2451657us) ts_tablet_manager.cc:1145] Deleting tablet e37f336c01974ba79caeb25f4781667a
0620 07:01:07.896376 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.896441 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2451403}
I20260620 07:01:07.896874 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 510) took 2440 ms. Trace:
I20260620 07:01:07.896950 1169 rpcz_store.cc:276] 0620 07:01:05.456736 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.456797 (+ 61us) service_pool.cc:227] Handling call
0620 07:01:07.896749 (+2439952us) ts_tablet_manager.cc:1145] Deleting tablet b4ee5c79e2a6419ea3847cbebdeced79
0620 07:01:07.896766 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.896830 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2436387}
I20260620 07:01:07.897182 1169 tablet_replica.cc:330] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:07.897384 1169 raft_consensus.cc:2229] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:07.897565 1169 raft_consensus.cc:2258] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:07.898082 1169 ts_tablet_manager.cc:1905] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.899098 868 tablet_service.cc:1467] Processing CreateTablet for tablet 2d1bad6b34f14270a060ce7245ff0c0f (DEFAULT_TABLE table=default.Table_fecf267dd00c407eaf57602a2584181b [id=970a178ca3a949c1804c11f092eea79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.899060 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 17c337e52ace48f99316960e655dd264 (DEFAULT_TABLE table=default.Table_47d0fc88515d40168f24f17a58c66098 [id=7c7f093d29e343078ca7584c27bdb162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.899441 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d1bad6b34f14270a060ce7245ff0c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.899456 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c337e52ace48f99316960e655dd264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.903105 865 tablet_service.cc:1467] Processing CreateTablet for tablet 2859db39c7dd486f9ad7e3b5f84927fa (DEFAULT_TABLE table=default.Table_1cf8ede352db4fbabbad8bf73d525087 [id=d6dc03f1e8ea457baf422b207c7410d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.903616 871 tablet_service.cc:1467] Processing CreateTablet for tablet bc96c62b938c4a36b17c008d3503ca31 (DEFAULT_TABLE table=default.Table_f8e5e036e6ba464fb31b06fd5c1ed9e7 [id=f6c59d8ad5054eb58ecda6750e987921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.903693 1170 tablet_bootstrap.cc:492] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:07.903664 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 2859db39c7dd486f9ad7e3b5f84927fa (DEFAULT_TABLE table=default.Table_1cf8ede352db4fbabbad8bf73d525087 [id=d6dc03f1e8ea457baf422b207c7410d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.903864 1170 ts_tablet_manager.cc:1397] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.153s user 0.006s sys 0.003s
I20260620 07:01:07.903975 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2859db39c7dd486f9ad7e3b5f84927fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.904002 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc96c62b938c4a36b17c008d3503ca31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.904649 1170 raft_consensus.cc:348] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.904882 1170 raft_consensus.cc:374] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.904947 1170 raft_consensus.cc:729] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.905167 1170 consensus_queue.cc:260] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.905740 1170 ts_tablet_manager.cc:1428] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:07.906088 1170 tablet_bootstrap.cc:492] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:07.907405 876 tablet_service.cc:1467] Processing CreateTablet for tablet 0147ed61f6904914b04433b8db049b7a (DEFAULT_TABLE table=default.Table_c8b01cca92cd4368b795c93728945929 [id=98050f19dcab4925843c69174cc94af7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.907694 875 tablet_service.cc:1467] Processing CreateTablet for tablet 2d262a232e884ed9be976b6b7a8e7a9c (DEFAULT_TABLE table=default.Table_7b70534507514814b1c557a5432f221b [id=adf8c87881024b16a9e3eca719426f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.907824 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0147ed61f6904914b04433b8db049b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.908066 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d262a232e884ed9be976b6b7a8e7a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.908290 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2859db39c7dd486f9ad7e3b5f84927fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.908609 874 tablet_service.cc:1467] Processing CreateTablet for tablet 3de447b04fc944688d6034db69fe2907 (DEFAULT_TABLE table=default.Table_d89e389b5c644055882085d52e4d1195 [id=f6d5ddd86fec4ec2bc1cbe4e1b910016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.909041 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3de447b04fc944688d6034db69fe2907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.885915 867 tablet_service.cc:1467] Processing CreateTablet for tablet 54871462333d4249bbd9da7e21035980 (DEFAULT_TABLE table=default.Table_9b219ed56eea4d9db45cb8c22f772b5b [id=df85c008467846469db557268713876d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.911186 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54871462333d4249bbd9da7e21035980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.911500 998 tablet_service.cc:1467] Processing CreateTablet for tablet 2de8ddbab4c6462999b074d9b375b3f6 (DEFAULT_TABLE table=default.Table_19c484fd2214414ca2f3f07207342be4 [id=24bd02bfb1b5486a8cc6b4272c74d2e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.911943 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2de8ddbab4c6462999b074d9b375b3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.912230 1170 tablet_bootstrap.cc:654] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.914633 995 tablet_service.cc:1467] Processing CreateTablet for tablet 2d1bad6b34f14270a060ce7245ff0c0f (DEFAULT_TABLE table=default.Table_fecf267dd00c407eaf57602a2584181b [id=970a178ca3a949c1804c11f092eea79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.914703 1165 ts_tablet_manager.cc:1905] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:07.915026 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d1bad6b34f14270a060ce7245ff0c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.902294 999 tablet_service.cc:1467] Processing CreateTablet for tablet 2d262a232e884ed9be976b6b7a8e7a9c (DEFAULT_TABLE table=default.Table_7b70534507514814b1c557a5432f221b [id=adf8c87881024b16a9e3eca719426f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.916719 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d262a232e884ed9be976b6b7a8e7a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.925300 1170 tablet_bootstrap.cc:492] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:07.925761 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0936aaf00bfd443a9fb64da285fd6a89" } modify_external_catalogs: true
I20260620 07:01:07.925999 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0936aaf00bfd443a9fb64da285fd6a89" } modify_external_catalogs: true
I20260620 07:01:07.927635 1167 tablet_bootstrap.cc:492] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:07.927663 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 033c8b817757441ea7ebc2dbf77aa2dd
I20260620 07:01:07.927772 1167 ts_tablet_manager.cc:1397] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.239s user 0.003s sys 0.004s
I20260620 07:01:07.928295 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 203ba3933d3a4fb2a4978b29cad614e6 with delete_type TABLET_DATA_DELETED (replaced by tablet f690e150839a4d23860932712f61e7c8) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.928550 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 63dfade71c254d7e908e00acada93638 with delete_type TABLET_DATA_DELETED (replaced by tablet dac4a1434751433488eb2913b1ddfd23) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.928647 1167 raft_consensus.cc:348] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.928862 1167 raft_consensus.cc:374] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.928936 1167 raft_consensus.cc:729] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.929210 1167 consensus_queue.cc:260] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.932811 1167 ts_tablet_manager.cc:1428] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260620 07:01:07.934053 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 033c8b817757441ea7ebc2dbf77aa2dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.935617 1167 tablet_bootstrap.cc:492] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:07.939558 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 033c8b817757441ea7ebc2dbf77aa2dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.939967 1170 ts_tablet_manager.cc:1397] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.005s
I20260620 07:01:07.942623 1167 tablet_bootstrap.cc:654] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.942989 1170 raft_consensus.cc:348] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.943323 1170 raft_consensus.cc:374] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.943459 1170 raft_consensus.cc:729] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.944054 1170 consensus_queue.cc:260] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.948904 1170 ts_tablet_manager.cc:1428] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260620 07:01:07.955502 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a0a5967c84434000a51fe7d819fac439
W20260620 07:01:07.962651 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54871462333d4249bbd9da7e21035980 consensus state has no leader
I20260620 07:01:07.964382 1170 tablet_bootstrap.cc:492] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:07.966972 1170 tablet_bootstrap.cc:654] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.967367 1165 ts_tablet_manager.cc:1918] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.967597 1165 log.cc:1196] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/076926f7dffe4a7b80c25ea3c18e9958
I20260620 07:01:07.967686 1167 tablet_bootstrap.cc:492] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:07.967900 1167 ts_tablet_manager.cc:1397] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.001s
I20260620 07:01:07.968071 1165 ts_tablet_manager.cc:1939] T 076926f7dffe4a7b80c25ea3c18e9958 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:07.968775 1167 raft_consensus.cc:348] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.969075 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 076926f7dffe4a7b80c25ea3c18e9958 (table default.Table_2411c7dd68274c07a75cd0b3ae3e2d32 [id=804a023058a643b189246bf7c6a98af6]) successfully deleted
I20260620 07:01:07.969133 1167 raft_consensus.cc:374] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:07.969233 1167 raft_consensus.cc:729] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:07.969534 1167 consensus_queue.cc:260] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:07.973744 1167 ts_tablet_manager.cc:1428] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260620 07:01:07.968971 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet a0a5967c84434000a51fe7d819fac439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.974279 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6801c84abfa54f6983fae4b66aca8fd0
I20260620 07:01:07.974797 1167 tablet_bootstrap.cc:492] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:07.975098 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 6801c84abfa54f6983fae4b66aca8fd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:07.975986 859 tablet_service.cc:1514] Processing DeleteTablet for tablet a0a5967c84434000a51fe7d819fac439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.976292 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 6801c84abfa54f6983fae4b66aca8fd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.976468 1001 tablet_service.cc:1467] Processing CreateTablet for tablet d28b8e8db31a49838bf47c79856bec41 (DEFAULT_TABLE table=default.Table_209bda59817e4eaeadbd831379bfe659 [id=809a8dce302c44b5b1b8247fba4833e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.977816 872 tablet_service.cc:1467] Processing CreateTablet for tablet 069b271c96ab49d8802ba3ae31c324d0 (DEFAULT_TABLE table=default.Table_fa0592a238ee4a3cb3150301dbb13135 [id=50d1de39ddbf4790970f240e1b8e8da5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.978485 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069b271c96ab49d8802ba3ae31c324d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.978442 1169 ts_tablet_manager.cc:1918] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:07.978577 1169 log.cc:1196] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/e14db4e3394046e49ecc69c9ca4dc840
I20260620 07:01:07.979709 1167 tablet_bootstrap.cc:654] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.980831 998 tablet_service.cc:1467] Processing CreateTablet for tablet 5f733e2ee8da488d81ab0478e9a0bd79 (DEFAULT_TABLE table=default.Table_5712ee2764bf41dcbd0cc6bd497d6e42 [id=f3a2b33556424f1da457b155961eac3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.981201 868 tablet_service.cc:1467] Processing CreateTablet for tablet 5f04603a2fe84988ac9c9975e94ce9ae (DEFAULT_TABLE table=default.Table_9b931e3e87534341b6bb5d0edd6e7dca [id=dff36693882c439eae5d7a2fe79719ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.981642 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f04603a2fe84988ac9c9975e94ce9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.987000 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 5f04603a2fe84988ac9c9975e94ce9ae (DEFAULT_TABLE table=default.Table_9b931e3e87534341b6bb5d0edd6e7dca [id=dff36693882c439eae5d7a2fe79719ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.987112 867 tablet_service.cc:1467] Processing CreateTablet for tablet a54ea2c027bb4d4b82fcdb8aa6eb1475 (DEFAULT_TABLE table=default.Table_15538b00a4f041cfb5143bd9afba2a95 [id=1fd990051b8b4d7abcef0e69f95e4f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.987560 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a54ea2c027bb4d4b82fcdb8aa6eb1475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.991082 876 tablet_service.cc:1467] Processing CreateTablet for tablet 5f733e2ee8da488d81ab0478e9a0bd79 (DEFAULT_TABLE table=default.Table_5712ee2764bf41dcbd0cc6bd497d6e42 [id=f3a2b33556424f1da457b155961eac3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.991495 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f733e2ee8da488d81ab0478e9a0bd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.992208 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d28b8e8db31a49838bf47c79856bec41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.994587 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1252d1dd03bd4a27983eb89d489b09d3
I20260620 07:01:07.995318 1846 raft_consensus.cc:482] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:07.995473 1846 raft_consensus.cc:504] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:07.995621 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad because the tablet was not found. No further retry: Not found: Tablet not found: 3c2f865b06ca4b9c8fc9d8d0b4aa0dad
I20260620 07:01:07.987775 732 tablet_service.cc:1467] Processing CreateTablet for tablet 54871462333d4249bbd9da7e21035980 (DEFAULT_TABLE table=default.Table_9b219ed56eea4d9db45cb8c22f772b5b [id=df85c008467846469db557268713876d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:07.995899 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 033c8b817757441ea7ebc2dbf77aa2dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033c8b817757441ea7ebc2dbf77aa2dd already in progress: creating tablet
W20260620 07:01:07.996116 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a0a5967c84434000a51fe7d819fac439 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a5967c84434000a51fe7d819fac439 already in progress: creating tablet
I20260620 07:01:07.996189 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54871462333d4249bbd9da7e21035980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.996228 1846 leader_election.cc:288] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:07.996346 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 1252d1dd03bd4a27983eb89d489b09d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:07.997361 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d17c49eecec741cdbd592c94b7f84c67" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:07.997996 830 leader_election.cc:341] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:07.998541 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6801c84abfa54f6983fae4b66aca8fd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6801c84abfa54f6983fae4b66aca8fd0 already in progress: creating tablet
I20260620 07:01:07.988379 721 tablet_service.cc:1467] Processing CreateTablet for tablet 2614cc40931e4c308a5a7208f2e8c400 (DEFAULT_TABLE table=default.Table_e72d9c9be46441e4b73ae53afe9ed50c [id=0e804808214c4e4ba1a52fee023efa15]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:07.998814 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1252d1dd03bd4a27983eb89d489b09d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1252d1dd03bd4a27983eb89d489b09d3 already in progress: creating tablet
I20260620 07:01:07.999099 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2614cc40931e4c308a5a7208f2e8c400. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:07.999254 831 leader_election.cc:341] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: d17c49eecec741cdbd592c94b7f84c67
I20260620 07:01:07.999375 831 leader_election.cc:302] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:08.000649 1846 raft_consensus.cc:2726] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:08.001102 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 1252d1dd03bd4a27983eb89d489b09d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.001593 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f04603a2fe84988ac9c9975e94ce9ae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:08.002063 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96453f82ff3048beabeb188fb27dee42 consensus state has no leader
I20260620 07:01:07.988726 722 tablet_service.cc:1467] Processing CreateTablet for tablet 0147ed61f6904914b04433b8db049b7a (DEFAULT_TABLE table=default.Table_c8b01cca92cd4368b795c93728945929 [id=98050f19dcab4925843c69174cc94af7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.003113 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0147ed61f6904914b04433b8db049b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.005807 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f733e2ee8da488d81ab0478e9a0bd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.989089 730 tablet_service.cc:1467] Processing CreateTablet for tablet 3de447b04fc944688d6034db69fe2907 (DEFAULT_TABLE table=default.Table_d89e389b5c644055882085d52e4d1195 [id=f6d5ddd86fec4ec2bc1cbe4e1b910016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.989245 727 tablet_service.cc:1514] Processing DeleteTablet for tablet a0a5967c84434000a51fe7d819fac439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:07.989429 725 tablet_service.cc:1467] Processing CreateTablet for tablet 2e266291f3b84aa7b7bf7e38d09a9acc (DEFAULT_TABLE table=default.Table_55ffe770776d4251afe1898a2e765988 [id=a44863e7f4b344dd83382b80746785fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.007244 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3de447b04fc944688d6034db69fe2907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.007488 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e266291f3b84aa7b7bf7e38d09a9acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:07.989764 733 tablet_service.cc:1467] Processing CreateTablet for tablet 17c337e52ace48f99316960e655dd264 (DEFAULT_TABLE table=default.Table_47d0fc88515d40168f24f17a58c66098 [id=7c7f093d29e343078ca7584c27bdb162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.010927 1168 tablet_bootstrap.cc:492] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.011089 1168 ts_tablet_manager.cc:1397] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.177s user 0.009s sys 0.005s
I20260620 07:01:08.011292 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c337e52ace48f99316960e655dd264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.012006 1168 raft_consensus.cc:348] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.012346 1168 raft_consensus.cc:374] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.012423 1168 raft_consensus.cc:729] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.012910 1168 consensus_queue.cc:260] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.013562 1168 ts_tablet_manager.cc:1428] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:08.014657 1168 tablet_bootstrap.cc:492] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:07.990006 718 tablet_service.cc:1467] Processing CreateTablet for tablet 069b271c96ab49d8802ba3ae31c324d0 (DEFAULT_TABLE table=default.Table_fa0592a238ee4a3cb3150301dbb13135 [id=50d1de39ddbf4790970f240e1b8e8da5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.990386 734 tablet_service.cc:1467] Processing CreateTablet for tablet 2d262a232e884ed9be976b6b7a8e7a9c (DEFAULT_TABLE table=default.Table_7b70534507514814b1c557a5432f221b [id=adf8c87881024b16a9e3eca719426f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.990626 715 tablet_service.cc:1467] Processing CreateTablet for tablet 5f04603a2fe84988ac9c9975e94ce9ae (DEFAULT_TABLE table=default.Table_9b931e3e87534341b6bb5d0edd6e7dca [id=dff36693882c439eae5d7a2fe79719ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.990741 720 tablet_service.cc:1467] Processing CreateTablet for tablet 2de8ddbab4c6462999b074d9b375b3f6 (DEFAULT_TABLE table=default.Table_19c484fd2214414ca2f3f07207342be4 [id=24bd02bfb1b5486a8cc6b4272c74d2e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.991071 731 tablet_service.cc:1467] Processing CreateTablet for tablet 2d1bad6b34f14270a060ce7245ff0c0f (DEFAULT_TABLE table=default.Table_fecf267dd00c407eaf57602a2584181b [id=970a178ca3a949c1804c11f092eea79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.991427 726 tablet_service.cc:1467] Processing CreateTablet for tablet 2859db39c7dd486f9ad7e3b5f84927fa (DEFAULT_TABLE table=default.Table_1cf8ede352db4fbabbad8bf73d525087 [id=d6dc03f1e8ea457baf422b207c7410d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.991595 724 tablet_service.cc:1467] Processing CreateTablet for tablet a54ea2c027bb4d4b82fcdb8aa6eb1475 (DEFAULT_TABLE table=default.Table_15538b00a4f041cfb5143bd9afba2a95 [id=1fd990051b8b4d7abcef0e69f95e4f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.991765 723 tablet_service.cc:1467] Processing CreateTablet for tablet bc96c62b938c4a36b17c008d3503ca31 (DEFAULT_TABLE table=default.Table_f8e5e036e6ba464fb31b06fd5c1ed9e7 [id=f6c59d8ad5054eb58ecda6750e987921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.992131 729 tablet_service.cc:1467] Processing CreateTablet for tablet d28b8e8db31a49838bf47c79856bec41 (DEFAULT_TABLE table=default.Table_209bda59817e4eaeadbd831379bfe659 [id=809a8dce302c44b5b1b8247fba4833e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.992169 728 tablet_service.cc:1467] Processing CreateTablet for tablet 5f733e2ee8da488d81ab0478e9a0bd79 (DEFAULT_TABLE table=default.Table_5712ee2764bf41dcbd0cc6bd497d6e42 [id=f3a2b33556424f1da457b155961eac3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:07.992334 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 033c8b817757441ea7ebc2dbf77aa2dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.016374 1168 tablet_bootstrap.cc:654] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.992487 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 6801c84abfa54f6983fae4b66aca8fd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.020991 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d1bad6b34f14270a060ce7245ff0c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.021308 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a54ea2c027bb4d4b82fcdb8aa6eb1475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.021960 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f733e2ee8da488d81ab0478e9a0bd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.022446 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d28b8e8db31a49838bf47c79856bec41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.023070 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d262a232e884ed9be976b6b7a8e7a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.023554 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc96c62b938c4a36b17c008d3503ca31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.024103 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2859db39c7dd486f9ad7e3b5f84927fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.024569 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2de8ddbab4c6462999b074d9b375b3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.025071 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f04603a2fe84988ac9c9975e94ce9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.026979 1169 ts_tablet_manager.cc:1939] T e14db4e3394046e49ecc69c9ca4dc840 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:08.028637 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 517) took 2498 ms. Trace:
I20260620 07:01:08.028776 1169 rpcz_store.cc:276] 0620 07:01:05.536489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.536604 (+ 115us) service_pool.cc:227] Handling call
0620 07:01:07.897120 (+2360516us) ts_tablet_manager.cc:1145] Deleting tablet e14db4e3394046e49ecc69c9ca4dc840
0620 07:01:07.897129 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.946401 (+ 49272us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.978298 (+ 31897us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.028586 (+ 50288us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2308319}
I20260620 07:01:08.029243 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 522) took 2396 ms. Trace:
I20260620 07:01:08.029371 1169 rpcz_store.cc:276] 0620 07:01:05.632947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.633083 (+ 136us) service_pool.cc:227] Handling call
0620 07:01:08.029074 (+2395991us) ts_tablet_manager.cc:1145] Deleting tablet 8b8659e903084f15ac3d9ea8c4c0dc0f
0620 07:01:08.029084 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.029206 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2387237}
I20260620 07:01:08.029718 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 524) took 2390 ms. Trace:
I20260620 07:01:08.029829 1169 rpcz_store.cc:276] 0620 07:01:05.639158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.639244 (+ 86us) service_pool.cc:227] Handling call
0620 07:01:08.029592 (+2390348us) ts_tablet_manager.cc:1145] Deleting tablet af743ffd2eb2427caa3779c7fceb8f30
0620 07:01:08.029600 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.029677 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2369227}
I20260620 07:01:08.030103 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 525) took 2385 ms. Trace:
I20260620 07:01:08.030205 1169 rpcz_store.cc:276] 0620 07:01:05.644555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.644656 (+ 101us) service_pool.cc:227] Handling call
0620 07:01:08.030001 (+2385345us) ts_tablet_manager.cc:1145] Deleting tablet 4308d1a5bec34588844920fa89a5db26
0620 07:01:08.030009 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.030067 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2364706}
I20260620 07:01:08.030546 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 532) took 2356 ms. Trace:
I20260620 07:01:08.031016 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069b271c96ab49d8802ba3ae31c324d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.037315 1167 tablet_bootstrap.cc:492] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.037599 1167 ts_tablet_manager.cc:1397] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.002s
I20260620 07:01:08.037537 1806 raft_consensus.cc:482] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.037813 1806 raft_consensus.cc:504] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.038568 1806 leader_election.cc:288] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:08.038651 1167 raft_consensus.cc:348] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.030669 1169 rpcz_store.cc:276] 0620 07:01:05.674143 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.677568 (+ 3425us) service_pool.cc:227] Handling call
0620 07:01:08.030399 (+2352831us) ts_tablet_manager.cc:1145] Deleting tablet 74eaa712962245b4bb14d17e4cdd8485
0620 07:01:08.030407 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.030511 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2346892}
W20260620 07:01:08.039783 969 leader_election.cc:341] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f9df1d52393e47ce991b5295d03624e8
W20260620 07:01:08.043403 968 leader_election.cc:341] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: f9df1d52393e47ce991b5295d03624e8
I20260620 07:01:08.043505 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 538) took 2368 ms. Trace:
I20260620 07:01:08.043612 1167 raft_consensus.cc:374] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.043701 968 leader_election.cc:302] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:08.043709 1169 rpcz_store.cc:276] 0620 07:01:05.674892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.821734 (+146842us) service_pool.cc:227] Handling call
0620 07:01:08.043318 (+2221584us) ts_tablet_manager.cc:1145] Deleting tablet 91f8c4955c164e6b9061ac607bbe081c
0620 07:01:08.043332 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.043458 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2165245}
I20260620 07:01:08.043900 1167 raft_consensus.cc:729] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.044174 1806 raft_consensus.cc:2726] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:08.044179 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 545) took 2172 ms. Trace:
I20260620 07:01:08.044297 1169 rpcz_store.cc:276] 0620 07:01:05.871891 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.878089 (+ 6198us) service_pool.cc:227] Handling call
0620 07:01:08.044017 (+2165928us) ts_tablet_manager.cc:1145] Deleting tablet 26719543504847389de3c3102efcc9b2
0620 07:01:08.044031 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.044142 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2131313}
I20260620 07:01:08.044406 1167 consensus_queue.cc:260] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.044797 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 547) took 2158 ms. Trace:
I20260620 07:01:08.044952 1169 rpcz_store.cc:276] 0620 07:01:05.886394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.912807 (+ 26413us) service_pool.cc:227] Handling call
0620 07:01:08.044624 (+2131817us) ts_tablet_manager.cc:1145] Deleting tablet 94e5ddcaf596455289fab50876c27dce
0620 07:01:08.044634 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.044727 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2115800}
I20260620 07:01:08.045336 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 548) took 2158 ms. Trace:
I20260620 07:01:08.045506 1167 ts_tablet_manager.cc:1428] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260620 07:01:08.045466 1169 rpcz_store.cc:276] 0620 07:01:05.886821 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.914861 (+ 28040us) service_pool.cc:227] Handling call
0620 07:01:08.045204 (+2130343us) ts_tablet_manager.cc:1145] Deleting tablet d4988c5cbb3a4818bc024da7472b96ff
0620 07:01:08.045213 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.045296 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2111094}
I20260620 07:01:08.045830 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 549) took 2158 ms. Trace:
I20260620 07:01:08.045986 1167 tablet_bootstrap.cc:492] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.045964 1169 rpcz_store.cc:276] 0620 07:01:05.887052 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.925583 (+ 38531us) service_pool.cc:227] Handling call
0620 07:01:08.045693 (+2120110us) ts_tablet_manager.cc:1145] Deleting tablet f591ba26b91b47f9a8933878d478655d
0620 07:01:08.045703 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.045790 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2109935}
I20260620 07:01:08.046329 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 546) took 2160 ms. Trace:
I20260620 07:01:08.046445 1169 rpcz_store.cc:276] 0620 07:01:05.885818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.887904 (+ 2086us) service_pool.cc:227] Handling call
0620 07:01:08.046192 (+2158288us) ts_tablet_manager.cc:1145] Deleting tablet 5d69ca4ae7434ca5b647e9135b5108ee
0620 07:01:08.046201 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.046294 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2109854}
I20260620 07:01:08.048092 1167 tablet_bootstrap.cc:654] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.058933 1168 tablet_bootstrap.cc:492] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.059130 1168 ts_tablet_manager.cc:1397] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260620 07:01:08.060196 1168 raft_consensus.cc:348] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.060742 1168 raft_consensus.cc:374] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.060863 1168 raft_consensus.cc:729] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:08.060928 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e07325dc3f649aca9c5fc21c47d360f has no consensus state
I20260620 07:01:08.061153 1168 consensus_queue.cc:260] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.061955 1168 ts_tablet_manager.cc:1428] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:08.063541 1167 tablet_bootstrap.cc:492] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.063755 1167 ts_tablet_manager.cc:1397] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260620 07:01:08.064611 1167 raft_consensus.cc:348] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.064920 1167 raft_consensus.cc:374] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.065034 1167 raft_consensus.cc:729] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.065347 1167 consensus_queue.cc:260] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.065598 1168 tablet_bootstrap.cc:492] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.066009 1167 ts_tablet_manager.cc:1428] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:08.066884 1167 tablet_bootstrap.cc:492] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.067407 1168 tablet_bootstrap.cc:654] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.068966 1167 tablet_bootstrap.cc:654] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.046765 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 550) took 2099 ms. Trace:
I20260620 07:01:08.074985 1169 rpcz_store.cc:276] 0620 07:01:05.946872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.946944 (+ 72us) service_pool.cc:227] Handling call
0620 07:01:08.046644 (+2099700us) ts_tablet_manager.cc:1145] Deleting tablet 5208f3136bcd45579de49b8b10745122
0620 07:01:08.046653 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.046721 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2098801}
I20260620 07:01:08.075865 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 551) took 1930 ms. Trace:
I20260620 07:01:08.076030 1169 rpcz_store.cc:276] 0620 07:01:06.145244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.147001 (+ 1757us) service_pool.cc:227] Handling call
0620 07:01:08.075612 (+1928611us) ts_tablet_manager.cc:1145] Deleting tablet b8e2d451eb1f48ff81828d7070a20027
0620 07:01:08.075630 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.075808 (+ 178us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1871600}
I20260620 07:01:08.078588 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 554) took 1556 ms. Trace:
I20260620 07:01:08.078754 1169 rpcz_store.cc:276] 0620 07:01:06.521947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.523092 (+ 1145us) service_pool.cc:227] Handling call
0620 07:01:08.078390 (+1555298us) ts_tablet_manager.cc:1145] Deleting tablet c9ad0680f1da4504b87d9d0d6bcbabcb
0620 07:01:08.078404 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.078529 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1554958}
I20260620 07:01:08.081532 1846 raft_consensus.cc:482] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.081689 1846 raft_consensus.cc:504] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.082363 1846 leader_election.cc:288] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.083200 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b961698fe54e7f9c16f41b90058093" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:08.083452 752 raft_consensus.cc:2454] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:08.083904 831 leader_election.cc:302] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:08.084389 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b961698fe54e7f9c16f41b90058093" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:08.084775 1846 raft_consensus.cc:2781] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:08.084897 1846 raft_consensus.cc:482] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:08.085001 1846 raft_consensus.cc:3037] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:08.085232 830 leader_election.cc:341] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:08.088178 1000 tablet_service.cc:1467] Processing CreateTablet for tablet a54ea2c027bb4d4b82fcdb8aa6eb1475 (DEFAULT_TABLE table=default.Table_15538b00a4f041cfb5143bd9afba2a95 [id=1fd990051b8b4d7abcef0e69f95e4f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.088759 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a54ea2c027bb4d4b82fcdb8aa6eb1475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.087884 1846 raft_consensus.cc:504] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.090132 1846 leader_election.cc:288] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.090482 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b961698fe54e7f9c16f41b90058093" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:08.091004 830 leader_election.cc:341] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:08.091763 1168 tablet_bootstrap.cc:492] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.091849 1167 tablet_bootstrap.cc:492] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.091939 1168 ts_tablet_manager.cc:1397] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260620 07:01:08.091992 1167 ts_tablet_manager.cc:1397] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.004s
I20260620 07:01:08.092664 1168 raft_consensus.cc:348] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.092698 1167 raft_consensus.cc:348] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.092900 1167 raft_consensus.cc:374] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.092906 1168 raft_consensus.cc:374] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.092976 1168 raft_consensus.cc:729] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.092993 1167 raft_consensus.cc:729] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.093204 1167 consensus_queue.cc:260] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.093241 1168 consensus_queue.cc:260] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.093526 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 069b271c96ab49d8802ba3ae31c324d0 (DEFAULT_TABLE table=default.Table_fa0592a238ee4a3cb3150301dbb13135 [id=50d1de39ddbf4790970f240e1b8e8da5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.093696 1167 ts_tablet_manager.cc:1428] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:08.093761 1168 ts_tablet_manager.cc:1428] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:08.094063 1168 tablet_bootstrap.cc:492] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.093986 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069b271c96ab49d8802ba3ae31c324d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.094179 1167 tablet_bootstrap.cc:492] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.095810 1168 tablet_bootstrap.cc:654] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.096035 1167 tablet_bootstrap.cc:654] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.108443 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet d066c73ae0104cb3be792790b1dfb93d (table default.Table_3dc4c1ec06e74b1ba496fb7896bea7da [id=c8fa0544c10a479ba4496d1482c535f3]) successfully deleted
W20260620 07:01:08.108822 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 777a6b981b7f43a4ba8978ba6f3971e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 777a6b981b7f43a4ba8978ba6f3971e1 already in progress: creating tablet
W20260620 07:01:08.109187 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2c0bb50405d0446488272384523c2deb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c0bb50405d0446488272384523c2deb already in progress: creating tablet
I20260620 07:01:08.109130 426 catalog_manager.cc:5495] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
W20260620 07:01:08.109671 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet fbf912f51bfd4df0afe7aa28815a897e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbf912f51bfd4df0afe7aa28815a897e already in progress: creating tablet
W20260620 07:01:08.109957 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ee90d961729b4088b0a312ec770d3cd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee90d961729b4088b0a312ec770d3cd0 already in progress: creating tablet
I20260620 07:01:08.109889 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d1317e297da54e3794bdefbfeedea221"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.110350 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 0a4bebaa8ed1431d8c775f4856a3d808 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a4bebaa8ed1431d8c775f4856a3d808 already in progress: creating tablet
W20260620 07:01:08.110565 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1317e297da54e3794bdefbfeedea221 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.111042 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4041cd9b1bdd4a96ad17ef5a4130d238"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.111673 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4041cd9b1bdd4a96ad17ef5a4130d238 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.112107 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d8ddf3cd80a941f1adc86a978bb18f6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.112646 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8ddf3cd80a941f1adc86a978bb18f6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.113011 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a1fa87d2ca544da28827f34c9879e744" } new_table_name: "default.Table_7468a287d55e4180bc8bfe93a9d10304" modify_external_catalogs: true
I20260620 07:01:08.113489 1168 tablet_bootstrap.cc:492] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.113385 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4e24db178c47408ea6e773cebddc3ddf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:08.113632 1168 ts_tablet_manager.cc:1397] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
W20260620 07:01:08.113826 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e24db178c47408ea6e773cebddc3ddf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.114176 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bf84c66d36b34388bbe83868fb2953f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:08.114405 1168 raft_consensus.cc:348] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:08.114598 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf84c66d36b34388bbe83868fb2953f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.114614 1168 raft_consensus.cc:374] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.114691 1168 raft_consensus.cc:729] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.114950 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_692cd4b8d66445a1aa9ced6df517c5f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:08.114941 1168 consensus_queue.cc:260] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:08.115362 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_692cd4b8d66445a1aa9ced6df517c5f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.115538 1168 ts_tablet_manager.cc:1428] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:08.116320 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 555) took 1559 ms. Trace:
W20260620 07:01:08.116772 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet e37f336c01974ba79caeb25f4781667a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e37f336c01974ba79caeb25f4781667a already in progress: creating tablet
I20260620 07:01:08.118907 1806 raft_consensus.cc:482] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.119160 1167 tablet_bootstrap.cc:492] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.119079 1806 raft_consensus.cc:504] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.119326 1167 ts_tablet_manager.cc:1397] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.005s
I20260620 07:01:08.119748 1806 leader_election.cc:288] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:08.120230 1167 raft_consensus.cc:348] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.120500 1167 raft_consensus.cc:374] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.120373 1169 rpcz_store.cc:276] 0620 07:01:06.524064 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.524117 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:08.083673 (+1559556us) ts_tablet_manager.cc:1145] Deleting tablet 8088fadabff64c35aa96a1ede17318c3
0620 07:01:08.083683 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.083823 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1559278}
I20260620 07:01:08.120594 1167 raft_consensus.cc:729] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.120893 1167 consensus_queue.cc:260] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.120999 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 556) took 1594 ms. Trace:
I20260620 07:01:08.121119 1169 rpcz_store.cc:276] 0620 07:01:06.526106 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.526277 (+ 171us) service_pool.cc:227] Handling call
0620 07:01:08.120832 (+1594555us) ts_tablet_manager.cc:1145] Deleting tablet 366d713325f84c8b9b1c1f4296513a20
0620 07:01:08.120845 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.120959 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1594365}
I20260620 07:01:08.121474 1167 ts_tablet_manager.cc:1428] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:08.121718 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 557) took 1593 ms. Trace:
W20260620 07:01:08.121786 969 leader_election.cc:341] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: add9e860802d4edebcfbc9fa3c4a6b24
I20260620 07:01:08.121846 1169 rpcz_store.cc:276] 0620 07:01:06.528065 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.528114 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:08.121538 (+1593424us) ts_tablet_manager.cc:1145] Deleting tablet 09886cbd967549118d3b1ba116f7834f
0620 07:01:08.121549 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.121685 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1593137}
I20260620 07:01:08.122361 1167 tablet_bootstrap.cc:492] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.122849 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b961698fe54e7f9c16f41b90058093" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
W20260620 07:01:08.124539 968 leader_election.cc:341] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: add9e860802d4edebcfbc9fa3c4a6b24
I20260620 07:01:08.124702 968 leader_election.cc:302] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:08.125742 754 raft_consensus.cc:3037] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.127806 1167 tablet_bootstrap.cc:654] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.128626 754 raft_consensus.cc:2454] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:08.129258 831 leader_election.cc:302] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:08.131129 1806 raft_consensus.cc:2726] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:08.133855 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
I20260620 07:01:08.138217 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a4e8c06f3f8544ecafb63dd7d04fdf05
I20260620 07:01:08.138635 418 catalog_manager.cc:6565] ReplaceTablet: tablet a4e8c06f3f8544ecafb63dd7d04fdf05 deleted and replaced by tablet ed042bdf10a2453eab5175f21d1184c1
I20260620 07:01:08.139056 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9116a47663d0429ca822aa70b4b56736"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.139658 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9116a47663d0429ca822aa70b4b56736 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:08.146404 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 1c64df83a18a470c98a9c1fd6bb38918 (table default.Table_b4024ad63b56439d939324ae131affe6 [id=4896f23e711941b988db4ea9f22ce625], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1c64df83a18a470c98a9c1fd6bb38918 consensus state has no leader
I20260620 07:01:08.149389 1843 raft_consensus.cc:2781] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:08.149569 1168 tablet_bootstrap.cc:492] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.149590 1843 raft_consensus.cc:686] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:08.149880 1843 consensus_queue.cc:237] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.150158 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet a4e8c06f3f8544ecafb63dd7d04fdf05 with delete_type TABLET_DATA_DELETED (replaced by tablet ed042bdf10a2453eab5175f21d1184c1) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.151580 1167 tablet_bootstrap.cc:492] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.151732 1167 ts_tablet_manager.cc:1397] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.002s
I20260620 07:01:08.152001 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 113dd3d57c144088ae7204dc5229f883
I20260620 07:01:08.152477 1167 raft_consensus.cc:348] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.152700 1167 raft_consensus.cc:374] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.152779 1167 raft_consensus.cc:729] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.152977 1167 consensus_queue.cc:260] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.153216 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a7969001e9164dd9a0a8dcd51f7ae54f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:08.153659 1167 ts_tablet_manager.cc:1428] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260620 07:01:08.153795 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7969001e9164dd9a0a8dcd51f7ae54f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.153957 1167 tablet_bootstrap.cc:492] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.158968 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 558) took 1629 ms. Trace:
I20260620 07:01:08.159209 1169 rpcz_store.cc:276] 0620 07:01:06.529439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.529483 (+ 44us) service_pool.cc:227] Handling call
0620 07:01:08.123690 (+1594207us) ts_tablet_manager.cc:1145] Deleting tablet 0efec7113a5b44f296e756dde466b82f
0620 07:01:08.123702 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.158918 (+ 35216us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1593876}
I20260620 07:01:08.159932 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 559) took 1629 ms. Trace:
I20260620 07:01:08.160105 1169 rpcz_store.cc:276] 0620 07:01:06.530554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.530605 (+ 51us) service_pool.cc:227] Handling call
0620 07:01:08.159777 (+1629172us) ts_tablet_manager.cc:1145] Deleting tablet 40c9d2d029434f37ba23d65f6662893b
0620 07:01:08.159790 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.159899 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1628651}
I20260620 07:01:08.160696 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 562) took 1566 ms. Trace:
I20260620 07:01:08.160863 1169 rpcz_store.cc:276] 0620 07:01:06.594616 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.594668 (+ 52us) service_pool.cc:227] Handling call
0620 07:01:08.160552 (+1565884us) ts_tablet_manager.cc:1145] Deleting tablet d3823954542a4928a99c1602c4f01ee2
0620 07:01:08.160563 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.160653 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1533542}
I20260620 07:01:08.161310 1169 tablet_replica.cc:330] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:08.161593 1169 raft_consensus.cc:2229] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.161847 1169 raft_consensus.cc:2258] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.162461 1169 ts_tablet_manager.cc:1905] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.164084 1167 tablet_bootstrap.cc:654] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:08.168042 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b4ee5c79e2a6419ea3847cbebdeced79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ee5c79e2a6419ea3847cbebdeced79 already in progress: creating tablet
W20260620 07:01:08.168339 413 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 51357.1us
I20260620 07:01:08.169209 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet e14db4e3394046e49ecc69c9ca4dc840 (table default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]) successfully deleted
W20260620 07:01:08.169579 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b8659e903084f15ac3d9ea8c4c0dc0f already in progress: creating tablet
W20260620 07:01:08.169909 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet af743ffd2eb2427caa3779c7fceb8f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af743ffd2eb2427caa3779c7fceb8f30 already in progress: creating tablet
W20260620 07:01:08.170269 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 4308d1a5bec34588844920fa89a5db26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4308d1a5bec34588844920fa89a5db26 already in progress: creating tablet
W20260620 07:01:08.170550 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 74eaa712962245b4bb14d17e4cdd8485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74eaa712962245b4bb14d17e4cdd8485 already in progress: creating tablet
W20260620 07:01:08.170857 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 91f8c4955c164e6b9061ac607bbe081c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91f8c4955c164e6b9061ac607bbe081c already in progress: creating tablet
W20260620 07:01:08.171131 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 26719543504847389de3c3102efcc9b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26719543504847389de3c3102efcc9b2 already in progress: creating tablet
W20260620 07:01:08.171415 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 94e5ddcaf596455289fab50876c27dce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94e5ddcaf596455289fab50876c27dce already in progress: creating tablet
I20260620 07:01:08.171504 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 113dd3d57c144088ae7204dc5229f883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:08.171717 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d4988c5cbb3a4818bc024da7472b96ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4988c5cbb3a4818bc024da7472b96ff already in progress: creating tablet
W20260620 07:01:08.171976 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f591ba26b91b47f9a8933878d478655d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f591ba26b91b47f9a8933878d478655d already in progress: creating tablet
I20260620 07:01:08.173794 1168 tablet_bootstrap.cc:654] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.176620 1167 tablet_bootstrap.cc:492] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.176806 1167 ts_tablet_manager.cc:1397] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260620 07:01:08.177480 1167 raft_consensus.cc:348] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.177711 1167 raft_consensus.cc:374] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.177790 1167 raft_consensus.cc:729] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.178004 1167 consensus_queue.cc:260] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.178516 1167 ts_tablet_manager.cc:1428] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:08.182924 1167 tablet_bootstrap.cc:492] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.185362 1167 tablet_bootstrap.cc:654] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:07.885085 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 265) took 7265 ms. Trace:
I20260620 07:01:08.189699 1166 rpcz_store.cc:276] 0620 07:01:00.619610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.045737 (+426127us) service_pool.cc:227] Handling call
0620 07:01:07.862167 (+6816430us) ts_tablet_manager.cc:1145] Deleting tablet 2906fe0a195149d2844232cc8d83f6dd
0620 07:01:07.862177 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:07.870277 (+ 8100us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.883563 (+ 13286us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:07.885017 (+ 1454us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6815812}
I20260620 07:01:08.190402 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 262) took 7596 ms. Trace:
I20260620 07:01:08.204406 1168 tablet_bootstrap.cc:492] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.204589 1168 ts_tablet_manager.cc:1397] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.055s user 0.012s sys 0.001s
I20260620 07:01:08.205313 1168 raft_consensus.cc:348] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.205569 1168 raft_consensus.cc:374] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.205632 1168 raft_consensus.cc:729] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.205852 1168 consensus_queue.cc:260] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:08.198040 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36a5dde9352f48a19f7a379dc40cf491 consensus state has no leader
I20260620 07:01:08.190635 1166 rpcz_store.cc:276] 0620 07:01:00.594440 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.024506 (+430066us) service_pool.cc:227] Handling call
0620 07:01:08.190169 (+7165663us) ts_tablet_manager.cc:1145] Deleting tablet 333eef8b98da4a279acceaead9405149
0620 07:01:08.190180 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.190340 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7127466}
I20260620 07:01:08.211421 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 2906fe0a195149d2844232cc8d83f6dd (table default.Table_06b2bcb778eb4444828c3050a4ed47ec [id=f12e60a2a8a341c8b574d0dc90fa315a]) successfully deleted
W20260620 07:01:08.211980 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 333eef8b98da4a279acceaead9405149 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 333eef8b98da4a279acceaead9405149 already in progress: creating tablet
I20260620 07:01:08.212673 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 271) took 7549 ms. Trace:
I20260620 07:01:08.212849 1166 rpcz_store.cc:276] 0620 07:01:00.662841 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.088128 (+425287us) service_pool.cc:227] Handling call
0620 07:01:08.212410 (+7124282us) ts_tablet_manager.cc:1145] Deleting tablet 261f0d97e1084e828b9562cb30ea422b
0620 07:01:08.212425 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.212601 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7124058}
W20260620 07:01:08.213373 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 261f0d97e1084e828b9562cb30ea422b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 261f0d97e1084e828b9562cb30ea422b already in progress: creating tablet
I20260620 07:01:08.214061 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 272) took 7546 ms. Trace:
I20260620 07:01:08.215103 1166 rpcz_store.cc:276] 0620 07:01:00.667813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.088364 (+420551us) service_pool.cc:227] Handling call
0620 07:01:08.213872 (+7125508us) ts_tablet_manager.cc:1145] Deleting tablet e5b6c578055d4f95b44c85eba8e92ac8
0620 07:01:08.213883 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.214007 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7125346}
I20260620 07:01:08.216234 1884 raft_consensus.cc:482] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.216467 1884 raft_consensus.cc:504] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:08.216828 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet e5b6c578055d4f95b44c85eba8e92ac8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5b6c578055d4f95b44c85eba8e92ac8 already in progress: creating tablet
I20260620 07:01:08.217135 1884 leader_election.cc:288] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.217268 1884 raft_consensus.cc:482] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.217391 1884 raft_consensus.cc:504] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.217788 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 273) took 7548 ms. Trace:
I20260620 07:01:08.217833 1884 leader_election.cc:288] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.219388 1166 rpcz_store.cc:276] 0620 07:01:00.669373 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.088544 (+419171us) service_pool.cc:227] Handling call
0620 07:01:08.217165 (+7128621us) ts_tablet_manager.cc:1145] Deleting tablet b5e08a38c42d4e3da20292343bf085b9
0620 07:01:08.217178 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.217725 (+ 547us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7128494}
I20260620 07:01:08.219561 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "581573cafab14ac79ff7ad19da0580b4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:08.219904 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b5e08a38c42d4e3da20292343bf085b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e08a38c42d4e3da20292343bf085b9 already in progress: creating tablet
I20260620 07:01:08.219412 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb26f1d10f9a4978b41afbd8894f1102" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:08.220180 1028 raft_consensus.cc:2454] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:08.220813 1168 ts_tablet_manager.cc:1428] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20260620 07:01:08.220793 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 263) took 7610 ms. Trace:
W20260620 07:01:08.221033 830 leader_election.cc:341] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:08.221115 1168 tablet_bootstrap.cc:492] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.221042 1166 rpcz_store.cc:276] 0620 07:01:00.610131 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.042422 (+432291us) service_pool.cc:227] Handling call
0620 07:01:08.220224 (+7177802us) ts_tablet_manager.cc:1145] Deleting tablet 704e8aaabe6d40138b6611bdc30abf16
0620 07:01:08.220233 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.220744 (+ 511us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7052158}
I20260620 07:01:08.221283 830 leader_election.cc:302] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
W20260620 07:01:08.221449 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 704e8aaabe6d40138b6611bdc30abf16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 704e8aaabe6d40138b6611bdc30abf16 already in progress: creating tablet
I20260620 07:01:08.222093 1846 raft_consensus.cc:2781] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:08.222251 1846 raft_consensus.cc:482] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:08.222411 1846 raft_consensus.cc:3037] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.222883 1168 tablet_bootstrap.cc:654] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.224378 1169 ts_tablet_manager.cc:1918] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.224545 1169 log.cc:1196] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ca380134173e42f6b562b56375f2ccad
I20260620 07:01:08.224910 1169 ts_tablet_manager.cc:1939] T ca380134173e42f6b562b56375f2ccad P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:08.227977 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 287) took 7194 ms. Trace:
I20260620 07:01:08.228147 1166 rpcz_store.cc:276] 0620 07:01:01.033545 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.798721 (+765176us) service_pool.cc:227] Handling call
0620 07:01:08.227792 (+6429071us) ts_tablet_manager.cc:1145] Deleting tablet 0c51ecf0f006400597f0e7f776698854
0620 07:01:08.227802 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.227900 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6428816}
W20260620 07:01:08.228598 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0c51ecf0f006400597f0e7f776698854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c51ecf0f006400597f0e7f776698854 already in progress: creating tablet
I20260620 07:01:08.228998 1167 tablet_bootstrap.cc:492] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.229147 1167 ts_tablet_manager.cc:1397] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.006s
I20260620 07:01:08.229380 1168 tablet_bootstrap.cc:492] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.229508 1168 ts_tablet_manager.cc:1397] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20260620 07:01:08.229964 1167 raft_consensus.cc:348] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.230189 1167 raft_consensus.cc:374] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.230293 1167 raft_consensus.cc:729] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.230186 1168 raft_consensus.cc:348] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.230384 1168 raft_consensus.cc:374] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.230578 1168 raft_consensus.cc:729] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.230684 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 288) took 7197 ms. Trace:
I20260620 07:01:08.230806 1166 rpcz_store.cc:276] 0620 07:01:01.033668 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.799006 (+765338us) service_pool.cc:227] Handling call
0620 07:01:08.230506 (+6431500us) ts_tablet_manager.cc:1145] Deleting tablet da1e30385ed44c7f8b7db868f2e2bc29
0620 07:01:08.230517 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.230617 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6363523}
I20260620 07:01:08.230832 1168 consensus_queue.cc:260] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:08.231333 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet da1e30385ed44c7f8b7db868f2e2bc29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da1e30385ed44c7f8b7db868f2e2bc29 already in progress: creating tablet
I20260620 07:01:08.231381 1168 ts_tablet_manager.cc:1428] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:08.231635 1168 tablet_bootstrap.cc:492] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.231752 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 289) took 7197 ms. Trace:
I20260620 07:01:08.231849 1166 rpcz_store.cc:276] 0620 07:01:01.033775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.826650 (+792875us) service_pool.cc:227] Handling call
0620 07:01:08.231576 (+6404926us) ts_tablet_manager.cc:1145] Deleting tablet 35cb81ac0ebd4865b9d53259ed5787d1
0620 07:01:08.231586 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.231689 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6360506}
W20260620 07:01:08.232257 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 35cb81ac0ebd4865b9d53259ed5787d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35cb81ac0ebd4865b9d53259ed5787d1 already in progress: creating tablet
I20260620 07:01:08.233207 1168 tablet_bootstrap.cc:654] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.241169 1750 raft_consensus.cc:482] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.241361 1750 raft_consensus.cc:504] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:08.245286 968 leader_election.cc:341] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e14db4e3394046e49ecc69c9ca4dc840
I20260620 07:01:08.246312 1750 leader_election.cc:288] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:08.251168 1166 tablet_replica.cc:330] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
W20260620 07:01:08.211426 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5d69ca4ae7434ca5b647e9135b5108ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d69ca4ae7434ca5b647e9135b5108ee already in progress: creating tablet
I20260620 07:01:08.252931 1168 tablet_bootstrap.cc:492] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.252960 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 564) took 1656 ms. Trace:
I20260620 07:01:08.253501 1169 rpcz_store.cc:276] 0620 07:01:06.596461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.596519 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:08.161252 (+1564733us) ts_tablet_manager.cc:1145] Deleting tablet ca380134173e42f6b562b56375f2ccad
0620 07:01:08.161261 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.193590 (+ 32329us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.224247 (+ 30657us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.252892 (+ 28645us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1529260}
I20260620 07:01:08.253630 1168 ts_tablet_manager.cc:1397] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.002s
W20260620 07:01:08.254072 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5208f3136bcd45579de49b8b10745122 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5208f3136bcd45579de49b8b10745122 already in progress: creating tablet
W20260620 07:01:08.253362 969 leader_election.cc:341] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e14db4e3394046e49ecc69c9ca4dc840
I20260620 07:01:08.254426 969 leader_election.cc:302] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:08.255108 1830 raft_consensus.cc:2726] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:08.255790 1166 raft_consensus.cc:2229] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:08.256389 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b8e2d451eb1f48ff81828d7070a20027 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8e2d451eb1f48ff81828d7070a20027 already in progress: creating tablet
I20260620 07:01:08.253823 1846 raft_consensus.cc:504] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.253603 1167 consensus_queue.cc:260] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.256968 1169 tablet_replica.cc:330] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:08.257179 1169 raft_consensus.cc:2229] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.257421 1169 raft_consensus.cc:2258] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.258858 1169 ts_tablet_manager.cc:1905] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.257181 1168 raft_consensus.cc:348] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.259580 1168 raft_consensus.cc:374] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.259690 1168 raft_consensus.cc:729] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.259891 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb26f1d10f9a4978b41afbd8894f1102" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:08.260097 1028 raft_consensus.cc:3037] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.260191 1168 consensus_queue.cc:260] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.260439 1167 ts_tablet_manager.cc:1428] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20260620 07:01:08.260742 1166 raft_consensus.cc:2258] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.261307 1166 ts_tablet_manager.cc:1905] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.261554 1846 leader_election.cc:288] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.261868 1168 ts_tablet_manager.cc:1428] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260620 07:01:08.263342 1168 tablet_bootstrap.cc:492] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.264688 1028 raft_consensus.cc:2454] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:08.269227 1168 tablet_bootstrap.cc:654] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.271116 830 leader_election.cc:302] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:08.274945 1846 raft_consensus.cc:2781] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:08.275230 1846 raft_consensus.cc:686] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:08.275555 1846 consensus_queue.cc:237] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.280838 1170 tablet_bootstrap.cc:492] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:08.281145 1170 ts_tablet_manager.cc:1397] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.317s user 0.013s sys 0.036s
W20260620 07:01:08.284797 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c9ad0680f1da4504b87d9d0d6bcbabcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9ad0680f1da4504b87d9d0d6bcbabcb already in progress: creating tablet
W20260620 07:01:08.286890 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8088fadabff64c35aa96a1ede17318c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8088fadabff64c35aa96a1ede17318c3 already in progress: creating tablet
I20260620 07:01:08.292016 1169 ts_tablet_manager.cc:1918] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.295068 1169 log.cc:1196] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/3c2f865b06ca4b9c8fc9d8d0b4aa0dad
I20260620 07:01:08.295876 1169 ts_tablet_manager.cc:1939] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:08.301920 1167 tablet_bootstrap.cc:492] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.307062 1167 tablet_bootstrap.cc:654] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.313915 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 568) took 1500 ms. Trace:
I20260620 07:01:08.314081 1169 rpcz_store.cc:276] 0620 07:01:06.813078 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.813151 (+ 73us) service_pool.cc:227] Handling call
0620 07:01:08.256868 (+1443717us) ts_tablet_manager.cc:1145] Deleting tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad
0620 07:01:08.256883 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.286392 (+ 29509us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.291858 (+ 5466us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.313870 (+ 22012us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16560,"tablet-delete.queue_time_us":1421824}
I20260620 07:01:08.314481 1169 tablet_replica.cc:330] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:08.314750 1169 raft_consensus.cc:2229] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.314951 1169 raft_consensus.cc:2258] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.315573 1169 ts_tablet_manager.cc:1905] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.330502 1170 raft_consensus.cc:348] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.330862 1170 raft_consensus.cc:374] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.330951 1170 raft_consensus.cc:729] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.331229 1170 consensus_queue.cc:260] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:08.332624 831 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 203352us
I20260620 07:01:08.334625 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb26f1d10f9a4978b41afbd8894f1102" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:08.334656 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb26f1d10f9a4978b41afbd8894f1102" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:08.334820 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "581573cafab14ac79ff7ad19da0580b4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:08.334899 749 raft_consensus.cc:3037] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.335050 752 raft_consensus.cc:2454] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:08.335523 876 tablet_service.cc:1514] Processing DeleteTablet for tablet a4e8c06f3f8544ecafb63dd7d04fdf05 with delete_type TABLET_DATA_DELETED (replaced by tablet ed042bdf10a2453eab5175f21d1184c1) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.335805 872 tablet_service.cc:1514] Processing DeleteTablet for tablet d17c49eecec741cdbd592c94b7f84c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.335894 831 leader_election.cc:302] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:08.336015 865 tablet_service.cc:1514] Processing DeleteTablet for tablet cb26f1d10f9a4978b41afbd8894f1102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.336171 875 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b961698fe54e7f9c16f41b90058093 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.336654 1165 tablet_replica.cc:330] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:08.336854 1165 raft_consensus.cc:2229] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.337042 1165 raft_consensus.cc:2258] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:08.337152 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a4e8c06f3f8544ecafb63dd7d04fdf05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4e8c06f3f8544ecafb63dd7d04fdf05 already in progress: creating tablet
W20260620 07:01:08.337188 413 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 45225us
W20260620 07:01:08.337430 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 366d713325f84c8b9b1c1f4296513a20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 366d713325f84c8b9b1c1f4296513a20 already in progress: creating tablet
I20260620 07:01:08.337579 1165 ts_tablet_manager.cc:1905] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:08.337618 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 09886cbd967549118d3b1ba116f7834f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09886cbd967549118d3b1ba116f7834f already in progress: creating tablet
I20260620 07:01:08.337910 749 raft_consensus.cc:2454] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:08.338311 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 113dd3d57c144088ae7204dc5229f883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:08.338486 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 0efec7113a5b44f296e756dde466b82f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0efec7113a5b44f296e756dde466b82f already in progress: creating tablet
I20260620 07:01:08.338541 868 tablet_service.cc:1514] Processing DeleteTablet for tablet ca380134173e42f6b562b56375f2ccad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:08.338670 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 40c9d2d029434f37ba23d65f6662893b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40c9d2d029434f37ba23d65f6662893b already in progress: creating tablet
W20260620 07:01:08.338869 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d3823954542a4928a99c1602c4f01ee2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3823954542a4928a99c1602c4f01ee2 already in progress: creating tablet
I20260620 07:01:08.339017 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ca380134173e42f6b562b56375f2ccad (table default.Table_6bd66e9c6f5d4e348b7345db1c1175d8 [id=82989da82c6244a7b6f52db6807af15f]) successfully deleted
I20260620 07:01:08.339188 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad (table default.Table_b043963ee56e4494be5b5a95ea01d158 [id=1aa84262b2da494d8f47bd49a6348733]) successfully deleted
I20260620 07:01:08.339849 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 1252d1dd03bd4a27983eb89d489b09d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.343751 1167 tablet_bootstrap.cc:492] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.344058 1165 ts_tablet_manager.cc:1918] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.344058 1167 ts_tablet_manager.cc:1397] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.004s
I20260620 07:01:08.344307 1165 log.cc:1196] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/d17c49eecec741cdbd592c94b7f84c67
I20260620 07:01:08.344810 1165 ts_tablet_manager.cc:1939] T d17c49eecec741cdbd592c94b7f84c67 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:08.345057 1167 raft_consensus.cc:348] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.345408 1167 raft_consensus.cc:374] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.345542 1167 raft_consensus.cc:729] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.345898 1167 consensus_queue.cc:260] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.346551 1167 ts_tablet_manager.cc:1428] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:08.347208 1167 tablet_bootstrap.cc:492] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.350057 1167 tablet_bootstrap.cc:654] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.350963 1879 raft_consensus.cc:2781] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:08.351177 1879 raft_consensus.cc:482] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:08.351365 1879 raft_consensus.cc:3037] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.353731 1846 raft_consensus.cc:482] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.353889 1846 raft_consensus.cc:504] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.354328 1879 raft_consensus.cc:504] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.354562 1846 leader_election.cc:288] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.355453 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca380134173e42f6b562b56375f2ccad" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:08.355716 1028 raft_consensus.cc:2454] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:08.356202 830 leader_election.cc:302] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:08.356765 1846 raft_consensus.cc:2781] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:08.356923 1846 raft_consensus.cc:482] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:08.357049 1846 raft_consensus.cc:3037] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.359686 1167 tablet_bootstrap.cc:492] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.359866 1167 ts_tablet_manager.cc:1397] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260620 07:01:08.360747 1169 ts_tablet_manager.cc:1918] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.360620 1846 raft_consensus.cc:504] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.360920 1169 log.cc:1196] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/7fc63351f767447c99b819fe7848d381
I20260620 07:01:08.361277 1169 ts_tablet_manager.cc:1939] T 7fc63351f767447c99b819fe7848d381 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:08.361281 1165 tablet_replica.cc:330] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:08.361673 1846 leader_election.cc:288] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.361788 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca380134173e42f6b562b56375f2ccad" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:08.362010 1028 raft_consensus.cc:3037] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.362385 1167 raft_consensus.cc:348] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.362673 1167 raft_consensus.cc:374] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.362811 1167 raft_consensus.cc:729] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.362852 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet d17c49eecec741cdbd592c94b7f84c67 (table default.Table_e21acc07ea2349cc9a821839ff680062 [id=f28fed67d2244a1694c6688535cc5213]) successfully deleted
I20260620 07:01:08.364624 1165 raft_consensus.cc:2229] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:08.364876 1165 pending_rounds.cc:62] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:08.364954 1165 pending_rounds.cc:68] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821604459864064 op_type: NO_OP noop_request { }
I20260620 07:01:08.364979 1028 raft_consensus.cc:2454] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:08.365080 1165 raft_consensus.cc:2866] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:08.366036 1167 consensus_queue.cc:260] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.365429 830 leader_election.cc:302] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:08.368896 1846 raft_consensus.cc:2781] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:08.369418 1846 raft_consensus.cc:686] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:08.369534 1167 ts_tablet_manager.cc:1428] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260620 07:01:08.369836 1167 tablet_bootstrap.cc:492] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.369927 1846 consensus_queue.cc:237] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.376307 1167 tablet_bootstrap.cc:654] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.379204 1170 ts_tablet_manager.cc:1428] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.098s user 0.002s sys 0.000s
W20260620 07:01:08.379050 831 leader_election.cc:341] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ca380134173e42f6b562b56375f2ccad
W20260620 07:01:08.379558 831 leader_election.cc:341] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ca380134173e42f6b562b56375f2ccad
I20260620 07:01:08.390874 1165 raft_consensus.cc:2258] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.393440 1170 tablet_bootstrap.cc:492] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:08.395423 1170 tablet_bootstrap.cc:654] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.395931 1165 ts_tablet_manager.cc:1905] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.400652 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 567) took 1601 ms. Trace:
I20260620 07:01:08.400859 1169 rpcz_store.cc:276] 0620 07:01:06.799646 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.799705 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:08.314396 (+1514691us) ts_tablet_manager.cc:1145] Deleting tablet 7fc63351f767447c99b819fe7848d381
0620 07:01:08.314425 (+ 29us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.318863 (+ 4438us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.360557 (+ 41694us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.400585 (+ 40028us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":34393,"tablet-delete.queue_time_us":1478874}
I20260620 07:01:08.401473 1169 tablet_replica.cc:330] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:08.401741 1169 raft_consensus.cc:2229] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:08.402256 1169 raft_consensus.cc:2258] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.403069 1169 ts_tablet_manager.cc:1905] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.407537 724 tablet_service.cc:1514] Processing DeleteTablet for tablet a4e8c06f3f8544ecafb63dd7d04fdf05 with delete_type TABLET_DATA_DELETED (replaced by tablet ed042bdf10a2453eab5175f21d1184c1) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.408263 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 113dd3d57c144088ae7204dc5229f883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.413618 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 1d09745353ef46b9b68397f48f391bcd from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:08.414251 1806 raft_consensus.cc:482] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.414412 1806 raft_consensus.cc:504] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.415257 1806 leader_election.cc:288] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:08.416640 968 leader_election.cc:341] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 3c2f865b06ca4b9c8fc9d8d0b4aa0dad
I20260620 07:01:08.417269 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 360880717af145628606b5b9fb26e350 with delete_type TABLET_DATA_DELETED (replaced by tablet 2910da33bbdb4410a4a90ff9747a7de1) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.417502 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet add9e860802d4edebcfbc9fa3c4a6b24 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a46df2909bf43f297b412c33f18a329) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.417398 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_59b0b7d236ea417689758568dbc1e467"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:08.417698 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet f9df1d52393e47ce991b5295d03624e8 with delete_type TABLET_DATA_DELETED (replaced by tablet b39e682e71ed4776a786f7d30158e7e0) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:08.418076 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59b0b7d236ea417689758568dbc1e467 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.418315 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ecd2d34af33b4920a820e7a49409c63b" } new_table_name: "default.Table_84dadb1417974806a37c5fc6f5347d2d" modify_external_catalogs: true
I20260620 07:01:08.419587 1167 tablet_bootstrap.cc:492] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.420142 1167 ts_tablet_manager.cc:1397] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.050s user 0.009s sys 0.005s
I20260620 07:01:08.420127 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6559046a0e474633ad24c9215e23b506" } modify_external_catalogs: true
I20260620 07:01:08.420539 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6559046a0e474633ad24c9215e23b506" } modify_external_catalogs: true
I20260620 07:01:08.421157 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_68c627af3b814440b64be782c7fbf9d4" } modify_external_catalogs: true
I20260620 07:01:08.421387 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_68c627af3b814440b64be782c7fbf9d4" } modify_external_catalogs: true
I20260620 07:01:08.421924 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ca4ebce0835d49c8a8d69ee21c9cec32" } modify_external_catalogs: true
I20260620 07:01:08.422087 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ca4ebce0835d49c8a8d69ee21c9cec32" } modify_external_catalogs: true
I20260620 07:01:08.422464 1167 raft_consensus.cc:348] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.422925 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 60ce7d59a97544fda80a54f7124d1dba from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:08.423122 1167 raft_consensus.cc:374] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.423206 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 95ba8444d70342f781bd84edefbca71f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:08.423398 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_20581d428c6345ce8216cc2467e7eeef" } new_table_name: "default.Table_811e4d61e71e47ab80ad8c0488b3183c" modify_external_catalogs: true
I20260620 07:01:08.423444 1167 raft_consensus.cc:729] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.424060 1167 consensus_queue.cc:260] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.422658 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e8cbdbd27e8345578bf36803fa9777b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.425201 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8cbdbd27e8345578bf36803fa9777b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.425724 1167 ts_tablet_manager.cc:1428] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 07:01:08.426474 1167 tablet_bootstrap.cc:492] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.426679 418 master_service.cc:946] ReplaceTablet: received request to replace tablet b39e682e71ed4776a786f7d30158e7e0 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:08.429236 1167 tablet_bootstrap.cc:654] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.435559 1879 leader_election.cc:288] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.439957 1168 tablet_bootstrap.cc:492] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.440130 1168 ts_tablet_manager.cc:1397] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.178s user 0.030s sys 0.029s
W20260620 07:01:08.440901 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c4b81f2b92f4363829034d3fe290742 consensus state has no leader
I20260620 07:01:08.441087 1168 raft_consensus.cc:348] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.441440 1168 raft_consensus.cc:374] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.441510 1168 raft_consensus.cc:729] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.441720 1168 consensus_queue.cc:260] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.442224 1168 ts_tablet_manager.cc:1428] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:08.442492 1168 tablet_bootstrap.cc:492] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.444370 1168 tablet_bootstrap.cc:654] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.446447 1167 tablet_bootstrap.cc:492] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.446678 1167 ts_tablet_manager.cc:1397] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260620 07:01:08.447526 1167 raft_consensus.cc:348] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.447831 1167 raft_consensus.cc:374] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.447952 1167 raft_consensus.cc:729] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.448241 1167 consensus_queue.cc:260] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.449004 1167 ts_tablet_manager.cc:1428] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:08.449673 1167 tablet_bootstrap.cc:492] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:08.451927 1167 tablet_bootstrap.cc:654] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.453775 1168 tablet_bootstrap.cc:492] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.453984 1168 ts_tablet_manager.cc:1397] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260620 07:01:08.454520 1170 tablet_bootstrap.cc:492] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:08.454840 1170 ts_tablet_manager.cc:1397] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.001s
I20260620 07:01:08.454780 1168 raft_consensus.cc:348] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.455025 1168 raft_consensus.cc:374] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.455096 1168 raft_consensus.cc:729] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.455295 1168 consensus_queue.cc:260] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.455799 1168 ts_tablet_manager.cc:1428] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:08.456059 1168 tablet_bootstrap.cc:492] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.457731 1168 tablet_bootstrap.cc:654] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.457892 1170 raft_consensus.cc:348] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.458428 1170 raft_consensus.cc:374] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.458660 1170 raft_consensus.cc:729] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.459174 1806 raft_consensus.cc:482] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.459126 1170 consensus_queue.cc:260] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.459338 1806 raft_consensus.cc:504] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.459964 1806 leader_election.cc:288] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:08.463253 1166 ts_tablet_manager.cc:1918] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.464139 1166 log.cc:1196] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/8cb04a2e17f3417aaf0f89f0c7f78159
I20260620 07:01:08.465181 1166 ts_tablet_manager.cc:1939] T 8cb04a2e17f3417aaf0f89f0c7f78159 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:08.467546 968 leader_election.cc:341] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: d066c73ae0104cb3be792790b1dfb93d
I20260620 07:01:08.467787 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "581573cafab14ac79ff7ad19da0580b4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:08.468045 749 raft_consensus.cc:3037] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.468573 1167 tablet_bootstrap.cc:492] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.468717 1167 ts_tablet_manager.cc:1397] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260620 07:01:08.469409 1167 raft_consensus.cc:348] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.469637 1167 raft_consensus.cc:374] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.469702 1167 raft_consensus.cc:729] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.469992 1165 ts_tablet_manager.cc:1918] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:08.470117 1165 log.cc:1196] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/cb26f1d10f9a4978b41afbd8894f1102
I20260620 07:01:08.469930 1167 consensus_queue.cc:260] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.471146 1167 ts_tablet_manager.cc:1428] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:08.471493 749 raft_consensus.cc:2454] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:08.472096 831 leader_election.cc:302] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:08.472312 1168 tablet_bootstrap.cc:492] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.472442 1168 ts_tablet_manager.cc:1397] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260620 07:01:08.472550 1879 raft_consensus.cc:2781] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:08.473184 1168 raft_consensus.cc:348] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.473606 1168 raft_consensus.cc:374] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.473677 1168 raft_consensus.cc:729] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.473901 1168 consensus_queue.cc:260] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.474614 1168 ts_tablet_manager.cc:1428] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:08.475095 1165 ts_tablet_manager.cc:1939] T cb26f1d10f9a4978b41afbd8894f1102 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:08.476112 1165 tablet_replica.cc:330] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:08.476352 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet cb26f1d10f9a4978b41afbd8894f1102 (table default.Table_622b45b592db43659f3fb16e236d0fb3 [id=b1edb1d369d341b4bd7aa4a9b1fcdea8]) successfully deleted
I20260620 07:01:08.476481 1165 raft_consensus.cc:2229] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:08.476730 1165 pending_rounds.cc:62] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:08.476926 1165 pending_rounds.cc:68] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821603944427520 op_type: NO_OP noop_request { }
I20260620 07:01:08.477128 1165 raft_consensus.cc:2866] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:08.477321 1165 raft_consensus.cc:2258] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.476701 1879 raft_consensus.cc:686] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:08.477834 1879 consensus_queue.cc:237] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.479817 1165 ts_tablet_manager.cc:1905] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.475142 1168 tablet_bootstrap.cc:492] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.482089 1168 tablet_bootstrap.cc:654] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.486321 1167 tablet_bootstrap.cc:492] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:08.489490 413 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.61:33455, user_credentials={real_user=slave}} blocked reactor thread for 68308us
I20260620 07:01:08.496592 1168 tablet_bootstrap.cc:492] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.496762 1168 ts_tablet_manager.cc:1397] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.002s
I20260620 07:01:08.497043 1165 ts_tablet_manager.cc:1918] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:08.497200 1165 log.cc:1196] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f8b961698fe54e7f9c16f41b90058093
I20260620 07:01:08.497639 1165 ts_tablet_manager.cc:1939] T f8b961698fe54e7f9c16f41b90058093 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:08.497573 1168 raft_consensus.cc:348] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.497802 1168 raft_consensus.cc:374] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.497859 1168 raft_consensus.cc:729] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.498085 1168 consensus_queue.cc:260] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.499046 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f8b961698fe54e7f9c16f41b90058093 (table default.Table_4fd706d123b84bd4869c44a4d0e794c3 [id=681c188b41234255b290334fb43f58f1]) successfully deleted
I20260620 07:01:08.499349 1165 tablet_replica.cc:330] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:08.499420 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 113dd3d57c144088ae7204dc5229f883 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 113dd3d57c144088ae7204dc5229f883 already in progress: creating tablet
I20260620 07:01:08.499549 1165 raft_consensus.cc:2229] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:08.499809 1165 pending_rounds.cc:62] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:08.499922 1165 pending_rounds.cc:68] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821604845977600 op_type: NO_OP noop_request { }
I20260620 07:01:08.500062 1165 raft_consensus.cc:2866] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:08.500180 1165 raft_consensus.cc:2258] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.500202 1170 ts_tablet_manager.cc:1428] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.045s user 0.001s sys 0.001s
I20260620 07:01:08.500909 1168 ts_tablet_manager.cc:1428] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:08.501096 1165 ts_tablet_manager.cc:1905] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.501160 1168 tablet_bootstrap.cc:492] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.502887 1170 tablet_bootstrap.cc:492] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:08.504361 1168 tablet_bootstrap.cc:654] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.507934 1879 raft_consensus.cc:482] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.508059 1879 raft_consensus.cc:504] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.508594 1879 leader_election.cc:288] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.509984 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8ec1e179a704e5480f3deaf856156e7" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:08.510524 831 leader_election.cc:341] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:08.510955 1165 ts_tablet_manager.cc:1918] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:08.511144 1165 log.cc:1196] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ca380134173e42f6b562b56375f2ccad
I20260620 07:01:08.511706 1165 ts_tablet_manager.cc:1939] T ca380134173e42f6b562b56375f2ccad P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:08.512032 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d066c73ae0104cb3be792790b1dfb93d" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:08.512283 890 raft_consensus.cc:2454] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:08.513200 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ca380134173e42f6b562b56375f2ccad (table default.Table_6bd66e9c6f5d4e348b7345db1c1175d8 [id=82989da82c6244a7b6f52db6807af15f]) successfully deleted
I20260620 07:01:08.492620 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 7fc63351f767447c99b819fe7848d381 (table default.Table_e84e884648ed447c91e20b4a2be65197 [id=38f5978d6a7945c9aec7b78d789241ce]) successfully deleted
I20260620 07:01:08.514482 1168 tablet_bootstrap.cc:492] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.514607 1168 ts_tablet_manager.cc:1397] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.005s
I20260620 07:01:08.515942 1168 raft_consensus.cc:348] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.516172 1168 raft_consensus.cc:374] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.516265 1168 raft_consensus.cc:729] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.516507 1168 consensus_queue.cc:260] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.517179 1168 ts_tablet_manager.cc:1428] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:08.517917 1168 tablet_bootstrap.cc:492] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.520217 1168 tablet_bootstrap.cc:654] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.521821 1170 tablet_bootstrap.cc:654] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:08.522157 969 leader_election.cc:341] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3c2f865b06ca4b9c8fc9d8d0b4aa0dad
I20260620 07:01:08.523020 969 leader_election.cc:302] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:08.523438 969 leader_election.cc:302] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:08.524459 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8ec1e179a704e5480f3deaf856156e7" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:08.524832 1806 raft_consensus.cc:2726] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:08.524984 1750 raft_consensus.cc:2781] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:08.525339 1750 raft_consensus.cc:482] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:08.525449 1750 raft_consensus.cc:3037] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:08.528081 830 leader_election.cc:341] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:08.528949 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "581573cafab14ac79ff7ad19da0580b4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:08.529174 1169 ts_tablet_manager.cc:1918] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:08.529301 1169 log.cc:1196] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/3f53f0302d1a4fb3a0fe3e1d98583550
I20260620 07:01:08.529428 1806 raft_consensus.cc:482] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.529400 830 leader_election.cc:302] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:08.529664 1879 raft_consensus.cc:2726] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:08.530874 1806 raft_consensus.cc:504] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.531550 1806 leader_election.cc:288] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:08.532375 830 leader_election.cc:341] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:08.532982 968 leader_election.cc:341] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: bea895c735c847f59794ab8c3282447d
I20260620 07:01:08.533113 1169 ts_tablet_manager.cc:1939] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:08.533279 1750 raft_consensus.cc:504] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.534090 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 569) took 1666 ms. Trace:
I20260620 07:01:08.534291 1750 leader_election.cc:288] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:08.534271 1169 rpcz_store.cc:276] 0620 07:01:06.868956 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.869027 (+ 71us) service_pool.cc:227] Handling call
0620 07:01:08.401369 (+1532342us) ts_tablet_manager.cc:1145] Deleting tablet 3f53f0302d1a4fb3a0fe3e1d98583550
0620 07:01:08.401384 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.406456 (+ 5072us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.529016 (+122560us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.534038 (+ 5022us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1380112}
W20260620 07:01:08.534972 968 leader_election.cc:341] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: d066c73ae0104cb3be792790b1dfb93d
I20260620 07:01:08.535418 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 290) took 7488 ms. Trace:
I20260620 07:01:08.535580 1166 rpcz_store.cc:276] 0620 07:01:01.033883 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:01.852550 (+818667us) service_pool.cc:227] Handling call
0620 07:01:08.251061 (+6398511us) ts_tablet_manager.cc:1145] Deleting tablet 8cb04a2e17f3417aaf0f89f0c7f78159
0620 07:01:08.251075 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.397438 (+146363us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.462953 (+ 65515us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.522605 (+ 59652us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6224902}
I20260620 07:01:08.536129 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 8cb04a2e17f3417aaf0f89f0c7f78159 (table default.Table_c649dd8a94d74f428ec6a8c9b77288c2 [id=82c73c656d3148df95ac377dfe7f38fd]) successfully deleted
I20260620 07:01:08.536247 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 302) took 7500 ms. Trace:
I20260620 07:01:08.536347 1166 rpcz_store.cc:276] 0620 07:01:01.036089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.134664 (+1098575us) service_pool.cc:227] Handling call
0620 07:01:08.536099 (+6401435us) ts_tablet_manager.cc:1145] Deleting tablet c2e38178b9244152915d4c0a9dcf59dc
0620 07:01:08.536115 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.536216 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6401105}
I20260620 07:01:08.536645 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 571) took 1513 ms. Trace:
W20260620 07:01:08.536859 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c2e38178b9244152915d4c0a9dcf59dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2e38178b9244152915d4c0a9dcf59dc already in progress: creating tablet
I20260620 07:01:08.536823 1169 rpcz_store.cc:276] 0620 07:01:07.022971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.023150 (+ 179us) service_pool.cc:227] Handling call
0620 07:01:08.536503 (+1513353us) ts_tablet_manager.cc:1145] Deleting tablet f5072c573ce54477881cafb63e18b030
0620 07:01:08.536518 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.536612 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1510493}
I20260620 07:01:08.537231 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 305) took 7458 ms. Trace:
I20260620 07:01:08.537413 1166 rpcz_store.cc:276] 0620 07:01:01.079490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.146041 (+1066551us) service_pool.cc:227] Handling call
0620 07:01:08.537096 (+6391055us) ts_tablet_manager.cc:1145] Deleting tablet 9b2f0c28057b4534a8a400d1ca7f3991
0620 07:01:08.537107 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.537198 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6390830}
I20260620 07:01:08.537683 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 570) took 1520 ms. Trace:
W20260620 07:01:08.537911 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9b2f0c28057b4534a8a400d1ca7f3991 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b2f0c28057b4534a8a400d1ca7f3991 already in progress: creating tablet
I20260620 07:01:08.538092 1169 rpcz_store.cc:276] 0620 07:01:07.017212 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.018578 (+ 1366us) service_pool.cc:227] Handling call
0620 07:01:08.537565 (+1518987us) ts_tablet_manager.cc:1145] Deleting tablet 3f53f0302d1a4fb3a0fe3e1d98583550
0620 07:01:08.537575 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.537651 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1508186}
I20260620 07:01:08.538277 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 306) took 7288 ms. Trace:
I20260620 07:01:08.538429 1166 rpcz_store.cc:276] 0620 07:01:01.250003 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.146284 (+896281us) service_pool.cc:227] Handling call
0620 07:01:08.538149 (+6391865us) ts_tablet_manager.cc:1145] Deleting tablet a9daee42d5c748ceaed7dc94f551c0d1
0620 07:01:08.538159 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.538245 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6391721}
W20260620 07:01:08.538921 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a9daee42d5c748ceaed7dc94f551c0d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9daee42d5c748ceaed7dc94f551c0d1 already in progress: creating tablet
I20260620 07:01:08.539330 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 307) took 7285 ms. Trace:
I20260620 07:01:08.539485 1169 tablet_replica.cc:330] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:08.539485 1166 rpcz_store.cc:276] 0620 07:01:01.253832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.146439 (+892607us) service_pool.cc:227] Handling call
0620 07:01:08.539192 (+6392753us) ts_tablet_manager.cc:1145] Deleting tablet 9e8cd4ec5619416a8983e1bc1b6b6a09
0620 07:01:08.539204 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.539294 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6392563}
W20260620 07:01:08.540028 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 already in progress: creating tablet
I20260620 07:01:08.541971 1167 tablet_bootstrap.cc:654] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.542339 1168 tablet_bootstrap.cc:492] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.542379 1169 raft_consensus.cc:2229] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.542500 1168 ts_tablet_manager.cc:1397] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.016s
I20260620 07:01:08.542130 1170 tablet_bootstrap.cc:492] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:08.542799 1170 ts_tablet_manager.cc:1397] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.002s
I20260620 07:01:08.543258 1168 raft_consensus.cc:348] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.543519 1168 raft_consensus.cc:374] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.543596 1168 raft_consensus.cc:729] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.543727 1170 raft_consensus.cc:348] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.544032 1170 raft_consensus.cc:374] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.544135 1170 raft_consensus.cc:729] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.543872 1168 consensus_queue.cc:260] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.545461 1168 ts_tablet_manager.cc:1428] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 07:01:08.544399 1170 consensus_queue.cc:260] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.546304 1168 tablet_bootstrap.cc:492] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.547498 1170 ts_tablet_manager.cc:1428] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:08.547868 1170 tablet_bootstrap.cc:492] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:08.548302 1168 tablet_bootstrap.cc:654] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.550055 1169 raft_consensus.cc:2258] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.550707 1169 ts_tablet_manager.cc:1905] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.557420 1170 tablet_bootstrap.cc:654] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.558151 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_aa50efd3e2c24b94ae1de367ad45588e" } modify_external_catalogs: true
I20260620 07:01:08.558481 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_aa50efd3e2c24b94ae1de367ad45588e" } modify_external_catalogs: true
W20260620 07:01:08.558822 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f5072c573ce54477881cafb63e18b030 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5072c573ce54477881cafb63e18b030 already in progress: creating tablet
I20260620 07:01:08.558279 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ddf7eee68cd64d798dd0e8cced08b38a" } new_table_name: "default.Table_703c2ae2881649669e2d23335bf7d54c" modify_external_catalogs: true
W20260620 07:01:08.559054 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3f53f0302d1a4fb3a0fe3e1d98583550 because the tablet was not found. No further retry: Not found: Tablet not found: 3f53f0302d1a4fb3a0fe3e1d98583550
I20260620 07:01:08.559834 1168 tablet_bootstrap.cc:492] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.559962 1168 ts_tablet_manager.cc:1397] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.002s
I20260620 07:01:08.560657 1168 raft_consensus.cc:348] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.560860 1168 raft_consensus.cc:374] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.560906 1168 raft_consensus.cc:729] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.561074 1168 consensus_queue.cc:260] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.561519 1168 ts_tablet_manager.cc:1428] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260620 07:01:08.561785 1168 tablet_bootstrap.cc:492] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.563279 1168 tablet_bootstrap.cc:654] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.565177 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
I20260620 07:01:08.565451 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_811e4d61e71e47ab80ad8c0488b3183c [id=2abd0f99a3034a0e8824bcb0002c91bd]). Expected version 3 got 2
I20260620 07:01:08.569957 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2bca6ccd0c6948739cd05c66a2a958ff" } new_table_name: "default.Table_cbb47a2ccdba4427955694329846054e" modify_external_catalogs: true
I20260620 07:01:08.571475 868 tablet_service.cc:1514] Processing DeleteTablet for tablet ca380134173e42f6b562b56375f2ccad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.571815 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.572008 1165 tablet_replica.cc:330] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:08.572189 1165 raft_consensus.cc:2229] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.572350 1165 raft_consensus.cc:2258] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.572587 875 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b961698fe54e7f9c16f41b90058093 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:08.572702 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ca380134173e42f6b562b56375f2ccad because the tablet was not found. No further retry: Not found: Tablet not found: ca380134173e42f6b562b56375f2ccad
I20260620 07:01:08.572814 865 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e30385ed44c7f8b7db868f2e2bc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.572893 1165 ts_tablet_manager.cc:1905] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.572993 867 tablet_service.cc:1514] Processing DeleteTablet for tablet d066c73ae0104cb3be792790b1dfb93d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.574985 872 tablet_service.cc:1514] Processing DeleteTablet for tablet a5757e05e9a2403a86ca98f455e11754 with delete_type TABLET_DATA_DELETED (replaced by tablet a2d6f7f2b5b3473aa010b8982a03aa5e) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.575169 876 tablet_service.cc:1514] Processing DeleteTablet for tablet d15ea9529afe40b6b4a702035479aef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.575330 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 82020156f3e44a1e84a9435d1f994124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.575491 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 581573cafab14ac79ff7ad19da0580b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.575887 861 tablet_service.cc:1514] Processing DeleteTablet for tablet cb26f1d10f9a4978b41afbd8894f1102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.579185 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2004ff6f00a441578b8e702e8c7605fc
I20260620 07:01:08.579473 1750 raft_consensus.cc:482] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.579790 1750 raft_consensus.cc:504] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:08.580335 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95ba8444d70342f781bd84edefbca71f consensus state has no leader
I20260620 07:01:08.580757 1750 leader_election.cc:288] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:08.581454 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 2004ff6f00a441578b8e702e8c7605fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.581861 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet ca380134173e42f6b562b56375f2ccad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.583259 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 82020156f3e44a1e84a9435d1f994124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.583750 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 95f9a6b2f2cb41e6b74715b2618d8a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.584020 1165 ts_tablet_manager.cc:1918] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.584132 1165 log.cc:1196] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/95f9a6b2f2cb41e6b74715b2618d8a70
I20260620 07:01:08.584429 1165 ts_tablet_manager.cc:1939] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:08.584524 998 tablet_service.cc:1514] Processing DeleteTablet for tablet bea895c735c847f59794ab8c3282447d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.584779 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet d066c73ae0104cb3be792790b1dfb93d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.585246 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 076926f7dffe4a7b80c25ea3c18e9958 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8cd4ec5619416a8983e1bc1b6b6a09) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.585435 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 95f9a6b2f2cb41e6b74715b2618d8a70 (table default.Table_6641e445a3014a60a287541bee6f57e2 [id=08b49e7b2cb8468e97d459fb1ab36211]) successfully deleted
I20260620 07:01:08.585662 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 2004ff6f00a441578b8e702e8c7605fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.585745 1165 tablet_replica.cc:330] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:08.585775 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f8b961698fe54e7f9c16f41b90058093 because the tablet was not found. No further retry: Not found: Tablet not found: f8b961698fe54e7f9c16f41b90058093
I20260620 07:01:08.585906 1165 raft_consensus.cc:2229] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.586064 1165 raft_consensus.cc:2258] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.581144 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b961698fe54e7f9c16f41b90058093" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:08.586848 1165 ts_tablet_manager.cc:1905] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:08.587127 968 leader_election.cc:341] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: Tablet not RUNNING: STOPPED
I20260620 07:01:08.590147 1168 tablet_bootstrap.cc:492] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.590279 1168 ts_tablet_manager.cc:1397] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.003s
I20260620 07:01:08.590971 1168 raft_consensus.cc:348] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.591228 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d066c73ae0104cb3be792790b1dfb93d" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:08.591167 1168 raft_consensus.cc:374] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.591430 1168 raft_consensus.cc:729] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.591653 1168 consensus_queue.cc:260] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.591442 890 raft_consensus.cc:3037] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.592133 1168 ts_tablet_manager.cc:1428] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:08.592378 1168 tablet_bootstrap.cc:492] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.593968 1168 tablet_bootstrap.cc:654] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.595377 890 raft_consensus.cc:2454] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
W20260620 07:01:08.598412 969 leader_election.cc:341] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: bea895c735c847f59794ab8c3282447d
I20260620 07:01:08.598666 969 leader_election.cc:302] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:08.598985 1750 raft_consensus.cc:2726] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:08.599668 969 leader_election.cc:302] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:08.599802 1165 ts_tablet_manager.cc:1918] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.599992 1750 raft_consensus.cc:2781] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:08.600147 1750 raft_consensus.cc:686] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:08.600471 1750 consensus_queue.cc:237] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.600967 1165 log.cc:1196] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/da1e30385ed44c7f8b7db868f2e2bc29
I20260620 07:01:08.601261 1165 ts_tablet_manager.cc:1939] T da1e30385ed44c7f8b7db868f2e2bc29 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:08.602293 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet da1e30385ed44c7f8b7db868f2e2bc29 (table default.Table_0d2790345adb48f6b1c2e10d634207e3 [id=640b0fb8da40454d94a90d23f41b06ff]) successfully deleted
I20260620 07:01:08.602833 1165 tablet_replica.cc:330] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:08.603580 1168 tablet_bootstrap.cc:492] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.603856 1168 ts_tablet_manager.cc:1397] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20260620 07:01:08.605273 1168 raft_consensus.cc:348] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.605605 1168 raft_consensus.cc:374] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.605741 1168 raft_consensus.cc:729] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.606153 1168 consensus_queue.cc:260] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.607555 1168 ts_tablet_manager.cc:1428] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260620 07:01:08.608147 969 leader_election.cc:341] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f8b961698fe54e7f9c16f41b90058093
I20260620 07:01:08.608371 969 leader_election.cc:302] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:08.608809 1806 raft_consensus.cc:2726] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:08.611647 1168 tablet_bootstrap.cc:492] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.614948 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 40d9875dde7b4455b24b053781993234
I20260620 07:01:08.617938 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 40d9875dde7b4455b24b053781993234 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.619240 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 40d9875dde7b4455b24b053781993234 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.620051 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 82020156f3e44a1e84a9435d1f994124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.624851 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0994a329d6c54dc7821fa869e23756f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.625494 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0994a329d6c54dc7821fa869e23756f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.625985 1165 raft_consensus.cc:2229] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.627274 1800 raft_consensus.cc:482] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.627460 1800 raft_consensus.cc:504] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.628222 1800 leader_election.cc:288] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.627492 868 tablet_service.cc:1467] Processing CreateTablet for tablet d05a505f73b24e0ba7159a3d411e5f4f (DEFAULT_TABLE table=default.Table_6d6ee060896c4d3ab31d9cefe862ef44 [id=6712915f69c7491b9e850ea41e0a9fb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.628669 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d05a505f73b24e0ba7159a3d411e5f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.628720 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 2004ff6f00a441578b8e702e8c7605fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.627835 859 tablet_service.cc:1467] Processing CreateTablet for tablet c7aeb82d6f4c4e53a164b3fc5eb47990 (DEFAULT_TABLE table=default.Table_83260c708b85456995a000801fb7aa87 [id=cc969f14ed2942218befe23ed14448f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.630985 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 60ce7d59a97544fda80a54f7124d1dba
I20260620 07:01:08.631088 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7aeb82d6f4c4e53a164b3fc5eb47990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.631467 424 catalog_manager.cc:6565] ReplaceTablet: tablet 60ce7d59a97544fda80a54f7124d1dba deleted and replaced by tablet bcdb23f67ac2402b9471748d98b8dae9
I20260620 07:01:08.633867 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5919c99f3324f7ba52c72e91b35afaf" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:08.628104 861 tablet_service.cc:1467] Processing CreateTablet for tablet a18617834201406f83ebe1dc63863e33 (DEFAULT_TABLE table=default.Table_3d9c38c934dc4976829baa74050e095b [id=e17532bc03aa483dbd9a010ff256eaa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.635170 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18617834201406f83ebe1dc63863e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.540779 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 308) took 7201 ms. Trace:
I20260620 07:01:08.635636 1166 rpcz_store.cc:276] 0620 07:01:01.339428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.146640 (+807212us) service_pool.cc:227] Handling call
0620 07:01:08.540329 (+6393689us) ts_tablet_manager.cc:1145] Deleting tablet b5014cf5cc70466bafb6921c9d46ba72
0620 07:01:08.540339 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.540679 (+ 340us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6393533}
I20260620 07:01:08.636062 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 310) took 7279 ms. Trace:
I20260620 07:01:08.636193 1166 rpcz_store.cc:276] 0620 07:01:01.360612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.147394 (+786782us) service_pool.cc:227] Handling call
0620 07:01:08.635915 (+6488521us) ts_tablet_manager.cc:1145] Deleting tablet cd75e318982a4fb9bf28cb35b030642f
0620 07:01:08.635927 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.636020 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6488337}
I20260620 07:01:08.636529 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 318) took 7002 ms. Trace:
I20260620 07:01:08.636480 1006 tablet_service.cc:1467] Processing CreateTablet for tablet d05a505f73b24e0ba7159a3d411e5f4f (DEFAULT_TABLE table=default.Table_6d6ee060896c4d3ab31d9cefe862ef44 [id=6712915f69c7491b9e850ea41e0a9fb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.636631 1166 rpcz_store.cc:276] 0620 07:01:01.633758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.345456 (+711698us) service_pool.cc:227] Handling call
0620 07:01:08.636398 (+6290942us) ts_tablet_manager.cc:1145] Deleting tablet 2bc3dd1306af4e49a9fec197b5740374
0620 07:01:08.636407 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.636493 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6279710}
I20260620 07:01:08.636878 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d05a505f73b24e0ba7159a3d411e5f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.636962 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 323) took 6839 ms. Trace:
I20260620 07:01:08.637053 1166 rpcz_store.cc:276] 0620 07:01:01.797327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.368024 (+570697us) service_pool.cc:227] Handling call
0620 07:01:08.636810 (+6268786us) ts_tablet_manager.cc:1145] Deleting tablet f6bdcd8cd2574acf867b7ec487559db2
0620 07:01:08.636817 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.636931 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6264940}
I20260620 07:01:08.637351 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 320) took 6975 ms. Trace:
I20260620 07:01:08.637454 1166 rpcz_store.cc:276] 0620 07:01:01.661501 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.365427 (+703926us) service_pool.cc:227] Handling call
0620 07:01:08.637233 (+6271806us) ts_tablet_manager.cc:1145] Deleting tablet cfff2a14b1184d39bd7ac1091ef749c9
0620 07:01:08.637242 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.637316 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6252608}
I20260620 07:01:08.637751 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 332) took 6442 ms. Trace:
I20260620 07:01:08.638026 1166 rpcz_store.cc:276] 0620 07:01:02.195749 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.411185 (+215436us) service_pool.cc:227] Handling call
0620 07:01:08.637639 (+6226454us) ts_tablet_manager.cc:1145] Deleting tablet 6fbd069552314f2c9ee010c054386644
0620 07:01:08.637647 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.637720 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6225399}
I20260620 07:01:08.640187 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 60ce7d59a97544fda80a54f7124d1dba with delete_type TABLET_DATA_DELETED (replaced by tablet bcdb23f67ac2402b9471748d98b8dae9) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.640743 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5919c99f3324f7ba52c72e91b35afaf" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:08.640967 890 raft_consensus.cc:2454] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:08.644941 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 60ce7d59a97544fda80a54f7124d1dba with delete_type TABLET_DATA_DELETED (replaced by tablet bcdb23f67ac2402b9471748d98b8dae9) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:08.645310 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b5014cf5cc70466bafb6921c9d46ba72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5014cf5cc70466bafb6921c9d46ba72 already in progress: creating tablet
I20260620 07:01:08.645802 1007 tablet_service.cc:1467] Processing CreateTablet for tablet a18617834201406f83ebe1dc63863e33 (DEFAULT_TABLE table=default.Table_3d9c38c934dc4976829baa74050e095b [id=e17532bc03aa483dbd9a010ff256eaa0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:08.646449 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet cd75e318982a4fb9bf28cb35b030642f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd75e318982a4fb9bf28cb35b030642f already in progress: creating tablet
W20260620 07:01:08.646858 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2bc3dd1306af4e49a9fec197b5740374 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bc3dd1306af4e49a9fec197b5740374 already in progress: creating tablet
W20260620 07:01:08.647414 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f6bdcd8cd2574acf867b7ec487559db2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6bdcd8cd2574acf867b7ec487559db2 already in progress: creating tablet
W20260620 07:01:08.647820 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet cfff2a14b1184d39bd7ac1091ef749c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfff2a14b1184d39bd7ac1091ef749c9 already in progress: creating tablet
W20260620 07:01:08.649127 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6fbd069552314f2c9ee010c054386644 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fbd069552314f2c9ee010c054386644 already in progress: creating tablet
W20260620 07:01:08.649500 681 leader_election.cc:341] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:08.649966 683 leader_election.cc:302] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:08.651420 1879 consensus_queue.cc:1035] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:08.651886 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18617834201406f83ebe1dc63863e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.653337 1165 raft_consensus.cc:2258] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.653932 1165 ts_tablet_manager.cc:1905] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.656879 1006 tablet_service.cc:1467] Processing CreateTablet for tablet c7aeb82d6f4c4e53a164b3fc5eb47990 (DEFAULT_TABLE table=default.Table_83260c708b85456995a000801fb7aa87 [id=cc969f14ed2942218befe23ed14448f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.657366 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7aeb82d6f4c4e53a164b3fc5eb47990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.660241 1830 raft_consensus.cc:482] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.660408 1830 raft_consensus.cc:504] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.661018 1830 leader_election.cc:288] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:08.661902 1165 ts_tablet_manager.cc:1918] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.663370 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_72c77ce50c2e43e3a966006e5fa68ceb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.664039 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72c77ce50c2e43e3a966006e5fa68ceb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.665851 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d4bf2488466f4efa97a5dfa13576e493"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:08.666424 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_93a86466c0d84a5d99d50bb785e28e32" } modify_external_catalogs: true
W20260620 07:01:08.666527 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4bf2488466f4efa97a5dfa13576e493 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.666633 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_93a86466c0d84a5d99d50bb785e28e32" } modify_external_catalogs: true
I20260620 07:01:08.666913 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_55ba5d893268477bb780b81c97f3440e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.667497 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55ba5d893268477bb780b81c97f3440e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.654819 1168 tablet_bootstrap.cc:654] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.672274 861 tablet_service.cc:1467] Processing CreateTablet for tablet 09eddf4734144bdaba24759647553020 (DEFAULT_TABLE table=default.Table_bc6f45b50d5647928a19eb8b0b789fd8 [id=d66c9d3d39c9401fbb8007dc460dd23f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.672783 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09eddf4734144bdaba24759647553020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.675356 1830 raft_consensus.cc:482] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.675521 1830 raft_consensus.cc:504] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.676149 1830 leader_election.cc:288] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:08.679811 859 tablet_service.cc:1467] Processing CreateTablet for tablet 7a024765ed144281a81db3b75cd271bf (DEFAULT_TABLE table=default.Table_03892f83a5e34559bbbe72bbb8bcd8c4 [id=0926dc30092f4d30b2ee2d929176a588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.680202 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a024765ed144281a81db3b75cd271bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.667511 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_de68c895f92f41ee880a5b9968500827"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.682237 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de68c895f92f41ee880a5b9968500827 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.683171 868 tablet_service.cc:1467] Processing CreateTablet for tablet 45358f467b864c3284040893d7351b03 (DEFAULT_TABLE table=default.Table_9a1f7fd6373b4013982e2a16179901fa [id=0eb661e0227c4c129b2f8cdb5f0a1375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.683547 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45358f467b864c3284040893d7351b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.684381 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 09eddf4734144bdaba24759647553020 (DEFAULT_TABLE table=default.Table_bc6f45b50d5647928a19eb8b0b789fd8 [id=d66c9d3d39c9401fbb8007dc460dd23f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.684831 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09eddf4734144bdaba24759647553020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.686945 1166 tablet_replica.cc:330] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:08.687086 876 tablet_service.cc:1467] Processing CreateTablet for tablet 1e3d4ea81afe43a2a6101e21cbd08f97 (DEFAULT_TABLE table=default.Table_1254e74518114bba933f842f6e7c7bac [id=82caaec7e8a94dd9b1031d22e30d5117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.687206 1166 raft_consensus.cc:2229] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.687404 1166 raft_consensus.cc:2258] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.687444 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e3d4ea81afe43a2a6101e21cbd08f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.688052 1166 ts_tablet_manager.cc:1905] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.691107 872 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa92aae55ef4527a1e8f98945e1e833 (DEFAULT_TABLE table=default.Table_305a2709be0040bda9f3552349b9ce3d [id=eabac0f8560d4df2af6d4ab75e27bb98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.691329 998 tablet_service.cc:1467] Processing CreateTablet for tablet 7a024765ed144281a81db3b75cd271bf (DEFAULT_TABLE table=default.Table_03892f83a5e34559bbbe72bbb8bcd8c4 [id=0926dc30092f4d30b2ee2d929176a588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.691457 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa92aae55ef4527a1e8f98945e1e833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.691679 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a024765ed144281a81db3b75cd271bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.695152 867 tablet_service.cc:1467] Processing CreateTablet for tablet ddd53657848a4ab291d48956d5778d7b (DEFAULT_TABLE table=default.Table_6d2275d5f69744859ef7115f74c45781 [id=33d883227fa3464991f93011b991640b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.695307 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 45358f467b864c3284040893d7351b03 (DEFAULT_TABLE table=default.Table_9a1f7fd6373b4013982e2a16179901fa [id=0eb661e0227c4c129b2f8cdb5f0a1375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.695533 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd53657848a4ab291d48956d5778d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.695664 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45358f467b864c3284040893d7351b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.699815 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 1e3d4ea81afe43a2a6101e21cbd08f97 (DEFAULT_TABLE table=default.Table_1254e74518114bba933f842f6e7c7bac [id=82caaec7e8a94dd9b1031d22e30d5117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.700259 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e3d4ea81afe43a2a6101e21cbd08f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.707667 865 tablet_service.cc:1467] Processing CreateTablet for tablet 14be3e06a9774ac0bada93bcfa4eddf7 (DEFAULT_TABLE table=default.Table_2bca6ccd0c6948739cd05c66a2a958ff [id=35a7c675023c43538c8bf3b089b095a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.708133 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14be3e06a9774ac0bada93bcfa4eddf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.711107 875 tablet_service.cc:1467] Processing CreateTablet for tablet e972b9bef1bd4c19ac0a8c86331dce60 (DEFAULT_TABLE table=default.Table_bf7c7b64562940fc8dc4ba352deea46c [id=7d78d83f2bdd4e678d4efefc73e538a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.711491 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e972b9bef1bd4c19ac0a8c86331dce60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.714290 871 tablet_service.cc:1467] Processing CreateTablet for tablet a570e8da585d46839281d606b2f51938 (DEFAULT_TABLE table=default.Table_6f28a009320146f2bf9ad40968c837d8 [id=13d4c6721fe24c61b91f5bb8f914763c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.714676 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a570e8da585d46839281d606b2f51938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.722862 1879 raft_consensus.cc:482] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.723021 1879 raft_consensus.cc:504] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.723659 1879 leader_election.cc:288] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.724144 1008 tablet_service.cc:1467] Processing CreateTablet for tablet e972b9bef1bd4c19ac0a8c86331dce60 (DEFAULT_TABLE table=default.Table_bf7c7b64562940fc8dc4ba352deea46c [id=7d78d83f2bdd4e678d4efefc73e538a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.724591 862 tablet_service.cc:1467] Processing CreateTablet for tablet 80138f3919f34d5d8163fdfc89d5c52b (DEFAULT_TABLE table=default.Table_186656f8bbdd43ad8e66efcc62300631 [id=ce0deb98b494489e8bbfa73de8d32b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.725082 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80138f3919f34d5d8163fdfc89d5c52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.725485 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e972b9bef1bd4c19ac0a8c86331dce60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.731371 874 tablet_service.cc:1467] Processing CreateTablet for tablet 82283b45f0cd438ebec4b0d75735d40a (DEFAULT_TABLE table=default.Table_961fb7cc2ac24b8198709c9465361979 [id=ee51888c133440aaaa214738c6daac36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.731794 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82283b45f0cd438ebec4b0d75735d40a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.732028 1010 tablet_service.cc:1467] Processing CreateTablet for tablet a570e8da585d46839281d606b2f51938 (DEFAULT_TABLE table=default.Table_6f28a009320146f2bf9ad40968c837d8 [id=13d4c6721fe24c61b91f5bb8f914763c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.732443 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a570e8da585d46839281d606b2f51938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.735534 857 tablet_service.cc:1467] Processing CreateTablet for tablet 8dad7e6437ab4328b9b88d5e6febe8a0 (DEFAULT_TABLE table=default.Table_83d56d1245704fd3935391f2558b3e89 [id=2920611d71ce4939bc2e2201f2e411ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.735984 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dad7e6437ab4328b9b88d5e6febe8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.740949 998 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa92aae55ef4527a1e8f98945e1e833 (DEFAULT_TABLE table=default.Table_305a2709be0040bda9f3552349b9ce3d [id=eabac0f8560d4df2af6d4ab75e27bb98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.741576 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa92aae55ef4527a1e8f98945e1e833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.742933 1166 ts_tablet_manager.cc:1918] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.742955 1879 raft_consensus.cc:482] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.743112 1879 raft_consensus.cc:504] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.743695 1879 leader_election.cc:288] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.744635 858 tablet_service.cc:1467] Processing CreateTablet for tablet 49bea93c06f644fabe2de0df4480dcd7 (DEFAULT_TABLE table=default.Table_1d3a2c1e3d244fe9b0a92d28995c3440 [id=e5f19b54beb1409dac3667797686802d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.745067 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49bea93c06f644fabe2de0df4480dcd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.746366 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 40d9875dde7b4455b24b053781993234 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.747023 864 tablet_service.cc:1467] Processing CreateTablet for tablet 140696dbd9e44a0cbe5d4639110aa580 (DEFAULT_TABLE table=default.Table_2c6ec989fb644883b60b35937533a489 [id=4573ff60adda4e508c06e281746fb46a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.747325 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 140696dbd9e44a0cbe5d4639110aa580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.747900 1169 ts_tablet_manager.cc:1918] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.748039 1169 log.cc:1196] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f8b961698fe54e7f9c16f41b90058093
I20260620 07:01:08.748382 1169 ts_tablet_manager.cc:1939] T f8b961698fe54e7f9c16f41b90058093 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:08.749153 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 572) took 1586 ms. Trace:
I20260620 07:01:08.749266 1169 rpcz_store.cc:276] 0620 07:01:07.163041 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.163152 (+ 111us) service_pool.cc:227] Handling call
0620 07:01:08.539420 (+1376268us) ts_tablet_manager.cc:1145] Deleting tablet f8b961698fe54e7f9c16f41b90058093
0620 07:01:08.539431 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.591243 (+ 51812us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.747779 (+156536us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.749092 (+ 1313us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1373623}
I20260620 07:01:08.749682 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 588) took 1396 ms. Trace:
I20260620 07:01:08.749769 1169 rpcz_store.cc:276] 0620 07:01:07.353033 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.353077 (+ 44us) service_pool.cc:227] Handling call
0620 07:01:08.749528 (+1396451us) ts_tablet_manager.cc:1145] Deleting tablet 030b90899c3c4c7e82807a61234f223e
0620 07:01:08.749539 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.749628 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1395076}
I20260620 07:01:08.750134 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 589) took 1395 ms. Trace:
I20260620 07:01:08.750233 1169 rpcz_store.cc:276] 0620 07:01:07.354560 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.354611 (+ 51us) service_pool.cc:227] Handling call
0620 07:01:08.749955 (+1395344us) ts_tablet_manager.cc:1145] Deleting tablet 602f6d47f23e4d7f80f372a6a507d095
0620 07:01:08.749964 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.750078 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1394767}
I20260620 07:01:08.750595 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 591) took 1374 ms. Trace:
I20260620 07:01:08.751451 724 tablet_service.cc:1467] Processing CreateTablet for tablet a18617834201406f83ebe1dc63863e33 (DEFAULT_TABLE table=default.Table_3d9c38c934dc4976829baa74050e095b [id=e17532bc03aa483dbd9a010ff256eaa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.751842 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18617834201406f83ebe1dc63863e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.752120 725 tablet_service.cc:1467] Processing CreateTablet for tablet 45358f467b864c3284040893d7351b03 (DEFAULT_TABLE table=default.Table_9a1f7fd6373b4013982e2a16179901fa [id=0eb661e0227c4c129b2f8cdb5f0a1375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.752498 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45358f467b864c3284040893d7351b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.753846 721 tablet_service.cc:1467] Processing CreateTablet for tablet a570e8da585d46839281d606b2f51938 (DEFAULT_TABLE table=default.Table_6f28a009320146f2bf9ad40968c837d8 [id=13d4c6721fe24c61b91f5bb8f914763c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.754179 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f8b961698fe54e7f9c16f41b90058093 (table default.Table_4fd706d123b84bd4869c44a4d0e794c3 [id=681c188b41234255b290334fb43f58f1]) successfully deleted
I20260620 07:01:08.754282 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a570e8da585d46839281d606b2f51938. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:08.754490 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 030b90899c3c4c7e82807a61234f223e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 030b90899c3c4c7e82807a61234f223e already in progress: creating tablet
W20260620 07:01:08.754674 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 602f6d47f23e4d7f80f372a6a507d095 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 602f6d47f23e4d7f80f372a6a507d095 already in progress: creating tablet
I20260620 07:01:08.755112 726 tablet_service.cc:1467] Processing CreateTablet for tablet d05a505f73b24e0ba7159a3d411e5f4f (DEFAULT_TABLE table=default.Table_6d6ee060896c4d3ab31d9cefe862ef44 [id=6712915f69c7491b9e850ea41e0a9fb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.755522 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d05a505f73b24e0ba7159a3d411e5f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.759104 723 tablet_service.cc:1467] Processing CreateTablet for tablet c7aeb82d6f4c4e53a164b3fc5eb47990 (DEFAULT_TABLE table=default.Table_83260c708b85456995a000801fb7aa87 [id=cc969f14ed2942218befe23ed14448f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.759171 722 tablet_service.cc:1467] Processing CreateTablet for tablet 82283b45f0cd438ebec4b0d75735d40a (DEFAULT_TABLE table=default.Table_961fb7cc2ac24b8198709c9465361979 [id=ee51888c133440aaaa214738c6daac36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.759438 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 60ce7d59a97544fda80a54f7124d1dba with delete_type TABLET_DATA_DELETED (replaced by tablet bcdb23f67ac2402b9471748d98b8dae9) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.759588 716 tablet_service.cc:1467] Processing CreateTablet for tablet 8dad7e6437ab4328b9b88d5e6febe8a0 (DEFAULT_TABLE table=default.Table_83d56d1245704fd3935391f2558b3e89 [id=2920611d71ce4939bc2e2201f2e411ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.761088 1800 raft_consensus.cc:2781] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:08.761714 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b37f2c150b314b7298f32c3d414ff43d
I20260620 07:01:08.750682 1169 rpcz_store.cc:276] 0620 07:01:07.376320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.376361 (+ 41us) service_pool.cc:227] Handling call
0620 07:01:08.750446 (+1374085us) ts_tablet_manager.cc:1145] Deleting tablet 18d08c30bf7e4c04b01368b9b4a6273c
0620 07:01:08.750457 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.750537 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1372767}
I20260620 07:01:08.765861 860 tablet_service.cc:1467] Processing CreateTablet for tablet 9e07325dc3f649aca9c5fc21c47d360f (DEFAULT_TABLE table=default.Table_8aa7864d15a54ee5bb36deaf2d452309 [id=6bf3a4189e76441a8088b07aa16c8484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.766351 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e07325dc3f649aca9c5fc21c47d360f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.771070 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 95ba8444d70342f781bd84edefbca71f
I20260620 07:01:08.771541 422 catalog_manager.cc:6565] ReplaceTablet: tablet 95ba8444d70342f781bd84edefbca71f deleted and replaced by tablet 5db563ce7027457fa0185ef94f3c05b5
I20260620 07:01:08.777005 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7aeb82d6f4c4e53a164b3fc5eb47990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.777925 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 95ba8444d70342f781bd84edefbca71f with delete_type TABLET_DATA_DELETED (replaced by tablet 5db563ce7027457fa0185ef94f3c05b5) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.778842 869 tablet_service.cc:1514] Processing DeleteTablet for tablet b37f2c150b314b7298f32c3d414ff43d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.779286 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82283b45f0cd438ebec4b0d75735d40a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.784150 729 tablet_service.cc:1467] Processing CreateTablet for tablet 09eddf4734144bdaba24759647553020 (DEFAULT_TABLE table=default.Table_bc6f45b50d5647928a19eb8b0b789fd8 [id=d66c9d3d39c9401fbb8007dc460dd23f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.774750 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6f28a009320146f2bf9ad40968c837d8" } new_table_name: "default.Table_375531d855b14594830e688497474a2c" modify_external_catalogs: true
I20260620 07:01:08.650377 1167 tablet_bootstrap.cc:492] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:08.789641 1166 log.cc:1196] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/cb26f1d10f9a4978b41afbd8894f1102
I20260620 07:01:08.789816 1167 ts_tablet_manager.cc:1397] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.304s user 0.005s sys 0.001s
I20260620 07:01:08.790426 1166 ts_tablet_manager.cc:1939] T cb26f1d10f9a4978b41afbd8894f1102 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:08.790665 1167 raft_consensus.cc:348] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.790907 1167 raft_consensus.cc:374] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.790997 1167 raft_consensus.cc:729] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.791218 1167 consensus_queue.cc:260] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.791486 727 tablet_service.cc:1467] Processing CreateTablet for tablet 9e07325dc3f649aca9c5fc21c47d360f (DEFAULT_TABLE table=default.Table_8aa7864d15a54ee5bb36deaf2d452309 [id=6bf3a4189e76441a8088b07aa16c8484]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:08.800858 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 18d08c30bf7e4c04b01368b9b4a6273c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18d08c30bf7e4c04b01368b9b4a6273c already in progress: creating tablet
I20260620 07:01:08.803812 1165 log.cc:1196] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/d066c73ae0104cb3be792790b1dfb93d
I20260620 07:01:08.805087 730 tablet_service.cc:1467] Processing CreateTablet for tablet 140696dbd9e44a0cbe5d4639110aa580 (DEFAULT_TABLE table=default.Table_2c6ec989fb644883b60b35937533a489 [id=4573ff60adda4e508c06e281746fb46a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.805083 731 tablet_service.cc:1467] Processing CreateTablet for tablet 7a024765ed144281a81db3b75cd271bf (DEFAULT_TABLE table=default.Table_03892f83a5e34559bbbe72bbb8bcd8c4 [id=0926dc30092f4d30b2ee2d929176a588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.807118 733 tablet_service.cc:1467] Processing CreateTablet for tablet 80138f3919f34d5d8163fdfc89d5c52b (DEFAULT_TABLE table=default.Table_186656f8bbdd43ad8e66efcc62300631 [id=ce0deb98b494489e8bbfa73de8d32b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.808101 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 00a34f01ce5d4d5696248dc88802dafd
W20260620 07:01:08.808148 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 14be3e06a9774ac0bada93bcfa4eddf7 consensus state has no leader
I20260620 07:01:08.808614 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_20896721839841d2bbf7bedd7d08b2c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:08.808835 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5cc308b9274141e4b97046f12359f301"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.809270 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20896721839841d2bbf7bedd7d08b2c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.809757 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_02bda5bfaeba42e6bb40e543534bbfa9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.810228 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02bda5bfaeba42e6bb40e543534bbfa9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.810480 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 574371fb6915427687df660e733407df
I20260620 07:01:08.811151 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fc3fba692ea14fa4b439fbffb8656e3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:08.811411 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_97026b9ce8a34cb0964e1672bc328516"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:08.811676 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc3fba692ea14fa4b439fbffb8656e3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:08.811944 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97026b9ce8a34cb0964e1672bc328516 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:08.809270 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cc308b9274141e4b97046f12359f301 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:08.814414 1879 raft_consensus.cc:482] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.815289 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b802d24491d343c693974cfbd8da495e" } new_table_name: "default.Table_353005aed9854c42bb2013ecbcd04165" modify_external_catalogs: true
I20260620 07:01:08.824350 1165 ts_tablet_manager.cc:1939] T d066c73ae0104cb3be792790b1dfb93d P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:08.814579 1879 raft_consensus.cc:504] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.827558 1879 leader_election.cc:288] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.828859 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 574371fb6915427687df660e733407df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.829124 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a34f01ce5d4d5696248dc88802dafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:08.830041 1165 tablet_replica.cc:330] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:08.830272 1165 raft_consensus.cc:2229] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.830425 1165 raft_consensus.cc:2258] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.830998 1165 ts_tablet_manager.cc:1905] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.832870 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 9e07325dc3f649aca9c5fc21c47d360f (DEFAULT_TABLE table=default.Table_8aa7864d15a54ee5bb36deaf2d452309 [id=6bf3a4189e76441a8088b07aa16c8484]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:08.833077 969 leader_election.cc:341] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d17c49eecec741cdbd592c94b7f84c67
I20260620 07:01:08.833190 996 tablet_service.cc:1514] Processing DeleteTablet for tablet b37f2c150b314b7298f32c3d414ff43d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.833418 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 95ba8444d70342f781bd84edefbca71f with delete_type TABLET_DATA_DELETED (replaced by tablet 5db563ce7027457fa0185ef94f3c05b5) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.833595 994 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a34f01ce5d4d5696248dc88802dafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:08.834674 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 82283b45f0cd438ebec4b0d75735d40a (DEFAULT_TABLE table=default.Table_961fb7cc2ac24b8198709c9465361979 [id=ee51888c133440aaaa214738c6daac36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.835088 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 8dad7e6437ab4328b9b88d5e6febe8a0 (DEFAULT_TABLE table=default.Table_83d56d1245704fd3935391f2558b3e89 [id=2920611d71ce4939bc2e2201f2e411ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.835414 995 tablet_service.cc:1467] Processing CreateTablet for tablet 49bea93c06f644fabe2de0df4480dcd7 (DEFAULT_TABLE table=default.Table_1d3a2c1e3d244fe9b0a92d28995c3440 [id=e5f19b54beb1409dac3667797686802d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.837868 1000 tablet_service.cc:1467] Processing CreateTablet for tablet ddd53657848a4ab291d48956d5778d7b (DEFAULT_TABLE table=default.Table_6d2275d5f69744859ef7115f74c45781 [id=33d883227fa3464991f93011b991640b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.838058 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 14be3e06a9774ac0bada93bcfa4eddf7 (DEFAULT_TABLE table=default.Table_2bca6ccd0c6948739cd05c66a2a958ff [id=35a7c675023c43538c8bf3b089b095a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.841729 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet d066c73ae0104cb3be792790b1dfb93d (table default.Table_3dc4c1ec06e74b1ba496fb7896bea7da [id=c8fa0544c10a479ba4496d1482c535f3]) successfully deleted
I20260620 07:01:08.842108 1879 raft_consensus.cc:482] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.842260 1879 raft_consensus.cc:504] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.842953 1879 leader_election.cc:288] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.845950 1750 raft_consensus.cc:482] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.847364 734 tablet_service.cc:1467] Processing CreateTablet for tablet 14be3e06a9774ac0bada93bcfa4eddf7 (DEFAULT_TABLE table=default.Table_2bca6ccd0c6948739cd05c66a2a958ff [id=35a7c675023c43538c8bf3b089b095a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.847618 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dad7e6437ab4328b9b88d5e6febe8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.849547 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 0e30fb1d050c4439bb72a21a0f2b13eb from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:08.858137 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "168fb1666e2c41358213240d34ef9572" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:08.862525 1168 tablet_bootstrap.cc:492] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:08.862860 1168 ts_tablet_manager.cc:1397] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.251s user 0.014s sys 0.009s
I20260620 07:01:08.864162 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_30d48f35343d4017b5b3e6750c89d54e" } new_table_name: "default.Table_c1ffe009c5034bb58dbe573808a6cf4a" modify_external_catalogs: true
I20260620 07:01:08.864622 1168 raft_consensus.cc:348] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.865127 1168 raft_consensus.cc:374] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.865257 1168 raft_consensus.cc:729] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.865664 1168 consensus_queue.cc:260] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.869565 1168 ts_tablet_manager.cc:1428] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260620 07:01:08.873462 1168 tablet_bootstrap.cc:492] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:08.882833 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_92f22e086c354b20820548c568f04d5f" } modify_external_catalogs: true
I20260620 07:01:08.883105 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_92f22e086c354b20820548c568f04d5f" } modify_external_catalogs: true
I20260620 07:01:08.883402 1165 ts_tablet_manager.cc:1918] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:08.883538 1165 log.cc:1196] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/a5757e05e9a2403a86ca98f455e11754
I20260620 07:01:08.884599 1165 ts_tablet_manager.cc:1939] T a5757e05e9a2403a86ca98f455e11754 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:08.886168 968 leader_election.cc:341] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: d17c49eecec741cdbd592c94b7f84c67
I20260620 07:01:08.890345 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet a5757e05e9a2403a86ca98f455e11754 (table default.Table_0f52b588d09748288097316c7b3de423 [id=7abc3167416745d0871a33a335f880c6]) successfully deleted
I20260620 07:01:08.891832 1800 raft_consensus.cc:482] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:08.892421 1165 tablet_replica.cc:330] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:08.892627 1165 raft_consensus.cc:2229] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:08.892735 1879 raft_consensus.cc:482] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.894879 1165 raft_consensus.cc:2258] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:08.894850 732 tablet_service.cc:1467] Processing CreateTablet for tablet ddd53657848a4ab291d48956d5778d7b (DEFAULT_TABLE table=default.Table_6d2275d5f69744859ef7115f74c45781 [id=33d883227fa3464991f93011b991640b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.896306 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09eddf4734144bdaba24759647553020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.893316 1879 raft_consensus.cc:504] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.897816 1879 leader_election.cc:288] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.899814 1168 tablet_bootstrap.cc:654] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:08.901257 717 tablet_service.cc:1514] Processing DeleteTablet for tablet a5757e05e9a2403a86ca98f455e11754 with delete_type TABLET_DATA_DELETED (replaced by tablet a2d6f7f2b5b3473aa010b8982a03aa5e) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.901423 1800 raft_consensus.cc:3037] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:08.901505 720 tablet_service.cc:1514] Processing DeleteTablet for tablet b37f2c150b314b7298f32c3d414ff43d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.901654 1165 ts_tablet_manager.cc:1905] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:08.902733 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fa0592a238ee4a3cb3150301dbb13135" } new_table_name: "default.Table_e88c7789790e41a9a67d7a1a01cedc02" modify_external_catalogs: true
I20260620 07:01:08.906140 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1cf8ede352db4fbabbad8bf73d525087" } modify_external_catalogs: true
I20260620 07:01:08.906395 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1cf8ede352db4fbabbad8bf73d525087" } modify_external_catalogs: true
I20260620 07:01:08.896052 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82020156f3e44a1e84a9435d1f994124" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:08.909210 1806 raft_consensus.cc:482] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.909842 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 581573cafab14ac79ff7ad19da0580b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.910097 715 tablet_service.cc:1467] Processing CreateTablet for tablet 1e3d4ea81afe43a2a6101e21cbd08f97 (DEFAULT_TABLE table=default.Table_1254e74518114bba933f842f6e7c7bac [id=82caaec7e8a94dd9b1031d22e30d5117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.913789 718 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa92aae55ef4527a1e8f98945e1e833 (DEFAULT_TABLE table=default.Table_305a2709be0040bda9f3552349b9ce3d [id=eabac0f8560d4df2af6d4ab75e27bb98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.914160 728 tablet_service.cc:1467] Processing CreateTablet for tablet e972b9bef1bd4c19ac0a8c86331dce60 (DEFAULT_TABLE table=default.Table_bf7c7b64562940fc8dc4ba352deea46c [id=7d78d83f2bdd4e678d4efefc73e538a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.915702 719 tablet_service.cc:1467] Processing CreateTablet for tablet 49bea93c06f644fabe2de0df4480dcd7 (DEFAULT_TABLE table=default.Table_1d3a2c1e3d244fe9b0a92d28995c3440 [id=e5f19b54beb1409dac3667797686802d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:08.932978 418 master_service.cc:946] ReplaceTablet: received request to replace tablet b39e682e71ed4776a786f7d30158e7e0 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:08.935263 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 590) took 1430 ms. Trace:
I20260620 07:01:08.935412 1169 rpcz_store.cc:276] 0620 07:01:07.375929 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.375974 (+ 45us) service_pool.cc:227] Handling call
0620 07:01:08.764169 (+1388195us) ts_tablet_manager.cc:1145] Deleting tablet 08ec769f903c4438bc1186d5fc1c5108
0620 07:01:08.784250 (+ 20081us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.806192 (+ 21942us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1384268}
W20260620 07:01:08.936952 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a570e8da585d46839281d606b2f51938 consensus state has no leader
W20260620 07:01:08.943593 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 08ec769f903c4438bc1186d5fc1c5108 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08ec769f903c4438bc1186d5fc1c5108 already in progress: creating tablet
W20260620 07:01:08.946331 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4f77b677ab34d9b8554de0da6564fb1 consensus state has no leader
I20260620 07:01:08.955276 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 592) took 1558 ms. Trace:
I20260620 07:01:08.955417 1169 rpcz_store.cc:276] 0620 07:01:07.377139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.377184 (+ 45us) service_pool.cc:227] Handling call
0620 07:01:08.935779 (+1558595us) ts_tablet_manager.cc:1145] Deleting tablet 3d9da1b03aae4cd9976109291ea43b4e
0620 07:01:08.935793 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.935907 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1496525}
W20260620 07:01:08.956542 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3d9da1b03aae4cd9976109291ea43b4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d9da1b03aae4cd9976109291ea43b4e already in progress: creating tablet
W20260620 07:01:08.961241 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e30fb1d050c4439bb72a21a0f2b13eb consensus state has no leader
I20260620 07:01:08.963748 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 593) took 1516 ms. Trace:
I20260620 07:01:08.964840 1169 rpcz_store.cc:276] 0620 07:01:07.439019 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.439088 (+ 69us) service_pool.cc:227] Handling call
0620 07:01:08.955680 (+1516592us) ts_tablet_manager.cc:1145] Deleting tablet 1d09745353ef46b9b68397f48f391bcd
0620 07:01:08.955690 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.955812 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1516065}
W20260620 07:01:08.965539 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1d09745353ef46b9b68397f48f391bcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d09745353ef46b9b68397f48f391bcd already in progress: creating tablet
W20260620 07:01:08.968390 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 069b271c96ab49d8802ba3ae31c324d0 consensus state has no leader
I20260620 07:01:08.977418 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6d6ee060896c4d3ab31d9cefe862ef44" } modify_external_catalogs: true
I20260620 07:01:08.962554 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 574371fb6915427687df660e733407df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.983948 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a024765ed144281a81db3b75cd271bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.984004 717 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e30385ed44c7f8b7db868f2e2bc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.983945 1917 raft_consensus.cc:482] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.984273 752 raft_consensus.cc:2454] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:08.984683 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 95ba8444d70342f781bd84edefbca71f with delete_type TABLET_DATA_DELETED (replaced by tablet 5db563ce7027457fa0185ef94f3c05b5) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.984753 1170 tablet_bootstrap.cc:492] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:08.984984 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 594) took 1438 ms. Trace:
I20260620 07:01:08.984297 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd53657848a4ab291d48956d5778d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.984817 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a34f01ce5d4d5696248dc88802dafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:08.985100 1170 ts_tablet_manager.cc:1397] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.437s user 0.010s sys 0.005s
I20260620 07:01:08.984762 1920 raft_consensus.cc:482] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:08.985775 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 140696dbd9e44a0cbe5d4639110aa580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.985102 1169 rpcz_store.cc:276] 0620 07:01:07.527294 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.527357 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:08.965183 (+1437826us) ts_tablet_manager.cc:1145] Deleting tablet 168fb1666e2c41358213240d34ef9572
0620 07:01:08.965197 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.965320 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1437595}
I20260620 07:01:08.984607 1917 raft_consensus.cc:504] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.986220 1920 raft_consensus.cc:504] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.986959 1800 raft_consensus.cc:504] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.987663 1800 leader_election.cc:288] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:08.988421 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e972b9bef1bd4c19ac0a8c86331dce60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.988384 1170 raft_consensus.cc:348] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.988619 1170 raft_consensus.cc:374] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:08.988754 1170 raft_consensus.cc:729] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:08.989004 1170 consensus_queue.cc:260] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:08.989779 1170 ts_tablet_manager.cc:1428] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:08.990161 1170 tablet_bootstrap.cc:492] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:08.995160 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 168fb1666e2c41358213240d34ef9572 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 168fb1666e2c41358213240d34ef9572 already in progress: creating tablet
I20260620 07:01:08.996083 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 595) took 1385 ms. Trace:
I20260620 07:01:08.996809 1169 rpcz_store.cc:276] 0620 07:01:07.610097 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.610205 (+ 108us) service_pool.cc:227] Handling call
0620 07:01:08.986675 (+1376470us) ts_tablet_manager.cc:1145] Deleting tablet fe3b70b1674e43768b29dea84b09a1a0
0620 07:01:08.986690 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.995519 (+ 8829us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1304450}
I20260620 07:01:08.998103 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 596) took 1314 ms. Trace:
I20260620 07:01:08.998214 1169 rpcz_store.cc:276] 0620 07:01:07.686926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.687147 (+ 221us) service_pool.cc:227] Handling call
0620 07:01:08.997105 (+1309958us) ts_tablet_manager.cc:1145] Deleting tablet 6363d1d9233d4938ba40abff452ed147
0620 07:01:08.997120 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.997213 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1272079}
I20260620 07:01:08.998773 1169 tablet_replica.cc:330] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:08.999013 1169 raft_consensus.cc:2229] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:08.999419 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet fe3b70b1674e43768b29dea84b09a1a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe3b70b1674e43768b29dea84b09a1a0 already in progress: creating tablet
W20260620 07:01:08.999771 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6363d1d9233d4938ba40abff452ed147 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6363d1d9233d4938ba40abff452ed147 already in progress: creating tablet
I20260620 07:01:08.999948 1879 raft_consensus.cc:482] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.000048 1169 raft_consensus.cc:2258] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.000124 1879 raft_consensus.cc:504] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.000846 1879 leader_election.cc:288] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:09.001479 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e3d4ea81afe43a2a6101e21cbd08f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:08.978048 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6d6ee060896c4d3ab31d9cefe862ef44" } modify_external_catalogs: true
I20260620 07:01:09.003628 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4ee5c79e2a6419ea3847cbebdeced79" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.004735 1165 ts_tablet_manager.cc:1918] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:09.004861 1165 log.cc:1196] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/d15ea9529afe40b6b4a702035479aef3
I20260620 07:01:09.005155 1165 ts_tablet_manager.cc:1939] T d15ea9529afe40b6b4a702035479aef3 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:09.005789 1165 tablet_replica.cc:330] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:09.006047 1165 raft_consensus.cc:2229] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:09.006035 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet d15ea9529afe40b6b4a702035479aef3 (table default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]) successfully deleted
I20260620 07:01:09.006215 1165 raft_consensus.cc:2258] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.006757 1165 ts_tablet_manager.cc:1905] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:09.015864 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9e96d0c1bbb4468b8017ab5c1cbdbd19" } new_table_name: "default.Table_473db1503a4346f39f7a647f8c55ff3c" modify_external_catalogs: true
I20260620 07:01:09.016306 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0994a329d6c54dc7821fa869e23756f1" } modify_external_catalogs: true
I20260620 07:01:09.016487 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0994a329d6c54dc7821fa869e23756f1" } modify_external_catalogs: true
I20260620 07:01:09.017486 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_315a6e60255641079c24df8d2bc90df4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.018069 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_315a6e60255641079c24df8d2bc90df4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.019678 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c7e0c2dc28504b13aeb390e85111eb8b" } modify_external_catalogs: true
I20260620 07:01:09.019888 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c7e0c2dc28504b13aeb390e85111eb8b" } modify_external_catalogs: true
I20260620 07:01:09.020854 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3beace102a7e4806ad2bb54d4e46dea9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.021445 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3beace102a7e4806ad2bb54d4e46dea9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.025384 420 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet c83a5455331945818d2c37f1a80bf4f0
I20260620 07:01:09.025810 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d7959a3e4df54745953dd46f404ae841"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.026372 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7959a3e4df54745953dd46f404ae841 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.027509 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 574371fb6915427687df660e733407df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:09.027779 969 leader_election.cc:341] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 360880717af145628606b5b9fb26e350
W20260620 07:01:09.027931 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 194630us
I20260620 07:01:09.029014 999 tablet_service.cc:1467] Processing CreateTablet for tablet 140696dbd9e44a0cbe5d4639110aa580 (DEFAULT_TABLE table=default.Table_2c6ec989fb644883b60b35937533a489 [id=4573ff60adda4e508c06e281746fb46a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.029578 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6dca84adc5940e5a5505378e7276731 consensus state has no leader
I20260620 07:01:09.029958 1169 ts_tablet_manager.cc:1905] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:09.030073 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 80138f3919f34d5d8163fdfc89d5c52b (DEFAULT_TABLE table=default.Table_186656f8bbdd43ad8e66efcc62300631 [id=ce0deb98b494489e8bbfa73de8d32b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.030725 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82283b45f0cd438ebec4b0d75735d40a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.030769 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 333) took 6644 ms. Trace:
I20260620 07:01:09.030896 1166 rpcz_store.cc:276] 0620 07:01:02.196846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.412281 (+215435us) service_pool.cc:227] Handling call
0620 07:01:08.686869 (+6274588us) ts_tablet_manager.cc:1145] Deleting tablet cb26f1d10f9a4978b41afbd8894f1102
0620 07:01:08.686882 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:08.728206 (+ 41324us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.742838 (+ 14632us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:08.841524 (+ 98686us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6274273}
I20260620 07:01:09.031514 1166 tablet_replica.cc:330] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:09.031704 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dad7e6437ab4328b9b88d5e6febe8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.031729 1166 raft_consensus.cc:2229] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:09.036429 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49bea93c06f644fabe2de0df4480dcd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.036783 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80138f3919f34d5d8163fdfc89d5c52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.036969 968 leader_election.cc:302] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.037406 1806 raft_consensus.cc:504] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.038383 1806 leader_election.cc:288] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:09.038623 1806 raft_consensus.cc:482] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.038844 1806 raft_consensus.cc:504] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.039589 1806 leader_election.cc:288] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:09.040073 1750 raft_consensus.cc:504] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.040377 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 140696dbd9e44a0cbe5d4639110aa580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.040881 1750 leader_election.cc:288] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:09.041105 1750 raft_consensus.cc:2726] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.041499 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14be3e06a9774ac0bada93bcfa4eddf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.043027 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd53657848a4ab291d48956d5778d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.043588 1925 raft_consensus.cc:482] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.043768 1925 raft_consensus.cc:504] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.043953 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "168fb1666e2c41358213240d34ef9572" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:09.045092 830 leader_election.cc:341] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.046041 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b98711dfb114a2985c5153e9b44147a" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:09.046603 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c64df83a18a470c98a9c1fd6bb38918" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:09.046819 1030 raft_consensus.cc:3037] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:09.047044 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c11f2678559c41d3bc71d4fa04efd0ac" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:09.048146 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet cb26f1d10f9a4978b41afbd8894f1102 (table default.Table_622b45b592db43659f3fb16e236d0fb3 [id=b1edb1d369d341b4bd7aa4a9b1fcdea8]) successfully deleted
W20260620 07:01:09.051460 830 leader_election.cc:341] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:09.051728 830 leader_election.cc:341] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.060075 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d5fc8ec0b1424625b98c20f4b8b78249"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.060812 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5fc8ec0b1424625b98c20f4b8b78249 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.067566 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_40893b674e3c45f897680cef510a227d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.068344 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40893b674e3c45f897680cef510a227d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.081040 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 96453f82ff3048beabeb188fb27dee42 (table default.Table_7e1bd0d27961486986559381614efd38 [id=7c6337d452d64674bd95e1738caa4345]). Expected version 2 got 0
I20260620 07:01:09.081069 874 tablet_service.cc:1467] Processing CreateTablet for tablet 5672e784e8b14e2bb540a68b0ee991ed (DEFAULT_TABLE table=default.Table_4e24db178c47408ea6e773cebddc3ddf [id=4cd416dd1bd94106a6e9df4074a1dbee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.081364 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet c11f2678559c41d3bc71d4fa04efd0ac (table default.Table_c74dcab9083d4b6f894cee0e428ad089 [id=9b7cbb1400d7413ca5debb997aeade9c]). Expected version 2 got 0
I20260620 07:01:09.081533 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5672e784e8b14e2bb540a68b0ee991ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.081596 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 1c64df83a18a470c98a9c1fd6bb38918 (table default.Table_b4024ad63b56439d939324ae131affe6 [id=4896f23e711941b988db4ea9f22ce625]). Expected version 2 got 0
I20260620 07:01:09.083660 857 tablet_service.cc:1467] Processing CreateTablet for tablet ea60cd6f33e94d3a94d3e7b1d7e31ffb (DEFAULT_TABLE table=default.Table_a7969001e9164dd9a0a8dcd51f7ae54f [id=9f94c4588848468bbafb534f8a1df6ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.084120 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea60cd6f33e94d3a94d3e7b1d7e31ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.085403 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c17256b58e4540fca63f3c14356e0d27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.086136 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c17256b58e4540fca63f3c14356e0d27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.086532 862 tablet_service.cc:1514] Processing DeleteTablet for tablet b4ee5c79e2a6419ea3847cbebdeced79 with delete_type TABLET_DATA_DELETED (replaced by tablet 63525282e222490687713a92e5371a5c) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.086984 865 tablet_service.cc:1467] Processing CreateTablet for tablet b6a69679d033433cb541bba7ebda282c (DEFAULT_TABLE table=default.Table_d8ddf3cd80a941f1adc86a978bb18f6b [id=14d0e2cf608e48d2bfd1e00faf69ba08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.087365 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a69679d033433cb541bba7ebda282c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.090523 872 tablet_service.cc:1467] Processing CreateTablet for tablet 5db563ce7027457fa0185ef94f3c05b5 (DEFAULT_TABLE table=default.Table_703c2ae2881649669e2d23335bf7d54c [id=2943ebfc86e54b75a06a5727fdcc6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.090935 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 168fb1666e2c41358213240d34ef9572 with delete_type TABLET_DATA_DELETED (replaced by tablet 8dad7e6437ab4328b9b88d5e6febe8a0) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.091166 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 46689d13712842bf9145ad2bc3fc2acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.091490 859 tablet_service.cc:1467] Processing CreateTablet for tablet 30a29b251bfd419c93e0e2dac8693937 (DEFAULT_TABLE table=default.Table_4041cd9b1bdd4a96ad17ef5a4130d238 [id=64f83a14aa534f9a8b485268c7e037cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.091914 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30a29b251bfd419c93e0e2dac8693937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.092662 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
I20260620 07:01:09.094225 858 tablet_service.cc:1467] Processing CreateTablet for tablet a27cd904d9cb4e1b8e7d0e42fca9a1d6 (DEFAULT_TABLE table=default.Table_9116a47663d0429ca822aa70b4b56736 [id=46704d98158f425b9c9811fd35dab282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.094627 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a27cd904d9cb4e1b8e7d0e42fca9a1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.094915 871 tablet_service.cc:1514] Processing DeleteTablet for tablet f8ec1e179a704e5480f3deaf856156e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c7f0513df34ddb8104b06e5733fb62) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.095188 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 8088fadabff64c35aa96a1ede17318c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.098505 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db563ce7027457fa0185ef94f3c05b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.099474 865 tablet_service.cc:1467] Processing CreateTablet for tablet b53304f072cb4a00a17de5df6f59168b (DEFAULT_TABLE table=default.Table_e8cbdbd27e8345578bf36803fa9777b4 [id=4aeafcb7edb447b494b26e1bafd78479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.099864 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b53304f072cb4a00a17de5df6f59168b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.102456 862 tablet_service.cc:1467] Processing CreateTablet for tablet ed042bdf10a2453eab5175f21d1184c1 (DEFAULT_TABLE table=default.Table_acc2e2a41f234841944aefbc998c1680 [id=af10c4d2a07c4903b72cd142200e6ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.102612 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_10542cf0587b4b6ea42cbafd00564c37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:09.102941 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed042bdf10a2453eab5175f21d1184c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:09.103317 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10542cf0587b4b6ea42cbafd00564c37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.117103 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0e30fb1d050c4439bb72a21a0f2b13eb
I20260620 07:01:09.117654 424 catalog_manager.cc:6565] ReplaceTablet: tablet 0e30fb1d050c4439bb72a21a0f2b13eb deleted and replaced by tablet 9cebdd8c947845528affd32316d9b336
I20260620 07:01:09.118497 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ade72c04813c4285bb87ba905a586546"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.119230 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ade72c04813c4285bb87ba905a586546 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.119946 860 tablet_service.cc:1467] Processing CreateTablet for tablet a4c9a581bf1f453c91424ca87081fc1a (DEFAULT_TABLE table=default.Table_bf84c66d36b34388bbe83868fb2953f6 [id=1e67a91503bd45f89fee39962eec7076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.120770 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb with delete_type TABLET_DATA_DELETED (replaced by tablet 9cebdd8c947845528affd32316d9b336) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.123099 872 tablet_service.cc:1467] Processing CreateTablet for tablet 6bec9e0a971440c8ae81d4e2271d6da6 (DEFAULT_TABLE table=default.Table_692cd4b8d66445a1aa9ced6df517c5f5 [id=2d56bbf5a1ab44af8f43f1056223c3e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.124109 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4c9a581bf1f453c91424ca87081fc1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.124339 1167 ts_tablet_manager.cc:1428] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:09.124380 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bec9e0a971440c8ae81d4e2271d6da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.124042 874 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd4539155d74bd082a0ce934e3126c5 (DEFAULT_TABLE table=default.Table_59b0b7d236ea417689758568dbc1e467 [id=a8b4ab20e5224c5693ec03cfd00232bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.124939 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd4539155d74bd082a0ce934e3126c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.126070 858 tablet_service.cc:1467] Processing CreateTablet for tablet bcdb23f67ac2402b9471748d98b8dae9 (DEFAULT_TABLE table=default.Table_1489f6b875284b46aa9ea05d1b2dfbd7 [id=d796beb9852f435ea31745e8c37c25b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.126386 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcdb23f67ac2402b9471748d98b8dae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.141718 865 tablet_service.cc:1467] Processing CreateTablet for tablet a201a40f85af4542b0e20dd7d38901bb (DEFAULT_TABLE table=default.Table_d1317e297da54e3794bdefbfeedea221 [id=5d6b6f5f3c8b41298577096af2f77c78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.142124 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a201a40f85af4542b0e20dd7d38901bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.146131 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2859db39c7dd486f9ad7e3b5f84927fa
W20260620 07:01:09.147354 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3dba2e33592f43a7867756a8b93b3a75 (table default.Table_80461b90cd2b4ddb863570b10b593012 [id=884365bae3b04a509968aa55e38b6335], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3dba2e33592f43a7867756a8b93b3a75 consensus state has no leader
I20260620 07:01:09.148082 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3a8d48f0f9dd4911876ec8f812688439
I20260620 07:01:09.148816 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3e9f0dba4466436f9cfc730d7d6b15fe
I20260620 07:01:09.156618 425 master_service.cc:946] ReplaceTablet: received request to replace tablet a570e8da585d46839281d606b2f51938 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:09.157253 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 2859db39c7dd486f9ad7e3b5f84927fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.158033 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.158579 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e9f0dba4466436f9cfc730d7d6b15fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.162871 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c64df83a18a470c98a9c1fd6bb38918" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.163439 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49bea93c06f644fabe2de0df4480dcd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.180303 872 tablet_service.cc:1514] Processing DeleteTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:09.180328 831 leader_election.cc:341] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.180501 831 leader_election.cc:302] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:09.180876 1879 raft_consensus.cc:2726] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.181272 831 leader_election.cc:302] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
W20260620 07:01:09.181663 831 raft_consensus.cc:2670] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:09.181921 831 leader_election.cc:341] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:09.182196 831 leader_election.cc:341] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.182335 831 leader_election.cc:302] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:09.182571 1879 raft_consensus.cc:2726] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.183255 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5919c99f3324f7ba52c72e91b35afaf" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:09.183455 892 raft_consensus.cc:3037] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:09.187211 892 raft_consensus.cc:2454] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:09.189560 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c121378eeebe452b9a4278fd21fba088" } new_table_name: "default.Table_162437373a6643e0b0c86bae5698a6ce" modify_external_catalogs: true
I20260620 07:01:09.191087 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0f0fb9d00a3343ffa74ad89bd28dc251"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.191656 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f0fb9d00a3343ffa74ad89bd28dc251 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.192253 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_23b632bb60cf401e8b3ecafcb4065636" } new_table_name: "default.Table_f1abb9b767ea4a9b9c8f3c8b03e0d1ec" modify_external_catalogs: true
I20260620 07:01:09.192723 1167 tablet_bootstrap.cc:492] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:09.193174 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5712ee2764bf41dcbd0cc6bd497d6e42" } new_table_name: "default.Table_6dfde630dd92495c9361a2117d78dd7c" modify_external_catalogs: true
I20260620 07:01:09.193236 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fcf0a9375d5a47feb43a24d647b72f8c" } new_table_name: "default.Table_fcb02cf6b9ed4de5b759604ce94f822f" modify_external_catalogs: true
I20260620 07:01:09.193917 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_02c16a393d864b6d9ca2890d79bdff69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.194559 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02c16a393d864b6d9ca2890d79bdff69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.195492 1166 raft_consensus.cc:2258] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.196180 1166 ts_tablet_manager.cc:1905] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:09.196399 1925 leader_election.cc:288] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:09.196419 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82020156f3e44a1e84a9435d1f994124" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:09.196815 1028 raft_consensus.cc:2454] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:09.196434 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4ee5c79e2a6419ea3847cbebdeced79" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:09.196485 969 leader_election.cc:341] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7fc63351f767447c99b819fe7848d381
W20260620 07:01:09.197510 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 146350us
W20260620 07:01:09.197777 969 leader_election.cc:341] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 95f9a6b2f2cb41e6b74715b2618d8a70
W20260620 07:01:09.197957 969 leader_election.cc:341] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 076926f7dffe4a7b80c25ea3c18e9958
I20260620 07:01:09.199891 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 5672e784e8b14e2bb540a68b0ee991ed (DEFAULT_TABLE table=default.Table_4e24db178c47408ea6e773cebddc3ddf [id=4cd416dd1bd94106a6e9df4074a1dbee]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.200464 830 leader_election.cc:341] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.200574 830 leader_election.cc:302] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:09.200793 1010 tablet_service.cc:1467] Processing CreateTablet for tablet ea60cd6f33e94d3a94d3e7b1d7e31ffb (DEFAULT_TABLE table=default.Table_a7969001e9164dd9a0a8dcd51f7ae54f [id=9f94c4588848468bbafb534f8a1df6ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.201582 995 tablet_service.cc:1467] Processing CreateTablet for tablet 30a29b251bfd419c93e0e2dac8693937 (DEFAULT_TABLE table=default.Table_4041cd9b1bdd4a96ad17ef5a4130d238 [id=64f83a14aa534f9a8b485268c7e037cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.201900 1004 tablet_service.cc:1467] Processing CreateTablet for tablet b53304f072cb4a00a17de5df6f59168b (DEFAULT_TABLE table=default.Table_e8cbdbd27e8345578bf36803fa9777b4 [id=4aeafcb7edb447b494b26e1bafd78479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.202544 1001 tablet_service.cc:1467] Processing CreateTablet for tablet b6a69679d033433cb541bba7ebda282c (DEFAULT_TABLE table=default.Table_d8ddf3cd80a941f1adc86a978bb18f6b [id=14d0e2cf608e48d2bfd1e00faf69ba08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.203104 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb with delete_type TABLET_DATA_DELETED (replaced by tablet 9cebdd8c947845528affd32316d9b336) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.203486 1006 tablet_service.cc:1467] Processing CreateTablet for tablet bcdb23f67ac2402b9471748d98b8dae9 (DEFAULT_TABLE table=default.Table_1489f6b875284b46aa9ea05d1b2dfbd7 [id=d796beb9852f435ea31745e8c37c25b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.204234 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd4539155d74bd082a0ce934e3126c5 (DEFAULT_TABLE table=default.Table_59b0b7d236ea417689758568dbc1e467 [id=a8b4ab20e5224c5693ec03cfd00232bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.205283 994 tablet_service.cc:1467] Processing CreateTablet for tablet 6bec9e0a971440c8ae81d4e2271d6da6 (DEFAULT_TABLE table=default.Table_692cd4b8d66445a1aa9ced6df517c5f5 [id=2d56bbf5a1ab44af8f43f1056223c3e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.205698 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e9f0dba4466436f9cfc730d7d6b15fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.205799 1002 tablet_service.cc:1467] Processing CreateTablet for tablet a201a40f85af4542b0e20dd7d38901bb (DEFAULT_TABLE table=default.Table_d1317e297da54e3794bdefbfeedea221 [id=5d6b6f5f3c8b41298577096af2f77c78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.206178 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 2859db39c7dd486f9ad7e3b5f84927fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.206259 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.206154 998 tablet_service.cc:1467] Processing CreateTablet for tablet ed042bdf10a2453eab5175f21d1184c1 (DEFAULT_TABLE table=default.Table_acc2e2a41f234841944aefbc998c1680 [id=af10c4d2a07c4903b72cd142200e6ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.206629 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8088fadabff64c35aa96a1ede17318c3" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:09.207037 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e07325dc3f649aca9c5fc21c47d360f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.207284 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a201a40f85af4542b0e20dd7d38901bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.207484 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd4539155d74bd082a0ce934e3126c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.207967 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bec9e0a971440c8ae81d4e2271d6da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.210937 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b53304f072cb4a00a17de5df6f59168b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.211194 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcdb23f67ac2402b9471748d98b8dae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.214712 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed042bdf10a2453eab5175f21d1184c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.227007 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea60cd6f33e94d3a94d3e7b1d7e31ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.230279 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5672e784e8b14e2bb540a68b0ee991ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.234422 999 tablet_service.cc:1467] Processing CreateTablet for tablet a4c9a581bf1f453c91424ca87081fc1a (DEFAULT_TABLE table=default.Table_bf84c66d36b34388bbe83868fb2953f6 [id=1e67a91503bd45f89fee39962eec7076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.235260 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4c9a581bf1f453c91424ca87081fc1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.200795 1879 consensus_queue.cc:1035] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260620 07:01:09.240125 1879 raft_consensus.cc:2726] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.240293 1879 raft_consensus.cc:482] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.240373 1879 raft_consensus.cc:504] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.245535 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30a29b251bfd419c93e0e2dac8693937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.252790 1168 tablet_bootstrap.cc:492] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:09.252707 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a69679d033433cb541bba7ebda282c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.252944 1168 ts_tablet_manager.cc:1397] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.381s user 0.003s sys 0.032s
I20260620 07:01:09.254662 1879 leader_election.cc:288] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:09.254850 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 5db563ce7027457fa0185ef94f3c05b5 (DEFAULT_TABLE table=default.Table_703c2ae2881649669e2d23335bf7d54c [id=2943ebfc86e54b75a06a5727fdcc6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.272892 1008 tablet_service.cc:1467] Processing CreateTablet for tablet a27cd904d9cb4e1b8e7d0e42fca9a1d6 (DEFAULT_TABLE table=default.Table_9116a47663d0429ca822aa70b4b56736 [id=46704d98158f425b9c9811fd35dab282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.274623 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db563ce7027457fa0185ef94f3c05b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.282779 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a27cd904d9cb4e1b8e7d0e42fca9a1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.286159 1168 raft_consensus.cc:348] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.286407 1168 raft_consensus.cc:374] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:09.286468 1168 raft_consensus.cc:729] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:09.286686 1168 consensus_queue.cc:260] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.287528 1168 ts_tablet_manager.cc:1428] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.035s user 0.000s sys 0.002s
I20260620 07:01:09.303622 1170 tablet_bootstrap.cc:654] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:09.305678 726 tablet_service.cc:1467] Processing CreateTablet for tablet a4c9a581bf1f453c91424ca87081fc1a (DEFAULT_TABLE table=default.Table_bf84c66d36b34388bbe83868fb2953f6 [id=1e67a91503bd45f89fee39962eec7076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.179255 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8088fadabff64c35aa96a1ede17318c3" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.310985 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c11f2678559c41d3bc71d4fa04efd0ac" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.322686 724 tablet_service.cc:1467] Processing CreateTablet for tablet 5672e784e8b14e2bb540a68b0ee991ed (DEFAULT_TABLE table=default.Table_4e24db178c47408ea6e773cebddc3ddf [id=4cd416dd1bd94106a6e9df4074a1dbee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.324343 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80138f3919f34d5d8163fdfc89d5c52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.325039 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d05a505f73b24e0ba7159a3d411e5f4f
I20260620 07:01:09.325750 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a570e8da585d46839281d606b2f51938
I20260620 07:01:09.326287 425 catalog_manager.cc:6565] ReplaceTablet: tablet a570e8da585d46839281d606b2f51938 deleted and replaced by tablet 02584f8ac08f4759a5f9a5aa699d0039
W20260620 07:01:09.326673 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba189cfcef094a7bb45bc7d5f4ee5b71 consensus state has no leader
W20260620 07:01:09.327294 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f733e2ee8da488d81ab0478e9a0bd79 consensus state has no leader
W20260620 07:01:09.328493 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71977c69b29143eebfcc8ece39daf78e consensus state has no leader
W20260620 07:01:09.331622 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 445410us
I20260620 07:01:09.335482 1168 tablet_bootstrap.cc:492] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:09.335500 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5883a8466d0c4e45aba3b4095ced91a4 consensus state has no leader
I20260620 07:01:09.339360 1916 raft_consensus.cc:482] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.341709 722 tablet_service.cc:1467] Processing CreateTablet for tablet a27cd904d9cb4e1b8e7d0e42fca9a1d6 (DEFAULT_TABLE table=default.Table_9116a47663d0429ca822aa70b4b56736 [id=46704d98158f425b9c9811fd35dab282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.343549 1920 leader_election.cc:288] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:09.343750 730 tablet_service.cc:1467] Processing CreateTablet for tablet 30a29b251bfd419c93e0e2dac8693937 (DEFAULT_TABLE table=default.Table_4041cd9b1bdd4a96ad17ef5a4130d238 [id=64f83a14aa534f9a8b485268c7e037cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.332661 994 tablet_service.cc:1514] Processing DeleteTablet for tablet d05a505f73b24e0ba7159a3d411e5f4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.342940 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet a570e8da585d46839281d606b2f51938 with delete_type TABLET_DATA_DELETED (replaced by tablet 02584f8ac08f4759a5f9a5aa699d0039) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.345667 1917 leader_election.cc:288] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:09.345669 860 tablet_service.cc:1514] Processing DeleteTablet for tablet d05a505f73b24e0ba7159a3d411e5f4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.345960 1929 tablet.cc:1722] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:09.347011 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b98711dfb114a2985c5153e9b44147a" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.349628 874 tablet_service.cc:1514] Processing DeleteTablet for tablet a570e8da585d46839281d606b2f51938 with delete_type TABLET_DATA_DELETED (replaced by tablet 02584f8ac08f4759a5f9a5aa699d0039) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.349669 683 leader_election.cc:302] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:09.350020 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb with delete_type TABLET_DATA_DELETED (replaced by tablet 9cebdd8c947845528affd32316d9b336) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:09.350147 717 tablet_service.cc:1467] Processing CreateTablet for tablet ed042bdf10a2453eab5175f21d1184c1 (DEFAULT_TABLE table=default.Table_acc2e2a41f234841944aefbc998c1680 [id=af10c4d2a07c4903b72cd142200e6ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.350399 720 tablet_service.cc:1467] Processing CreateTablet for tablet b53304f072cb4a00a17de5df6f59168b (DEFAULT_TABLE table=default.Table_e8cbdbd27e8345578bf36803fa9777b4 [id=4aeafcb7edb447b494b26e1bafd78479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.349993 728 tablet_service.cc:1467] Processing CreateTablet for tablet b6a69679d033433cb541bba7ebda282c (DEFAULT_TABLE table=default.Table_d8ddf3cd80a941f1adc86a978bb18f6b [id=14d0e2cf608e48d2bfd1e00faf69ba08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.349550 731 tablet_service.cc:1467] Processing CreateTablet for tablet 5db563ce7027457fa0185ef94f3c05b5 (DEFAULT_TABLE table=default.Table_703c2ae2881649669e2d23335bf7d54c [id=2943ebfc86e54b75a06a5727fdcc6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.352348 723 tablet_service.cc:1467] Processing CreateTablet for tablet ea60cd6f33e94d3a94d3e7b1d7e31ffb (DEFAULT_TABLE table=default.Table_a7969001e9164dd9a0a8dcd51f7ae54f [id=9f94c4588848468bbafb534f8a1df6ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.352705 1917 raft_consensus.cc:2781] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:09.354001 1166 ts_tablet_manager.cc:1918] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:09.353354 1917 raft_consensus.cc:686] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:09.354697 1917 consensus_queue.cc:237] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:09.355813 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 156598us
W20260620 07:01:09.356604 831 leader_election.cc:341] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:09.356859 831 leader_election.cc:341] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.356950 831 leader_election.cc:302] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:09.357209 1879 raft_consensus.cc:2726] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.357574 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82020156f3e44a1e84a9435d1f994124" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:09.365585 721 tablet_service.cc:1467] Processing CreateTablet for tablet bcdb23f67ac2402b9471748d98b8dae9 (DEFAULT_TABLE table=default.Table_1489f6b875284b46aa9ea05d1b2dfbd7 [id=d796beb9852f435ea31745e8c37c25b2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.365664 749 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.542s user 0.018s sys 0.044s
I20260620 07:01:09.366843 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5672e784e8b14e2bb540a68b0ee991ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.367426 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a27cd904d9cb4e1b8e7d0e42fca9a1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.348604 1916 raft_consensus.cc:504] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.377624 1165 ts_tablet_manager.cc:1918] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:09.381898 725 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd4539155d74bd082a0ce934e3126c5 (DEFAULT_TABLE table=default.Table_59b0b7d236ea417689758568dbc1e467 [id=a8b4ab20e5224c5693ec03cfd00232bb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.379287 749 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.565s user 0.018s sys 0.045s
I20260620 07:01:09.402057 1879 raft_consensus.cc:482] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.403565 1165 log.cc:1196] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/82020156f3e44a1e84a9435d1f994124
I20260620 07:01:09.405948 1165 ts_tablet_manager.cc:1939] T 82020156f3e44a1e84a9435d1f994124 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:09.406663 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 82020156f3e44a1e84a9435d1f994124 (table default.Table_136e581f613845f79105f13229d93e06 [id=e3117c7c078044e9872c3c7e880aed79]) successfully deleted
I20260620 07:01:09.417346 1916 leader_election.cc:288] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:09.417408 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96453f82ff3048beabeb188fb27dee42" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.373649 1166 log.cc:1196] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/9e643fb0890042ae891ea17f0bc03740
I20260620 07:01:09.420317 1830 raft_consensus.cc:482] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.424901 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5919c99f3324f7ba52c72e91b35afaf" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:09.429193 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14be3e06a9774ac0bada93bcfa4eddf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.432410 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e07325dc3f649aca9c5fc21c47d360f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.432812 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcdb23f67ac2402b9471748d98b8dae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.433573 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82020156f3e44a1e84a9435d1f994124" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:09.408185 1168 tablet_bootstrap.cc:654] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:09.406968 1165 tablet_replica.cc:330] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:09.435137 1165 raft_consensus.cc:2229] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:09.435772 1165 pending_rounds.cc:62] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:09.435861 1165 pending_rounds.cc:68] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821605289885696 op_type: NO_OP noop_request { }
I20260620 07:01:09.436151 1165 raft_consensus.cc:2866] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:09.407526 1879 raft_consensus.cc:504] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.437817 1879 leader_election.cc:288] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:09.438244 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 237768us
I20260620 07:01:09.438501 1167 tablet_bootstrap.cc:700] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9: Time spent opening tablet: real 0.103s user 0.002s sys 0.000s
W20260620 07:01:09.439330 754 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s user 0.006s sys 0.005s
I20260620 07:01:09.439563 1029 raft_consensus.cc:2454] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:09.439594 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da1e30385ed44c7f8b7db868f2e2bc29" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:09.439886 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5757e05e9a2403a86ca98f455e11754" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:09.440285 968 leader_election.cc:341] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 360880717af145628606b5b9fb26e350
I20260620 07:01:09.440470 968 leader_election.cc:302] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.440819 1806 raft_consensus.cc:2726] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:09.441363 968 leader_election.cc:341] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 95f9a6b2f2cb41e6b74715b2618d8a70
I20260620 07:01:09.441557 968 leader_election.cc:302] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.441838 1806 raft_consensus.cc:2726] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:09.442184 968 leader_election.cc:341] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 076926f7dffe4a7b80c25ea3c18e9958
I20260620 07:01:09.442340 968 leader_election.cc:302] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.442576 1806 raft_consensus.cc:2726] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.443588 968 leader_election.cc:302] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.443959 1806 raft_consensus.cc:2726] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:09.444300 968 leader_election.cc:341] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 7fc63351f767447c99b819fe7848d381
I20260620 07:01:09.444584 968 leader_election.cc:302] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.445207 1806 raft_consensus.cc:2726] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:09.446897 754 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s user 0.006s sys 0.005s
I20260620 07:01:09.441461 1830 raft_consensus.cc:504] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:09.447314 681 leader_election.cc:341] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.448004 1830 leader_election.cc:288] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:09.436367 1165 raft_consensus.cc:2258] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.457293 1165 ts_tablet_manager.cc:1905] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:09.469007 681 leader_election.cc:302] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:09.469485 1167 tablet_bootstrap.cc:654] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:09.469460 681 leader_election.cc:341] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.469676 1916 raft_consensus.cc:2781] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:09.469813 1916 raft_consensus.cc:482] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:09.469914 1916 raft_consensus.cc:3037] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:09.477599 681 leader_election.cc:341] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.478050 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed042bdf10a2453eab5175f21d1184c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.479554 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd4539155d74bd082a0ce934e3126c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.481052 732 tablet_service.cc:1467] Processing CreateTablet for tablet 6bec9e0a971440c8ae81d4e2271d6da6 (DEFAULT_TABLE table=default.Table_692cd4b8d66445a1aa9ced6df517c5f5 [id=2d56bbf5a1ab44af8f43f1056223c3e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.482126 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea60cd6f33e94d3a94d3e7b1d7e31ffb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:09.491962 831 leader_election.cc:341] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.493201 1166 ts_tablet_manager.cc:1939] T 9e643fb0890042ae891ea17f0bc03740 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:09.494294 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 335) took 7286 ms. Trace:
I20260620 07:01:09.494464 1166 rpcz_store.cc:276] 0620 07:01:02.208231 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.415365 (+207134us) service_pool.cc:227] Handling call
0620 07:01:09.031411 (+6616046us) ts_tablet_manager.cc:1145] Deleting tablet 9e643fb0890042ae891ea17f0bc03740
0620 07:01:09.031425 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:09.218255 (+186830us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:09.302994 (+ 84739us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:09.494236 (+191242us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6615764}
I20260620 07:01:09.495152 1166 tablet_replica.cc:330] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:09.495440 1166 raft_consensus.cc:2229] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:09.495548 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 9e643fb0890042ae891ea17f0bc03740 (table default.Table_ddfa02b01d2248a188748eda117387da [id=65b5bbb9004b4c28b8233868e05c293a]) successfully deleted
I20260620 07:01:09.495770 1166 raft_consensus.cc:2258] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.496057 1936 raft_consensus.cc:482] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.496230 1936 raft_consensus.cc:504] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.497287 1936 leader_election.cc:288] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:09.497682 413 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.61:33455, user_credentials={real_user=slave}} blocked reactor thread for 273965us
I20260620 07:01:09.498023 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96453f82ff3048beabeb188fb27dee42" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:09.498175 830 leader_election.cc:341] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.498289 830 leader_election.cc:302] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:09.499665 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46689d13712842bf9145ad2bc3fc2acf" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:09.500519 830 leader_election.cc:341] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.500638 830 leader_election.cc:302] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:09.501071 1935 raft_consensus.cc:2726] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:09.501379 969 leader_election.cc:341] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d15ea9529afe40b6b4a702035479aef3
W20260620 07:01:09.501753 969 consensus_peers.cc:487] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d066c73ae0104cb3be792790b1dfb93d. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:09.502300 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a292d66ee14a48959c1f6a63e0a0f492" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:09.509295 1943 tablet.cc:1722] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:09.514457 1167 tablet_bootstrap.cc:492] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:09.516112 1168 tablet_bootstrap.cc:492] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:09.516335 1167 ts_tablet_manager.cc:1397] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.391s user 0.006s sys 0.001s
I20260620 07:01:09.516537 1168 ts_tablet_manager.cc:1397] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.224s user 0.010s sys 0.004s
I20260620 07:01:09.517835 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b53304f072cb4a00a17de5df6f59168b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:09.518059 830 leader_election.cc:341] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.518970 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa92aae55ef4527a1e8f98945e1e833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.518937 1167 raft_consensus.cc:348] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.519212 1167 raft_consensus.cc:374] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:09.519306 1167 raft_consensus.cc:729] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
W20260620 07:01:09.519660 830 leader_election.cc:341] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.522944 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a69679d033433cb541bba7ebda282c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.523183 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bec9e0a971440c8ae81d4e2271d6da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.535954 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30a29b251bfd419c93e0e2dac8693937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.535238 1167 consensus_queue.cc:260] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.542491 1168 raft_consensus.cc:348] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.542799 1168 raft_consensus.cc:374] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:09.542866 1168 raft_consensus.cc:729] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:09.543114 1168 consensus_queue.cc:260] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.543736 1168 ts_tablet_manager.cc:1428] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260620 07:01:09.548750 1167 ts_tablet_manager.cc:1428] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260620 07:01:09.504189 1935 raft_consensus.cc:2726] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.549820 1165 ts_tablet_manager.cc:1918] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:09.550022 1165 log.cc:1196] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/581573cafab14ac79ff7ad19da0580b4
I20260620 07:01:09.550462 1165 ts_tablet_manager.cc:1939] T 581573cafab14ac79ff7ad19da0580b4 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:09.552009 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d15ea9529afe40b6b4a702035479aef3" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.552544 1165 tablet_replica.cc:330] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:09.552821 1165 raft_consensus.cc:2229] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:09.553021 1165 raft_consensus.cc:2258] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.553082 1167 tablet_bootstrap.cc:492] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:09.559692 1167 tablet_bootstrap.cc:654] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:09.571887 968 leader_election.cc:341] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.571970 1165 ts_tablet_manager.cc:1905] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:09.572124 968 leader_election.cc:302] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.572754 1925 raft_consensus.cc:2726] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.573220 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db563ce7027457fa0185ef94f3c05b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.588728 1167 tablet_bootstrap.cc:492] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:09.589156 1167 ts_tablet_manager.cc:1397] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.006s
I20260620 07:01:09.590831 1167 raft_consensus.cc:348] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.591576 1167 raft_consensus.cc:374] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:09.591797 1167 raft_consensus.cc:729] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:09.592232 1167 consensus_queue.cc:260] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.593158 1167 ts_tablet_manager.cc:1428] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 07:01:09.593930 1167 tablet_bootstrap.cc:492] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:09.555430 1168 tablet_bootstrap.cc:492] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:09.596721 1167 tablet_bootstrap.cc:654] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:09.597543 1168 tablet_bootstrap.cc:654] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:09.599190 1165 ts_tablet_manager.cc:1918] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:09.599455 1165 log.cc:1196] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/b4ee5c79e2a6419ea3847cbebdeced79
I20260620 07:01:09.599931 1165 ts_tablet_manager.cc:1939] T b4ee5c79e2a6419ea3847cbebdeced79 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:09.599954 718 tablet_service.cc:1467] Processing CreateTablet for tablet a201a40f85af4542b0e20dd7d38901bb (DEFAULT_TABLE table=default.Table_d1317e297da54e3794bdefbfeedea221 [id=5d6b6f5f3c8b41298577096af2f77c78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.600378 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4c9a581bf1f453c91424ca87081fc1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.600674 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a201a40f85af4542b0e20dd7d38901bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.601208 1165 tablet_replica.cc:330] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:09.601462 1165 raft_consensus.cc:2229] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:09.601676 1165 raft_consensus.cc:2258] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.602221 1165 ts_tablet_manager.cc:1905] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:09.605556 1939 log.cc:924] Time spent T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
W20260620 07:01:09.610631 1853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 07:01:09.610919 683 leader_election.cc:341] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: Tablet not RUNNING: STOPPED
W20260620 07:01:09.611337 1853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 07:01:09.611569 1853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260620 07:01:09.612157 1166 ts_tablet_manager.cc:1905] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:09.612129 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 2859db39c7dd486f9ad7e3b5f84927fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:09.616460 1167 tablet_bootstrap.cc:492] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:09.618911 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 581573cafab14ac79ff7ad19da0580b4 (table default.Table_52bddb4b77954070ad4efafc2734ea40 [id=8f88c270fabb4c93a3b154ed158ab22b]) successfully deleted
W20260620 07:01:09.619122 414 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 67866.5us
I20260620 07:01:09.619360 1167 ts_tablet_manager.cc:1397] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.004s
I20260620 07:01:09.621579 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e9f0dba4466436f9cfc730d7d6b15fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:09.621631 1167 raft_consensus.cc:348] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.622399 1167 raft_consensus.cc:374] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:09.622836 1167 raft_consensus.cc:729] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:09.623162 1167 consensus_queue.cc:260] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:09.623533 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet cb26f1d10f9a4978b41afbd8894f1102 because the tablet was not found. No further retry: Not found: Tablet not found: cb26f1d10f9a4978b41afbd8894f1102
W20260620 07:01:09.623945 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2004ff6f00a441578b8e702e8c7605fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2004ff6f00a441578b8e702e8c7605fc already in progress: creating tablet
I20260620 07:01:09.624372 1165 ts_tablet_manager.cc:1918] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:09.624481 1165 log.cc:1196] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/168fb1666e2c41358213240d34ef9572
W20260620 07:01:09.624497 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 118702us
I20260620 07:01:09.624773 1165 ts_tablet_manager.cc:1939] T 168fb1666e2c41358213240d34ef9572 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:09.629117 1167 ts_tablet_manager.cc:1428] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
W20260620 07:01:09.629119 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 40d9875dde7b4455b24b053781993234 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40d9875dde7b4455b24b053781993234 already in progress: creating tablet
I20260620 07:01:09.631112 1165 tablet_replica.cc:330] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:09.631407 1165 raft_consensus.cc:2229] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:09.631630 1165 raft_consensus.cc:2258] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.632285 1165 ts_tablet_manager.cc:1905] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:09.634320 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 60ce7d59a97544fda80a54f7124d1dba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60ce7d59a97544fda80a54f7124d1dba already in progress: creating tablet
I20260620 07:01:09.634995 1167 tablet_bootstrap.cc:492] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:09.637910 1167 tablet_bootstrap.cc:654] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:09.636286 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:09.638726 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 95ba8444d70342f781bd84edefbca71f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95ba8444d70342f781bd84edefbca71f already in progress: creating tablet
I20260620 07:01:09.638767 1165 ts_tablet_manager.cc:1918] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:09.639029 733 tablet_service.cc:1514] Processing DeleteTablet for tablet d05a505f73b24e0ba7159a3d411e5f4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:09.639109 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b37f2c150b314b7298f32c3d414ff43d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b37f2c150b314b7298f32c3d414ff43d already in progress: creating tablet
W20260620 07:01:09.640425 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 574371fb6915427687df660e733407df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 574371fb6915427687df660e733407df already in progress: creating tablet
W20260620 07:01:09.640861 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 00a34f01ce5d4d5696248dc88802dafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00a34f01ce5d4d5696248dc88802dafd already in progress: creating tablet
I20260620 07:01:09.641180 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet b4ee5c79e2a6419ea3847cbebdeced79 (table default.Table_34eaeb05ad0243cb9f083eb279a8ba73 [id=5a23c89228964939bd74b5079dd25881]) successfully deleted
I20260620 07:01:09.641402 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 168fb1666e2c41358213240d34ef9572 (table default.Table_83d56d1245704fd3935391f2558b3e89 [id=2920611d71ce4939bc2e2201f2e411ac]) successfully deleted
I20260620 07:01:09.649021 865 tablet_service.cc:1514] Processing DeleteTablet for tablet ed69a44c466047d298cf7653b2a2bb23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.650873 865 tablet_service.cc:1467] Processing CreateTablet for tablet 4b565f418cc54d77ba9d405a7d024646 (DEFAULT_TABLE table=default.Table_c17256b58e4540fca63f3c14356e0d27 [id=fac903daa14e4a7abf1e0b5933c3c58c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.651119 683 leader_election.cc:341] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: da1e30385ed44c7f8b7db868f2e2bc29
I20260620 07:01:09.651202 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 4b565f418cc54d77ba9d405a7d024646 (DEFAULT_TABLE table=default.Table_c17256b58e4540fca63f3c14356e0d27 [id=fac903daa14e4a7abf1e0b5933c3c58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.651366 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b565f418cc54d77ba9d405a7d024646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.651608 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b565f418cc54d77ba9d405a7d024646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.651587 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e5288a8179334813988c13c09263d3fb" } modify_external_catalogs: true
I20260620 07:01:09.651867 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e5288a8179334813988c13c09263d3fb" } modify_external_catalogs: true
I20260620 07:01:09.652299 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_89bf00306e9c44a0a0de2e0a7235f436" } new_table_name: "default.Table_361c16a82c8b4f518117b6747d4aa3bc" modify_external_catalogs: true
I20260620 07:01:09.654027 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_993f8296657448808071f4daac209774"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.654605 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_993f8296657448808071f4daac209774 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.654543 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 (DEFAULT_TABLE table=default.Table_d5fc8ec0b1424625b98c20f4b8b78249 [id=ab38ab3dce124e85b838a82e8117806a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.654711 427 master_service.cc:946] ReplaceTablet: received request to replace tablet af743ffd2eb2427caa3779c7fceb8f30 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:09.655630 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_715948cd71c24a039a15b1a9598243ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.656103 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_715948cd71c24a039a15b1a9598243ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.656255 729 tablet_service.cc:1514] Processing DeleteTablet for tablet a570e8da585d46839281d606b2f51938 with delete_type TABLET_DATA_DELETED (replaced by tablet 02584f8ac08f4759a5f9a5aa699d0039) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:09.656517 1916 raft_consensus.cc:504] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.657160 1916 leader_election.cc:288] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:09.657696 858 tablet_service.cc:1467] Processing CreateTablet for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 (DEFAULT_TABLE table=default.Table_d5fc8ec0b1424625b98c20f4b8b78249 [id=ab38ab3dce124e85b838a82e8117806a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.658061 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.658951 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f1244539cb0347b9ac10cd187df81019"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.659395 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1244539cb0347b9ac10cd187df81019 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.661504 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_97e6f2abc164418f8571bab6b7db96e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:09.662051 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bddd763d82d14db2bc1ceb50eaa2ae69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.662551 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bddd763d82d14db2bc1ceb50eaa2ae69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:09.662037 413 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc -> Peer 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455): Couldn't send request to peer 2395d394cd84440ebae89d1ecfa13fb5. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 07:01:09.664038 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_09cc34c1ecf8432980b9247bf2be1e8d" } modify_external_catalogs: true
I20260620 07:01:09.664276 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_09cc34c1ecf8432980b9247bf2be1e8d" } modify_external_catalogs: true
I20260620 07:01:09.664415 874 tablet_service.cc:1467] Processing CreateTablet for tablet 969b2e5291d14d86bcaa4de5f419c41d (DEFAULT_TABLE table=default.Table_3beace102a7e4806ad2bb54d4e46dea9 [id=4ca71dc900b04277a5b247d9b5b8d929]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.664800 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969b2e5291d14d86bcaa4de5f419c41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.665836 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2975167a62b94aa0aaf9d2301469a1a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.666394 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2975167a62b94aa0aaf9d2301469a1a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.668000 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7681a9fcfe6a48a5aa3028d8c9113a73" } modify_external_catalogs: true
I20260620 07:01:09.668264 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7681a9fcfe6a48a5aa3028d8c9113a73" } modify_external_catalogs: true
I20260620 07:01:09.668830 860 tablet_service.cc:1467] Processing CreateTablet for tablet 70e7fada94584d68b287c2318e21d345 (DEFAULT_TABLE table=default.Table_315a6e60255641079c24df8d2bc90df4 [id=d7ceba38b69d4120a93159553869bc1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.669219 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e7fada94584d68b287c2318e21d345. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:09.662009 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97e6f2abc164418f8571bab6b7db96e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.673427 1168 tablet_bootstrap.cc:492] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:09.673573 1168 ts_tablet_manager.cc:1397] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.118s user 0.003s sys 0.000s
I20260620 07:01:09.674283 1168 raft_consensus.cc:348] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.674494 1168 raft_consensus.cc:374] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:09.674613 1168 raft_consensus.cc:729] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:09.674863 683 leader_election.cc:302] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.674875 1168 consensus_queue.cc:260] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:09.675259 1922 log.cc:924] Time spent T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Append to log took a long time: real 0.093s user 0.000s sys 0.000s
I20260620 07:01:09.675446 1168 ts_tablet_manager.cc:1428] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:09.676712 862 tablet_service.cc:1467] Processing CreateTablet for tablet b58ce7876b614d63932d458036c7e041 (DEFAULT_TABLE table=default.Table_97026b9ce8a34cb0964e1672bc328516 [id=4a2fe9d489c74f03ad6600a8260ca12e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.676898 857 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe7d23df64c417d8fcd974fac94bc08 (DEFAULT_TABLE table=default.Table_02bda5bfaeba42e6bb40e543534bbfa9 [id=5277e9b0aaa04bc39868a4f2c546beee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.677322 859 tablet_service.cc:1467] Processing CreateTablet for tablet 01b82aa3a0ba48f7bf61401713aca6bc (DEFAULT_TABLE table=default.Table_5cc308b9274141e4b97046f12359f301 [id=5d62781d6d534481a854e20fce2e90dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.677500 1170 tablet_bootstrap.cc:492] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:09.676709 872 tablet_service.cc:1467] Processing CreateTablet for tablet 39e9f8eb03a74bb5ab4c9cc1c7b109c2 (DEFAULT_TABLE table=default.Table_fc3fba692ea14fa4b439fbffb8656e3c [id=4f85b59614144ddda7ba378ffd80db4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.679128 1168 tablet_bootstrap.cc:492] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:09.680791 1168 tablet_bootstrap.cc:654] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:09.680734 871 tablet_service.cc:1467] Processing CreateTablet for tablet b45d144514134cb6a644087e62c436e3 (DEFAULT_TABLE table=default.Table_20896721839841d2bbf7bedd7d08b2c7 [id=4039e0f0ac7a40d6be657fd181106bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.681097 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe7d23df64c417d8fcd974fac94bc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.681732 861 tablet_service.cc:1467] Processing CreateTablet for tablet b0fffaab2edf45d7890ea2889422b134 (DEFAULT_TABLE table=default.Table_de68c895f92f41ee880a5b9968500827 [id=cbefa30fe2bb42a1bb390df7512930b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.683605 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82020156f3e44a1e84a9435d1f994124" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:09.685863 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0fffaab2edf45d7890ea2889422b134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.688547 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 01b82aa3a0ba48f7bf61401713aca6bc (DEFAULT_TABLE table=default.Table_5cc308b9274141e4b97046f12359f301 [id=5d62781d6d534481a854e20fce2e90dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.689297 1002 tablet_service.cc:1467] Processing CreateTablet for tablet b45d144514134cb6a644087e62c436e3 (DEFAULT_TABLE table=default.Table_20896721839841d2bbf7bedd7d08b2c7 [id=4039e0f0ac7a40d6be657fd181106bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.689404 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe7d23df64c417d8fcd974fac94bc08 (DEFAULT_TABLE table=default.Table_02bda5bfaeba42e6bb40e543534bbfa9 [id=5277e9b0aaa04bc39868a4f2c546beee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.689675 995 tablet_service.cc:1467] Processing CreateTablet for tablet 969b2e5291d14d86bcaa4de5f419c41d (DEFAULT_TABLE table=default.Table_3beace102a7e4806ad2bb54d4e46dea9 [id=4ca71dc900b04277a5b247d9b5b8d929]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.690099 994 tablet_service.cc:1467] Processing CreateTablet for tablet b0fffaab2edf45d7890ea2889422b134 (DEFAULT_TABLE table=default.Table_de68c895f92f41ee880a5b9968500827 [id=cbefa30fe2bb42a1bb390df7512930b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.690253 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 39e9f8eb03a74bb5ab4c9cc1c7b109c2 (DEFAULT_TABLE table=default.Table_fc3fba692ea14fa4b439fbffb8656e3c [id=4f85b59614144ddda7ba378ffd80db4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.690680 1028 raft_consensus.cc:3037] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:09.691390 1925 raft_consensus.cc:482] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.691529 1925 raft_consensus.cc:504] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.692130 1925 leader_election.cc:288] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:09.692384 998 tablet_service.cc:1467] Processing CreateTablet for tablet b58ce7876b614d63932d458036c7e041 (DEFAULT_TABLE table=default.Table_97026b9ce8a34cb0964e1672bc328516 [id=4a2fe9d489c74f03ad6600a8260ca12e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.692677 999 tablet_service.cc:1467] Processing CreateTablet for tablet 70e7fada94584d68b287c2318e21d345 (DEFAULT_TABLE table=default.Table_315a6e60255641079c24df8d2bc90df4 [id=d7ceba38b69d4120a93159553869bc1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.693897 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5919c99f3324f7ba52c72e91b35afaf" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:09.694130 890 raft_consensus.cc:2379] T c5919c99f3324f7ba52c72e91b35afaf P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06a32ef63b2b495a9ade1de48c024ae9 in current term 1: Already voted for candidate 2b84cae646b24bc7bd424eb8434ad425 in this term.
I20260620 07:01:09.694340 1028 raft_consensus.cc:2454] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:09.695071 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.695462 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e7fada94584d68b287c2318e21d345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.695708 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe7d23df64c417d8fcd974fac94bc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.695895 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b58ce7876b614d63932d458036c7e041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.696175 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b82aa3a0ba48f7bf61401713aca6bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.698828 734 tablet_service.cc:1467] Processing CreateTablet for tablet 4b565f418cc54d77ba9d405a7d024646 (DEFAULT_TABLE table=default.Table_c17256b58e4540fca63f3c14356e0d27 [id=fac903daa14e4a7abf1e0b5933c3c58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.702378 681 leader_election.cc:302] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:09.704916 729 tablet_service.cc:1467] Processing CreateTablet for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 (DEFAULT_TABLE table=default.Table_d5fc8ec0b1424625b98c20f4b8b78249 [id=ab38ab3dce124e85b838a82e8117806a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.706475 968 consensus_peers.cc:487] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d066c73ae0104cb3be792790b1dfb93d. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:09.708808 1853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 07:01:09.708942 1853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 07:01:09.709018 1853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 07:01:09.709100 1853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 07:01:09.709693 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b58ce7876b614d63932d458036c7e041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.709617 733 tablet_service.cc:1467] Processing CreateTablet for tablet 70e7fada94584d68b287c2318e21d345 (DEFAULT_TABLE table=default.Table_315a6e60255641079c24df8d2bc90df4 [id=d7ceba38b69d4120a93159553869bc1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.710284 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b45d144514134cb6a644087e62c436e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:09.713745 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89f5e2f055fb469dbbb935bba724dcb5 consensus state has no leader
I20260620 07:01:09.715035 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39e9f8eb03a74bb5ab4c9cc1c7b109c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.718350 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8cca283f4d2645c0b59f750949b7e263
I20260620 07:01:09.719219 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b82aa3a0ba48f7bf61401713aca6bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.719242 1916 raft_consensus.cc:2726] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.720449 421 master_service.cc:946] ReplaceTablet: received request to replace tablet 877a71e8db5f4bf689df39f83735f326 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:09.723065 715 tablet_service.cc:1467] Processing CreateTablet for tablet 969b2e5291d14d86bcaa4de5f419c41d (DEFAULT_TABLE table=default.Table_3beace102a7e4806ad2bb54d4e46dea9 [id=4ca71dc900b04277a5b247d9b5b8d929]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.723470 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 52215.4us
W20260620 07:01:09.723752 683 leader_election.cc:341] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a5757e05e9a2403a86ca98f455e11754
I20260620 07:01:09.724704 683 leader_election.cc:302] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.725565 1917 raft_consensus.cc:2781] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:09.725698 1917 raft_consensus.cc:686] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:09.726290 722 tablet_service.cc:1467] Processing CreateTablet for tablet 39e9f8eb03a74bb5ab4c9cc1c7b109c2 (DEFAULT_TABLE table=default.Table_fc3fba692ea14fa4b439fbffb8656e3c [id=4f85b59614144ddda7ba378ffd80db4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.727820 1170 ts_tablet_manager.cc:1397] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.688s user 0.008s sys 0.008s
I20260620 07:01:09.730770 724 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe7d23df64c417d8fcd974fac94bc08 (DEFAULT_TABLE table=default.Table_02bda5bfaeba42e6bb40e543534bbfa9 [id=5277e9b0aaa04bc39868a4f2c546beee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.731523 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 13c7f0513df34ddb8104b06e5733fb62
I20260620 07:01:09.731994 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cca283f4d2645c0b59f750949b7e263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.736052 1920 raft_consensus.cc:2726] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.738211 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.738386 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b565f418cc54d77ba9d405a7d024646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.744284 1917 consensus_queue.cc:237] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:09.751327 683 leader_election.cc:341] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 82020156f3e44a1e84a9435d1f994124
I20260620 07:01:09.638900 1165 log.cc:1196] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/46689d13712842bf9145ad2bc3fc2acf
I20260620 07:01:09.755472 1165 ts_tablet_manager.cc:1939] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:09.756238 1165 tablet_replica.cc:330] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:09.756428 1165 raft_consensus.cc:2229] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:09.756573 1165 raft_consensus.cc:2258] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.752746 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a292d66ee14a48959c1f6a63e0a0f492" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.757215 1165 ts_tablet_manager.cc:1905] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:09.758773 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 46689d13712842bf9145ad2bc3fc2acf (table default.Table_eedf4e35718843d2bb59ddbb3c085feb [id=00c840fc683c4a4491fe102554b4bc2a]) successfully deleted
I20260620 07:01:09.761709 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0fffaab2edf45d7890ea2889422b134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.764907 859 tablet_service.cc:1467] Processing CreateTablet for tablet 30f56d1419de4d4f9a1bcde8ba38508f (DEFAULT_TABLE table=default.Table_72c77ce50c2e43e3a966006e5fa68ceb [id=0776d6fc6b784d21937281cb44c121ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.765348 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30f56d1419de4d4f9a1bcde8ba38508f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.752776 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe7d23df64c417d8fcd974fac94bc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.772130 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cca283f4d2645c0b59f750949b7e263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.772614 720 tablet_service.cc:1467] Processing CreateTablet for tablet b0fffaab2edf45d7890ea2889422b134 (DEFAULT_TABLE table=default.Table_de68c895f92f41ee880a5b9968500827 [id=cbefa30fe2bb42a1bb390df7512930b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.773294 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 490eb0893a4f4811b7574c445e483549
I20260620 07:01:09.752825 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5919c99f3324f7ba52c72e91b35afaf" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.774170 1925 raft_consensus.cc:482] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.774235 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5630d0cf800a45efb1b1bfeee6223c8c" } new_table_name: "default.Table_fc572851b8c44ec5b5403b38a65d7049" modify_external_catalogs: true
I20260620 07:01:09.774956 1925 raft_consensus.cc:504] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.775674 1925 leader_election.cc:288] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:09.776099 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d9a5c76430d34f31a928af10dfa284c6" } new_table_name: "default.Table_7146361681104709b5dfbac7fcecd7cd" modify_external_catalogs: true
I20260620 07:01:09.776638 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
I20260620 07:01:09.777424 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0ff972e19ff44c88864624047e7aff38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.777972 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ff972e19ff44c88864624047e7aff38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.783581 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_171ec3d5af68477aa002548e814e04d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:09.784255 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_171ec3d5af68477aa002548e814e04d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.787303 1935 raft_consensus.cc:482] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.787449 1935 raft_consensus.cc:504] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.787397 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5e750ac167754573aaf4644d64503ecd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:09.788076 1935 leader_election.cc:288] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:09.788062 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e750ac167754573aaf4644d64503ecd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.788895 968 leader_election.cc:302] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.789479 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bf7c7b64562940fc8dc4ba352deea46c" } modify_external_catalogs: true
I20260620 07:01:09.789697 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bf7c7b64562940fc8dc4ba352deea46c" } modify_external_catalogs: true
I20260620 07:01:09.794427 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39e9f8eb03a74bb5ab4c9cc1c7b109c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.795426 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 490eb0893a4f4811b7574c445e483549 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.795821 1925 raft_consensus.cc:3037] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:09.793889 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.798513 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 30f56d1419de4d4f9a1bcde8ba38508f (DEFAULT_TABLE table=default.Table_72c77ce50c2e43e3a966006e5fa68ceb [id=0776d6fc6b784d21937281cb44c121ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.799679 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2de23d7d170247068bfba22c795a5c56" } new_table_name: "default.Table_ff68e2419ecb4968bd4e87c0a1d30b8b" modify_external_catalogs: true
I20260620 07:01:09.801720 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e72d9c9be46441e4b73ae53afe9ed50c" } modify_external_catalogs: true
I20260620 07:01:09.801920 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e72d9c9be46441e4b73ae53afe9ed50c" } modify_external_catalogs: true
I20260620 07:01:09.803881 1925 raft_consensus.cc:2726] T c5919c99f3324f7ba52c72e91b35afaf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.804200 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
W20260620 07:01:09.805634 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39504144a623423c873ded7d6839367a consensus state has no leader
I20260620 07:01:09.806277 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_51842d9d7b0349ba9f9ef93fe5727b59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:09.818501 1168 tablet_bootstrap.cc:492] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
W20260620 07:01:09.820061 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51842d9d7b0349ba9f9ef93fe5727b59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:09.820106 861 tablet_service.cc:1467] Processing CreateTablet for tablet 2feb83cb7d0b427eaa936f326f83aad0 (DEFAULT_TABLE table=default.Table_d4bf2488466f4efa97a5dfa13576e493 [id=d365d4ca6252415ea605e5ce7dc1149f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.820410 419 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
I20260620 07:01:09.820763 860 tablet_service.cc:1467] Processing CreateTablet for tablet e6c6ac49e30e441396c7c29f950fed31 (DEFAULT_TABLE table=default.Table_55ba5d893268477bb780b81c97f3440e [id=f9e5e0107be4466e9fec404f730b2a0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.821332 858 tablet_service.cc:1467] Processing CreateTablet for tablet ffe453ce52ce406fad5206bdedad9ef0 (DEFAULT_TABLE table=default.Table_d7959a3e4df54745953dd46f404ae841 [id=e91f74f496424487a1cbe9c969d5fe9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.821761 865 tablet_service.cc:1467] Processing CreateTablet for tablet 7f85c8a0ea484b57bb50425867e2774e (DEFAULT_TABLE table=default.Table_40893b674e3c45f897680cef510a227d [id=de25130a1eff4ac6a749808713413090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.820106 874 tablet_service.cc:1467] Processing CreateTablet for tablet 9cebdd8c947845528affd32316d9b336 (DEFAULT_TABLE table=default.Table_353005aed9854c42bb2013ecbcd04165 [id=37e74ef650534d1c90d6669ca2b43d19]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.822714 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a064674792b42d49e9ff20a7496f820 consensus state has no leader
W20260620 07:01:09.823604 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 25adb514cb22461bbcbecad7d74e643c consensus state has no leader
I20260620 07:01:09.825052 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2feb83cb7d0b427eaa936f326f83aad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.825325 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffe453ce52ce406fad5206bdedad9ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.830919 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f85c8a0ea484b57bb50425867e2774e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.831553 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6c6ac49e30e441396c7c29f950fed31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.831969 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cebdd8c947845528affd32316d9b336. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:09.835029 831 leader_election.cc:341] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.835163 831 leader_election.cc:302] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:09.835755 1935 raft_consensus.cc:2726] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.752704 730 tablet_service.cc:1467] Processing CreateTablet for tablet b58ce7876b614d63932d458036c7e041 (DEFAULT_TABLE table=default.Table_97026b9ce8a34cb0964e1672bc328516 [id=4a2fe9d489c74f03ad6600a8260ca12e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.835557 422 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_811e4d61e71e47ab80ad8c0488b3183c [id=2abd0f99a3034a0e8824bcb0002c91bd] alter complete (version 3)
I20260620 07:01:09.839848 727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49218 (request call id 641) took 1019 ms. Trace:
I20260620 07:01:09.840906 872 tablet_service.cc:1514] Processing DeleteTablet for tablet f690e150839a4d23860932712f61e7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.840824 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46689d13712842bf9145ad2bc3fc2acf" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.859498 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9b931e3e87534341b6bb5d0edd6e7dca" } new_table_name: "default.Table_f2f0727404f240818c87ef3b6e2c28de" modify_external_catalogs: true
I20260620 07:01:09.864163 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5757e05e9a2403a86ca98f455e11754" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.870859 728 tablet_service.cc:1467] Processing CreateTablet for tablet b45d144514134cb6a644087e62c436e3 (DEFAULT_TABLE table=default.Table_20896721839841d2bbf7bedd7d08b2c7 [id=4039e0f0ac7a40d6be657fd181106bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.842850 1170 raft_consensus.cc:348] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.874162 749 raft_consensus.cc:2454] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:09.876477 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e972b9bef1bd4c19ac0a8c86331dce60
I20260620 07:01:09.877053 831 leader_election.cc:302] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
W20260620 07:01:09.877291 831 raft_consensus.cc:2670] T 46689d13712842bf9145ad2bc3fc2acf P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:09.877302 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2614cc40931e4c308a5a7208f2e8c400
I20260620 07:01:09.878755 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 2614cc40931e4c308a5a7208f2e8c400 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:09.879161 969 leader_election.cc:341] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a5757e05e9a2403a86ca98f455e11754
I20260620 07:01:09.879264 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfff2a14b1184d39bd7ac1091ef749c9" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:09.879351 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 84011.8us
I20260620 07:01:09.879925 1925 raft_consensus.cc:482] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:09.880111 1925 raft_consensus.cc:504] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.880823 1925 leader_election.cc:288] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:09.881069 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet e972b9bef1bd4c19ac0a8c86331dce60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.880462 1853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:33455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=38159
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 06:01:36 UTC on ccycloud.quasar-ouulox.root.comops.site
build id 4457022
ASAN enabled
I20260620 07:01:09.881295 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 7f85c8a0ea484b57bb50425867e2774e (DEFAULT_TABLE table=default.Table_40893b674e3c45f897680cef510a227d [id=de25130a1eff4ac6a749808713413090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.881742 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 2614cc40931e4c308a5a7208f2e8c400 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.882179 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 9cebdd8c947845528affd32316d9b336 (DEFAULT_TABLE table=default.Table_353005aed9854c42bb2013ecbcd04165 [id=37e74ef650534d1c90d6669ca2b43d19]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.882956 830 leader_election.cc:341] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.884328 1008 tablet_service.cc:1467] Processing CreateTablet for tablet ffe453ce52ce406fad5206bdedad9ef0 (DEFAULT_TABLE table=default.Table_d7959a3e4df54745953dd46f404ae841 [id=e91f74f496424487a1cbe9c969d5fe9e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:09.884898 969 leader_election.cc:341] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e7d1e4719cd441dd8054b24861cbd8a2
I20260620 07:01:09.885551 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:09.885612 1010 tablet_service.cc:1467] Processing CreateTablet for tablet e6c6ac49e30e441396c7c29f950fed31 (DEFAULT_TABLE table=default.Table_55ba5d893268477bb780b81c97f3440e [id=f9e5e0107be4466e9fec404f730b2a0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.886816 998 tablet_service.cc:1467] Processing CreateTablet for tablet 2feb83cb7d0b427eaa936f326f83aad0 (DEFAULT_TABLE table=default.Table_d4bf2488466f4efa97a5dfa13576e493 [id=d365d4ca6252415ea605e5ce7dc1149f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.887881 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.887967 727 rpcz_store.cc:276] 0620 07:01:08.753278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.760300 (+ 7022us) service_pool.cc:227] Handling call
0620 07:01:08.801278 (+ 40978us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:08.801324 (+ 46us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:09.678868 (+877544us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:09.755603 (+ 76735us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:09.772320 (+ 16717us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17024}
I20260620 07:01:09.887662 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969b2e5291d14d86bcaa4de5f419c41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.888245 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e7fada94584d68b287c2318e21d345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.887912 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cca283f4d2645c0b59f750949b7e263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:09.888851 1853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 07:01:09.889493 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cebdd8c947845528affd32316d9b336. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:09.890200 968 leader_election.cc:341] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e7d1e4719cd441dd8054b24861cbd8a2
I20260620 07:01:09.890394 968 leader_election.cc:302] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:09.890895 1925 raft_consensus.cc:2726] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.891204 716 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49218 (request call id 638) took 1002 ms. Trace:
I20260620 07:01:09.894479 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b45d144514134cb6a644087e62c436e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.894922 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f85c8a0ea484b57bb50425867e2774e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.896047 716 rpcz_store.cc:276] 0620 07:01:08.752868 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.759382 (+ 6514us) service_pool.cc:227] Handling call
0620 07:01:08.801360 (+ 41978us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:08.801383 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:09.632686 (+831303us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:09.754716 (+122030us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:09.754934 (+ 218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:09.897189 1853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 07:01:09.899194 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffe453ce52ce406fad5206bdedad9ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.903224 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30f56d1419de4d4f9a1bcde8ba38508f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.903684 754 raft_consensus.cc:2454] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:09.903631 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfff2a14b1184d39bd7ac1091ef749c9" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:09.903998 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 490eb0893a4f4811b7574c445e483549 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:09.904410 727 tablet_service.cc:1467] Processing CreateTablet for tablet 2feb83cb7d0b427eaa936f326f83aad0 (DEFAULT_TABLE table=default.Table_d4bf2488466f4efa97a5dfa13576e493 [id=d365d4ca6252415ea605e5ce7dc1149f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.906452 968 leader_election.cc:302] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:09.906809 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b45d144514134cb6a644087e62c436e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.907038 1925 raft_consensus.cc:2781] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:09.907157 1925 raft_consensus.cc:482] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:09.907266 1925 raft_consensus.cc:3037] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:09.909471 831 leader_election.cc:341] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:09.909623 831 leader_election.cc:302] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:09.909931 1935 raft_consensus.cc:2726] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:09.911536 1169 ts_tablet_manager.cc:1918] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:09.917527 717 tablet_service.cc:1467] Processing CreateTablet for tablet 9cebdd8c947845528affd32316d9b336 (DEFAULT_TABLE table=default.Table_353005aed9854c42bb2013ecbcd04165 [id=37e74ef650534d1c90d6669ca2b43d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.917984 716 tablet_service.cc:1467] Processing CreateTablet for tablet e6c6ac49e30e441396c7c29f950fed31 (DEFAULT_TABLE table=default.Table_55ba5d893268477bb780b81c97f3440e [id=f9e5e0107be4466e9fec404f730b2a0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.923265 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6c6ac49e30e441396c7c29f950fed31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.927196 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2feb83cb7d0b427eaa936f326f83aad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.931607 1169 log.cc:1196] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/cb26f1d10f9a4978b41afbd8894f1102
I20260620 07:01:09.933738 1958 tablet.cc:1722] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:09.934190 732 tablet_service.cc:1467] Processing CreateTablet for tablet 30f56d1419de4d4f9a1bcde8ba38508f (DEFAULT_TABLE table=default.Table_72c77ce50c2e43e3a966006e5fa68ceb [id=0776d6fc6b784d21937281cb44c121ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.937152 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0fffaab2edf45d7890ea2889422b134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.937395 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6c6ac49e30e441396c7c29f950fed31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.938616 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2feb83cb7d0b427eaa936f326f83aad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.938690 731 tablet_service.cc:1467] Processing CreateTablet for tablet 7f85c8a0ea484b57bb50425867e2774e (DEFAULT_TABLE table=default.Table_40893b674e3c45f897680cef510a227d [id=de25130a1eff4ac6a749808713413090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.939100 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f85c8a0ea484b57bb50425867e2774e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.941591 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30f56d1419de4d4f9a1bcde8ba38508f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.943879 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b58ce7876b614d63932d458036c7e041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.944427 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969b2e5291d14d86bcaa4de5f419c41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.945649 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39e9f8eb03a74bb5ab4c9cc1c7b109c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.937088 1168 ts_tablet_manager.cc:1397] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.161s user 0.005s sys 0.000s
I20260620 07:01:09.947793 1168 raft_consensus.cc:348] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.952623 725 tablet_service.cc:1467] Processing CreateTablet for tablet ffe453ce52ce406fad5206bdedad9ef0 (DEFAULT_TABLE table=default.Table_d7959a3e4df54745953dd46f404ae841 [id=e91f74f496424487a1cbe9c969d5fe9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.955888 1925 raft_consensus.cc:504] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.956511 1166 ts_tablet_manager.cc:1918] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:09.956670 1166 log.cc:1196] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/978f99d2a7d6448aba8dcd2611b75af3
I20260620 07:01:09.957132 1925 leader_election.cc:288] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:09.957108 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5757e05e9a2403a86ca98f455e11754" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
W20260620 07:01:09.958119 969 leader_election.cc:341] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a5757e05e9a2403a86ca98f455e11754
I20260620 07:01:09.958585 420 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
W20260620 07:01:09.961930 412 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 78559.2us
I20260620 07:01:09.967908 718 tablet_service.cc:1467] Processing CreateTablet for tablet 01b82aa3a0ba48f7bf61401713aca6bc (DEFAULT_TABLE table=default.Table_5cc308b9274141e4b97046f12359f301 [id=5d62781d6d534481a854e20fce2e90dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:09.969775 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffe453ce52ce406fad5206bdedad9ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:09.973381 1166 ts_tablet_manager.cc:1939] T 978f99d2a7d6448aba8dcd2611b75af3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:09.976030 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet a5757e05e9a2403a86ca98f455e11754 with delete_type TABLET_DATA_DELETED (replaced by tablet a2d6f7f2b5b3473aa010b8982a03aa5e) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:09.979413 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 322) took 8309 ms. Trace:
I20260620 07:01:09.820187 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 490eb0893a4f4811b7574c445e483549 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.960696 1165 ts_tablet_manager.cc:1918] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:09.979863 1165 log.cc:1196] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f8ec1e179a704e5480f3deaf856156e7
I20260620 07:01:09.967979 865 tablet_service.cc:1514] Processing DeleteTablet for tablet cfff2a14b1184d39bd7ac1091ef749c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.965484 860 tablet_service.cc:1514] Processing DeleteTablet for tablet e972b9bef1bd4c19ac0a8c86331dce60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:09.979398 1168 raft_consensus.cc:374] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:09.980564 1165 ts_tablet_manager.cc:1939] T f8ec1e179a704e5480f3deaf856156e7 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:09.981173 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f04603a2fe84988ac9c9975e94ce9ae consensus state has no leader
I20260620 07:01:09.980695 1168 raft_consensus.cc:729] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:09.982820 1170 raft_consensus.cc:374] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:09.982940 1170 raft_consensus.cc:729] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:09.983142 1166 rpcz_store.cc:276] 0620 07:01:01.669785 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.366504 (+696719us) service_pool.cc:227] Handling call
0620 07:01:09.495062 (+7128558us) ts_tablet_manager.cc:1145] Deleting tablet 978f99d2a7d6448aba8dcd2611b75af3
0620 07:01:09.495076 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:09.635946 (+140870us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:09.956393 (+320447us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:09.979377 (+ 22984us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":113614,"tablet-delete.queue_time_us":7058992}
I20260620 07:01:09.984393 1166 tablet_replica.cc:330] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:09.984649 1167 tablet_bootstrap.cc:492] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:09.984848 1167 ts_tablet_manager.cc:1397] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.350s user 0.009s sys 0.016s
I20260620 07:01:09.985038 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 978f99d2a7d6448aba8dcd2611b75af3 (table default.Table_407d8f13b4bd41fb8675708922430b28 [id=c6b286f7e44a496aa9f070c73a885062]) successfully deleted
I20260620 07:01:09.986739 751 raft_consensus.cc:3037] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:09.982857 1165 tablet_replica.cc:330] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:09.987221 1165 raft_consensus.cc:2229] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:09.987464 1165 raft_consensus.cc:2258] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.988234 1165 ts_tablet_manager.cc:1905] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:09.991567 1167 raft_consensus.cc:348] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.973778 719 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49218 (request call id 639) took 1201 ms. Trace:
I20260620 07:01:09.993875 1169 ts_tablet_manager.cc:1939] T cb26f1d10f9a4978b41afbd8894f1102 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:09.986578 1170 consensus_queue.cc:260] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.984876 1166 raft_consensus.cc:2229] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:09.994915 1167 raft_consensus.cc:374] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:09.994995 1166 raft_consensus.cc:2258] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:09.995092 1167 raft_consensus.cc:729] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:09.995175 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 597) took 2205 ms. Trace:
I20260620 07:01:09.995430 1167 consensus_queue.cc:260] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:09.995671 1166 ts_tablet_manager.cc:1905] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:09.996065 1167 ts_tablet_manager.cc:1428] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 07:01:09.997241 1167 tablet_bootstrap.cc:492] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:09.999281 1167 tablet_bootstrap.cc:654] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.001257 1170 ts_tablet_manager.cc:1428] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.267s user 0.004s sys 0.000s
I20260620 07:01:10.003839 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_871c3bd853224b7da9f77c9c7efb1065"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:10.004415 1165 ts_tablet_manager.cc:1918] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:10.004733 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_871c3bd853224b7da9f77c9c7efb1065 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.005415 1165 log.cc:1196] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/8088fadabff64c35aa96a1ede17318c3
I20260620 07:01:10.006659 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b12b11dc5a904c46882ddf9974d89df7" } new_table_name: "default.Table_ecf861541ad040c68363a1ed9fe3fb70" modify_external_catalogs: true
I20260620 07:01:10.007299 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1f805755212a4ca8861811107079a79b" } modify_external_catalogs: true
I20260620 07:01:10.007529 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1f805755212a4ca8861811107079a79b" } modify_external_catalogs: true
I20260620 07:01:10.008543 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_39654cee1c26433a94f549acb9787681"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.009214 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39654cee1c26433a94f549acb9787681 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.010936 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_97026b9ce8a34cb0964e1672bc328516" } modify_external_catalogs: true
I20260620 07:01:10.011025 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_02c16a393d864b6d9ca2890d79bdff69" } modify_external_catalogs: true
I20260620 07:01:10.011157 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_97026b9ce8a34cb0964e1672bc328516" } modify_external_catalogs: true
I20260620 07:01:10.011271 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_02c16a393d864b6d9ca2890d79bdff69" } modify_external_catalogs: true
I20260620 07:01:10.012053 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ffb7f02cd84f4eeba71dc4d8abc459da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.012686 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffb7f02cd84f4eeba71dc4d8abc459da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.014321 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7e14acf1c0a24b5fb959872664181f23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.014915 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e14acf1c0a24b5fb959872664181f23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.014837 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d82480660a9a4d358324cb6f84fdb341"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.015376 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d82480660a9a4d358324cb6f84fdb341 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.016882 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b79f978eee17412da963a4c4ccd88fcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.017443 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b79f978eee17412da963a4c4ccd88fcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.020468 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f1984579a670481b9fbcc82593055fa3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.021100 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1984579a670481b9fbcc82593055fa3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.002535 719 rpcz_store.cc:276] 0620 07:01:08.753012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.759744 (+ 6732us) service_pool.cc:227] Handling call
0620 07:01:08.915900 (+156156us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:08.915918 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:09.845558 (+929640us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:09.946277 (+100719us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:09.954543 (+ 8266us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8107}
I20260620 07:01:10.027807 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1d27a7ef447b4adaa697d276f936bd20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.028469 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d27a7ef447b4adaa697d276f936bd20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.005986 1169 rpcz_store.cc:276] 0620 07:01:07.789582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.791590 (+ 2008us) service_pool.cc:227] Handling call
0620 07:01:08.998444 (+1206854us) ts_tablet_manager.cc:1145] Deleting tablet cb26f1d10f9a4978b41afbd8894f1102
0620 07:01:08.998454 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:09.677293 (+678839us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:09.847399 (+170106us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:09.995127 (+147728us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189227}
W20260620 07:01:10.031945 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9d4ef3ba51e432f889fb927a6af8b49 consensus state has no leader
I20260620 07:01:10.032083 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 581573cafab14ac79ff7ad19da0580b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.032582 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2c6ec989fb644883b60b35937533a489" } new_table_name: "default.Table_7d3fe8285a864648bee0f14dd8103287" modify_external_catalogs: true
I20260620 07:01:10.034025 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cebdd8c947845528affd32316d9b336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.042348 1166 ts_tablet_manager.cc:1918] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.042520 1166 log.cc:1196] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/6ff06bc5fc684b9195c719cbf39d34a6
I20260620 07:01:10.006027 1165 ts_tablet_manager.cc:1939] T 8088fadabff64c35aa96a1ede17318c3 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:10.038154 1935 raft_consensus.cc:482] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.044123 1935 raft_consensus.cc:504] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.044179 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_eb719a986c8b4e01a4a98f5e68582421" } new_table_name: "default.Table_982eb8abebd34542b51573e542ad6085" modify_external_catalogs: true
I20260620 07:01:10.044835 1935 leader_election.cc:288] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:10.045428 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f690e150839a4d23860932712f61e7c8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:10.045725 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 8088fadabff64c35aa96a1ede17318c3 (table default.Table_2aa5bfb35aed447f8788be438410abc7 [id=cce39caa12524890aa7c670b5d0aa8af]) successfully deleted
W20260620 07:01:10.046175 830 leader_election.cc:341] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:10.046132 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 611) took 2044 ms. Trace:
I20260620 07:01:10.046890 1166 ts_tablet_manager.cc:1939] T 6ff06bc5fc684b9195c719cbf39d34a6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:10.046996 1170 tablet_bootstrap.cc:492] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:10.047597 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0e30fb1d050c4439bb72a21a0f2b13eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e30fb1d050c4439bb72a21a0f2b13eb already in progress: creating tablet
I20260620 07:01:10.049015 1925 raft_consensus.cc:482] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.049297 1925 raft_consensus.cc:504] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:10.050385 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 140696dbd9e44a0cbe5d4639110aa580 consensus state has no leader
W20260620 07:01:10.051203 969 leader_election.cc:341] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 169b93c38e59435db218152f2d25bdfa
I20260620 07:01:10.051467 1925 leader_election.cc:288] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:10.051853 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2859db39c7dd486f9ad7e3b5f84927fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2859db39c7dd486f9ad7e3b5f84927fa already in progress: creating tablet
W20260620 07:01:10.052568 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3a8d48f0f9dd4911876ec8f812688439 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a8d48f0f9dd4911876ec8f812688439 already in progress: creating tablet
W20260620 07:01:10.053077 968 leader_election.cc:341] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 169b93c38e59435db218152f2d25bdfa
W20260620 07:01:10.053148 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3e9f0dba4466436f9cfc730d7d6b15fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e9f0dba4466436f9cfc730d7d6b15fe already in progress: creating tablet
I20260620 07:01:10.053207 968 leader_election.cc:302] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:10.053823 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 334) took 7847 ms. Trace:
I20260620 07:01:10.054098 1165 tablet_replica.cc:330] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:10.054169 1925 raft_consensus.cc:2726] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:10.054257 1166 rpcz_store.cc:276] 0620 07:01:02.206129 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.412586 (+206457us) service_pool.cc:227] Handling call
0620 07:01:09.984293 (+7571707us) ts_tablet_manager.cc:1145] Deleting tablet 6ff06bc5fc684b9195c719cbf39d34a6
0620 07:01:09.984303 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:09.999700 (+ 15397us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.042186 (+ 42486us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.053447 (+ 11261us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7547496}
I20260620 07:01:10.054735 1165 raft_consensus.cc:2229] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.058247 1165 raft_consensus.cc:2258] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.058454 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 6ff06bc5fc684b9195c719cbf39d34a6 (table default.Table_009386cbc364471099079c21ecb6c8e0 [id=74f991adb273483bb626c5939a2cc63c]) successfully deleted
I20260620 07:01:10.058549 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 319) took 8398 ms. Trace:
I20260620 07:01:10.059496 1165 ts_tablet_manager.cc:1905] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.058696 1166 rpcz_store.cc:276] 0620 07:01:01.660588 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.356746 (+696158us) service_pool.cc:227] Handling call
0620 07:01:10.057899 (+7701153us) ts_tablet_manager.cc:1145] Deleting tablet 54bb495eea4c49b7ad7bf2300ad0e60a
0620 07:01:10.057916 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.058510 (+ 594us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7593764}
W20260620 07:01:10.060218 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 54bb495eea4c49b7ad7bf2300ad0e60a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54bb495eea4c49b7ad7bf2300ad0e60a already in progress: creating tablet
I20260620 07:01:10.060637 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 336) took 7852 ms. Trace:
W20260620 07:01:10.065243 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9a7fab4d1684604be1b81d4d4bbe560 consensus state has no leader
I20260620 07:01:10.065544 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b82aa3a0ba48f7bf61401713aca6bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.066928 1166 rpcz_store.cc:276] 0620 07:01:02.208349 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.415663 (+207314us) service_pool.cc:227] Handling call
0620 07:01:10.060119 (+7644456us) ts_tablet_manager.cc:1145] Deleting tablet 877a71e8db5f4bf689df39f83735f326
0620 07:01:10.060134 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.060557 (+ 423us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7534453}
W20260620 07:01:10.067665 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 877a71e8db5f4bf689df39f83735f326 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 877a71e8db5f4bf689df39f83735f326 already in progress: creating tablet
I20260620 07:01:10.068341 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 349) took 7434 ms. Trace:
I20260620 07:01:10.069310 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0d696424e47747e8aff9258ac6a3dec4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.070142 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d696424e47747e8aff9258ac6a3dec4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.070372 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_be27fd7716994cc5abc227788b648db5" } new_table_name: "default.Table_0e5d141713ad4e5ca15dac2497f41f13" modify_external_catalogs: true
I20260620 07:01:10.071538 1166 rpcz_store.cc:276] 0620 07:01:02.634067 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.668894 (+ 34827us) service_pool.cc:227] Handling call
0620 07:01:10.068123 (+7399229us) ts_tablet_manager.cc:1145] Deleting tablet 3456cf91d65a4413a35efe94513c723d
0620 07:01:10.068143 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.068296 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7370952}
I20260620 07:01:10.073647 861 tablet_service.cc:1467] Processing CreateTablet for tablet 80de91cb9403499baccde4ffcf4abf5a (DEFAULT_TABLE table=default.Table_0ff972e19ff44c88864624047e7aff38 [id=a62d063e2e7847f08aa928e6bff800d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.074156 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80de91cb9403499baccde4ffcf4abf5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.074975 1169 rpcz_store.cc:276] 0620 07:01:07.989087 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.989137 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:10.028726 (+2039589us) ts_tablet_manager.cc:1145] Deleting tablet a0a5967c84434000a51fe7d819fac439
0620 07:01:10.028739 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.033886 (+ 5147us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2021657}
W20260620 07:01:10.075897 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3456cf91d65a4413a35efe94513c723d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3456cf91d65a4413a35efe94513c723d already in progress: creating tablet
I20260620 07:01:10.076964 1168 consensus_queue.cc:260] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.077553 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 350) took 7437 ms. Trace:
I20260620 07:01:10.078979 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 41a03013bba54676abeaed30195e8a1e
I20260620 07:01:10.079169 1166 rpcz_store.cc:276] 0620 07:01:02.641999 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.671372 (+ 29373us) service_pool.cc:227] Handling call
0620 07:01:10.077384 (+7406012us) ts_tablet_manager.cc:1145] Deleting tablet 95a109e7871241ec9467858dca467bbe
0620 07:01:10.077398 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.077511 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7379990}
I20260620 07:01:10.081573 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 41a03013bba54676abeaed30195e8a1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.085230 1168 ts_tablet_manager.cc:1428] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.138s user 0.002s sys 0.000s
I20260620 07:01:10.086544 1165 ts_tablet_manager.cc:1918] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.081408 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 41a03013bba54676abeaed30195e8a1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:10.088317 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 95a109e7871241ec9467858dca467bbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95a109e7871241ec9467858dca467bbe already in progress: creating tablet
I20260620 07:01:10.089075 751 raft_consensus.cc:2454] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:10.089865 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 352) took 7397 ms. Trace:
I20260620 07:01:10.091333 995 tablet_service.cc:1467] Processing CreateTablet for tablet 80de91cb9403499baccde4ffcf4abf5a (DEFAULT_TABLE table=default.Table_0ff972e19ff44c88864624047e7aff38 [id=a62d063e2e7847f08aa928e6bff800d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.092350 968 leader_election.cc:302] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:10.092804 1925 raft_consensus.cc:2781] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:10.093029 1925 raft_consensus.cc:686] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:10.094516 1925 consensus_queue.cc:237] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.094872 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b58ce7876b614d63932d458036c7e041
I20260620 07:01:10.096553 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet b58ce7876b614d63932d458036c7e041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.094192 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 610) took 2088 ms. Trace:
I20260620 07:01:10.100595 1167 tablet_bootstrap.cc:492] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:10.100831 1167 ts_tablet_manager.cc:1397] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.104s user 0.006s sys 0.003s
I20260620 07:01:10.101657 1167 raft_consensus.cc:348] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.102581 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet cb26f1d10f9a4978b41afbd8894f1102 (table default.Table_622b45b592db43659f3fb16e236d0fb3 [id=b1edb1d369d341b4bd7aa4a9b1fcdea8]) successfully deleted
W20260620 07:01:10.103070 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31c56e80a73c442aa3cc65126a76c8be consensus state has no leader
I20260620 07:01:10.103749 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80de91cb9403499baccde4ffcf4abf5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.120780 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f690e150839a4d23860932712f61e7c8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:10.123044 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a0a5967c84434000a51fe7d819fac439 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a5967c84434000a51fe7d819fac439 already in progress: creating tablet
I20260620 07:01:10.103721 1166 rpcz_store.cc:276] 0620 07:01:02.692470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.697434 (+ 4964us) service_pool.cc:227] Handling call
0620 07:01:10.089643 (+7392209us) ts_tablet_manager.cc:1145] Deleting tablet c8f81fa4e88945f1a392fbacfd031392
0620 07:01:10.089658 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.089813 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7373046}
I20260620 07:01:10.106774 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 393521cca6b44618bbfb71423f36c6a1 (DEFAULT_TABLE table=default.Table_97e6f2abc164418f8571bab6b7db96e3 [id=fb35a9a8fe0941dd90ac690e188aa5bd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:10.124715 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c8f81fa4e88945f1a392fbacfd031392 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8f81fa4e88945f1a392fbacfd031392 already in progress: creating tablet
I20260620 07:01:10.125051 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 393521cca6b44618bbfb71423f36c6a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.125156 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 351) took 7481 ms. Trace:
I20260620 07:01:10.125288 1166 rpcz_store.cc:276] 0620 07:01:02.643831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.697219 (+ 53388us) service_pool.cc:227] Handling call
0620 07:01:10.124967 (+7427748us) ts_tablet_manager.cc:1145] Deleting tablet f690e150839a4d23860932712f61e7c8
0620 07:01:10.124978 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.125115 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7402546}
W20260620 07:01:10.126123 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f690e150839a4d23860932712f61e7c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f690e150839a4d23860932712f61e7c8 already in progress: creating tablet
I20260620 07:01:10.126654 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 353) took 7394 ms. Trace:
I20260620 07:01:10.127431 720 tablet_service.cc:1514] Processing DeleteTablet for tablet e972b9bef1bd4c19ac0a8c86331dce60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.127743 1167 raft_consensus.cc:374] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.127856 1167 raft_consensus.cc:729] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.128125 1167 consensus_queue.cc:260] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.128751 1167 ts_tablet_manager.cc:1428] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.028s user 0.000s sys 0.001s
I20260620 07:01:10.129019 1167 tablet_bootstrap.cc:492] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:10.130825 1167 tablet_bootstrap.cc:654] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.131345 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f4e3145a872348b6a85a19d1678636bc
I20260620 07:01:10.132598 995 tablet_service.cc:1514] Processing DeleteTablet for tablet f4e3145a872348b6a85a19d1678636bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.135798 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 2e05786efb6341ea85fb3d3c42bd85d7 (DEFAULT_TABLE table=default.Table_2975167a62b94aa0aaf9d2301469a1a3 [id=6ca6b6ef3e8f48ec9d4603ef851a98f0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:10.137135 1967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:01:10.137568 1969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:01:10.142047 1165 log.cc:1196] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/a292d66ee14a48959c1f6a63e0a0f492
I20260620 07:01:10.136528 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e05786efb6341ea85fb3d3c42bd85d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.143864 998 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e30385ed44c7f8b7db868f2e2bc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.142452 999 tablet_service.cc:1467] Processing CreateTablet for tablet ef4e6fda73ba45c6892273b33b37a688 (DEFAULT_TABLE table=default.Table_f1244539cb0347b9ac10cd187df81019 [id=dc2e07584fb642de943bcfa4e41183c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.140028 1166 rpcz_store.cc:276] 0620 07:01:02.732647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.738089 (+ 5442us) service_pool.cc:227] Handling call
0620 07:01:10.126359 (+7388270us) ts_tablet_manager.cc:1145] Deleting tablet b39e682e71ed4776a786f7d30158e7e0
0620 07:01:10.126369 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.126609 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7376071}
I20260620 07:01:10.144831 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef4e6fda73ba45c6892273b33b37a688. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:10.144856 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b39e682e71ed4776a786f7d30158e7e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b39e682e71ed4776a786f7d30158e7e0 already in progress: creating tablet
I20260620 07:01:10.145325 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 354) took 7408 ms. Trace:
I20260620 07:01:10.145466 1166 rpcz_store.cc:276] 0620 07:01:02.736546 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.739551 (+ 3005us) service_pool.cc:227] Handling call
0620 07:01:10.145145 (+7405594us) ts_tablet_manager.cc:1145] Deleting tablet 4655d289c94c4bce9707be375fc4b850
0620 07:01:10.145158 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.145279 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7377082}
W20260620 07:01:10.145964 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4655d289c94c4bce9707be375fc4b850 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4655d289c94c4bce9707be375fc4b850 already in progress: creating tablet
I20260620 07:01:10.146341 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 355) took 7390 ms. Trace:
I20260620 07:01:10.145895 1169 rpcz_store.cc:276] 0620 07:01:07.988989 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.992271 (+ 3282us) service_pool.cc:227] Handling call
0620 07:01:10.075448 (+2083177us) ts_tablet_manager.cc:1145] Deleting tablet 033c8b817757441ea7ebc2dbf77aa2dd
0620 07:01:10.075462 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.077391 (+ 1929us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2058996}
I20260620 07:01:10.146458 1166 rpcz_store.cc:276] 0620 07:01:02.755398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.759298 (+ 3900us) service_pool.cc:227] Handling call
0620 07:01:10.146174 (+7386876us) ts_tablet_manager.cc:1145] Deleting tablet 8a56f30ca69e45e3a9ddd41f117f61e2
0620 07:01:10.146185 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.146252 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7294720}
W20260620 07:01:10.146835 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8a56f30ca69e45e3a9ddd41f117f61e2 because the tablet was not found. No further retry: Not found: Tablet not found: 8a56f30ca69e45e3a9ddd41f117f61e2
I20260620 07:01:10.147207 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 357) took 7223 ms. Trace:
I20260620 07:01:10.143179 994 tablet_service.cc:1467] Processing CreateTablet for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc (DEFAULT_TABLE table=default.Table_715948cd71c24a039a15b1a9598243ae [id=577676d7bf474665a4d1c87ed156bd7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:10.147512 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet f4f77b677ab34d9b8554de0da6564fb1 (table default.Table_c1ffe009c5034bb58dbe573808a6cf4a [id=fa021110da20405293f8488c41387d6c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f4f77b677ab34d9b8554de0da6564fb1 consensus state has no leader
I20260620 07:01:10.147630 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.147342 1166 rpcz_store.cc:276] 0620 07:01:02.923269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:02.927304 (+ 4035us) service_pool.cc:227] Handling call
0620 07:01:10.147041 (+7219737us) ts_tablet_manager.cc:1145] Deleting tablet f8ec1e179a704e5480f3deaf856156e7
0620 07:01:10.147051 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.147159 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7215073}
I20260620 07:01:10.151793 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 370) took 6904 ms. Trace:
I20260620 07:01:10.153187 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 612) took 2159 ms. Trace:
I20260620 07:01:10.153766 1853 server_base.cc:1034] running on GCE node
I20260620 07:01:10.141615 1001 tablet_service.cc:1467] Processing CreateTablet for tablet cce8fe9c323b49f9b5bc876d88f2e47f (DEFAULT_TABLE table=default.Table_171ec3d5af68477aa002548e814e04d2 [id=60a442d3849948528129a1864966c7b6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:10.154881 1966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:01:10.155231 1169 rpcz_store.cc:276] 0620 07:01:07.989554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.992423 (+ 2869us) service_pool.cc:227] Handling call
0620 07:01:10.146663 (+2154240us) ts_tablet_manager.cc:1145] Deleting tablet 6801c84abfa54f6983fae4b66aca8fd0
0620 07:01:10.146676 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.148711 (+ 2035us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2130206}
I20260620 07:01:10.155727 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 617) took 1816 ms. Trace:
I20260620 07:01:10.156172 1853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 07:01:10.158155 1853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 07:01:10.158574 1165 ts_tablet_manager.cc:1939] T a292d66ee14a48959c1f6a63e0a0f492 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:10.155879 1169 rpcz_store.cc:276] 0620 07:01:08.339691 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.339770 (+ 79us) service_pool.cc:227] Handling call
0620 07:01:10.155566 (+1815796us) ts_tablet_manager.cc:1145] Deleting tablet 1252d1dd03bd4a27983eb89d489b09d3
0620 07:01:10.155579 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.155691 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1815578}
I20260620 07:01:10.160205 1165 tablet_replica.cc:330] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:10.143748 995 tablet_service.cc:1467] Processing CreateTablet for tablet 7a554c1eebd542619bb1989987a3d9a6 (DEFAULT_TABLE table=default.Table_bddd763d82d14db2bc1ceb50eaa2ae69 [id=ce0f0684c47c4e5cab33dff293229b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.160418 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_35e279985d0c48b7b6580e1b957d3f39" } modify_external_catalogs: true
I20260620 07:01:10.160631 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_35e279985d0c48b7b6580e1b957d3f39" } modify_external_catalogs: true
I20260620 07:01:10.159030 1166 rpcz_store.cc:276] 0620 07:01:03.247041 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.247098 (+ 57us) service_pool.cc:227] Handling call
0620 07:01:10.151556 (+6904458us) ts_tablet_manager.cc:1145] Deleting tablet 864c95b908674e4f8425d765444c281b
0620 07:01:10.151566 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.151743 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6904209}
I20260620 07:01:10.161726 1166 tablet_replica.cc:330] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
W20260620 07:01:10.162251 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 864c95b908674e4f8425d765444c281b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 864c95b908674e4f8425d765444c281b already in progress: creating tablet
I20260620 07:01:10.162868 994 tablet_service.cc:1467] Processing CreateTablet for tablet 98a4eaf5abc0430590b6946cc5af33f5 (DEFAULT_TABLE table=default.Table_10542cf0587b4b6ea42cbafd00564c37 [id=a27ec536384c472aa8343ba8ebb96122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.163617 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cce8fe9c323b49f9b5bc876d88f2e47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.163479 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0634bf6a5c6e44348cbf328d2d3169c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:10.163622 1166 raft_consensus.cc:2229] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.164019 1166 raft_consensus.cc:2258] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:10.164074 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0634bf6a5c6e44348cbf328d2d3169c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.164229 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a554c1eebd542619bb1989987a3d9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.165429 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fcb02cf6b9ed4de5b759604ce94f822f" } modify_external_catalogs: true
I20260620 07:01:10.165598 1853 hybrid_clock.cc:648] HybridClock initialized: now 1781938870165513 us; error 68 us; skew 500 ppm
I20260620 07:01:10.165655 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fcb02cf6b9ed4de5b759604ce94f822f" } modify_external_catalogs: true
I20260620 07:01:10.166036 1853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 07:01:10.171355 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 4260b0c953c14a198dbf9b64a30e7e05 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:10.171460 1166 ts_tablet_manager.cc:1905] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.172551 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 46689d13712842bf9145ad2bc3fc2acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.093577 874 tablet_service.cc:1467] Processing CreateTablet for tablet cce8fe9c323b49f9b5bc876d88f2e47f (DEFAULT_TABLE table=default.Table_171ec3d5af68477aa002548e814e04d2 [id=60a442d3849948528129a1864966c7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.177184 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cce8fe9c323b49f9b5bc876d88f2e47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.178418 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98a4eaf5abc0430590b6946cc5af33f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.178171 1165 raft_consensus.cc:2229] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.180063 1165 raft_consensus.cc:2258] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.180624 1165 ts_tablet_manager.cc:1905] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.095781 860 tablet_service.cc:1514] Processing DeleteTablet for tablet b58ce7876b614d63932d458036c7e041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.105238 865 tablet_service.cc:1467] Processing CreateTablet for tablet 393521cca6b44618bbfb71423f36c6a1 (DEFAULT_TABLE table=default.Table_97e6f2abc164418f8571bab6b7db96e3 [id=fb35a9a8fe0941dd90ac690e188aa5bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.107959 859 tablet_service.cc:1467] Processing CreateTablet for tablet 2e05786efb6341ea85fb3d3c42bd85d7 (DEFAULT_TABLE table=default.Table_2975167a62b94aa0aaf9d2301469a1a3 [id=6ca6b6ef3e8f48ec9d4603ef851a98f0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:10.121487 831 leader_election.cc:341] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:10.181283 831 leader_election.cc:302] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:10.181481 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 393521cca6b44618bbfb71423f36c6a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:10.181579 831 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 60108.8us
I20260620 07:01:10.181627 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e05786efb6341ea85fb3d3c42bd85d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.182667 1935 raft_consensus.cc:2726] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:10.182809 872 tablet_service.cc:1467] Processing CreateTablet for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc (DEFAULT_TABLE table=default.Table_715948cd71c24a039a15b1a9598243ae [id=577676d7bf474665a4d1c87ed156bd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.182961 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet a292d66ee14a48959c1f6a63e0a0f492 (table default.Table_a31b6fbb7c36401aae31f37d6bcb978e [id=f178692be04f4e4db4933fb296012ddd]) successfully deleted
I20260620 07:01:10.183139 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:10.183241 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d05a505f73b24e0ba7159a3d411e5f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d05a505f73b24e0ba7159a3d411e5f4f already in progress: creating tablet
W20260620 07:01:10.183491 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a570e8da585d46839281d606b2f51938 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a570e8da585d46839281d606b2f51938 already in progress: creating tablet
I20260620 07:01:10.183887 858 tablet_service.cc:1467] Processing CreateTablet for tablet ef4e6fda73ba45c6892273b33b37a688 (DEFAULT_TABLE table=default.Table_f1244539cb0347b9ac10cd187df81019 [id=dc2e07584fb642de943bcfa4e41183c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.184187 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef4e6fda73ba45c6892273b33b37a688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.187398 1925 raft_consensus.cc:482] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.187462 871 tablet_service.cc:1467] Processing CreateTablet for tablet 98a4eaf5abc0430590b6946cc5af33f5 (DEFAULT_TABLE table=default.Table_10542cf0587b4b6ea42cbafd00564c37 [id=a27ec536384c472aa8343ba8ebb96122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.187595 1925 raft_consensus.cc:504] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.187841 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98a4eaf5abc0430590b6946cc5af33f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.188436 1925 leader_election.cc:288] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:10.187855 861 tablet_service.cc:1467] Processing CreateTablet for tablet 7a554c1eebd542619bb1989987a3d9a6 (DEFAULT_TABLE table=default.Table_bddd763d82d14db2bc1ceb50eaa2ae69 [id=ce0f0684c47c4e5cab33dff293229b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.188954 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a554c1eebd542619bb1989987a3d9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.189127 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a594df0df6ad48cab77cc1deed22bff0
W20260620 07:01:10.189713 969 leader_election.cc:341] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 46689d13712842bf9145ad2bc3fc2acf
I20260620 07:01:10.191103 860 tablet_service.cc:1514] Processing DeleteTablet for tablet f4e3145a872348b6a85a19d1678636bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.192166 860 tablet_service.cc:1514] Processing DeleteTablet for tablet a594df0df6ad48cab77cc1deed22bff0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.193343 872 tablet_service.cc:1467] Processing CreateTablet for tablet 41a03013bba54676abeaed30195e8a1e (DEFAULT_TABLE table=default.Table_02c16a393d864b6d9ca2890d79bdff69 [id=e98f701f6ea84a3eb83b1ad95cb0a7a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.176034 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 618) took 1763 ms. Trace:
I20260620 07:01:10.193737 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41a03013bba54676abeaed30195e8a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.195272 717 tablet_service.cc:1514] Processing DeleteTablet for tablet 2614cc40931e4c308a5a7208f2e8c400 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.087236 1168 tablet_bootstrap.cc:492] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:10.200953 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2d68ec4a72bf44408ae7549661a637e3" } new_table_name: "default.Table_bb633c146e9743d092c50bf2e1aeb423" modify_external_catalogs: true
I20260620 07:01:10.201759 861 tablet_service.cc:1467] Processing CreateTablet for tablet ffe4cee1210f4baf9fd02639444c0ec2 (DEFAULT_TABLE table=default.Table_ade72c04813c4285bb87ba905a586546 [id=5f5d3e219d3e41fb9800a745eb859503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.202122 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffe4cee1210f4baf9fd02639444c0ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.202358 1168 tablet_bootstrap.cc:654] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.204793 871 tablet_service.cc:1467] Processing CreateTablet for tablet b1aed58dc714451b94fc9a6c14b7d734 (DEFAULT_TABLE table=default.Table_0f0fb9d00a3343ffa74ad89bd28dc251 [id=e35f4f5df74544fc83864687526164d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.205411 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1aed58dc714451b94fc9a6c14b7d734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.205868 423 catalog_manager.cc:5495] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:10.210636 858 tablet_service.cc:1467] Processing CreateTablet for tablet d612e9caa8b540b4b96860491d653f11 (DEFAULT_TABLE table=default.Table_993f8296657448808071f4daac209774 [id=50b4364aa7f64b769c7f7968cccff4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.211179 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d612e9caa8b540b4b96860491d653f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.213519 872 tablet_service.cc:1467] Processing CreateTablet for tablet 02584f8ac08f4759a5f9a5aa699d0039 (DEFAULT_TABLE table=default.Table_375531d855b14594830e688497474a2c [id=13d4c6721fe24c61b91f5bb8f914763c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.214774 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02584f8ac08f4759a5f9a5aa699d0039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.215360 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46689d13712842bf9145ad2bc3fc2acf" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:10.215838 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet a594df0df6ad48cab77cc1deed22bff0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.219487 1000 tablet_service.cc:1467] Processing CreateTablet for tablet d612e9caa8b540b4b96860491d653f11 (DEFAULT_TABLE table=default.Table_993f8296657448808071f4daac209774 [id=50b4364aa7f64b769c7f7968cccff4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.220073 998 tablet_service.cc:1467] Processing CreateTablet for tablet 02584f8ac08f4759a5f9a5aa699d0039 (DEFAULT_TABLE table=default.Table_375531d855b14594830e688497474a2c [id=13d4c6721fe24c61b91f5bb8f914763c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.220541 999 tablet_service.cc:1467] Processing CreateTablet for tablet ffe4cee1210f4baf9fd02639444c0ec2 (DEFAULT_TABLE table=default.Table_ade72c04813c4285bb87ba905a586546 [id=5f5d3e219d3e41fb9800a745eb859503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.221729 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5883a8466d0c4e45aba3b4095ced91a4
I20260620 07:01:10.225914 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d612e9caa8b540b4b96860491d653f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.225963 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e94e3deb764f4de49ed3291a61ee8ab1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.226675 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e94e3deb764f4de49ed3291a61ee8ab1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.227029 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4260b0c953c14a198dbf9b64a30e7e05
I20260620 07:01:10.227126 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02584f8ac08f4759a5f9a5aa699d0039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.227464 422 catalog_manager.cc:6565] ReplaceTablet: tablet 4260b0c953c14a198dbf9b64a30e7e05 deleted and replaced by tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a
I20260620 07:01:10.229017 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 5883a8466d0c4e45aba3b4095ced91a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.228854 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 4260b0c953c14a198dbf9b64a30e7e05 with delete_type TABLET_DATA_DELETED (replaced by tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:10.229688 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0e6ef65b5f44f6d9f2100dd404b2e5f consensus state has no leader
I20260620 07:01:10.229998 1169 rpcz_store.cc:276] 0620 07:01:08.407362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.407426 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:10.159734 (+1752308us) ts_tablet_manager.cc:1145] Deleting tablet a4e8c06f3f8544ecafb63dd7d04fdf05
0620 07:01:10.159751 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.171210 (+ 11459us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1752029}
I20260620 07:01:10.230311 1009 tablet_service.cc:1467] Processing CreateTablet for tablet b1aed58dc714451b94fc9a6c14b7d734 (DEFAULT_TABLE table=default.Table_0f0fb9d00a3343ffa74ad89bd28dc251 [id=e35f4f5df74544fc83864687526164d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.231282 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9d9e9ea2ddae464a96fb6335aba96e75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:10.231768 751 raft_consensus.cc:2454] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
W20260620 07:01:10.231873 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d9e9ea2ddae464a96fb6335aba96e75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.232142 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffe4cee1210f4baf9fd02639444c0ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.216406 720 tablet_service.cc:1467] Processing CreateTablet for tablet 80de91cb9403499baccde4ffcf4abf5a (DEFAULT_TABLE table=default.Table_0ff972e19ff44c88864624047e7aff38 [id=a62d063e2e7847f08aa928e6bff800d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.232771 968 leader_election.cc:302] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:10.236503 1165 ts_tablet_manager.cc:1918] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.236420 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6f307d70fb934b379cdbbdabbc992f99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.237141 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f307d70fb934b379cdbbdabbc992f99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.237295 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 41a03013bba54676abeaed30195e8a1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.238059 1165 log.cc:1196] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ed69a44c466047d298cf7653b2a2bb23
I20260620 07:01:10.238443 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b4024ad63b56439d939324ae131affe6" } new_table_name: "default.Table_e96d88a6ea654cfcbfb4d47fed5a1c83" modify_external_catalogs: true
I20260620 07:01:10.239095 1165 ts_tablet_manager.cc:1939] T ed69a44c466047d298cf7653b2a2bb23 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:10.239274 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5d72ef54fe32494391f31d295db01e4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.239959 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d72ef54fe32494391f31d295db01e4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.241178 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ed69a44c466047d298cf7653b2a2bb23 (table default.Table_f99b2d2b64ca4a6b8acb835f5dbbc740 [id=e0814f1fc9264eae8150af51e6ede5f1]) successfully deleted
I20260620 07:01:10.241883 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b5161297262f49d1ac8ed9744005a35a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.242424 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5161297262f49d1ac8ed9744005a35a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.245110 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 4260b0c953c14a198dbf9b64a30e7e05 with delete_type TABLET_DATA_DELETED (replaced by tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.245369 1750 raft_consensus.cc:2781] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:10.239432 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 5883a8466d0c4e45aba3b4095ced91a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:10.246446 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8cca283f4d2645c0b59f750949b7e263 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cca283f4d2645c0b59f750949b7e263 already in progress: creating tablet
I20260620 07:01:10.246924 1750 raft_consensus.cc:482] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:10.247061 1750 raft_consensus.cc:3037] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:10.248267 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1aed58dc714451b94fc9a6c14b7d734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.246670 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 41a03013bba54676abeaed30195e8a1e (DEFAULT_TABLE table=default.Table_02c16a393d864b6d9ca2890d79bdff69 [id=e98f701f6ea84a3eb83b1ad95cb0a7a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.251189 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80de91cb9403499baccde4ffcf4abf5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.252455 1168 tablet_bootstrap.cc:492] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.252576 1168 ts_tablet_manager.cc:1397] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.165s user 0.005s sys 0.000s
I20260620 07:01:10.253342 1168 raft_consensus.cc:348] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.253616 1168 raft_consensus.cc:374] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.253675 1168 raft_consensus.cc:729] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.253854 1168 consensus_queue.cc:260] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.255040 717 tablet_service.cc:1467] Processing CreateTablet for tablet 393521cca6b44618bbfb71423f36c6a1 (DEFAULT_TABLE table=default.Table_97e6f2abc164418f8571bab6b7db96e3 [id=fb35a9a8fe0941dd90ac690e188aa5bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.255436 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 393521cca6b44618bbfb71423f36c6a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.256001 1935 raft_consensus.cc:482] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.255868 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_31d0405bb6474308a84704c3e98bb9fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:10.256126 1935 raft_consensus.cc:504] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:10.256464 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31d0405bb6474308a84704c3e98bb9fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.256666 1935 leader_election.cc:288] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:10.254074 1750 raft_consensus.cc:504] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.258293 1750 leader_election.cc:288] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:10.257301 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4e3145a872348b6a85a19d1678636bc" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:10.258875 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 619) took 1841 ms. Trace:
W20260620 07:01:10.259408 830 leader_election.cc:341] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:10.260962 969 leader_election.cc:341] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 46689d13712842bf9145ad2bc3fc2acf
I20260620 07:01:10.261107 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41a03013bba54676abeaed30195e8a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.263001 1168 ts_tablet_manager.cc:1428] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260620 07:01:10.262884 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_02dd512d8cdb48e98679252eee51b6bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.263427 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02dd512d8cdb48e98679252eee51b6bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:10.264463 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 13c7f0513df34ddb8104b06e5733fb62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13c7f0513df34ddb8104b06e5733fb62 already in progress: creating tablet
I20260620 07:01:10.265018 1165 tablet_replica.cc:330] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:10.265805 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_55c10675b20148549679607191b74a20" } new_table_name: "default.Table_759a7e5d01564a1fb58f0994637d7897" modify_external_catalogs: true
I20260620 07:01:10.266964 1168 tablet_bootstrap.cc:492] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:10.267175 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b72b2c9d38dd47108c5784845153d5e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.267715 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b72b2c9d38dd47108c5784845153d5e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.268364 1168 tablet_bootstrap.cc:654] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.268653 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 5a4390225af348f89c934f0f179ddab5 (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]). Expected version 1 got 0
I20260620 07:01:10.269683 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46689d13712842bf9145ad2bc3fc2acf" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:10.270313 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c74dcab9083d4b6f894cee0e428ad089" } new_table_name: "default.Table_13403c45f0a94678999f62954a653d5f" modify_external_catalogs: true
I20260620 07:01:10.273066 423 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 5a4390225af348f89c934f0f179ddab5 (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]). Expected version 1 got 0
I20260620 07:01:10.274426 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 1b98711dfb114a2985c5153e9b44147a (table default.Table_97d5316440584dd08daee78c90a8eb10 [id=fd979c937e3048858b59d596663abdc4]). Expected version 2 got 0
W20260620 07:01:10.280580 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1c64df83a18a470c98a9c1fd6bb38918 consensus state has no leader
I20260620 07:01:10.272967 715 tablet_service.cc:1467] Processing CreateTablet for tablet cce8fe9c323b49f9b5bc876d88f2e47f (DEFAULT_TABLE table=default.Table_171ec3d5af68477aa002548e814e04d2 [id=60a442d3849948528129a1864966c7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.286800 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4e3145a872348b6a85a19d1678636bc" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:10.287355 752 raft_consensus.cc:3037] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:10.287473 831 leader_election.cc:341] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:10.287592 831 leader_election.cc:302] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:10.287825 1935 raft_consensus.cc:2726] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:10.288115 728 tablet_service.cc:1467] Processing CreateTablet for tablet 2e05786efb6341ea85fb3d3c42bd85d7 (DEFAULT_TABLE table=default.Table_2975167a62b94aa0aaf9d2301469a1a3 [id=6ca6b6ef3e8f48ec9d4603ef851a98f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.288952 734 tablet_service.cc:1514] Processing DeleteTablet for tablet b58ce7876b614d63932d458036c7e041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.290498 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_811e4d61e71e47ab80ad8c0488b3183c" } modify_external_catalogs: true
I20260620 07:01:10.291304 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_811e4d61e71e47ab80ad8c0488b3183c" } modify_external_catalogs: true
I20260620 07:01:10.298146 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_94105963fc7f435e8b8a16141f29f408" } modify_external_catalogs: true
I20260620 07:01:10.298476 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_94105963fc7f435e8b8a16141f29f408" } modify_external_catalogs: true
I20260620 07:01:10.301867 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cce8fe9c323b49f9b5bc876d88f2e47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.265195 1165 raft_consensus.cc:2229] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.304064 1165 raft_consensus.cc:2258] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.305224 1165 ts_tablet_manager.cc:1905] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.306437 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_03892f83a5e34559bbbe72bbb8bcd8c4" } new_table_name: "default.Table_b2ccc4a1e0b04597931d5b0e14de403c" modify_external_catalogs: true
I20260620 07:01:10.315742 1166 ts_tablet_manager.cc:1918] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.316208 1853 webserver.cc:460] Webserver started at http://127.0.97.61:38159/ using document root <none> and password file <none>
I20260620 07:01:10.316565 733 tablet_service.cc:1467] Processing CreateTablet for tablet ef4e6fda73ba45c6892273b33b37a688 (DEFAULT_TABLE table=default.Table_f1244539cb0347b9ac10cd187df81019 [id=dc2e07584fb642de943bcfa4e41183c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.318427 1853 fs_manager.cc:359] Metadata directory not provided
I20260620 07:01:10.318907 1853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 07:01:10.316735 1169 rpcz_store.cc:276] 0620 07:01:08.408130 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.408189 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:10.230348 (+1822159us) ts_tablet_manager.cc:1145] Deleting tablet 113dd3d57c144088ae7204dc5229f883
0620 07:01:10.246892 (+ 16544us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.250004 (+ 3112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1821940}
I20260620 07:01:10.322707 1165 ts_tablet_manager.cc:1918] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.323460 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e05786efb6341ea85fb3d3c42bd85d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.324424 1170 tablet_bootstrap.cc:700] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425: Time spent opening tablet: real 0.139s user 0.000s sys 0.000s
I20260620 07:01:10.325006 729 tablet_service.cc:1467] Processing CreateTablet for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc (DEFAULT_TABLE table=default.Table_715948cd71c24a039a15b1a9598243ae [id=577676d7bf474665a4d1c87ed156bd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.325279 1165 log.cc:1196] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f690e150839a4d23860932712f61e7c8
I20260620 07:01:10.326174 1165 ts_tablet_manager.cc:1939] T f690e150839a4d23860932712f61e7c8 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:10.332373 1169 tablet_replica.cc:330] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:10.335572 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef4e6fda73ba45c6892273b33b37a688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.336859 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.342489 752 raft_consensus.cc:2454] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:10.344816 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_03279cc268a143a0b89229d8a948759b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.345652 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03279cc268a143a0b89229d8a948759b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:10.346035 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f8ddfba5500406eba8f184bd5039170 consensus state has no leader
I20260620 07:01:10.347681 720 tablet_service.cc:1514] Processing DeleteTablet for tablet f4e3145a872348b6a85a19d1678636bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.352926 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9016cc3335c9474492924d45cbc4dcea" } modify_external_catalogs: true
I20260620 07:01:10.353901 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9016cc3335c9474492924d45cbc4dcea" } modify_external_catalogs: true
I20260620 07:01:10.338917 734 tablet_service.cc:1467] Processing CreateTablet for tablet 7a554c1eebd542619bb1989987a3d9a6 (DEFAULT_TABLE table=default.Table_bddd763d82d14db2bc1ceb50eaa2ae69 [id=ce0f0684c47c4e5cab33dff293229b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.366519 1169 raft_consensus.cc:2229] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:10.369024 731 tablet_service.cc:1514] Processing DeleteTablet for tablet a594df0df6ad48cab77cc1deed22bff0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.371891 716 tablet_service.cc:1467] Processing CreateTablet for tablet 41a03013bba54676abeaed30195e8a1e (DEFAULT_TABLE table=default.Table_02c16a393d864b6d9ca2890d79bdff69 [id=e98f701f6ea84a3eb83b1ad95cb0a7a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.376327 1169 pending_rounds.cc:62] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:10.376602 1170 tablet_bootstrap.cc:654] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.377867 1169 pending_rounds.cc:68] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821610507997184 op_type: NO_OP noop_request { }
I20260620 07:01:10.378149 1169 raft_consensus.cc:2866] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:10.378363 1169 raft_consensus.cc:2258] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.379321 1169 ts_tablet_manager.cc:1905] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.385090 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f690e150839a4d23860932712f61e7c8 (table default.Table_52bd8cf613ad458b8436906e69e4cbd8 [id=72036a5a731244a4a1f797ec8663aef8]) successfully deleted
I20260620 07:01:10.385236 1165 tablet_replica.cc:330] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:10.385476 1165 raft_consensus.cc:2229] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.385654 1165 raft_consensus.cc:2258] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.386183 1165 ts_tablet_manager.cc:1905] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.387661 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a554c1eebd542619bb1989987a3d9a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:10.391110 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2614cc40931e4c308a5a7208f2e8c400 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2614cc40931e4c308a5a7208f2e8c400 already in progress: creating tablet
W20260620 07:01:10.391469 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 490eb0893a4f4811b7574c445e483549 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 490eb0893a4f4811b7574c445e483549 already in progress: creating tablet
I20260620 07:01:10.393923 1165 ts_tablet_manager.cc:1918] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.394147 1165 log.cc:1196] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/cfff2a14b1184d39bd7ac1091ef749c9
I20260620 07:01:10.396322 1165 ts_tablet_manager.cc:1939] T cfff2a14b1184d39bd7ac1091ef749c9 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:10.397006 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet cfff2a14b1184d39bd7ac1091ef749c9 (table default.Table_625f2cf95ae74282910b8556035bc856 [id=dfd2898601854be0ba91e18aca844d9f]) successfully deleted
W20260620 07:01:10.397377 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e972b9bef1bd4c19ac0a8c86331dce60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e972b9bef1bd4c19ac0a8c86331dce60 already in progress: creating tablet
I20260620 07:01:10.331969 1925 raft_consensus.cc:482] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:10.397723 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 41a03013bba54676abeaed30195e8a1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41a03013bba54676abeaed30195e8a1e already in progress: creating tablet
I20260620 07:01:10.397780 1925 raft_consensus.cc:504] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.398818 1925 leader_election.cc:288] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:10.343477 968 leader_election.cc:302] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
W20260620 07:01:10.399170 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 55752.7us
I20260620 07:01:10.385442 1167 tablet_bootstrap.cc:492] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:01:10.400346 969 leader_election.cc:341] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 369c205d7f7841598cb99f661b25736f
I20260620 07:01:10.400555 1925 raft_consensus.cc:2781] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:10.400580 1168 tablet_bootstrap.cc:492] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.400714 1925 raft_consensus.cc:686] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
W20260620 07:01:10.401093 968 leader_election.cc:341] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 369c205d7f7841598cb99f661b25736f
I20260620 07:01:10.401008 1925 consensus_queue.cc:237] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.401224 968 leader_election.cc:302] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:10.401714 1750 raft_consensus.cc:2726] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:10.401896 1750 raft_consensus.cc:482] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.402074 1750 raft_consensus.cc:504] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.402271 1167 ts_tablet_manager.cc:1397] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.271s user 0.037s sys 0.039s
I20260620 07:01:10.402709 1750 leader_election.cc:288] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:10.403429 1168 ts_tablet_manager.cc:1397] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.137s user 0.018s sys 0.004s
I20260620 07:01:10.403642 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d04bb18f7b0c43d8aeeb6fbeba126279" } modify_external_catalogs: true
I20260620 07:01:10.403959 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d04bb18f7b0c43d8aeeb6fbeba126279" } modify_external_catalogs: true
I20260620 07:01:10.404426 1168 raft_consensus.cc:348] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.404677 1168 raft_consensus.cc:374] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.404750 1168 raft_consensus.cc:729] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:10.408854 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c11f2678559c41d3bc71d4fa04efd0ac consensus state has no leader
I20260620 07:01:10.412170 1168 consensus_queue.cc:260] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:10.412884 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b58ce7876b614d63932d458036c7e041 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b58ce7876b614d63932d458036c7e041 already in progress: creating tablet
W20260620 07:01:10.415067 968 leader_election.cc:341] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e2b0faf91f2f469f9b06e17caa4709e4
I20260620 07:01:10.415321 1165 tablet_replica.cc:330] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:10.415491 1168 ts_tablet_manager.cc:1428] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
W20260620 07:01:10.415865 969 leader_election.cc:341] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e2b0faf91f2f469f9b06e17caa4709e4
I20260620 07:01:10.416021 969 leader_election.cc:302] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:10.416440 1750 raft_consensus.cc:2726] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:10.395670 724 tablet_service.cc:1467] Processing CreateTablet for tablet 98a4eaf5abc0430590b6946cc5af33f5 (DEFAULT_TABLE table=default.Table_10542cf0587b4b6ea42cbafd00564c37 [id=a27ec536384c472aa8343ba8ebb96122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.415807 1168 tablet_bootstrap.cc:492] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:10.406849 731 tablet_service.cc:1467] Processing CreateTablet for tablet b1aed58dc714451b94fc9a6c14b7d734 (DEFAULT_TABLE table=default.Table_0f0fb9d00a3343ffa74ad89bd28dc251 [id=e35f4f5df74544fc83864687526164d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.417719 1167 raft_consensus.cc:348] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.418062 1167 raft_consensus.cc:374] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.418176 1167 raft_consensus.cc:729] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.418707 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 261f0d97e1084e828b9562cb30ea422b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.418459 1167 consensus_queue.cc:260] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.419119 1165 raft_consensus.cc:2229] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.419421 1165 raft_consensus.cc:2258] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.420037 1165 ts_tablet_manager.cc:1905] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.420675 1167 ts_tablet_manager.cc:1428] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260620 07:01:10.421267 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41a03013bba54676abeaed30195e8a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.421780 1167 tablet_bootstrap.cc:492] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:10.422276 1168 tablet_bootstrap.cc:654] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.423156 727 tablet_service.cc:1467] Processing CreateTablet for tablet ffe4cee1210f4baf9fd02639444c0ec2 (DEFAULT_TABLE table=default.Table_ade72c04813c4285bb87ba905a586546 [id=5f5d3e219d3e41fb9800a745eb859503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.423789 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 09eddf4734144bdaba24759647553020 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:10.426393 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_51c799b6e1ca4b06828745a6337bdaa0" } modify_external_catalogs: true
I20260620 07:01:10.426654 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_51c799b6e1ca4b06828745a6337bdaa0" } modify_external_catalogs: true
I20260620 07:01:10.427048 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f0e54f1185cd4c5c8e5d2ed289b61650
W20260620 07:01:10.427489 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7a024765ed144281a81db3b75cd271bf consensus state has no leader
I20260620 07:01:10.428105 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a13a60f7f3e74f7dbf5204c974e0e346
I20260620 07:01:10.428506 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e54f1185cd4c5c8e5d2ed289b61650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.428712 1750 raft_consensus.cc:482] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.428829 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1aed58dc714451b94fc9a6c14b7d734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.428902 1750 raft_consensus.cc:504] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.429503 1750 leader_election.cc:288] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:10.432842 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0467f4c59a6647f0b8dc78ce62517b66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.433736 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0467f4c59a6647f0b8dc78ce62517b66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.435130 733 tablet_service.cc:1467] Processing CreateTablet for tablet 02584f8ac08f4759a5f9a5aa699d0039 (DEFAULT_TABLE table=default.Table_375531d855b14594830e688497474a2c [id=13d4c6721fe24c61b91f5bb8f914763c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.436517 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98a4eaf5abc0430590b6946cc5af33f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.436847 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet a13a60f7f3e74f7dbf5204c974e0e346 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.438189 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_162437373a6643e0b0c86bae5698a6ce" } new_table_name: "default.Table_35a0e30f853640ff94b025abf4fe9d66" modify_external_catalogs: true
W20260620 07:01:10.438548 969 leader_election.cc:341] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: da1e30385ed44c7f8b7db868f2e2bc29
I20260620 07:01:10.439160 858 tablet_service.cc:1514] Processing DeleteTablet for tablet a13a60f7f3e74f7dbf5204c974e0e346 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.439495 1167 tablet_bootstrap.cc:654] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.439935 1166 log.cc:1196] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/d15ea9529afe40b6b4a702035479aef3
I20260620 07:01:10.440456 1166 ts_tablet_manager.cc:1939] T d15ea9529afe40b6b4a702035479aef3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:10.441429 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 371) took 7190 ms. Trace:
I20260620 07:01:10.441599 1166 rpcz_store.cc:276] 0620 07:01:03.251197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.251271 (+ 74us) service_pool.cc:227] Handling call
0620 07:01:10.161668 (+6910397us) ts_tablet_manager.cc:1145] Deleting tablet d15ea9529afe40b6b4a702035479aef3
0620 07:01:10.161676 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.250668 (+ 88992us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.315582 (+ 64914us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.441370 (+125788us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11648,"tablet-delete.queue_time_us":6910084}
I20260620 07:01:10.442625 1917 consensus_queue.cc:1035] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 07:01:10.443198 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffe4cee1210f4baf9fd02639444c0ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.444020 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 4260b0c953c14a198dbf9b64a30e7e05 with delete_type TABLET_DATA_DELETED (replaced by tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.445071 861 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e54f1185cd4c5c8e5d2ed289b61650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.457087 720 tablet_service.cc:1514] Processing DeleteTablet for tablet d15ea9529afe40b6b4a702035479aef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.462081 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_394931c572964938b1a601ca97ea4a2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.462958 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_394931c572964938b1a601ca97ea4a2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:10.463621 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 033c8b817757441ea7ebc2dbf77aa2dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033c8b817757441ea7ebc2dbf77aa2dd already in progress: creating tablet
W20260620 07:01:10.466504 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6801c84abfa54f6983fae4b66aca8fd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6801c84abfa54f6983fae4b66aca8fd0 already in progress: creating tablet
W20260620 07:01:10.466917 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1252d1dd03bd4a27983eb89d489b09d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1252d1dd03bd4a27983eb89d489b09d3 already in progress: creating tablet
W20260620 07:01:10.467777 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba189cfcef094a7bb45bc7d5f4ee5b71 consensus state has no leader
W20260620 07:01:10.469264 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a4e8c06f3f8544ecafb63dd7d04fdf05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4e8c06f3f8544ecafb63dd7d04fdf05 already in progress: creating tablet
W20260620 07:01:10.469857 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 113dd3d57c144088ae7204dc5229f883 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 113dd3d57c144088ae7204dc5229f883 already in progress: creating tablet
I20260620 07:01:10.472877 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_79f21480be5047f7ac25be9822c09588"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.473639 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79f21480be5047f7ac25be9822c09588 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.475420 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6db2de0b2a534fa99a3ea6ee35d2c508"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.476023 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6db2de0b2a534fa99a3ea6ee35d2c508 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.477360 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 5883a8466d0c4e45aba3b4095ced91a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.478402 723 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e54f1185cd4c5c8e5d2ed289b61650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.479363 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da1e30385ed44c7f8b7db868f2e2bc29" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:10.481936 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_28b6597a276f422ca492083967fb6ee4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.482623 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28b6597a276f422ca492083967fb6ee4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.483451 717 tablet_service.cc:1467] Processing CreateTablet for tablet d612e9caa8b540b4b96860491d653f11 (DEFAULT_TABLE table=default.Table_993f8296657448808071f4daac209774 [id=50b4364aa7f64b769c7f7968cccff4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.484362 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 46689d13712842bf9145ad2bc3fc2acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.484561 752 raft_consensus.cc:2454] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:10.486960 732 tablet_service.cc:1514] Processing DeleteTablet for tablet a13a60f7f3e74f7dbf5204c974e0e346 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.487219 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02584f8ac08f4759a5f9a5aa699d0039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.447940 1167 tablet_bootstrap.cc:492] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:10.489975 1167 ts_tablet_manager.cc:1397] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.069s user 0.006s sys 0.004s
I20260620 07:01:10.490031 1166 tablet_replica.cc:330] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:10.490264 1166 raft_consensus.cc:2229] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.490456 1166 raft_consensus.cc:2258] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.490830 1167 raft_consensus.cc:348] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.491048 1167 raft_consensus.cc:374] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.491129 1167 raft_consensus.cc:729] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.491330 1167 consensus_queue.cc:260] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.491863 1167 ts_tablet_manager.cc:1428] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:10.492163 1167 tablet_bootstrap.cc:492] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:10.493829 1167 tablet_bootstrap.cc:654] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.485014 968 leader_election.cc:302] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:10.497138 1977 raft_consensus.cc:2781] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:10.497226 1977 raft_consensus.cc:482] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:10.497323 1977 raft_consensus.cc:3037] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:10.499986 1977 raft_consensus.cc:504] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.500705 1977 leader_election.cc:288] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:10.501619 969 leader_election.cc:341] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: da1e30385ed44c7f8b7db868f2e2bc29
I20260620 07:01:10.503042 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d612e9caa8b540b4b96860491d653f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.504976 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da1e30385ed44c7f8b7db868f2e2bc29" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:10.505788 754 raft_consensus.cc:3037] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:10.484048 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8aa7864d15a54ee5bb36deaf2d452309" } new_table_name: "default.Table_3047443c44374ec98f280f73cbe2e6f6" modify_external_catalogs: true
I20260620 07:01:10.490137 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet d15ea9529afe40b6b4a702035479aef3 (table default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]) successfully deleted
I20260620 07:01:10.496803 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ecac1f12f41f42609220ff60055c6e50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.508713 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecac1f12f41f42609220ff60055c6e50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.516806 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 4f41781c106e4a9bbbda32dc84b08797 (DEFAULT_TABLE table=default.Table_f1984579a670481b9fbcc82593055fa3 [id=a1aab549cb7349a6a8ab8cd4a1880619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.517285 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f41781c106e4a9bbbda32dc84b08797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.518740 858 tablet_service.cc:1467] Processing CreateTablet for tablet 0e8e9256a3c0466abfacc2b4266a5db2 (DEFAULT_TABLE table=default.Table_1d27a7ef447b4adaa697d276f936bd20 [id=ef91f3de05904b66a815cba96a596385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.518740 871 tablet_service.cc:1467] Processing CreateTablet for tablet 1d4994d7318d4d4aa427d3aaea3454de (DEFAULT_TABLE table=default.Table_ffb7f02cd84f4eeba71dc4d8abc459da [id=d62735e0b3ff4286bddd7f339310c608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.519236 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e8e9256a3c0466abfacc2b4266a5db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.519383 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d4994d7318d4d4aa427d3aaea3454de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.522051 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_372f2b67fb3f40de80d976f4dcf68621"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.522694 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_372f2b67fb3f40de80d976f4dcf68621 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.523602 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 0e8e9256a3c0466abfacc2b4266a5db2 (DEFAULT_TABLE table=default.Table_1d27a7ef447b4adaa697d276f936bd20 [id=ef91f3de05904b66a815cba96a596385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.524108 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e8e9256a3c0466abfacc2b4266a5db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.527173 998 tablet_service.cc:1467] Processing CreateTablet for tablet 1d4994d7318d4d4aa427d3aaea3454de (DEFAULT_TABLE table=default.Table_ffb7f02cd84f4eeba71dc4d8abc459da [id=d62735e0b3ff4286bddd7f339310c608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.527714 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d4994d7318d4d4aa427d3aaea3454de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.527812 1165 ts_tablet_manager.cc:1918] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.527947 1165 log.cc:1196] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f4e3145a872348b6a85a19d1678636bc
I20260620 07:01:10.528270 1165 ts_tablet_manager.cc:1939] T f4e3145a872348b6a85a19d1678636bc P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:10.528889 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f4e3145a872348b6a85a19d1678636bc (table default.Table_1f805755212a4ca8861811107079a79b [id=543dd082f0474b39ae0f0e66dc257ebb]) successfully deleted
I20260620 07:01:10.529124 1165 tablet_replica.cc:330] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:10.529233 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a594df0df6ad48cab77cc1deed22bff0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a594df0df6ad48cab77cc1deed22bff0 already in progress: creating tablet
I20260620 07:01:10.529326 1165 raft_consensus.cc:2229] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:10.529428 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 4260b0c953c14a198dbf9b64a30e7e05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4260b0c953c14a198dbf9b64a30e7e05 already in progress: creating tablet
I20260620 07:01:10.529476 1165 raft_consensus.cc:2258] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:10.529687 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5883a8466d0c4e45aba3b4095ced91a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5883a8466d0c4e45aba3b4095ced91a4 already in progress: creating tablet
I20260620 07:01:10.530450 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cdf87d4ae1fc4d17a096825dfe433346"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.531060 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdf87d4ae1fc4d17a096825dfe433346 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.533509 728 tablet_service.cc:1467] Processing CreateTablet for tablet 4f41781c106e4a9bbbda32dc84b08797 (DEFAULT_TABLE table=default.Table_f1984579a670481b9fbcc82593055fa3 [id=a1aab549cb7349a6a8ab8cd4a1880619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.533972 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f41781c106e4a9bbbda32dc84b08797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.536473 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 63525282e222490687713a92e5371a5c from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:10.538038 861 tablet_service.cc:1467] Processing CreateTablet for tablet 4f41781c106e4a9bbbda32dc84b08797 (DEFAULT_TABLE table=default.Table_f1984579a670481b9fbcc82593055fa3 [id=a1aab549cb7349a6a8ab8cd4a1880619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.538440 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f41781c106e4a9bbbda32dc84b08797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.539233 1920 consensus_queue.cc:1035] T c5919c99f3324f7ba52c72e91b35afaf P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:10.541563 1920 raft_consensus.cc:482] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.541792 1920 raft_consensus.cc:504] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.542500 1920 leader_election.cc:288] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:10.544945 683 leader_election.cc:341] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d15ea9529afe40b6b4a702035479aef3
I20260620 07:01:10.547896 1168 tablet_bootstrap.cc:492] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.548017 1168 ts_tablet_manager.cc:1397] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.132s user 0.005s sys 0.009s
I20260620 07:01:10.548847 1165 ts_tablet_manager.cc:1905] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.548755 1168 raft_consensus.cc:348] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.548941 1168 raft_consensus.cc:374] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.548993 1168 raft_consensus.cc:729] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.549201 1168 consensus_queue.cc:260] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.550078 1168 ts_tablet_manager.cc:1428] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:10.550338 1168 tablet_bootstrap.cc:492] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:10.550851 681 leader_election.cc:341] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: d15ea9529afe40b6b4a702035479aef3
I20260620 07:01:10.551052 681 leader_election.cc:302] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:10.552503 1920 raft_consensus.cc:2726] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:10.553813 1853 fs_manager.cc:709] Time spent opening directory manager: real 0.195s user 0.006s sys 0.001s
I20260620 07:01:10.557816 1168 tablet_bootstrap.cc:654] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.559289 1166 ts_tablet_manager.cc:1905] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.560424 858 tablet_service.cc:1467] Processing CreateTablet for tablet 5855497e5b22493bb60024d30cc23e03 (DEFAULT_TABLE table=default.Table_7e14acf1c0a24b5fb959872664181f23 [id=63a6e59515664aaea4b249b982e806da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.561537 871 tablet_service.cc:1467] Processing CreateTablet for tablet 5d394816a1114bf688692a825a176c92 (DEFAULT_TABLE table=default.Table_871c3bd853224b7da9f77c9c7efb1065 [id=b646278387f5410882006e44fc0fdb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.562304 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 5d394816a1114bf688692a825a176c92 (DEFAULT_TABLE table=default.Table_871c3bd853224b7da9f77c9c7efb1065 [id=b646278387f5410882006e44fc0fdb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.562960 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d394816a1114bf688692a825a176c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.562386 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 5855497e5b22493bb60024d30cc23e03 (DEFAULT_TABLE table=default.Table_7e14acf1c0a24b5fb959872664181f23 [id=63a6e59515664aaea4b249b982e806da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.563428 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5855497e5b22493bb60024d30cc23e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.565536 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d394816a1114bf688692a825a176c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.569177 1168 tablet_bootstrap.cc:492] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.569311 1168 ts_tablet_manager.cc:1397] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260620 07:01:10.570075 1168 raft_consensus.cc:348] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.570279 1168 raft_consensus.cc:374] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.570326 1168 raft_consensus.cc:729] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.570528 1168 consensus_queue.cc:260] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.571383 1168 ts_tablet_manager.cc:1428] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:10.571724 1168 tablet_bootstrap.cc:492] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:10.573035 859 tablet_service.cc:1467] Processing CreateTablet for tablet 47365e10ce274af891055b34e2f0a2bd (DEFAULT_TABLE table=default.Table_d82480660a9a4d358324cb6f84fdb341 [id=498b500cdad240b2a9ecb40dcdd49be9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.573057 994 tablet_service.cc:1467] Processing CreateTablet for tablet 47365e10ce274af891055b34e2f0a2bd (DEFAULT_TABLE table=default.Table_d82480660a9a4d358324cb6f84fdb341 [id=498b500cdad240b2a9ecb40dcdd49be9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.573448 1168 tablet_bootstrap.cc:654] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.573455 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47365e10ce274af891055b34e2f0a2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.574321 871 tablet_service.cc:1467] Processing CreateTablet for tablet 2acd2bd3fd5a42b0ba00820462e49bee (DEFAULT_TABLE table=default.Table_b79f978eee17412da963a4c4ccd88fcc [id=3a6efe4303a045848dc121fb1e81275d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.574632 999 tablet_service.cc:1467] Processing CreateTablet for tablet 2acd2bd3fd5a42b0ba00820462e49bee (DEFAULT_TABLE table=default.Table_b79f978eee17412da963a4c4ccd88fcc [id=3a6efe4303a045848dc121fb1e81275d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.574638 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2acd2bd3fd5a42b0ba00820462e49bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.574961 1166 ts_tablet_manager.cc:1918] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.575085 1166 log.cc:1196] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f8b961698fe54e7f9c16f41b90058093
I20260620 07:01:10.575111 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2acd2bd3fd5a42b0ba00820462e49bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.575479 1166 ts_tablet_manager.cc:1939] T f8b961698fe54e7f9c16f41b90058093 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:10.576350 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 372) took 7305 ms. Trace:
I20260620 07:01:10.576478 1166 rpcz_store.cc:276] 0620 07:01:03.270664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.270737 (+ 73us) service_pool.cc:227] Handling call
0620 07:01:10.489915 (+7219178us) ts_tablet_manager.cc:1145] Deleting tablet f8b961698fe54e7f9c16f41b90058093
0620 07:01:10.489929 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.563050 (+ 73121us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.574809 (+ 11759us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.576296 (+ 1487us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7218820}
I20260620 07:01:10.576979 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 373) took 7299 ms. Trace:
I20260620 07:01:10.577107 1166 rpcz_store.cc:276] 0620 07:01:03.277794 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.277867 (+ 73us) service_pool.cc:227] Handling call
0620 07:01:10.576816 (+7298949us) ts_tablet_manager.cc:1145] Deleting tablet 485ce059be9b4900adb1dbc3268efb55
0620 07:01:10.576826 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.576944 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7298623}
I20260620 07:01:10.577464 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 386) took 7147 ms. Trace:
I20260620 07:01:10.577564 1166 rpcz_store.cc:276] 0620 07:01:03.430510 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.430566 (+ 56us) service_pool.cc:227] Handling call
0620 07:01:10.577343 (+7146777us) ts_tablet_manager.cc:1145] Deleting tablet 9da80903ac124d1aae937c2329f9b13e
0620 07:01:10.577352 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.577432 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7146548}
I20260620 07:01:10.577889 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 387) took 7147 ms. Trace:
I20260620 07:01:10.577996 1166 rpcz_store.cc:276] 0620 07:01:03.430700 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.430852 (+ 152us) service_pool.cc:227] Handling call
0620 07:01:10.577783 (+7146931us) ts_tablet_manager.cc:1145] Deleting tablet 25b878def9344cbdae65b209cac4067f
0620 07:01:10.577791 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.577857 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7146780}
I20260620 07:01:10.578315 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 388) took 7144 ms. Trace:
I20260620 07:01:10.578423 1166 rpcz_store.cc:276] 0620 07:01:03.433917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.433977 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:10.578215 (+7144238us) ts_tablet_manager.cc:1145] Deleting tablet 7d9f7cf9e3a14e28ac20662b5e86dc41
0620 07:01:10.578224 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.578278 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7143948}
I20260620 07:01:10.578670 1166 tablet_replica.cc:330] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:10.579262 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5855497e5b22493bb60024d30cc23e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.579301 1166 raft_consensus.cc:2229] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.579547 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f8b961698fe54e7f9c16f41b90058093 (table default.Table_4fd706d123b84bd4869c44a4d0e794c3 [id=681c188b41234255b290334fb43f58f1]) successfully deleted
W20260620 07:01:10.579895 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 485ce059be9b4900adb1dbc3268efb55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 485ce059be9b4900adb1dbc3268efb55 already in progress: creating tablet
W20260620 07:01:10.580120 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9da80903ac124d1aae937c2329f9b13e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9da80903ac124d1aae937c2329f9b13e already in progress: creating tablet
W20260620 07:01:10.580292 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 25b878def9344cbdae65b209cac4067f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25b878def9344cbdae65b209cac4067f already in progress: creating tablet
W20260620 07:01:10.580500 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7d9f7cf9e3a14e28ac20662b5e86dc41 because the tablet was not found. No further retry: Not found: Tablet not found: 7d9f7cf9e3a14e28ac20662b5e86dc41
I20260620 07:01:10.580708 861 tablet_service.cc:1467] Processing CreateTablet for tablet 6723948279f347fe96054e1e1fd29b40 (DEFAULT_TABLE table=default.Table_51842d9d7b0349ba9f9ef93fe5727b59 [id=6cb6aca8e45a4f4abaa3d3214d273fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.583381 732 tablet_service.cc:1467] Processing CreateTablet for tablet 1d4994d7318d4d4aa427d3aaea3454de (DEFAULT_TABLE table=default.Table_ffb7f02cd84f4eeba71dc4d8abc459da [id=d62735e0b3ff4286bddd7f339310c608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.586290 1166 raft_consensus.cc:2258] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.584560 998 tablet_service.cc:1467] Processing CreateTablet for tablet 6723948279f347fe96054e1e1fd29b40 (DEFAULT_TABLE table=default.Table_51842d9d7b0349ba9f9ef93fe5727b59 [id=6cb6aca8e45a4f4abaa3d3214d273fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.580858 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47365e10ce274af891055b34e2f0a2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.587230 1166 ts_tablet_manager.cc:1905] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.588225 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d4994d7318d4d4aa427d3aaea3454de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.589596 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6723948279f347fe96054e1e1fd29b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.596128 1166 ts_tablet_manager.cc:1918] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.597494 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6723948279f347fe96054e1e1fd29b40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:10.606498 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e07325dc3f649aca9c5fc21c47d360f consensus state has no leader
I20260620 07:01:10.593812 718 tablet_service.cc:1467] Processing CreateTablet for tablet 0e8e9256a3c0466abfacc2b4266a5db2 (DEFAULT_TABLE table=default.Table_1d27a7ef447b4adaa697d276f936bd20 [id=ef91f3de05904b66a815cba96a596385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.609787 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fc3fba692ea14fa4b439fbffb8656e3c" } new_table_name: "default.Table_7089aa2571e44d8aaa70cadb5e74d87e" modify_external_catalogs: true
I20260620 07:01:10.614430 872 tablet_service.cc:1467] Processing CreateTablet for tablet 7a44aedbe24c4d9798663bfe3e1e5342 (DEFAULT_TABLE table=default.Table_39654cee1c26433a94f549acb9787681 [id=70c608a162464e60bf24c338d6e49161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.614530 859 tablet_service.cc:1467] Processing CreateTablet for tablet 24a2fa7712d9407cb64e67f0f6338fcf (DEFAULT_TABLE table=default.Table_5e750ac167754573aaf4644d64503ecd [id=cd22d162be674c9b8bc21d1ce0059149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.615243 865 tablet_service.cc:1467] Processing CreateTablet for tablet 0b9222f1374e4e96bd760af1a52f3a1c (DEFAULT_TABLE table=default.Table_0d696424e47747e8aff9258ac6a3dec4 [id=8fdc5f3c56fd4fbaacef64dc1da4d345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.615460 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e8e9256a3c0466abfacc2b4266a5db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.619424 1169 ts_tablet_manager.cc:1918] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:10.620726 1165 ts_tablet_manager.cc:1918] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:10.622103 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a44aedbe24c4d9798663bfe3e1e5342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.623390 1166 log.cc:1196] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ea6102e0da4e42cd9f1d6e294bb372b2
I20260620 07:01:10.623466 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b9222f1374e4e96bd760af1a52f3a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.599432 1167 tablet_bootstrap.cc:492] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:10.615653 999 tablet_service.cc:1467] Processing CreateTablet for tablet 0b9222f1374e4e96bd760af1a52f3a1c (DEFAULT_TABLE table=default.Table_0d696424e47747e8aff9258ac6a3dec4 [id=8fdc5f3c56fd4fbaacef64dc1da4d345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.624837 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b9222f1374e4e96bd760af1a52f3a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.624576 1167 ts_tablet_manager.cc:1397] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.132s user 0.008s sys 0.000s
I20260620 07:01:10.626888 1167 raft_consensus.cc:348] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.627458 1167 raft_consensus.cc:374] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.627717 1167 raft_consensus.cc:729] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.628229 1167 consensus_queue.cc:260] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.629387 1167 ts_tablet_manager.cc:1428] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 07:01:10.615782 994 tablet_service.cc:1467] Processing CreateTablet for tablet 24a2fa7712d9407cb64e67f0f6338fcf (DEFAULT_TABLE table=default.Table_5e750ac167754573aaf4644d64503ecd [id=cd22d162be674c9b8bc21d1ce0059149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.622553 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 7a44aedbe24c4d9798663bfe3e1e5342 (DEFAULT_TABLE table=default.Table_39654cee1c26433a94f549acb9787681 [id=70c608a162464e60bf24c338d6e49161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.624121 1166 ts_tablet_manager.cc:1939] T ea6102e0da4e42cd9f1d6e294bb372b2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:10.630268 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24a2fa7712d9407cb64e67f0f6338fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.630939 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a44aedbe24c4d9798663bfe3e1e5342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.631268 1165 log.cc:1196] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/261f0d97e1084e828b9562cb30ea422b
I20260620 07:01:10.632459 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24a2fa7712d9407cb64e67f0f6338fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.632839 1935 raft_consensus.cc:482] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.632961 1935 raft_consensus.cc:504] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.633611 1168 tablet_bootstrap.cc:492] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.633637 1935 leader_election.cc:288] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:10.633728 1168 ts_tablet_manager.cc:1397] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.062s user 0.008s sys 0.004s
I20260620 07:01:10.634138 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:10.634547 1168 raft_consensus.cc:348] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.634737 1168 raft_consensus.cc:374] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.634836 1168 raft_consensus.cc:729] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:10.635028 830 leader_election.cc:341] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:10.635087 1168 consensus_queue.cc:260] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.635694 1168 ts_tablet_manager.cc:1428] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:10.635994 1168 tablet_bootstrap.cc:492] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:10.636937 1994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 07:01:10.639161 1168 tablet_bootstrap.cc:654] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.641534 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 389) took 7195 ms. Trace:
I20260620 07:01:10.642066 734 tablet_service.cc:1467] Processing CreateTablet for tablet 5855497e5b22493bb60024d30cc23e03 (DEFAULT_TABLE table=default.Table_7e14acf1c0a24b5fb959872664181f23 [id=63a6e59515664aaea4b249b982e806da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.642175 1166 rpcz_store.cc:276] 0620 07:01:03.445997 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.446061 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:10.578608 (+7132547us) ts_tablet_manager.cc:1145] Deleting tablet ea6102e0da4e42cd9f1d6e294bb372b2
0620 07:01:10.578616 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.592165 (+ 13549us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.596023 (+ 3858us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.641143 (+ 45120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7132290}
I20260620 07:01:10.644281 1166 tablet_replica.cc:330] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:10.645201 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:10.646092 831 leader_election.cc:341] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:10.646286 831 leader_election.cc:302] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:10.646546 1935 raft_consensus.cc:2726] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:10.646610 1853 fs_manager.cc:725] Time spent opening block manager: real 0.047s user 0.002s sys 0.000s
I20260620 07:01:10.647379 1168 tablet_bootstrap.cc:492] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.647508 1168 ts_tablet_manager.cc:1397] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.004s
I20260620 07:01:10.646816 1853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data,/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
uuid: "2395d394cd84440ebae89d1ecfa13fb5"
format_stamp: "Formatted at 2026-06-20 07:00:51 on dist-test-slave-jd6w"
I20260620 07:01:10.648236 1168 raft_consensus.cc:348] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.648450 1168 raft_consensus.cc:374] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.648502 1168 raft_consensus.cc:729] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.648706 1168 consensus_queue.cc:260] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.649286 1168 ts_tablet_manager.cc:1428] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:10.649546 1168 tablet_bootstrap.cc:492] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:10.651243 728 tablet_service.cc:1467] Processing CreateTablet for tablet 5d394816a1114bf688692a825a176c92 (DEFAULT_TABLE table=default.Table_871c3bd853224b7da9f77c9c7efb1065 [id=b646278387f5410882006e44fc0fdb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.652575 1935 raft_consensus.cc:482] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.652688 1935 raft_consensus.cc:504] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.652779 1167 tablet_bootstrap.cc:492] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:10.653221 1935 leader_election.cc:288] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:10.653857 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34dc2af503684aaba8388a4611fab48e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:10.654337 830 leader_election.cc:341] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:10.655043 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ea6102e0da4e42cd9f1d6e294bb372b2 (table default.Table_6114f9a7dc6143338db6a4d5e2d30761 [id=d59e957fcc294728a196534643e42db4]) successfully deleted
I20260620 07:01:10.656309 725 tablet_service.cc:1467] Processing CreateTablet for tablet 6723948279f347fe96054e1e1fd29b40 (DEFAULT_TABLE table=default.Table_51842d9d7b0349ba9f9ef93fe5727b59 [id=6cb6aca8e45a4f4abaa3d3214d273fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.657279 1170 tablet_bootstrap.cc:492] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:10.657915 1169 log.cc:1196] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/82020156f3e44a1e84a9435d1f994124
I20260620 07:01:10.658694 1170 ts_tablet_manager.cc:1397] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.656s user 0.007s sys 0.000s
I20260620 07:01:10.663520 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34dc2af503684aaba8388a4611fab48e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:10.663990 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_35d07463a39145159df79be022763773"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.664587 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35d07463a39145159df79be022763773 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.665632 754 raft_consensus.cc:2454] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:10.665897 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7294e5678ad44622a3249c1113b5e297
I20260620 07:01:10.666540 968 leader_election.cc:302] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:10.666603 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5fbe6fc81d864458b668001f7b6af936" } new_table_name: "default.Table_55a40d12ea5d42b8b6b51b6b11ae4f7b" modify_external_catalogs: true
W20260620 07:01:10.667227 831 leader_election.cc:341] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:10.667366 831 leader_election.cc:302] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:10.667623 1935 raft_consensus.cc:2726] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:10.668700 1925 raft_consensus.cc:2781] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:10.669520 1925 raft_consensus.cc:686] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:10.670037 1925 consensus_queue.cc:237] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.648638 1853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 07:01:10.671315 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 7294e5678ad44622a3249c1113b5e297 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.673344 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 36f1fc6123cd40cb839d47de316502b3
I20260620 07:01:10.674034 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_97d5316440584dd08daee78c90a8eb10" } new_table_name: "default.Table_33deacfd38b2421a8d8bf2f5c548a399" modify_external_catalogs: true
I20260620 07:01:10.675312 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 09eddf4734144bdaba24759647553020
I20260620 07:01:10.675707 419 catalog_manager.cc:6565] ReplaceTablet: tablet 09eddf4734144bdaba24759647553020 deleted and replaced by tablet 028ca38aefdc40f29b1413bbed7ed0ae
I20260620 07:01:10.676524 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 36f1fc6123cd40cb839d47de316502b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.676645 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 09eddf4734144bdaba24759647553020 with delete_type TABLET_DATA_DELETED (replaced by tablet 028ca38aefdc40f29b1413bbed7ed0ae) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.632143 1165 ts_tablet_manager.cc:1939] T 261f0d97e1084e828b9562cb30ea422b P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:10.677965 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 261f0d97e1084e828b9562cb30ea422b (table default.Table_49629c65f95a46ff815a7d39c7143227 [id=466c737c0047420081fddb786a8093f3]) successfully deleted
I20260620 07:01:10.678656 1165 tablet_replica.cc:330] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:10.678894 1165 raft_consensus.cc:2229] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.679051 1165 raft_consensus.cc:2258] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.679525 1165 ts_tablet_manager.cc:1905] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.680363 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_815bd5183e254243bbd89ce69522aafb" } modify_external_catalogs: true
I20260620 07:01:10.680423 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_305a2709be0040bda9f3552349b9ce3d" } modify_external_catalogs: true
I20260620 07:01:10.680593 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_815bd5183e254243bbd89ce69522aafb" } modify_external_catalogs: true
W20260620 07:01:10.680794 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a13a60f7f3e74f7dbf5204c974e0e346 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a13a60f7f3e74f7dbf5204c974e0e346 already in progress: creating tablet
I20260620 07:01:10.680593 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_305a2709be0040bda9f3552349b9ce3d" } modify_external_catalogs: true
I20260620 07:01:10.683854 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 09eddf4734144bdaba24759647553020 with delete_type TABLET_DATA_DELETED (replaced by tablet 028ca38aefdc40f29b1413bbed7ed0ae) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.684329 994 tablet_service.cc:1514] Processing DeleteTablet for tablet 36f1fc6123cd40cb839d47de316502b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.685130 1170 raft_consensus.cc:348] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.685444 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5855497e5b22493bb60024d30cc23e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.687345 1168 tablet_bootstrap.cc:654] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.694032 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 960fca9c94764f3d8d2daae20a0f8388
I20260620 07:01:10.694644 730 tablet_service.cc:1467] Processing CreateTablet for tablet 7a44aedbe24c4d9798663bfe3e1e5342 (DEFAULT_TABLE table=default.Table_39654cee1c26433a94f549acb9787681 [id=70c608a162464e60bf24c338d6e49161]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:10.694811 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39e9f8eb03a74bb5ab4c9cc1c7b109c2 consensus state has no leader
I20260620 07:01:10.694818 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 63525282e222490687713a92e5371a5c
I20260620 07:01:10.695393 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.695482 424 catalog_manager.cc:6565] ReplaceTablet: tablet 63525282e222490687713a92e5371a5c deleted and replaced by tablet d8a0073b1e034755bf3576927805a8d7
I20260620 07:01:10.696128 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 63525282e222490687713a92e5371a5c with delete_type TABLET_DATA_DELETED (replaced by tablet d8a0073b1e034755bf3576927805a8d7) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.696390 716 tablet_service.cc:1467] Processing CreateTablet for tablet 2acd2bd3fd5a42b0ba00820462e49bee (DEFAULT_TABLE table=default.Table_b79f978eee17412da963a4c4ccd88fcc [id=3a6efe4303a045848dc121fb1e81275d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.696712 1168 tablet_bootstrap.cc:492] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.696679 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 63525282e222490687713a92e5371a5c with delete_type TABLET_DATA_DELETED (replaced by tablet d8a0073b1e034755bf3576927805a8d7) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.696751 1170 raft_consensus.cc:374] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.696877 1168 ts_tablet_manager.cc:1397] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.000s
I20260620 07:01:10.696913 1170 raft_consensus.cc:729] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.697180 1170 consensus_queue.cc:260] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.697645 1168 raft_consensus.cc:348] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.697847 1168 raft_consensus.cc:374] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.697877 1170 ts_tablet_manager.cc:1428] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
I20260620 07:01:10.697901 1168 raft_consensus.cc:729] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.699009 1169 ts_tablet_manager.cc:1939] T 82020156f3e44a1e84a9435d1f994124 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:10.699033 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 7294e5678ad44622a3249c1113b5e297 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.699285 994 tablet_service.cc:1514] Processing DeleteTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.699429 715 tablet_service.cc:1467] Processing CreateTablet for tablet 47365e10ce274af891055b34e2f0a2bd (DEFAULT_TABLE table=default.Table_d82480660a9a4d358324cb6f84fdb341 [id=498b500cdad240b2a9ecb40dcdd49be9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.702759 723 tablet_service.cc:1467] Processing CreateTablet for tablet 0b9222f1374e4e96bd760af1a52f3a1c (DEFAULT_TABLE table=default.Table_0d696424e47747e8aff9258ac6a3dec4 [id=8fdc5f3c56fd4fbaacef64dc1da4d345]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:10.703974 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06fd96feb4a74b9f8d3243b7d774f388 consensus state has no leader
I20260620 07:01:10.704246 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6723948279f347fe96054e1e1fd29b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.707628 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a44aedbe24c4d9798663bfe3e1e5342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.707422 1168 consensus_queue.cc:260] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.708030 1168 ts_tablet_manager.cc:1428] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260620 07:01:10.708312 1168 tablet_bootstrap.cc:492] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:10.711251 727 tablet_service.cc:1467] Processing CreateTablet for tablet 24a2fa7712d9407cb64e67f0f6338fcf (DEFAULT_TABLE table=default.Table_5e750ac167754573aaf4644d64503ecd [id=cd22d162be674c9b8bc21d1ce0059149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.718935 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 620) took 2097 ms. Trace:
I20260620 07:01:10.719390 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8aa92aae55ef4527a1e8f98945e1e833
I20260620 07:01:10.719411 1169 rpcz_store.cc:276] 0620 07:01:08.619776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.619948 (+ 172us) service_pool.cc:227] Handling call
0620 07:01:10.320752 (+1700804us) ts_tablet_manager.cc:1145] Deleting tablet 82020156f3e44a1e84a9435d1f994124
0620 07:01:10.320785 (+ 33us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.456521 (+135736us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.587786 (+131265us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:10.717600 (+129814us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1700472}
I20260620 07:01:10.721088 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 69113a64960d4aee9a2a4fcb28570bf2
I20260620 07:01:10.722083 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa92aae55ef4527a1e8f98945e1e833 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.724201 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_871c3bd853224b7da9f77c9c7efb1065" } new_table_name: "default.Table_6199c2fbd7fe41bf929440f2927e709a" modify_external_catalogs: true
I20260620 07:01:10.726392 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_db689efc7c5a47cfbd13b34707385ca5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.727113 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db689efc7c5a47cfbd13b34707385ca5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.729990 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 69113a64960d4aee9a2a4fcb28570bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.730885 1170 tablet_bootstrap.cc:492] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:10.732501 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 621) took 2108 ms. Trace:
I20260620 07:01:10.733448 1169 rpcz_store.cc:276] 0620 07:01:08.624251 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.628635 (+ 4384us) service_pool.cc:227] Handling call
0620 07:01:10.719804 (+2091169us) ts_tablet_manager.cc:1145] Deleting tablet 2004ff6f00a441578b8e702e8c7605fc
0620 07:01:10.730607 (+ 10803us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.732422 (+ 1815us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2090937}
I20260620 07:01:10.734160 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 9dbfd0959737438e8508b96777afb8e1 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:10.734200 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 622) took 1988 ms. Trace:
I20260620 07:01:10.734951 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fbcc45a7e4864cd49c799eb03fcd64ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.735600 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbcc45a7e4864cd49c799eb03fcd64ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.747377 1168 tablet_bootstrap.cc:654] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:10.754637 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d394816a1114bf688692a825a176c92 consensus state has no leader
I20260620 07:01:10.756822 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d394816a1114bf688692a825a176c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.757725 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2acd2bd3fd5a42b0ba00820462e49bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.759541 1170 tablet_bootstrap.cc:654] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.759517 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9dbfd0959737438e8508b96777afb8e1
I20260620 07:01:10.759977 422 catalog_manager.cc:6565] ReplaceTablet: tablet 9dbfd0959737438e8508b96777afb8e1 deleted and replaced by tablet 0eaa780687e1479eb165b6dfa7e32023
I20260620 07:01:10.763746 1925 raft_consensus.cc:482] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.764214 1925 raft_consensus.cc:504] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.766929 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dbfd0959737438e8508b96777afb8e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0eaa780687e1479eb165b6dfa7e32023) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:10.768065 969 leader_election.cc:341] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f8ec1e179a704e5480f3deaf856156e7
I20260620 07:01:10.768860 994 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa92aae55ef4527a1e8f98945e1e833 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.768749 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dbfd0959737438e8508b96777afb8e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0eaa780687e1479eb165b6dfa7e32023) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.771399 1169 rpcz_store.cc:276] 0620 07:01:08.745382 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.745445 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:10.733981 (+1988536us) ts_tablet_manager.cc:1145] Deleting tablet 40d9875dde7b4455b24b053781993234
0620 07:01:10.733992 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.734159 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1987466}
I20260620 07:01:10.771778 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 69113a64960d4aee9a2a4fcb28570bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:10.772122 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 626) took 2020 ms. Trace:
I20260620 07:01:10.772529 1169 rpcz_store.cc:276] 0620 07:01:08.751502 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.759353 (+ 7851us) service_pool.cc:227] Handling call
0620 07:01:10.771927 (+2012574us) ts_tablet_manager.cc:1145] Deleting tablet 60ce7d59a97544fda80a54f7124d1dba
0620 07:01:10.771944 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.772080 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2012366}
I20260620 07:01:10.772945 1169 tablet_replica.cc:330] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:10.773823 1925 leader_election.cc:288] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:10.775909 1167 tablet_bootstrap.cc:654] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.778903 1166 raft_consensus.cc:2229] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:10.780416 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b9222f1374e4e96bd760af1a52f3a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.780834 1169 raft_consensus.cc:2229] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.780895 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24a2fa7712d9407cb64e67f0f6338fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.781050 1169 raft_consensus.cc:2258] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.781672 1169 ts_tablet_manager.cc:1905] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.783429 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47365e10ce274af891055b34e2f0a2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.783840 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 7294e5678ad44622a3249c1113b5e297 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.746230 1165 ts_tablet_manager.cc:1918] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260620 07:01:10.789561 1165 log.cc:1196] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f0e54f1185cd4c5c8e5d2ed289b61650
I20260620 07:01:10.790851 1165 ts_tablet_manager.cc:1939] T f0e54f1185cd4c5c8e5d2ed289b61650 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:10.793249 1166 raft_consensus.cc:2258] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.793295 1165 tablet_replica.cc:330] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:10.793849 1166 ts_tablet_manager.cc:1905] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.796103 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_811e4d61e71e47ab80ad8c0488b3183c [id=2abd0f99a3034a0e8824bcb0002c91bd]) successfully deleted
W20260620 07:01:10.796459 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7294e5678ad44622a3249c1113b5e297 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7294e5678ad44622a3249c1113b5e297 already in progress: creating tablet
W20260620 07:01:10.796694 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 09eddf4734144bdaba24759647553020 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09eddf4734144bdaba24759647553020 already in progress: creating tablet
W20260620 07:01:10.796936 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 36f1fc6123cd40cb839d47de316502b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36f1fc6123cd40cb839d47de316502b3 already in progress: creating tablet
W20260620 07:01:10.797168 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 960fca9c94764f3d8d2daae20a0f8388 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 960fca9c94764f3d8d2daae20a0f8388 already in progress: creating tablet
W20260620 07:01:10.797381 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 63525282e222490687713a92e5371a5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63525282e222490687713a92e5371a5c already in progress: creating tablet
I20260620 07:01:10.797361 1165 raft_consensus.cc:2229] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:10.797600 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8aa92aae55ef4527a1e8f98945e1e833 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aa92aae55ef4527a1e8f98945e1e833 already in progress: creating tablet
I20260620 07:01:10.798400 859 tablet_service.cc:1467] Processing CreateTablet for tablet f73cad102c5a410f904c1332ba92941d (DEFAULT_TABLE table=default.Table_6db2de0b2a534fa99a3ea6ee35d2c508 [id=6c2b3ed597154c57b3cf63ba10648611]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.798902 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f73cad102c5a410f904c1332ba92941d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.799059 1165 raft_consensus.cc:2258] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.799295 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 36f1fc6123cd40cb839d47de316502b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.800170 1988 raft_consensus.cc:482] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.801721 1165 ts_tablet_manager.cc:1905] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.805579 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 09eddf4734144bdaba24759647553020 with delete_type TABLET_DATA_DELETED (replaced by tablet 028ca38aefdc40f29b1413bbed7ed0ae) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.805958 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.806582 1750 raft_consensus.cc:482] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.806310 1920 raft_consensus.cc:482] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:10.806754 1750 raft_consensus.cc:504] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.808015 872 tablet_service.cc:1467] Processing CreateTablet for tablet 016029eafa1d438da54d963a64767ec5 (DEFAULT_TABLE table=default.Table_79f21480be5047f7ac25be9822c09588 [id=ea5bc9bef9654a9d8c7db871ef5835cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.808430 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016029eafa1d438da54d963a64767ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.808357 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 016029eafa1d438da54d963a64767ec5 (DEFAULT_TABLE table=default.Table_79f21480be5047f7ac25be9822c09588 [id=ea5bc9bef9654a9d8c7db871ef5835cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.809971 999 tablet_service.cc:1467] Processing CreateTablet for tablet f73cad102c5a410f904c1332ba92941d (DEFAULT_TABLE table=default.Table_6db2de0b2a534fa99a3ea6ee35d2c508 [id=6c2b3ed597154c57b3cf63ba10648611]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.811151 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 82020156f3e44a1e84a9435d1f994124 (table default.Table_136e581f613845f79105f13229d93e06 [id=e3117c7c078044e9872c3c7e880aed79]) successfully deleted
I20260620 07:01:10.814222 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016029eafa1d438da54d963a64767ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.816063 1750 leader_election.cc:288] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:10.818252 1920 raft_consensus.cc:504] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.819084 1920 leader_election.cc:288] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:10.820174 859 tablet_service.cc:1467] Processing CreateTablet for tablet a1a735f60ed7492e8cabbd1254b19800 (DEFAULT_TABLE table=default.Table_03279cc268a143a0b89229d8a948759b [id=6e76e9d95750458db1ab3b02c60e40b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.820538 861 tablet_service.cc:1467] Processing CreateTablet for tablet fc40cf4ca353452590c770c86be0814c (DEFAULT_TABLE table=default.Table_b72b2c9d38dd47108c5784845153d5e3 [id=44aa8a4e73eb4b4bad579233404f2979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.820204 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c11f2678559c41d3bc71d4fa04efd0ac" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:10.820828 890 raft_consensus.cc:2454] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:10.820626 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1a735f60ed7492e8cabbd1254b19800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.821383 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc40cf4ca353452590c770c86be0814c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.821842 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 63525282e222490687713a92e5371a5c with delete_type TABLET_DATA_DELETED (replaced by tablet d8a0073b1e034755bf3576927805a8d7) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.823397 865 tablet_service.cc:1467] Processing CreateTablet for tablet 64addb9379b247dfa678e2a0ae1af0cf (DEFAULT_TABLE table=default.Table_02dd512d8cdb48e98679252eee51b6bd [id=9280d71683cd4b34a5fd30beafd90eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.823709 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64addb9379b247dfa678e2a0ae1af0cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:10.824819 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2004ff6f00a441578b8e702e8c7605fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2004ff6f00a441578b8e702e8c7605fc already in progress: creating tablet
W20260620 07:01:10.825313 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 40d9875dde7b4455b24b053781993234 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40d9875dde7b4455b24b053781993234 already in progress: creating tablet
W20260620 07:01:10.825521 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 60ce7d59a97544fda80a54f7124d1dba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60ce7d59a97544fda80a54f7124d1dba already in progress: creating tablet
I20260620 07:01:10.813416 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet c11f2678559c41d3bc71d4fa04efd0ac (table default.Table_13403c45f0a94678999f62954a653d5f [id=9b7cbb1400d7413ca5debb997aeade9c]). Expected version 3 got 0
I20260620 07:01:10.830418 871 tablet_service.cc:1467] Processing CreateTablet for tablet 4d23f06461284d6cb950b258e8b39540 (DEFAULT_TABLE table=default.Table_6f307d70fb934b379cdbbdabbc992f99 [id=2a1d721da6b943b497a62d7f24d7aaf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.830868 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d23f06461284d6cb950b258e8b39540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.830844 865 tablet_service.cc:1467] Processing CreateTablet for tablet 0ca4bb86788c4ba1ac48ca5a57a3a85d (DEFAULT_TABLE table=default.Table_31d0405bb6474308a84704c3e98bb9fa [id=5e021e5163384542bcdbe25ff67c3a50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.831331 858 tablet_service.cc:1467] Processing CreateTablet for tablet 5046d808d01f4af3803cb3edf425f777 (DEFAULT_TABLE table=default.Table_9d9e9ea2ddae464a96fb6335aba96e75 [id=00228c063a1e4e418276206a6831a387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.831568 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ca4bb86788c4ba1ac48ca5a57a3a85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.831779 860 tablet_service.cc:1467] Processing CreateTablet for tablet eb29ab54c11a4ef98c67fad8e233e3c4 (DEFAULT_TABLE table=default.Table_e94e3deb764f4de49ed3291a61ee8ab1 [id=6bb16252d83f40b2b3da76fa9ec94539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.832047 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb29ab54c11a4ef98c67fad8e233e3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.832945 872 tablet_service.cc:1467] Processing CreateTablet for tablet 70f09b7dfdc1467eb47b8d7acb214919 (DEFAULT_TABLE table=default.Table_0467f4c59a6647f0b8dc78ce62517b66 [id=9369b6e3a1bb4a6bb74b17b456b20c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.833218 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70f09b7dfdc1467eb47b8d7acb214919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.835023 874 tablet_service.cc:1467] Processing CreateTablet for tablet 6172551cb6c44f18952433eeac8ec4e7 (DEFAULT_TABLE table=default.Table_0634bf6a5c6e44348cbf328d2d3169c2 [id=ed52db45c83e465ea15cf690687cb2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.835304 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5046d808d01f4af3803cb3edf425f777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.835495 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6172551cb6c44f18952433eeac8ec4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.837553 421 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 1c64df83a18a470c98a9c1fd6bb38918 (table default.Table_e96d88a6ea654cfcbfb4d47fed5a1c83 [id=4896f23e711941b988db4ea9f22ce625]). Expected version 3 got 0
I20260620 07:01:10.839414 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c3e2020a90174ee1a722e88d9580e69e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.840205 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3e2020a90174ee1a722e88d9580e69e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.842191 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0e91deb619774c1a8b520408d0d7504f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:10.842278 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_daf0a27dab6a4b18b63b0dbd7bffa56c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.842922 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daf0a27dab6a4b18b63b0dbd7bffa56c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.842952 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 3456cf91d65a4413a35efe94513c723d from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:10.843056 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e91deb619774c1a8b520408d0d7504f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.844060 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3ddd49ed6a384706b1b4548a74f18d04" } new_table_name: "default.Table_5089bff86b114c6e8beaa9be1dec9854" modify_external_catalogs: true
I20260620 07:01:10.847824 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 34dc2af503684aaba8388a4611fab48e (table default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9]). Expected version 1 got 0
I20260620 07:01:10.847817 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 69113a64960d4aee9a2a4fcb28570bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.848014 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:10.848239 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]). Expected version 3 got 0
W20260620 07:01:10.850515 969 leader_election.cc:341] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 581573cafab14ac79ff7ad19da0580b4
I20260620 07:01:10.800426 1988 raft_consensus.cc:504] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.854611 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa92aae55ef4527a1e8f98945e1e833 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.854687 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 5208f3136bcd45579de49b8b10745122 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d9875dde7b4455b24b053781993234) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.855260 994 tablet_service.cc:1467] Processing CreateTablet for tablet 70f09b7dfdc1467eb47b8d7acb214919 (DEFAULT_TABLE table=default.Table_0467f4c59a6647f0b8dc78ce62517b66 [id=9369b6e3a1bb4a6bb74b17b456b20c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.858703 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 5046d808d01f4af3803cb3edf425f777 (DEFAULT_TABLE table=default.Table_9d9e9ea2ddae464a96fb6335aba96e75 [id=00228c063a1e4e418276206a6831a387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.858968 1006 tablet_service.cc:1467] Processing CreateTablet for tablet b9549196b4474939ac64f1f46b85d84e (DEFAULT_TABLE table=default.Table_b5161297262f49d1ac8ed9744005a35a [id=3fd061316c38447ab1314bfe81649e9c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:10.859081 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0eaa780687e1479eb165b6dfa7e32023 has no consensus state
I20260620 07:01:10.859144 1008 tablet_service.cc:1467] Processing CreateTablet for tablet eb29ab54c11a4ef98c67fad8e233e3c4 (DEFAULT_TABLE table=default.Table_e94e3deb764f4de49ed3291a61ee8ab1 [id=6bb16252d83f40b2b3da76fa9ec94539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.859282 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 64addb9379b247dfa678e2a0ae1af0cf (DEFAULT_TABLE table=default.Table_02dd512d8cdb48e98679252eee51b6bd [id=9280d71683cd4b34a5fd30beafd90eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.859282 683 leader_election.cc:302] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:10.862941 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 04db48e910514d46bb4deb9acf54f7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.864234 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 6172551cb6c44f18952433eeac8ec4e7 (DEFAULT_TABLE table=default.Table_0634bf6a5c6e44348cbf328d2d3169c2 [id=ed52db45c83e465ea15cf690687cb2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.864945 862 tablet_service.cc:1467] Processing CreateTablet for tablet 3513341e1b664af1813f2b4ffbce1535 (DEFAULT_TABLE table=default.Table_394931c572964938b1a601ca97ea4a2d [id=ea2114a375674e6fa1edc034675828ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.865334 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3513341e1b664af1813f2b4ffbce1535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.866429 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f73cad102c5a410f904c1332ba92941d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.868254 1001 tablet_service.cc:1467] Processing CreateTablet for tablet fc40cf4ca353452590c770c86be0814c (DEFAULT_TABLE table=default.Table_b72b2c9d38dd47108c5784845153d5e3 [id=44aa8a4e73eb4b4bad579233404f2979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.868666 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 4d23f06461284d6cb950b258e8b39540 (DEFAULT_TABLE table=default.Table_6f307d70fb934b379cdbbdabbc992f99 [id=2a1d721da6b943b497a62d7f24d7aaf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.869268 1920 raft_consensus.cc:2781] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:10.869395 1920 raft_consensus.cc:482] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:10.859985 998 tablet_service.cc:1467] Processing CreateTablet for tablet a1a735f60ed7492e8cabbd1254b19800 (DEFAULT_TABLE table=default.Table_03279cc268a143a0b89229d8a948759b [id=6e76e9d95750458db1ab3b02c60e40b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.869719 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dbfd0959737438e8508b96777afb8e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0eaa780687e1479eb165b6dfa7e32023) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:10.872555 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 3513341e1b664af1813f2b4ffbce1535 (DEFAULT_TABLE table=default.Table_394931c572964938b1a601ca97ea4a2d [id=ea2114a375674e6fa1edc034675828ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.872717 858 tablet_service.cc:1467] Processing CreateTablet for tablet 95d4f7dc014e40e8a749b40418831efb (DEFAULT_TABLE table=default.Table_5d72ef54fe32494391f31d295db01e4a [id=5b3f0ef584c14c56bae13f7267a44334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.872717 862 tablet_service.cc:1467] Processing CreateTablet for tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a (DEFAULT_TABLE table=default.Table_d66e26edeccc4a138950de609d6c107f [id=dbe2ab45243b4aeca16c961149135563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.873173 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95d4f7dc014e40e8a749b40418831efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.874470 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.877450 995 tablet_service.cc:1467] Processing CreateTablet for tablet 0ca4bb86788c4ba1ac48ca5a57a3a85d (DEFAULT_TABLE table=default.Table_31d0405bb6474308a84704c3e98bb9fa [id=5e021e5163384542bcdbe25ff67c3a50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.878731 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet c11f2678559c41d3bc71d4fa04efd0ac (table default.Table_13403c45f0a94678999f62954a653d5f [id=9b7cbb1400d7413ca5debb997aeade9c]). Expected version 3 got 0
I20260620 07:01:10.864945 859 tablet_service.cc:1467] Processing CreateTablet for tablet b9549196b4474939ac64f1f46b85d84e (DEFAULT_TABLE table=default.Table_b5161297262f49d1ac8ed9744005a35a [id=3fd061316c38447ab1314bfe81649e9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.880897 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3513341e1b664af1813f2b4ffbce1535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.881723 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9549196b4474939ac64f1f46b85d84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.896595 2008 tablet.cc:1722] T 1b98711dfb114a2985c5153e9b44147a P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:10.896727 1920 raft_consensus.cc:3037] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:10.900061 1168 tablet_bootstrap.cc:492] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.900221 1168 ts_tablet_manager.cc:1397] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.192s user 0.003s sys 0.014s
I20260620 07:01:10.907224 1168 raft_consensus.cc:348] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.907483 1168 raft_consensus.cc:374] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.907546 1168 raft_consensus.cc:729] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.907747 1168 consensus_queue.cc:260] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.908330 1168 ts_tablet_manager.cc:1428] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260620 07:01:10.908636 1168 tablet_bootstrap.cc:492] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:10.909071 716 tablet_service.cc:1467] Processing CreateTablet for tablet f73cad102c5a410f904c1332ba92941d (DEFAULT_TABLE table=default.Table_6db2de0b2a534fa99a3ea6ee35d2c508 [id=6c2b3ed597154c57b3cf63ba10648611]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.909505 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f73cad102c5a410f904c1332ba92941d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.915987 872 tablet_service.cc:1514] Processing DeleteTablet for tablet eea1525b54cc42b78180ba6867957f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.918668 1165 ts_tablet_manager.cc:1918] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:10.926842 1165 log.cc:1196] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/69113a64960d4aee9a2a4fcb28570bf2
I20260620 07:01:10.927692 1165 ts_tablet_manager.cc:1939] T 69113a64960d4aee9a2a4fcb28570bf2 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:10.927132 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 109060us
I20260620 07:01:10.930423 865 tablet_service.cc:1467] Processing CreateTablet for tablet 3829b52f99c24dd79047bc5388fc3bdd (DEFAULT_TABLE table=default.Table_28b6597a276f422ca492083967fb6ee4 [id=f3f8bdd128024f189e1e1ab9554b845f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.923419 1168 tablet_bootstrap.cc:654] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.930644 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]) successfully deleted
I20260620 07:01:10.925943 872 tablet_service.cc:1467] Processing CreateTablet for tablet 90fb564b3db04207a278904038777d77 (DEFAULT_TABLE table=default.Table_db689efc7c5a47cfbd13b34707385ca5 [id=b55465ec08be4c1685867b73405fbbf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.931519 858 tablet_service.cc:1467] Processing CreateTablet for tablet 464614a1d17a464190597f01c8539fba (DEFAULT_TABLE table=default.Table_cdf87d4ae1fc4d17a096825dfe433346 [id=dbaf6e43fd89431496db8606168d2c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.931795 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3829b52f99c24dd79047bc5388fc3bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.932011 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 464614a1d17a464190597f01c8539fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.932264 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90fb564b3db04207a278904038777d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.936761 419 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_33deacfd38b2421a8d8bf2f5c548a399 [id=fd979c937e3048858b59d596663abdc4] alter complete (version 3)
I20260620 07:01:10.940284 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_186656f8bbdd43ad8e66efcc62300631" } modify_external_catalogs: true
I20260620 07:01:10.940534 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_186656f8bbdd43ad8e66efcc62300631" } modify_external_catalogs: true
I20260620 07:01:10.940368 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a9daa65902764470b46116dd8693e062"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.941092 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9daa65902764470b46116dd8693e062 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.942431 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b700a15c3ddb49248d638c0c8ea908bd" } modify_external_catalogs: true
I20260620 07:01:10.942626 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b700a15c3ddb49248d638c0c8ea908bd" } modify_external_catalogs: true
W20260620 07:01:10.943537 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9dbfd0959737438e8508b96777afb8e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9dbfd0959737438e8508b96777afb8e1 already in progress: creating tablet
I20260620 07:01:10.943872 1165 tablet_replica.cc:330] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:10.944960 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_94bc617747744718a7f1037868df1790"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.945709 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94bc617747744718a7f1037868df1790 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.946276 1165 raft_consensus.cc:2229] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:10.946491 1165 raft_consensus.cc:2258] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:10.928546 861 tablet_service.cc:1467] Processing CreateTablet for tablet 1fc71cb2df0348e09c772bf11fa5656b (DEFAULT_TABLE table=default.Table_35d07463a39145159df79be022763773 [id=f8c0c65cdc1048bd9262456f229ef679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.947681 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fc71cb2df0348e09c772bf11fa5656b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.948137 871 tablet_service.cc:1467] Processing CreateTablet for tablet 028ca38aefdc40f29b1413bbed7ed0ae (DEFAULT_TABLE table=default.Table_bc6f45b50d5647928a19eb8b0b789fd8 [id=d66c9d3d39c9401fbb8007dc460dd23f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.948496 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 028ca38aefdc40f29b1413bbed7ed0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.948683 1168 tablet_bootstrap.cc:492] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.948804 1168 ts_tablet_manager.cc:1397] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.000s
I20260620 07:01:10.949479 1168 raft_consensus.cc:348] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.949668 1168 raft_consensus.cc:374] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.949712 1168 raft_consensus.cc:729] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.949898 1168 consensus_queue.cc:260] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:10.956125 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bf10ad0aef124efa8d14687eb39c572e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:10.956562 1168 ts_tablet_manager.cc:1428] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20260620 07:01:10.956791 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf10ad0aef124efa8d14687eb39c572e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.956875 1168 tablet_bootstrap.cc:492] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:10.958230 1168 tablet_bootstrap.cc:654] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:10.958261 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d3219442b0f145f7b2e94b234889b7de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:10.958781 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3219442b0f145f7b2e94b234889b7de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:10.960475 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_acc2e2a41f234841944aefbc998c1680" } new_table_name: "default.Table_e3cfd3eb18ae43ce9c2265792904718f" modify_external_catalogs: true
I20260620 07:01:10.962011 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_993f8296657448808071f4daac209774" } modify_external_catalogs: true
I20260620 07:01:10.962191 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_993f8296657448808071f4daac209774" } modify_external_catalogs: true
I20260620 07:01:10.964767 860 tablet_service.cc:1514] Processing DeleteTablet for tablet c38c628514c44c6fa5aff64928e515d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.921072 862 tablet_service.cc:1467] Processing CreateTablet for tablet fe92ec6b3f6b4bfe9643139330a0bf6d (DEFAULT_TABLE table=default.Table_0e91deb619774c1a8b520408d0d7504f [id=f52f78c1c0504e928958f0d635c4f47d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.967607 1165 ts_tablet_manager.cc:1905] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:10.969764 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 80138f3919f34d5d8163fdfc89d5c52b
I20260620 07:01:10.969925 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 610a25c729cf41b4bd71372bc36365a8
I20260620 07:01:10.967897 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe92ec6b3f6b4bfe9643139330a0bf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.928545 859 tablet_service.cc:1467] Processing CreateTablet for tablet de6ccea1cd074afb9fef17c8e07f444f (DEFAULT_TABLE table=default.Table_daf0a27dab6a4b18b63b0dbd7bffa56c [id=1715fc38dc0c448fbf018cfddb6bdbad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.971697 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de6ccea1cd074afb9fef17c8e07f444f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.971990 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 610a25c729cf41b4bd71372bc36365a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.972404 857 tablet_service.cc:1467] Processing CreateTablet for tablet b99781ba1ed44f6895af7da082618616 (DEFAULT_TABLE table=default.Table_ecac1f12f41f42609220ff60055c6e50 [id=b22bf01348b04d348a7d6fea3cf21496]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.972774 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b99781ba1ed44f6895af7da082618616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.973925 1168 tablet_bootstrap.cc:492] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:10.974093 1168 ts_tablet_manager.cc:1397] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260620 07:01:10.974742 1168 raft_consensus.cc:348] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.974897 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 80138f3919f34d5d8163fdfc89d5c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:10.974978 1168 raft_consensus.cc:374] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:10.975028 1168 raft_consensus.cc:729] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:10.975211 1168 consensus_queue.cc:260] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:10.975760 1168 ts_tablet_manager.cc:1428] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:10.978749 860 tablet_service.cc:1467] Processing CreateTablet for tablet d8a0073b1e034755bf3576927805a8d7 (DEFAULT_TABLE table=default.Table_34eaeb05ad0243cb9f083eb279a8ba73 [id=5a23c89228964939bd74b5079dd25881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.979141 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8a0073b1e034755bf3576927805a8d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:10.983520 720 tablet_service.cc:1467] Processing CreateTablet for tablet b9549196b4474939ac64f1f46b85d84e (DEFAULT_TABLE table=default.Table_b5161297262f49d1ac8ed9744005a35a [id=3fd061316c38447ab1314bfe81649e9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.988471 874 tablet_service.cc:1467] Processing CreateTablet for tablet 812b1e2457374feabb9c3692f81488b0 (DEFAULT_TABLE table=default.Table_c3e2020a90174ee1a722e88d9580e69e [id=ce2868d50af24783b8644b52921214a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.988873 864 tablet_service.cc:1467] Processing CreateTablet for tablet 0eaa780687e1479eb165b6dfa7e32023 (DEFAULT_TABLE table=default.Table_5089bff86b114c6e8beaa9be1dec9854 [id=12048e9dd9204beba16542fe67618456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.996115 868 tablet_service.cc:1467] Processing CreateTablet for tablet 969b451c02594e029f1522af54d5a8cd (DEFAULT_TABLE table=default.Table_fbcc45a7e4864cd49c799eb03fcd64ff [id=83e2439a30b44745a1f7527a635d244d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.944950 858 tablet_service.cc:1467] Processing CreateTablet for tablet 55f7ae7d91484d6c99faf7a0d837b546 (DEFAULT_TABLE table=default.Table_372f2b67fb3f40de80d976f4dcf68621 [id=76f4c9d5997c469eb6697f8940e740e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:10.999267 1165 ts_tablet_manager.cc:1918] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.002421 1165 log.cc:1196] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/5208f3136bcd45579de49b8b10745122
I20260620 07:01:11.003142 1165 ts_tablet_manager.cc:1939] T 5208f3136bcd45579de49b8b10745122 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:11.015782 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_440c27829a3b42a8b452c15509a150bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:11.016168 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4d3d2172df004ee39d7e56f81179364f" } modify_external_catalogs: true
I20260620 07:01:11.016405 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4d3d2172df004ee39d7e56f81179364f" } modify_external_catalogs: true
W20260620 07:01:11.016535 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_440c27829a3b42a8b452c15509a150bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.017155 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7ff3385435e3457aa03dba26530f9f0b" } new_table_name: "default.Table_dd975c3c465e439db363c170ba3e4147" modify_external_catalogs: true
I20260620 07:01:11.017892 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e96d88a6ea654cfcbfb4d47fed5a1c83" } new_table_name: "default.Table_0317c7d3f556484385f6af21f10cbc97" modify_external_catalogs: true
I20260620 07:01:11.043864 1168 tablet_bootstrap.cc:492] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.045357 1168 tablet_bootstrap.cc:654] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.046047 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 812b1e2457374feabb9c3692f81488b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.046295 1165 tablet_replica.cc:330] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:11.046957 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 5208f3136bcd45579de49b8b10745122 (table default.Table_6559046a0e474633ad24c9215e23b506 [id=47d63992f58d45c3aef24a7a606ce4bf]) successfully deleted
I20260620 07:01:11.047379 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eaa780687e1479eb165b6dfa7e32023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.051040 1935 raft_consensus.cc:482] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:11.051191 1935 raft_consensus.cc:504] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.051924 1935 leader_election.cc:288] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:11.054998 1165 raft_consensus.cc:2229] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.055168 1165 raft_consensus.cc:2258] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.055919 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b112301348ea4d389930b5ecdc98183d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.056547 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b112301348ea4d389930b5ecdc98183d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.056622 730 tablet_service.cc:1467] Processing CreateTablet for tablet fc40cf4ca353452590c770c86be0814c (DEFAULT_TABLE table=default.Table_b72b2c9d38dd47108c5784845153d5e3 [id=44aa8a4e73eb4b4bad579233404f2979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.058128 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969b451c02594e029f1522af54d5a8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.058435 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_638b93421e824f669670b9bd1cac3389"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.058980 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_638b93421e824f669670b9bd1cac3389 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.061659 733 tablet_service.cc:1467] Processing CreateTablet for tablet 3513341e1b664af1813f2b4ffbce1535 (DEFAULT_TABLE table=default.Table_394931c572964938b1a601ca97ea4a2d [id=ea2114a375674e6fa1edc034675828ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.062191 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d612e9caa8b540b4b96860491d653f11
W20260620 07:01:11.062841 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed042bdf10a2453eab5175f21d1184c1 consensus state has no leader
I20260620 07:01:11.064105 1935 raft_consensus.cc:482] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:11.064231 1935 raft_consensus.cc:504] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.064853 1935 leader_election.cc:288] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:11.066293 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9a1f7fd6373b4013982e2a16179901fa" } modify_external_catalogs: true
I20260620 07:01:11.066968 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9a1f7fd6373b4013982e2a16179901fa" } modify_external_catalogs: true
I20260620 07:01:11.067147 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b8429caf0e3d441cb3b0c1e46841a3d2" } new_table_name: "default.Table_b35c1b131d2246a7858fcb8cba1ac3f5" modify_external_catalogs: true
I20260620 07:01:11.068599 1165 ts_tablet_manager.cc:1905] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.072593 859 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d6f7f2b5b3473aa010b8982a03aa5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.072585 726 tablet_service.cc:1467] Processing CreateTablet for tablet eb29ab54c11a4ef98c67fad8e233e3c4 (DEFAULT_TABLE table=default.Table_e94e3deb764f4de49ed3291a61ee8ab1 [id=6bb16252d83f40b2b3da76fa9ec94539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.073019 874 tablet_service.cc:1514] Processing DeleteTablet for tablet d612e9caa8b540b4b96860491d653f11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.076028 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2f5cab7043db44b18d164d5864ce8b51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.076649 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f5cab7043db44b18d164d5864ce8b51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.077809 1165 ts_tablet_manager.cc:1918] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.077919 1165 log.cc:1196] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/04db48e910514d46bb4deb9acf54f7c0
I20260620 07:01:11.077924 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_924b0013b02d4626ac48d394c68f6183"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:11.078215 1165 ts_tablet_manager.cc:1939] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:11.078501 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_924b0013b02d4626ac48d394c68f6183 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.078832 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 04db48e910514d46bb4deb9acf54f7c0 (table default.Table_e398e5c359f8400eac47c32d10c9a432 [id=41c90959790840acbf26b2339272e8ae]) successfully deleted
I20260620 07:01:11.079174 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b5161297262f49d1ac8ed9744005a35a" } new_table_name: "default.Table_21039ee90ca04efe95c0962d4e518005" modify_external_catalogs: true
I20260620 07:01:11.084654 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55f7ae7d91484d6c99faf7a0d837b546. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.086126 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf0bae39e1634710af12de493f7f58d5 consensus state has no leader
I20260620 07:01:11.087409 1165 tablet_replica.cc:330] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:11.087641 1165 raft_consensus.cc:2229] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.088475 1165 raft_consensus.cc:2258] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.089895 1165 ts_tablet_manager.cc:1905] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.090109 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_80ea7d8d27774de9944d7ceec99cf8a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.090842 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80ea7d8d27774de9944d7ceec99cf8a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.097592 729 tablet_service.cc:1467] Processing CreateTablet for tablet 0ca4bb86788c4ba1ac48ca5a57a3a85d (DEFAULT_TABLE table=default.Table_31d0405bb6474308a84704c3e98bb9fa [id=5e021e5163384542bcdbe25ff67c3a50]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:11.098342 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1c64df83a18a470c98a9c1fd6bb38918 consensus state has no leader
I20260620 07:01:11.098440 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9549196b4474939ac64f1f46b85d84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.104089 734 tablet_service.cc:1467] Processing CreateTablet for tablet 95d4f7dc014e40e8a749b40418831efb (DEFAULT_TABLE table=default.Table_5d72ef54fe32494391f31d295db01e4a [id=5b3f0ef584c14c56bae13f7267a44334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.105576 732 tablet_service.cc:1467] Processing CreateTablet for tablet 016029eafa1d438da54d963a64767ec5 (DEFAULT_TABLE table=default.Table_79f21480be5047f7ac25be9822c09588 [id=ea5bc9bef9654a9d8c7db871ef5835cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.104804 724 tablet_service.cc:1467] Processing CreateTablet for tablet 70f09b7dfdc1467eb47b8d7acb214919 (DEFAULT_TABLE table=default.Table_0467f4c59a6647f0b8dc78ce62517b66 [id=9369b6e3a1bb4a6bb74b17b456b20c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.108392 719 tablet_service.cc:1467] Processing CreateTablet for tablet 4d23f06461284d6cb950b258e8b39540 (DEFAULT_TABLE table=default.Table_6f307d70fb934b379cdbbdabbc992f99 [id=2a1d721da6b943b497a62d7f24d7aaf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.108819 721 tablet_service.cc:1467] Processing CreateTablet for tablet 5046d808d01f4af3803cb3edf425f777 (DEFAULT_TABLE table=default.Table_9d9e9ea2ddae464a96fb6335aba96e75 [id=00228c063a1e4e418276206a6831a387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.109179 731 tablet_service.cc:1467] Processing CreateTablet for tablet a1a735f60ed7492e8cabbd1254b19800 (DEFAULT_TABLE table=default.Table_03279cc268a143a0b89229d8a948759b [id=6e76e9d95750458db1ab3b02c60e40b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.110669 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04db48e910514d46bb4deb9acf54f7c0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:11.110973 718 tablet_service.cc:1467] Processing CreateTablet for tablet 6172551cb6c44f18952433eeac8ec4e7 (DEFAULT_TABLE table=default.Table_0634bf6a5c6e44348cbf328d2d3169c2 [id=ed52db45c83e465ea15cf690687cb2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.111074 1165 ts_tablet_manager.cc:1918] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.111196 1165 log.cc:1196] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/eea1525b54cc42b78180ba6867957f76
I20260620 07:01:11.111418 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ca4bb86788c4ba1ac48ca5a57a3a85d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.111392 831 leader_election.cc:341] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:11.111483 1165 ts_tablet_manager.cc:1939] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:11.112044 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet eea1525b54cc42b78180ba6867957f76 (table default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6 [id=9ccc7eaea2334670b3c18570de5dcb3b]) successfully deleted
I20260620 07:01:11.112125 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea1525b54cc42b78180ba6867957f76" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:11.112730 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5046d808d01f4af3803cb3edf425f777. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.119367 831 leader_election.cc:341] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:11.119736 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d23f06461284d6cb950b258e8b39540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.123025 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1a735f60ed7492e8cabbd1254b19800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.127000 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016029eafa1d438da54d963a64767ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.131119 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70f09b7dfdc1467eb47b8d7acb214919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.135046 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6172551cb6c44f18952433eeac8ec4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.138944 1170 tablet_bootstrap.cc:492] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:11.141430 858 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0b0969fb784dba96459ea441f88ae9 (DEFAULT_TABLE table=default.Table_a9daa65902764470b46116dd8693e062 [id=b091c6f29b82472da2f0c8b8af967aaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.141760 722 tablet_service.cc:1467] Processing CreateTablet for tablet 64addb9379b247dfa678e2a0ae1af0cf (DEFAULT_TABLE table=default.Table_02dd512d8cdb48e98679252eee51b6bd [id=9280d71683cd4b34a5fd30beafd90eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.142113 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c0b0969fb784dba96459ea441f88ae9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.147692 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52d2a46f972e45f5aeadb09101a68149 consensus state has no leader
I20260620 07:01:11.148082 1170 ts_tablet_manager.cc:1397] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.411s user 0.006s sys 0.006s
W20260620 07:01:11.150565 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ed042bdf10a2453eab5175f21d1184c1 (table default.Table_e3cfd3eb18ae43ce9c2265792904718f [id=af10c4d2a07c4903b72cd142200e6ba3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ed042bdf10a2453eab5175f21d1184c1 consensus state has no leader
I20260620 07:01:11.151930 1165 tablet_replica.cc:330] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:11.153020 1165 raft_consensus.cc:2229] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.153327 1165 raft_consensus.cc:2258] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.155257 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc40cf4ca353452590c770c86be0814c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.156045 1165 ts_tablet_manager.cc:1905] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.156659 421 master_service.cc:946] ReplaceTablet: received request to replace tablet 2057b7689b1c4c65901ed8ec04279568 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:11.157796 717 tablet_service.cc:1467] Processing CreateTablet for tablet fe92ec6b3f6b4bfe9643139330a0bf6d (DEFAULT_TABLE table=default.Table_0e91deb619774c1a8b520408d0d7504f [id=f52f78c1c0504e928958f0d635c4f47d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.160919 1935 raft_consensus.cc:482] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:11.161093 1935 raft_consensus.cc:504] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.161692 1935 leader_election.cc:288] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:11.162170 1920 raft_consensus.cc:504] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.162889 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a4390225af348f89c934f0f179ddab5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:11.163492 831 leader_election.cc:341] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:11.164592 1170 raft_consensus.cc:348] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.164858 1170 raft_consensus.cc:374] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.164983 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64addb9379b247dfa678e2a0ae1af0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.166360 1170 raft_consensus.cc:729] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.166677 1170 consensus_queue.cc:260] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.171031 1165 ts_tablet_manager.cc:1918] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.174254 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb29ab54c11a4ef98c67fad8e233e3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.175482 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c11f2678559c41d3bc71d4fa04efd0ac" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:11.175694 890 raft_consensus.cc:3037] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:11.179431 890 raft_consensus.cc:2454] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:11.180197 1165 log.cc:1196] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/c38c628514c44c6fa5aff64928e515d9
I20260620 07:01:11.180778 1165 ts_tablet_manager.cc:1939] T c38c628514c44c6fa5aff64928e515d9 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:11.181764 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9549196b4474939ac64f1f46b85d84e consensus state has no leader
I20260620 07:01:11.182578 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cae8e192c99a43f3975359ae78131167" } modify_external_catalogs: true
I20260620 07:01:11.182755 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet c38c628514c44c6fa5aff64928e515d9 (table default.Table_5a07e98698e24414a5ac54521c1b251c [id=a6be77da33394794ac37a31806294616]) successfully deleted
I20260620 07:01:11.182881 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cae8e192c99a43f3975359ae78131167" } modify_external_catalogs: true
I20260620 07:01:11.183125 1165 tablet_replica.cc:330] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:11.183370 1165 raft_consensus.cc:2229] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.183575 1165 raft_consensus.cc:2258] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.183498 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0d0e1d25b4b4481c836dfb048e9c1604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.184156 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d0e1d25b4b4481c836dfb048e9c1604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.185392 1165 ts_tablet_manager.cc:1905] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.187285 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_489099e333304b76a22a77be828f6e46" } modify_external_catalogs: true
I20260620 07:01:11.187484 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_489099e333304b76a22a77be828f6e46" } modify_external_catalogs: true
I20260620 07:01:11.188611 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe92ec6b3f6b4bfe9643139330a0bf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.190114 683 leader_election.cc:302] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:11.191239 2016 raft_consensus.cc:2781] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:11.193287 1920 leader_election.cc:288] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:11.193750 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95d4f7dc014e40e8a749b40418831efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.194777 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4302edba0ec04d7abc2789bc7be1beca
I20260620 07:01:11.195879 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 4302edba0ec04d7abc2789bc7be1beca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.199548 1165 ts_tablet_manager.cc:1918] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260620 07:01:11.199733 1165 log.cc:1196] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/610a25c729cf41b4bd71372bc36365a8
I20260620 07:01:11.200152 1165 ts_tablet_manager.cc:1939] T 610a25c729cf41b4bd71372bc36365a8 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:11.200536 1170 ts_tablet_manager.cc:1428] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.039s user 0.003s sys 0.000s
I20260620 07:01:11.200932 1170 tablet_bootstrap.cc:492] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:11.201280 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 610a25c729cf41b4bd71372bc36365a8 (table default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3]) successfully deleted
I20260620 07:01:11.202438 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 45358f467b864c3284040893d7351b03
I20260620 07:01:11.203715 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 45358f467b864c3284040893d7351b03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.205137 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3513341e1b664af1813f2b4ffbce1535. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.207353 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 80138f3919f34d5d8163fdfc89d5c52b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80138f3919f34d5d8163fdfc89d5c52b already in progress: creating tablet
I20260620 07:01:11.207713 1165 tablet_replica.cc:330] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:11.208153 1165 raft_consensus.cc:2229] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.209199 1165 raft_consensus.cc:2258] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.210062 1165 ts_tablet_manager.cc:1905] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.215081 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 80a83948f0424b47889f4be7fee15706
I20260620 07:01:11.215898 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 80a83948f0424b47889f4be7fee15706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.219944 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6497405bcc42404db11302f413834ec1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:11.220032 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_78748b90376d4d5086c8ef2429c3cb29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.220618 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6497405bcc42404db11302f413834ec1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:11.220695 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78748b90376d4d5086c8ef2429c3cb29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.225881 715 tablet_service.cc:1467] Processing CreateTablet for tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a (DEFAULT_TABLE table=default.Table_d66e26edeccc4a138950de609d6c107f [id=dbe2ab45243b4aeca16c961149135563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.229255 1165 ts_tablet_manager.cc:1918] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.229395 1165 log.cc:1196] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/a2d6f7f2b5b3473aa010b8982a03aa5e
I20260620 07:01:11.229312 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_079ba68269814e1ebd7439714bcf4fee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:11.229688 1165 ts_tablet_manager.cc:1939] T a2d6f7f2b5b3473aa010b8982a03aa5e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:11.229911 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_079ba68269814e1ebd7439714bcf4fee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.234974 1170 tablet_bootstrap.cc:654] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.233783 727 tablet_service.cc:1467] Processing CreateTablet for tablet de6ccea1cd074afb9fef17c8e07f444f (DEFAULT_TABLE table=default.Table_daf0a27dab6a4b18b63b0dbd7bffa56c [id=1715fc38dc0c448fbf018cfddb6bdbad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.241503 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.257318 858 tablet_service.cc:1467] Processing CreateTablet for tablet 4e71110c1bd247c1b6afa43e3361534b (DEFAULT_TABLE table=default.Table_638b93421e824f669670b9bd1cac3389 [id=4a598c714b2e40ba8bb1a9fe0372ea4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.258124 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e71110c1bd247c1b6afa43e3361534b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.245687 683 consensus_peers.cc:487] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 610a25c729cf41b4bd71372bc36365a8. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:11.249588 725 tablet_service.cc:1467] Processing CreateTablet for tablet 90fb564b3db04207a278904038777d77 (DEFAULT_TABLE table=default.Table_db689efc7c5a47cfbd13b34707385ca5 [id=b55465ec08be4c1685867b73405fbbf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.260731 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de6ccea1cd074afb9fef17c8e07f444f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.261106 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90fb564b3db04207a278904038777d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.262451 872 tablet_service.cc:1467] Processing CreateTablet for tablet 5773d09ad37c45198d62886624c87eea (DEFAULT_TABLE table=default.Table_b112301348ea4d389930b5ecdc98183d [id=fbe4f139f91143049259f3d0aaca5323]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.262850 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5773d09ad37c45198d62886624c87eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.267602 1935 raft_consensus.cc:482] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:11.267743 1935 raft_consensus.cc:504] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.268304 1935 leader_election.cc:288] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:11.269475 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9f21f8c0c60642fd97b87ce5e1befcaf" } modify_external_catalogs: true
I20260620 07:01:11.269771 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9f21f8c0c60642fd97b87ce5e1befcaf" } modify_external_catalogs: true
I20260620 07:01:11.269851 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet a2d6f7f2b5b3473aa010b8982a03aa5e (table default.Table_0f52b588d09748288097316c7b3de423 [id=7abc3167416745d0871a33a335f880c6]) successfully deleted
I20260620 07:01:11.270299 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0bd72c17169f4beeab67a8556e097bd4" } new_table_name: "default.Table_19e2dfb2a64543aa85620a960b34758e" modify_external_catalogs: true
I20260620 07:01:11.272317 857 tablet_service.cc:1467] Processing CreateTablet for tablet a93395ecdc41414bb9491a44788d144b (DEFAULT_TABLE table=default.Table_94bc617747744718a7f1037868df1790 [id=d42b6c9e1b094436bec36ede5faf3d14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.272789 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a93395ecdc41414bb9491a44788d144b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.273926 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 29b8ce279cfe4684bd296a48e8783e1b
I20260620 07:01:11.274314 868 tablet_service.cc:1467] Processing CreateTablet for tablet 0532a5d9ae484bd186f5c64bebd1b66c (DEFAULT_TABLE table=default.Table_d3219442b0f145f7b2e94b234889b7de [id=f9fe6caf41ce4c9a87f7e33e9f06a789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.274642 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0532a5d9ae484bd186f5c64bebd1b66c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.280333 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet d612e9caa8b540b4b96860491d653f11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d612e9caa8b540b4b96860491d653f11 already in progress: creating tablet
I20260620 07:01:11.280439 732 tablet_service.cc:1467] Processing CreateTablet for tablet 3829b52f99c24dd79047bc5388fc3bdd (DEFAULT_TABLE table=default.Table_28b6597a276f422ca492083967fb6ee4 [id=f3f8bdd128024f189e1e1ab9554b845f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:11.280635 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 4302edba0ec04d7abc2789bc7be1beca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4302edba0ec04d7abc2789bc7be1beca already in progress: creating tablet
W20260620 07:01:11.280856 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 45358f467b864c3284040893d7351b03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45358f467b864c3284040893d7351b03 already in progress: creating tablet
W20260620 07:01:11.281031 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 80a83948f0424b47889f4be7fee15706 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80a83948f0424b47889f4be7fee15706 already in progress: creating tablet
I20260620 07:01:11.282104 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b8ce279cfe4684bd296a48e8783e1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.282410 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6dca84adc5940e5a5505378e7276731" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:11.285887 721 tablet_service.cc:1467] Processing CreateTablet for tablet 464614a1d17a464190597f01c8539fba (DEFAULT_TABLE table=default.Table_cdf87d4ae1fc4d17a096825dfe433346 [id=dbaf6e43fd89431496db8606168d2c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.289716 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3829b52f99c24dd79047bc5388fc3bdd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.293133 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 29b8ce279cfe4684bd296a48e8783e1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29b8ce279cfe4684bd296a48e8783e1b already in progress: creating tablet
I20260620 07:01:11.297559 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ca4bb86788c4ba1ac48ca5a57a3a85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.301848 1925 raft_consensus.cc:482] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:11.303493 1988 leader_election.cc:288] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:11.303581 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d23f06461284d6cb950b258e8b39540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.304677 1003 tablet_service.cc:1467] Processing CreateTablet for tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a (DEFAULT_TABLE table=default.Table_d66e26edeccc4a138950de609d6c107f [id=dbe2ab45243b4aeca16c961149135563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.302484 996 tablet_service.cc:1467] Processing CreateTablet for tablet 95d4f7dc014e40e8a749b40418831efb (DEFAULT_TABLE table=default.Table_5d72ef54fe32494391f31d295db01e4a [id=5b3f0ef584c14c56bae13f7267a44334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.317433 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_830d9712bacd489bb685565167ded664"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:11.317626 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b6ae67323cd248cd93143c8bdcf3187e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.318118 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6ae67323cd248cd93143c8bdcf3187e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.319561 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f30c54c24f5f4cf9a19e699edc793a12" } new_table_name: "default.Table_8d56988a28214a3cb3c2acec75bde794" modify_external_catalogs: true
I20260620 07:01:11.320842 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1049597486e048af84978e2f18e6e952" } new_table_name: "default.Table_ddc492bc0f3749f4b49444e9f6f76689" modify_external_catalogs: true
W20260620 07:01:11.318120 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_830d9712bacd489bb685565167ded664 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:11.320036 1009 consensus_meta.cc:287] T 5855497e5b22493bb60024d30cc23e03 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent flushing consensus metadata: real 0.625s user 0.005s sys 0.000s
I20260620 07:01:11.313956 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb29ab54c11a4ef98c67fad8e233e3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.329231 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_865d7722c6fc4b1c8fec64adfc18d9e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.329954 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_865d7722c6fc4b1c8fec64adfc18d9e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.330865 1925 raft_consensus.cc:504] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.331686 1925 leader_election.cc:288] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:11.331954 1167 tablet_bootstrap.cc:492] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:11.332201 1167 ts_tablet_manager.cc:1397] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.702s user 0.002s sys 0.006s
I20260620 07:01:11.333716 872 tablet_service.cc:1467] Processing CreateTablet for tablet d67c46962e4240fc9137a5c8ce2fddee (DEFAULT_TABLE table=default.Table_440c27829a3b42a8b452c15509a150bd [id=ba7c8fdf76b9443595693568793679ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.334656 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d67c46962e4240fc9137a5c8ce2fddee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.292109 719 tablet_service.cc:1467] Processing CreateTablet for tablet b99781ba1ed44f6895af7da082618616 (DEFAULT_TABLE table=default.Table_ecac1f12f41f42609220ff60055c6e50 [id=b22bf01348b04d348a7d6fea3cf21496]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.292445 731 tablet_service.cc:1467] Processing CreateTablet for tablet 1fc71cb2df0348e09c772bf11fa5656b (DEFAULT_TABLE table=default.Table_35d07463a39145159df79be022763773 [id=f8c0c65cdc1048bd9262456f229ef679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.338090 858 tablet_service.cc:1467] Processing CreateTablet for tablet afddbb6bbbbf40f9b466ebcd06083fc2 (DEFAULT_TABLE table=default.Table_bf10ad0aef124efa8d14687eb39c572e [id=7b1a0565bcb54b72ac287ccc8cb71a64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.338986 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afddbb6bbbbf40f9b466ebcd06083fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.342552 718 tablet_service.cc:1467] Processing CreateTablet for tablet 55f7ae7d91484d6c99faf7a0d837b546 (DEFAULT_TABLE table=default.Table_372f2b67fb3f40de80d976f4dcf68621 [id=76f4c9d5997c469eb6697f8940e740e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.342748 1169 ts_tablet_manager.cc:1918] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:11.344296 831 leader_election.cc:341] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:11.344863 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95d4f7dc014e40e8a749b40418831efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.351152 724 tablet_service.cc:1467] Processing CreateTablet for tablet 028ca38aefdc40f29b1413bbed7ed0ae (DEFAULT_TABLE table=default.Table_bc6f45b50d5647928a19eb8b0b789fd8 [id=d66c9d3d39c9401fbb8007dc460dd23f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.353137 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 80138f3919f34d5d8163fdfc89d5c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:11.353399 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 610a25c729cf41b4bd71372bc36365a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:11.353840 728 tablet_service.cc:1467] Processing CreateTablet for tablet d8a0073b1e034755bf3576927805a8d7 (DEFAULT_TABLE table=default.Table_34eaeb05ad0243cb9f083eb279a8ba73 [id=5a23c89228964939bd74b5079dd25881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.342938 1169 log.cc:1196] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/a5757e05e9a2403a86ca98f455e11754
I20260620 07:01:11.355474 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7468a287d55e4180bc8bfe93a9d10304" } new_table_name: "default.Table_7d80e3481b2146b289e99842ce23a03e" modify_external_catalogs: true
I20260620 07:01:11.355666 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_146feffa684d4d3cbf8835807e85bcd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.356287 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_146feffa684d4d3cbf8835807e85bcd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.356343 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 464614a1d17a464190597f01c8539fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.358865 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8a0073b1e034755bf3576927805a8d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.359375 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fc71cb2df0348e09c772bf11fa5656b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.362972 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55f7ae7d91484d6c99faf7a0d837b546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.358433 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8ec1e179a704e5480f3deaf856156e7" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:11.364390 2011 tablet.cc:1722] T 1b98711dfb114a2985c5153e9b44147a P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:11.365995 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.366020 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c11f2678559c41d3bc71d4fa04efd0ac" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:11.367071 1028 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s user 0.033s sys 0.107s
I20260620 07:01:11.368301 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 028ca38aefdc40f29b1413bbed7ed0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.368590 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b99781ba1ed44f6895af7da082618616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.372339 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "581573cafab14ac79ff7ad19da0580b4" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:11.372679 751 raft_consensus.cc:2379] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06a32ef63b2b495a9ade1de48c024ae9 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:01:11.381388 734 tablet_service.cc:1467] Processing CreateTablet for tablet 812b1e2457374feabb9c3692f81488b0 (DEFAULT_TABLE table=default.Table_c3e2020a90174ee1a722e88d9580e69e [id=ce2868d50af24783b8644b52921214a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.381954 717 tablet_service.cc:1467] Processing CreateTablet for tablet 0eaa780687e1479eb165b6dfa7e32023 (DEFAULT_TABLE table=default.Table_5089bff86b114c6e8beaa9be1dec9854 [id=12048e9dd9204beba16542fe67618456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.382341 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 812b1e2457374feabb9c3692f81488b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.382568 1169 ts_tablet_manager.cc:1939] T a5757e05e9a2403a86ca98f455e11754 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:11.384646 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eaa780687e1479eb165b6dfa7e32023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.404605 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 643) took 2556 ms. Trace:
I20260620 07:01:11.404748 1169 rpcz_store.cc:276] 0620 07:01:08.847832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.847946 (+ 114us) service_pool.cc:227] Handling call
0620 07:01:10.772880 (+1924934us) ts_tablet_manager.cc:1145] Deleting tablet a5757e05e9a2403a86ca98f455e11754
0620 07:01:10.772892 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.107410 (+334518us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.267795 (+160385us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.404577 (+136782us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1871450}
I20260620 07:01:11.405243 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 642) took 2604 ms. Trace:
I20260620 07:01:11.405339 1169 rpcz_store.cc:276] 0620 07:01:08.800495 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.800993 (+ 498us) service_pool.cc:227] Handling call
0620 07:01:11.405105 (+2604112us) ts_tablet_manager.cc:1145] Deleting tablet b37f2c150b314b7298f32c3d414ff43d
0620 07:01:11.405116 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.405226 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2503503}
I20260620 07:01:11.405601 1169 tablet_replica.cc:330] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:11.405792 1169 raft_consensus.cc:2229] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.405931 1169 raft_consensus.cc:2258] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.406448 1169 ts_tablet_manager.cc:1905] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.407281 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6172551cb6c44f18952433eeac8ec4e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.407759 1028 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s user 0.033s sys 0.107s
I20260620 07:01:11.408944 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c11f2678559c41d3bc71d4fa04efd0ac" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:11.410271 1167 raft_consensus.cc:348] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.410604 1167 raft_consensus.cc:374] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.416419 720 tablet_service.cc:1514] Processing DeleteTablet for tablet d612e9caa8b540b4b96860491d653f11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:11.416900 720 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0b0969fb784dba96459ea441f88ae9 (DEFAULT_TABLE table=default.Table_a9daa65902764470b46116dd8693e062 [id=b091c6f29b82472da2f0c8b8af967aaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.417346 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c0b0969fb784dba96459ea441f88ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.425993 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 4302edba0ec04d7abc2789bc7be1beca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:11.426528 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 45358f467b864c3284040893d7351b03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:11.435580 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 261f0d97e1084e828b9562cb30ea422b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:11.440400 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 80a83948f0424b47889f4be7fee15706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:11.440857 727 tablet_service.cc:1467] Processing CreateTablet for tablet 4e71110c1bd247c1b6afa43e3361534b (DEFAULT_TABLE table=default.Table_638b93421e824f669670b9bd1cac3389 [id=4a598c714b2e40ba8bb1a9fe0372ea4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.441056 729 tablet_service.cc:1467] Processing CreateTablet for tablet 969b451c02594e029f1522af54d5a8cd (DEFAULT_TABLE table=default.Table_fbcc45a7e4864cd49c799eb03fcd64ff [id=83e2439a30b44745a1f7527a635d244d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.445482 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969b451c02594e029f1522af54d5a8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.448097 722 tablet_service.cc:1467] Processing CreateTablet for tablet 5773d09ad37c45198d62886624c87eea (DEFAULT_TABLE table=default.Table_b112301348ea4d389930b5ecdc98183d [id=fbe4f139f91143049259f3d0aaca5323]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.448500 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5773d09ad37c45198d62886624c87eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.448441 716 tablet_service.cc:1467] Processing CreateTablet for tablet 0532a5d9ae484bd186f5c64bebd1b66c (DEFAULT_TABLE table=default.Table_d3219442b0f145f7b2e94b234889b7de [id=f9fe6caf41ce4c9a87f7e33e9f06a789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.449148 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0532a5d9ae484bd186f5c64bebd1b66c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.455726 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e71110c1bd247c1b6afa43e3361534b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.457548 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b8ce279cfe4684bd296a48e8783e1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:11.459138 733 tablet_service.cc:1467] Processing CreateTablet for tablet a93395ecdc41414bb9491a44788d144b (DEFAULT_TABLE table=default.Table_94bc617747744718a7f1037868df1790 [id=d42b6c9e1b094436bec36ede5faf3d14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.459728 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a93395ecdc41414bb9491a44788d144b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.462770 1167 raft_consensus.cc:729] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.463161 1167 consensus_queue.cc:260] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.462811 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc40cf4ca353452590c770c86be0814c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.462757 968 leader_election.cc:341] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:11.464813 1167 ts_tablet_manager.cc:1428] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.132s user 0.001s sys 0.001s
I20260620 07:01:11.464833 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5046d808d01f4af3803cb3edf425f777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.471139 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64addb9379b247dfa678e2a0ae1af0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.473363 724 tablet_service.cc:1467] Processing CreateTablet for tablet d67c46962e4240fc9137a5c8ce2fddee (DEFAULT_TABLE table=default.Table_440c27829a3b42a8b452c15509a150bd [id=ba7c8fdf76b9443595693568793679ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.473845 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d67c46962e4240fc9137a5c8ce2fddee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.473928 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9549196b4474939ac64f1f46b85d84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.476979 1166 ts_tablet_manager.cc:1918] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:11.477136 1166 log.cc:1196] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/04d5d361a5404dcf99a89e93ac1f7dd8
I20260620 07:01:11.478057 968 leader_election.cc:302] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:11.478585 1166 ts_tablet_manager.cc:1939] T 04d5d361a5404dcf99a89e93ac1f7dd8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:11.479605 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 390) took 8032 ms. Trace:
I20260620 07:01:11.479753 1167 tablet_bootstrap.cc:492] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:11.496662 1925 raft_consensus.cc:2726] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:11.498935 1166 rpcz_store.cc:276] 0620 07:01:03.447518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.447569 (+ 51us) service_pool.cc:227] Handling call
0620 07:01:10.643881 (+7196312us) ts_tablet_manager.cc:1145] Deleting tablet 04d5d361a5404dcf99a89e93ac1f7dd8
0620 07:01:10.643898 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:10.880613 (+236715us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.476136 (+595523us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.479571 (+ 3435us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":136402,"tablet-delete.queue_time_us":7195945}
W20260620 07:01:11.500003 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 76394.7us
I20260620 07:01:11.500290 968 leader_election.cc:302] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:11.500548 1925 raft_consensus.cc:3037] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:11.503157 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1a735f60ed7492e8cabbd1254b19800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.504113 725 tablet_service.cc:1467] Processing CreateTablet for tablet afddbb6bbbbf40f9b466ebcd06083fc2 (DEFAULT_TABLE table=default.Table_bf10ad0aef124efa8d14687eb39c572e [id=7b1a0565bcb54b72ac287ccc8cb71a64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.504626 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afddbb6bbbbf40f9b466ebcd06083fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.506578 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c64df83a18a470c98a9c1fd6bb38918" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:11.509493 681 leader_election.cc:341] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:11.516180 681 leader_election.cc:341] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:11.518118 1988 raft_consensus.cc:482] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:11.518268 1988 raft_consensus.cc:504] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.519363 1988 leader_election.cc:288] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:11.519491 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 396) took 7901 ms. Trace:
I20260620 07:01:11.526310 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70f09b7dfdc1467eb47b8d7acb214919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.526865 1166 rpcz_store.cc:276] 0620 07:01:03.601792 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.606856 (+ 5064us) service_pool.cc:227] Handling call
0620 07:01:11.499415 (+7892559us) ts_tablet_manager.cc:1145] Deleting tablet a2d6f7f2b5b3473aa010b8982a03aa5e
0620 07:01:11.499432 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.502855 (+ 3423us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7891853}
I20260620 07:01:11.529525 1169 ts_tablet_manager.cc:1918] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.529665 1169 log.cc:1196] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/581573cafab14ac79ff7ad19da0580b4
I20260620 07:01:11.531858 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet a5757e05e9a2403a86ca98f455e11754 (table default.Table_0f52b588d09748288097316c7b3de423 [id=7abc3167416745d0871a33a335f880c6]) successfully deleted
W20260620 07:01:11.532270 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b37f2c150b314b7298f32c3d414ff43d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b37f2c150b314b7298f32c3d414ff43d already in progress: creating tablet
W20260620 07:01:11.540904 413 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc -> Peer 2395d394cd84440ebae89d1ecfa13fb5 (127.0.97.61:33455): Couldn't send request to peer 2395d394cd84440ebae89d1ecfa13fb5. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 07:01:11.564126 1169 ts_tablet_manager.cc:1939] T 581573cafab14ac79ff7ad19da0580b4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:11.564944 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed69a44c466047d298cf7653b2a2bb23" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:11.566915 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 645) took 2670 ms. Trace:
I20260620 07:01:11.567196 1169 rpcz_store.cc:276] 0620 07:01:08.896581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.901609 (+ 5028us) service_pool.cc:227] Handling call
0620 07:01:11.405557 (+2503948us) ts_tablet_manager.cc:1145] Deleting tablet 581573cafab14ac79ff7ad19da0580b4
0620 07:01:11.405566 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.472304 (+ 66738us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.529423 (+ 57119us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.566891 (+ 37468us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2495562}
I20260620 07:01:11.568171 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 648) took 2625 ms. Trace:
I20260620 07:01:11.568416 1169 rpcz_store.cc:276] 0620 07:01:08.942560 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.953685 (+ 11125us) service_pool.cc:227] Handling call
0620 07:01:11.567915 (+2614230us) ts_tablet_manager.cc:1145] Deleting tablet 574371fb6915427687df660e733407df
0620 07:01:11.567959 (+ 44us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.568153 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2584654}
I20260620 07:01:11.569049 1169 tablet_replica.cc:330] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:11.569494 1169 raft_consensus.cc:2229] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.570027 1169 raft_consensus.cc:2258] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.571384 1169 ts_tablet_manager.cc:1905] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.571550 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 581573cafab14ac79ff7ad19da0580b4 (table default.Table_52bddb4b77954070ad4efafc2734ea40 [id=8f88c270fabb4c93a3b154ed158ab22b]) successfully deleted
W20260620 07:01:11.572309 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 574371fb6915427687df660e733407df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 574371fb6915427687df660e733407df already in progress: creating tablet
W20260620 07:01:11.579298 968 leader_election.cc:341] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:11.579749 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 397) took 7932 ms. Trace:
W20260620 07:01:11.582336 723 consensus_meta.cc:287] T 0b9222f1374e4e96bd760af1a52f3a1c P 2b84cae646b24bc7bd424eb8434ad425: Time spent flushing consensus metadata: real 0.773s user 0.021s sys 0.007s
W20260620 07:01:11.585531 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 54634.2us
W20260620 07:01:11.588182 968 consensus_peers.cc:487] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5757e05e9a2403a86ca98f455e11754. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:11.588398 968 leader_election.cc:341] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: add9e860802d4edebcfbc9fa3c4a6b24
W20260620 07:01:11.588776 968 leader_election.cc:341] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:11.588791 1999 consensus_queue.cc:1035] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:11.590338 1168 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.544s user 0.064s sys 0.170s
W20260620 07:01:11.590559 1168 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.545s user 0.064s sys 0.170s
I20260620 07:01:11.596000 1168 tablet_bootstrap.cc:492] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.597186 1168 ts_tablet_manager.cc:1397] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.553s user 0.066s sys 0.170s
I20260620 07:01:11.600095 1168 raft_consensus.cc:348] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.600787 1168 raft_consensus.cc:374] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.600996 1168 raft_consensus.cc:729] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.601619 1168 consensus_queue.cc:260] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.603420 1168 ts_tablet_manager.cc:1428] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260620 07:01:11.604995 1168 tablet_bootstrap.cc:492] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.611282 1168 tablet_bootstrap.cc:654] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.619118 1167 tablet_bootstrap.cc:654] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.621378 1925 raft_consensus.cc:2726] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:11.629429 1168 tablet_bootstrap.cc:492] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.629966 1168 ts_tablet_manager.cc:1397] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.007s
I20260620 07:01:11.631611 1168 raft_consensus.cc:348] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.632117 1168 raft_consensus.cc:374] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.632244 1168 raft_consensus.cc:729] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.632869 1168 consensus_queue.cc:260] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.635703 1168 ts_tablet_manager.cc:1428] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 07:01:11.637022 1168 tablet_bootstrap.cc:492] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.643107 1168 tablet_bootstrap.cc:654] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.643077 1166 rpcz_store.cc:276] 0620 07:01:03.601913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.606955 (+ 5042us) service_pool.cc:227] Handling call
0620 07:01:11.529034 (+7922079us) ts_tablet_manager.cc:1145] Deleting tablet 7b781d0578834708ae64b24419959cca
0620 07:01:11.529047 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.534710 (+ 5663us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7921212}
I20260620 07:01:11.643715 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 399) took 8041 ms. Trace:
I20260620 07:01:11.643806 1166 rpcz_store.cc:276] 0620 07:01:03.602139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.606977 (+ 4838us) service_pool.cc:227] Handling call
0620 07:01:11.643509 (+8036532us) ts_tablet_manager.cc:1145] Deleting tablet d0f7e6245c074c82a5a72be79ab1987f
0620 07:01:11.643524 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.643669 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8035560}
I20260620 07:01:11.644191 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 400) took 7981 ms. Trace:
I20260620 07:01:11.644268 1166 rpcz_store.cc:276] 0620 07:01:03.662826 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.662891 (+ 65us) service_pool.cc:227] Handling call
0620 07:01:11.644059 (+7981168us) ts_tablet_manager.cc:1145] Deleting tablet 816218c726a9473e9849b7a97c820678
0620 07:01:11.644070 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.644176 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7980924}
I20260620 07:01:11.644559 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 398) took 8042 ms. Trace:
I20260620 07:01:11.644629 1166 rpcz_store.cc:276] 0620 07:01:03.602011 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.665632 (+ 63621us) service_pool.cc:227] Handling call
0620 07:01:11.644451 (+7978819us) ts_tablet_manager.cc:1145] Deleting tablet c06bf6c4d1af40479c81bd1d85e2848f
0620 07:01:11.644462 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.644544 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7976446}
I20260620 07:01:11.658483 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 401) took 7917 ms. Trace:
I20260620 07:01:11.658663 1166 rpcz_store.cc:276] 0620 07:01:03.741164 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.741233 (+ 69us) service_pool.cc:227] Handling call
0620 07:01:11.658329 (+7917096us) ts_tablet_manager.cc:1145] Deleting tablet 1d9d4b5a69484176a7b0f4fded010867
0620 07:01:11.658342 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.658463 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7916852}
I20260620 07:01:11.659351 1166 tablet_replica.cc:330] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:11.659639 1166 raft_consensus.cc:2229] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.659891 1166 raft_consensus.cc:2258] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.660565 1166 ts_tablet_manager.cc:1905] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.663269 1168 tablet_bootstrap.cc:492] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.663491 1168 ts_tablet_manager.cc:1397] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.001s
I20260620 07:01:11.664970 1168 raft_consensus.cc:348] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.665305 1168 raft_consensus.cc:374] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.665395 1168 raft_consensus.cc:729] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.665776 1168 consensus_queue.cc:260] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.668828 1168 ts_tablet_manager.cc:1428] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
W20260620 07:01:11.675532 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d42118f181da4fa489a919a9b4c6664b consensus state has no leader
I20260620 07:01:11.676013 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0435678022914e6991c974e116d1a9f7
I20260620 07:01:11.677081 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8d71ef260d5149c9aa47d33c9b4e3c8f" } new_table_name: "default.Table_837dfe71dadf41468194692d0c1e1ed0" modify_external_catalogs: true
I20260620 07:01:11.677886 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c41bac2c663c4696912c8121d03cfbb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:11.679250 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 0435678022914e6991c974e116d1a9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.679809 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e71e331ae68345a9b88c2e93ecb5d73d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.680471 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e71e331ae68345a9b88c2e93ecb5d73d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.681783 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_361c16a82c8b4f518117b6747d4aa3bc" } modify_external_catalogs: true
I20260620 07:01:11.682085 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_361c16a82c8b4f518117b6747d4aa3bc" } modify_external_catalogs: true
W20260620 07:01:11.683982 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0435678022914e6991c974e116d1a9f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0435678022914e6991c974e116d1a9f7 already in progress: creating tablet
W20260620 07:01:11.684203 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c41bac2c663c4696912c8121d03cfbb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:11.675532 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d3868f92cd244e4b0321a0761f51c3f consensus state has no leader
W20260620 07:01:11.692127 862 consensus_meta.cc:287] T fe92ec6b3f6b4bfe9643139330a0bf6d P 978f112862c64141b1009856bef3d624: Time spent flushing consensus metadata: real 0.718s user 0.011s sys 0.000s
I20260620 07:01:11.711668 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 0435678022914e6991c974e116d1a9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:11.712731 968 consensus_peers.cc:487] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:11.717413 1170 tablet_bootstrap.cc:492] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:11.717571 1170 ts_tablet_manager.cc:1397] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.517s user 0.005s sys 0.024s
I20260620 07:01:11.721405 1168 tablet_bootstrap.cc:492] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.722813 1168 tablet_bootstrap.cc:654] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.726650 1168 tablet_bootstrap.cc:492] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.726799 1168 ts_tablet_manager.cc:1397] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:11.727480 1168 raft_consensus.cc:348] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.727696 1168 raft_consensus.cc:374] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.727757 1168 raft_consensus.cc:729] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.727968 1168 consensus_queue.cc:260] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:11.728220 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b17bbf2f844b4c01ad5d6dc36e096ee5 consensus state has no leader
I20260620 07:01:11.728451 1168 ts_tablet_manager.cc:1428] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:11.728750 1168 tablet_bootstrap.cc:492] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.728658 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_63c1143c0e0d411591cb240b7750c572" } modify_external_catalogs: true
I20260620 07:01:11.728754 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_83fba3799d694596940b78ff2610c8c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:11.729379 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83fba3799d694596940b78ff2610c8c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.729725 858 tablet_service.cc:1514] Processing DeleteTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.729784 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 2910da33bbdb4410a4a90ff9747a7de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.730099 1168 tablet_bootstrap.cc:654] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.731787 1165 tablet_replica.cc:330] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:11.731992 1165 raft_consensus.cc:2229] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.732228 1165 raft_consensus.cc:2258] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.728889 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_63c1143c0e0d411591cb240b7750c572" } modify_external_catalogs: true
I20260620 07:01:11.736238 862 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b6c578055d4f95b44c85eba8e92ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.736231 1165 ts_tablet_manager.cc:1905] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.738150 1168 tablet_bootstrap.cc:492] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.738193 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_22154b88a133429f981e2e3a4d1fd4aa" } modify_external_catalogs: true
I20260620 07:01:11.738270 1168 ts_tablet_manager.cc:1397] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260620 07:01:11.738418 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_22154b88a133429f981e2e3a4d1fd4aa" } modify_external_catalogs: true
I20260620 07:01:11.738483 1853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 07:01:11.739252 1168 raft_consensus.cc:348] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.739475 1168 raft_consensus.cc:374] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.739533 1168 raft_consensus.cc:729] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.739760 1168 consensus_queue.cc:260] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.739897 1853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 07:01:11.740242 1853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 07:01:11.740316 1168 ts_tablet_manager.cc:1428] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:11.740568 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cca283f4d2645c0b59f750949b7e263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:11.739948 1170 raft_consensus.cc:348] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.740912 1168 tablet_bootstrap.cc:492] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.741393 1170 raft_consensus.cc:374] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.741532 1170 raft_consensus.cc:729] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
W20260620 07:01:11.740140 2016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.516s user 0.003s sys 0.009s
I20260620 07:01:11.742774 1168 tablet_bootstrap.cc:654] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:11.742523 2016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.551s user 0.003s sys 0.009s
I20260620 07:01:11.743129 2016 raft_consensus.cc:686] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:11.743410 2016 consensus_queue.cc:237] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.761688 1165 ts_tablet_manager.cc:1918] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.761935 1165 log.cc:1196] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/b5014cf5cc70466bafb6921c9d46ba72
I20260620 07:01:11.762414 1165 ts_tablet_manager.cc:1939] T b5014cf5cc70466bafb6921c9d46ba72 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:11.763197 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet b5014cf5cc70466bafb6921c9d46ba72 (table default.Table_833694b1c9684acb97bca68ebefecb45 [id=0d5d9534e45441a290f21fca41209793]) successfully deleted
I20260620 07:01:11.763615 1165 tablet_replica.cc:330] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:11.763864 1165 raft_consensus.cc:2229] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.764077 1165 raft_consensus.cc:2258] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.764492 1166 ts_tablet_manager.cc:1918] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.764680 1166 log.cc:1196] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/e7d1e4719cd441dd8054b24861cbd8a2
I20260620 07:01:11.764842 1165 ts_tablet_manager.cc:1905] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.765157 1166 ts_tablet_manager.cc:1939] T e7d1e4719cd441dd8054b24861cbd8a2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:11.766393 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 402) took 7985 ms. Trace:
I20260620 07:01:11.752249 1170 consensus_queue.cc:260] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.767390 1989 raft_consensus.cc:482] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:11.767519 1989 raft_consensus.cc:504] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.767716 1999 raft_consensus.cc:482] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b84cae646b24bc7bd424eb8434ad425)
I20260620 07:01:11.767963 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6dca84adc5940e5a5505378e7276731" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:11.768064 1989 leader_election.cc:288] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:11.768173 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04db48e910514d46bb4deb9acf54f7c0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:11.768564 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea1525b54cc42b78180ba6867957f76" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:11.768857 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a4390225af348f89c934f0f179ddab5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:11.769079 994 tablet_service.cc:1467] Processing CreateTablet for tablet fe92ec6b3f6b4bfe9643139330a0bf6d (DEFAULT_TABLE table=default.Table_0e91deb619774c1a8b520408d0d7504f [id=f52f78c1c0504e928958f0d635c4f47d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.769536 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe92ec6b3f6b4bfe9643139330a0bf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.770848 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 464614a1d17a464190597f01c8539fba (DEFAULT_TABLE table=default.Table_cdf87d4ae1fc4d17a096825dfe433346 [id=dbaf6e43fd89431496db8606168d2c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.771040 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 90fb564b3db04207a278904038777d77 (DEFAULT_TABLE table=default.Table_db689efc7c5a47cfbd13b34707385ca5 [id=b55465ec08be4c1685867b73405fbbf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.771168 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 464614a1d17a464190597f01c8539fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.771377 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 1fc71cb2df0348e09c772bf11fa5656b (DEFAULT_TABLE table=default.Table_35d07463a39145159df79be022763773 [id=f8c0c65cdc1048bd9262456f229ef679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.771811 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 3829b52f99c24dd79047bc5388fc3bdd (DEFAULT_TABLE table=default.Table_28b6597a276f422ca492083967fb6ee4 [id=f3f8bdd128024f189e1e1ab9554b845f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.771871 1169 ts_tablet_manager.cc:1918] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.771986 1169 log.cc:1196] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/da1e30385ed44c7f8b7db868f2e2bc29
I20260620 07:01:11.772212 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 55f7ae7d91484d6c99faf7a0d837b546 (DEFAULT_TABLE table=default.Table_372f2b67fb3f40de80d976f4dcf68621 [id=76f4c9d5997c469eb6697f8940e740e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.772506 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 028ca38aefdc40f29b1413bbed7ed0ae (DEFAULT_TABLE table=default.Table_bc6f45b50d5647928a19eb8b0b789fd8 [id=d66c9d3d39c9401fbb8007dc460dd23f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.773739 1168 tablet_bootstrap.cc:492] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.774150 1170 ts_tablet_manager.cc:1428] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.056s user 0.003s sys 0.000s
I20260620 07:01:11.774338 1168 ts_tablet_manager.cc:1397] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.004s
I20260620 07:01:11.774434 1170 tablet_bootstrap.cc:492] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:11.770689 1001 tablet_service.cc:1467] Processing CreateTablet for tablet de6ccea1cd074afb9fef17c8e07f444f (DEFAULT_TABLE table=default.Table_daf0a27dab6a4b18b63b0dbd7bffa56c [id=1715fc38dc0c448fbf018cfddb6bdbad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.775066 1168 raft_consensus.cc:348] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.775312 1168 raft_consensus.cc:374] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.775372 1168 raft_consensus.cc:729] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.775687 1168 consensus_queue.cc:260] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.780242 1168 ts_tablet_manager.cc:1428] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:11.782469 1168 tablet_bootstrap.cc:492] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.772853 1009 tablet_service.cc:1467] Processing CreateTablet for tablet d8a0073b1e034755bf3576927805a8d7 (DEFAULT_TABLE table=default.Table_34eaeb05ad0243cb9f083eb279a8ba73 [id=5a23c89228964939bd74b5079dd25881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.772913 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 80138f3919f34d5d8163fdfc89d5c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:11.772851 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 610a25c729cf41b4bd71372bc36365a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:11.772513 995 tablet_service.cc:1467] Processing CreateTablet for tablet b99781ba1ed44f6895af7da082618616 (DEFAULT_TABLE table=default.Table_ecac1f12f41f42609220ff60055c6e50 [id=b22bf01348b04d348a7d6fea3cf21496]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.787866 1170 tablet_bootstrap.cc:654] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:11.773777 968 leader_election.cc:341] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 203ba3933d3a4fb2a4978b29cad614e6
I20260620 07:01:11.782610 1999 raft_consensus.cc:504] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.789152 1999 leader_election.cc:288] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:11.783064 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90fb564b3db04207a278904038777d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.789783 1168 tablet_bootstrap.cc:654] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.790910 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8a0073b1e034755bf3576927805a8d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.791144 1169 ts_tablet_manager.cc:1939] T da1e30385ed44c7f8b7db868f2e2bc29 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:11.791916 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 644) took 2899 ms. Trace:
I20260620 07:01:11.792006 1169 rpcz_store.cc:276] 0620 07:01:08.892445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.901467 (+ 9022us) service_pool.cc:227] Handling call
0620 07:01:11.568968 (+2667501us) ts_tablet_manager.cc:1145] Deleting tablet da1e30385ed44c7f8b7db868f2e2bc29
0620 07:01:11.568982 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.753522 (+184540us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.771771 (+ 18249us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.791890 (+ 20119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2584759}
I20260620 07:01:11.792500 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet da1e30385ed44c7f8b7db868f2e2bc29 (table default.Table_0d2790345adb48f6b1c2e10d634207e3 [id=640b0fb8da40454d94a90d23f41b06ff]) successfully deleted
I20260620 07:01:11.795550 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3829b52f99c24dd79047bc5388fc3bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.796458 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 646) took 2888 ms. Trace:
I20260620 07:01:11.796550 1169 rpcz_store.cc:276] 0620 07:01:08.907698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.910031 (+ 2333us) service_pool.cc:227] Handling call
0620 07:01:11.796243 (+2886212us) ts_tablet_manager.cc:1145] Deleting tablet 95ba8444d70342f781bd84edefbca71f
0620 07:01:11.796260 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.796431 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2811291}
W20260620 07:01:11.797087 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 95ba8444d70342f781bd84edefbca71f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95ba8444d70342f781bd84edefbca71f already in progress: creating tablet
I20260620 07:01:11.798103 1168 tablet_bootstrap.cc:492] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.798125 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 647) took 2862 ms. Trace:
I20260620 07:01:11.798244 1168 ts_tablet_manager.cc:1397] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260620 07:01:11.798213 1169 rpcz_store.cc:276] 0620 07:01:08.936102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.946004 (+ 9902us) service_pool.cc:227] Handling call
0620 07:01:11.797996 (+2851992us) ts_tablet_manager.cc:1145] Deleting tablet 00a34f01ce5d4d5696248dc88802dafd
0620 07:01:11.798008 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.798105 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2812751}
W20260620 07:01:11.798655 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 00a34f01ce5d4d5696248dc88802dafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00a34f01ce5d4d5696248dc88802dafd already in progress: creating tablet
W20260620 07:01:11.799181 393 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 44806.7us
I20260620 07:01:11.799374 1168 raft_consensus.cc:348] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.799598 1168 raft_consensus.cc:374] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.799633 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 028ca38aefdc40f29b1413bbed7ed0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.799649 1168 raft_consensus.cc:729] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.800056 1168 consensus_queue.cc:260] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.800612 1168 ts_tablet_manager.cc:1428] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:11.803185 1165 ts_tablet_manager.cc:1918] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.803299 1165 log.cc:1196] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/2910da33bbdb4410a4a90ff9747a7de1
I20260620 07:01:11.803582 1165 ts_tablet_manager.cc:1939] T 2910da33bbdb4410a4a90ff9747a7de1 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:11.804068 1168 tablet_bootstrap.cc:492] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.804715 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b99781ba1ed44f6895af7da082618616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.806046 1168 tablet_bootstrap.cc:654] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.807567 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 2910da33bbdb4410a4a90ff9747a7de1 (table default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]) successfully deleted
I20260620 07:01:11.807899 1165 tablet_replica.cc:330] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:11.808081 1170 tablet_bootstrap.cc:492] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:11.808079 1165 raft_consensus.cc:2229] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.808208 1170 ts_tablet_manager.cc:1397] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.003s
I20260620 07:01:11.808226 1165 raft_consensus.cc:2258] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.808497 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 659) took 2460 ms. Trace:
I20260620 07:01:11.808583 1169 rpcz_store.cc:276] 0620 07:01:09.348227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.349548 (+ 1321us) service_pool.cc:227] Handling call
0620 07:01:11.808329 (+2458781us) ts_tablet_manager.cc:1145] Deleting tablet 0e30fb1d050c4439bb72a21a0f2b13eb
0620 07:01:11.808347 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.808474 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2458159}
I20260620 07:01:11.808914 1170 raft_consensus.cc:348] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.809072 1165 ts_tablet_manager.cc:1905] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:11.809048 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 0e30fb1d050c4439bb72a21a0f2b13eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e30fb1d050c4439bb72a21a0f2b13eb already in progress: creating tablet
I20260620 07:01:11.809113 1170 raft_consensus.cc:374] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.809161 1170 raft_consensus.cc:729] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.809396 1170 consensus_queue.cc:260] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.809998 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55f7ae7d91484d6c99faf7a0d837b546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.810034 1170 ts_tablet_manager.cc:1428] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:11.810284 1170 tablet_bootstrap.cc:492] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:11.811036 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 663) took 2452 ms. Trace:
I20260620 07:01:11.811190 1169 rpcz_store.cc:276] 0620 07:01:09.358724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.605307 (+246583us) service_pool.cc:227] Handling call
0620 07:01:11.810899 (+2205592us) ts_tablet_manager.cc:1145] Deleting tablet 2859db39c7dd486f9ad7e3b5f84927fa
0620 07:01:11.810910 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.811019 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2198618}
W20260620 07:01:11.811723 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2859db39c7dd486f9ad7e3b5f84927fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2859db39c7dd486f9ad7e3b5f84927fa already in progress: creating tablet
I20260620 07:01:11.813686 1170 tablet_bootstrap.cc:654] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.815348 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de6ccea1cd074afb9fef17c8e07f444f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.817075 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 665) took 2455 ms. Trace:
I20260620 07:01:11.817214 1169 rpcz_store.cc:276] 0620 07:01:09.361882 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.621427 (+259545us) service_pool.cc:227] Handling call
0620 07:01:11.816837 (+2195410us) ts_tablet_manager.cc:1145] Deleting tablet 3e9f0dba4466436f9cfc730d7d6b15fe
0620 07:01:11.816857 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.817040 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195049}
W20260620 07:01:11.818011 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3e9f0dba4466436f9cfc730d7d6b15fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e9f0dba4466436f9cfc730d7d6b15fe already in progress: creating tablet
I20260620 07:01:11.818974 1168 tablet_bootstrap.cc:492] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.819099 1168 ts_tablet_manager.cc:1397] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.002s
I20260620 07:01:11.819883 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fc71cb2df0348e09c772bf11fa5656b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.819792 1168 raft_consensus.cc:348] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.820075 1168 raft_consensus.cc:374] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.820137 1168 raft_consensus.cc:729] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.820381 1168 consensus_queue.cc:260] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.821796 1168 ts_tablet_manager.cc:1428] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:11.822731 1168 tablet_bootstrap.cc:492] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.824450 1168 tablet_bootstrap.cc:654] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:11.825953 968 leader_election.cc:341] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 3f53f0302d1a4fb3a0fe3e1d98583550
W20260620 07:01:11.827637 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36a5dde9352f48a19f7a379dc40cf491 consensus state has no leader
I20260620 07:01:11.830245 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2056d596b0ae4f398e6c525a8016ff09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:11.830992 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 664) took 2469 ms. Trace:
I20260620 07:01:11.831094 1169 rpcz_store.cc:276] 0620 07:01:09.361729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.612320 (+250591us) service_pool.cc:227] Handling call
0620 07:01:11.830833 (+2218513us) ts_tablet_manager.cc:1145] Deleting tablet 3a8d48f0f9dd4911876ec8f812688439
0620 07:01:11.830845 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.830967 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2192228}
W20260620 07:01:11.831593 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3a8d48f0f9dd4911876ec8f812688439 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a8d48f0f9dd4911876ec8f812688439 already in progress: creating tablet
W20260620 07:01:11.832242 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2056d596b0ae4f398e6c525a8016ff09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:11.834908 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 666) took 2284 ms. Trace:
I20260620 07:01:11.835096 1169 rpcz_store.cc:276] 0620 07:01:09.550573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.621799 (+ 71226us) service_pool.cc:227] Handling call
0620 07:01:11.834600 (+2212801us) ts_tablet_manager.cc:1145] Deleting tablet d05a505f73b24e0ba7159a3d411e5f4f
0620 07:01:11.834755 (+ 155us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.834887 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195427}
I20260620 07:01:11.835466 999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 730) took 1035 ms. Trace:
I20260620 07:01:11.835558 999 rpcz_store.cc:276] 0620 07:01:10.800330 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.802673 (+ 2343us) service_pool.cc:227] Handling call
0620 07:01:10.810333 (+ 7660us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:10.810355 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:11.707210 (+896855us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.782454 (+ 75244us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:11.835316 (+ 52862us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x618000005118. stack: 00007f5f3ef5866e 00007f5f3ef58430 00007f5f3dfdf5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f5f3ef4e0fd 00007f5f3ef4f16e 00007f5f51ea3cfd 00007f5f51e21883 00007f5f4e0c0e65 00007f5f4e0b53b0 00007f5f4e0b6cf9 00007f5f4e00e40b 00007f5f48637ac6 00007f5f486377f5
0620 07:01:11.835423 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":120632064}
W20260620 07:01:11.835686 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d05a505f73b24e0ba7159a3d411e5f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d05a505f73b24e0ba7159a3d411e5f4f already in progress: creating tablet
I20260620 07:01:11.836251 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 667) took 2283 ms. Trace:
I20260620 07:01:11.836751 1169 rpcz_store.cc:276] 0620 07:01:09.552640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.627786 (+ 75146us) service_pool.cc:227] Handling call
0620 07:01:11.836114 (+2208328us) ts_tablet_manager.cc:1145] Deleting tablet a570e8da585d46839281d606b2f51938
0620 07:01:11.836125 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.836232 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2179695}
W20260620 07:01:11.839578 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4128a4e9a228456cb5cd08eef2bf73d4 consensus state has no leader
W20260620 07:01:11.839918 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a570e8da585d46839281d606b2f51938 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a570e8da585d46839281d606b2f51938 already in progress: creating tablet
I20260620 07:01:11.840783 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 679) took 1976 ms. Trace:
I20260620 07:01:11.841647 1169 rpcz_store.cc:276] 0620 07:01:09.864541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.864787 (+ 246us) service_pool.cc:227] Handling call
0620 07:01:11.840629 (+1975842us) ts_tablet_manager.cc:1145] Deleting tablet 13c7f0513df34ddb8104b06e5733fb62
0620 07:01:11.840640 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.840762 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1954891}
W20260620 07:01:11.843393 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 13c7f0513df34ddb8104b06e5733fb62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13c7f0513df34ddb8104b06e5733fb62 already in progress: creating tablet
I20260620 07:01:11.844738 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 678) took 2090 ms. Trace:
I20260620 07:01:11.844818 1170 tablet_bootstrap.cc:492] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:11.844867 1169 rpcz_store.cc:276] 0620 07:01:09.753458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.753509 (+ 51us) service_pool.cc:227] Handling call
0620 07:01:11.843876 (+2090367us) ts_tablet_manager.cc:1145] Deleting tablet 8cca283f4d2645c0b59f750949b7e263
0620 07:01:11.843887 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.843996 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1955433}
W20260620 07:01:11.845391 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8cca283f4d2645c0b59f750949b7e263 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cca283f4d2645c0b59f750949b7e263 already in progress: creating tablet
I20260620 07:01:11.845031 1170 ts_tablet_manager.cc:1397] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.001s
I20260620 07:01:11.846341 1170 raft_consensus.cc:348] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.847294 1165 ts_tablet_manager.cc:1918] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.847469 1165 log.cc:1196] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/e5b6c578055d4f95b44c85eba8e92ac8
I20260620 07:01:11.847903 1165 ts_tablet_manager.cc:1939] T e5b6c578055d4f95b44c85eba8e92ac8 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:11.849068 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet e5b6c578055d4f95b44c85eba8e92ac8 (table default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a [id=b64b98af489b40d3a363f9101d971f53]) successfully deleted
I20260620 07:01:11.849529 1165 tablet_replica.cc:330] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:11.849777 1165 raft_consensus.cc:2229] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.850200 1165 raft_consensus.cc:2258] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.851332 1165 ts_tablet_manager.cc:1905] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.854892 1170 raft_consensus.cc:374] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.855000 1170 raft_consensus.cc:729] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.855355 1170 consensus_queue.cc:260] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.846891 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 681) took 1958 ms. Trace:
I20260620 07:01:11.855748 1169 rpcz_store.cc:276] 0620 07:01:09.888741 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.888796 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:11.846665 (+1957869us) ts_tablet_manager.cc:1145] Deleting tablet 490eb0893a4f4811b7574c445e483549
0620 07:01:11.846674 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.846767 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1942519}
W20260620 07:01:11.856419 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 490eb0893a4f4811b7574c445e483549 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 490eb0893a4f4811b7574c445e483549 already in progress: creating tablet
I20260620 07:01:11.857067 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 687) took 1735 ms. Trace:
I20260620 07:01:11.857263 1169 rpcz_store.cc:276] 0620 07:01:10.123979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.124028 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:11.856794 (+1732766us) ts_tablet_manager.cc:1145] Deleting tablet e972b9bef1bd4c19ac0a8c86331dce60
0620 07:01:11.856812 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.857044 (+ 232us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1729224}
W20260620 07:01:11.858913 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet e972b9bef1bd4c19ac0a8c86331dce60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e972b9bef1bd4c19ac0a8c86331dce60 already in progress: creating tablet
I20260620 07:01:11.859448 1168 tablet_bootstrap.cc:492] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.859594 1168 ts_tablet_manager.cc:1397] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.002s
I20260620 07:01:11.859869 1170 ts_tablet_manager.cc:1428] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260620 07:01:11.860283 1168 raft_consensus.cc:348] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.860493 1168 raft_consensus.cc:374] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.860543 1168 raft_consensus.cc:729] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.860767 1168 consensus_queue.cc:260] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.861280 1168 ts_tablet_manager.cc:1428] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:11.861536 1168 tablet_bootstrap.cc:492] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.861567 1166 rpcz_store.cc:276] 0620 07:01:03.780394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.780458 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:11.659302 (+7878844us) ts_tablet_manager.cc:1145] Deleting tablet e7d1e4719cd441dd8054b24861cbd8a2
0620 07:01:11.659312 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.663920 (+ 4608us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.764386 (+100466us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.766271 (+ 1885us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7878620}
I20260620 07:01:11.862071 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 403) took 8063 ms. Trace:
I20260620 07:01:11.862335 1166 rpcz_store.cc:276] 0620 07:01:03.798911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.798966 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:11.861930 (+8062964us) ts_tablet_manager.cc:1145] Deleting tablet 6229a52adf8d4b17bdf89347e01621ed
0620 07:01:11.861942 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.862051 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8062759}
I20260620 07:01:11.862752 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 404) took 8031 ms. Trace:
I20260620 07:01:11.862912 1166 rpcz_store.cc:276] 0620 07:01:03.831232 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.831295 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:11.862635 (+8031340us) ts_tablet_manager.cc:1145] Deleting tablet c9d344f9e4b444e4b6018fdf0cf762fd
0620 07:01:11.862644 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.862737 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8031060}
I20260620 07:01:11.863256 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 405) took 8027 ms. Trace:
I20260620 07:01:11.863370 1166 rpcz_store.cc:276] 0620 07:01:03.835838 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.835895 (+ 57us) service_pool.cc:227] Handling call
0620 07:01:11.863164 (+8027269us) ts_tablet_manager.cc:1145] Deleting tablet 5926946427294a5ca6fbc72d3e1b612d
0620 07:01:11.863173 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.863243 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8026984}
I20260620 07:01:11.863735 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 412) took 7952 ms. Trace:
I20260620 07:01:11.863899 1166 rpcz_store.cc:276] 0620 07:01:03.911669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.911727 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:11.863629 (+7951902us) ts_tablet_manager.cc:1145] Deleting tablet 3651ef9790d342ec96f554134ae714dc
0620 07:01:11.863637 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.863720 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7951665}
I20260620 07:01:11.864307 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 416) took 7895 ms. Trace:
I20260620 07:01:11.864471 1166 rpcz_store.cc:276] 0620 07:01:03.968419 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.968806 (+ 387us) service_pool.cc:227] Handling call
0620 07:01:11.864203 (+7895397us) ts_tablet_manager.cc:1145] Deleting tablet 8d2c706414684bb1bacc6f9b870fc9c1
0620 07:01:11.864215 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.864292 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7895054}
I20260620 07:01:11.859457 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 688) took 1687 ms. Trace:
I20260620 07:01:11.864675 1169 rpcz_store.cc:276] 0620 07:01:10.171999 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.172065 (+ 66us) service_pool.cc:227] Handling call
0620 07:01:11.859293 (+1687228us) ts_tablet_manager.cc:1145] Deleting tablet 2614cc40931e4c308a5a7208f2e8c400
0620 07:01:11.859305 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.859438 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1663868}
I20260620 07:01:11.865032 1168 tablet_bootstrap.cc:654] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.865298 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 415) took 7897 ms. Trace:
W20260620 07:01:11.865396 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2614cc40931e4c308a5a7208f2e8c400 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2614cc40931e4c308a5a7208f2e8c400 already in progress: creating tablet
I20260620 07:01:11.865383 1166 rpcz_store.cc:276] 0620 07:01:03.968184 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:03.968765 (+ 581us) service_pool.cc:227] Handling call
0620 07:01:11.865185 (+7896420us) ts_tablet_manager.cc:1145] Deleting tablet ab60101b34144f85b0afd2e8c4846e48
0620 07:01:11.865197 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.865279 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7895367}
I20260620 07:01:11.865666 1166 tablet_replica.cc:330] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:11.865917 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 690) took 1651 ms. Trace:
I20260620 07:01:11.866146 1166 raft_consensus.cc:2229] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.867223 1166 raft_consensus.cc:2258] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.867182 1169 rpcz_store.cc:276] 0620 07:01:10.214986 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.215269 (+ 283us) service_pool.cc:227] Handling call
0620 07:01:11.865786 (+1650517us) ts_tablet_manager.cc:1145] Deleting tablet 41a03013bba54676abeaed30195e8a1e
0620 07:01:11.865798 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.865897 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1628279}
W20260620 07:01:11.867741 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 41a03013bba54676abeaed30195e8a1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41a03013bba54676abeaed30195e8a1e already in progress: creating tablet
I20260620 07:01:11.864959 1170 tablet_bootstrap.cc:492] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:11.868381 1165 ts_tablet_manager.cc:1918] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.868547 1165 log.cc:1196] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/8cca283f4d2645c0b59f750949b7e263
I20260620 07:01:11.868948 1165 ts_tablet_manager.cc:1939] T 8cca283f4d2645c0b59f750949b7e263 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:11.869706 1170 tablet_bootstrap.cc:654] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.870566 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 8cca283f4d2645c0b59f750949b7e263 (table default.Table_e5288a8179334813988c13c09263d3fb [id=c1fc89d0749e49239f909c0b75349ec3]) successfully deleted
I20260620 07:01:11.870038 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 692) took 1619 ms. Trace:
I20260620 07:01:11.873508 1169 rpcz_store.cc:276] 0620 07:01:10.250992 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.253050 (+ 2058us) service_pool.cc:227] Handling call
0620 07:01:11.869886 (+1616836us) ts_tablet_manager.cc:1145] Deleting tablet b58ce7876b614d63932d458036c7e041
0620 07:01:11.869899 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.870018 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1580647}
I20260620 07:01:11.873733 1166 ts_tablet_manager.cc:1905] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:11.874459 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b58ce7876b614d63932d458036c7e041 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b58ce7876b614d63932d458036c7e041 already in progress: creating tablet
I20260620 07:01:11.875438 1169 tablet_replica.cc:330] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:11.875694 1169 raft_consensus.cc:2229] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.875963 1169 raft_consensus.cc:2258] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.876888 1169 ts_tablet_manager.cc:1905] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.893191 1168 tablet_bootstrap.cc:492] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.893363 1168 ts_tablet_manager.cc:1397] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.032s user 0.015s sys 0.007s
I20260620 07:01:11.894114 1168 raft_consensus.cc:348] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.894340 1168 raft_consensus.cc:374] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.894405 1168 raft_consensus.cc:729] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.894738 1168 consensus_queue.cc:260] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.895787 1170 tablet_bootstrap.cc:492] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:11.895977 1170 ts_tablet_manager.cc:1397] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.003s
I20260620 07:01:11.896291 1168 ts_tablet_manager.cc:1428] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 07:01:11.897277 1168 tablet_bootstrap.cc:492] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.897138 1170 raft_consensus.cc:348] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.897678 1170 raft_consensus.cc:374] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.897784 1170 raft_consensus.cc:729] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.898072 1170 consensus_queue.cc:260] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.898990 1168 tablet_bootstrap.cc:654] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.900066 1170 ts_tablet_manager.cc:1428] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:11.902062 1170 tablet_bootstrap.cc:492] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:11.907305 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c64df83a18a470c98a9c1fd6bb38918" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:11.907430 1170 tablet_bootstrap.cc:654] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.907549 890 raft_consensus.cc:2454] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:11.897174 1169 ts_tablet_manager.cc:1918] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:11.907783 1169 log.cc:1196] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f4e3145a872348b6a85a19d1678636bc
I20260620 07:01:11.908149 1169 ts_tablet_manager.cc:1939] T f4e3145a872348b6a85a19d1678636bc P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:11.908301 1168 tablet_bootstrap.cc:492] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:11.908440 1168 ts_tablet_manager.cc:1397] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260620 07:01:11.909289 1168 raft_consensus.cc:348] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.909505 1168 raft_consensus.cc:374] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.909559 1168 raft_consensus.cc:729] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.909799 1168 consensus_queue.cc:260] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:11.911119 1168 ts_tablet_manager.cc:1428] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:11.911778 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 695) took 1626 ms. Trace:
I20260620 07:01:11.912161 1168 tablet_bootstrap.cc:492] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:11.912657 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 04d5d361a5404dcf99a89e93ac1f7dd8 (table default.Table_45f4253095cd4fd8a48faf559ccb7385 [id=47c6065c3bc34d55ba72235cbf26f2ee]) successfully deleted
I20260620 07:01:11.912148 1169 rpcz_store.cc:276] 0620 07:01:10.285291 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.319882 (+ 34591us) service_pool.cc:227] Handling call
0620 07:01:11.875009 (+1555127us) ts_tablet_manager.cc:1145] Deleting tablet f4e3145a872348b6a85a19d1678636bc
0620 07:01:11.875028 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.880130 (+ 5102us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.897066 (+ 16936us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.911756 (+ 14690us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1527059}
I20260620 07:01:11.915313 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 701) took 1558 ms. Trace:
I20260620 07:01:11.915374 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f4e3145a872348b6a85a19d1678636bc (table default.Table_1f805755212a4ca8861811107079a79b [id=543dd082f0474b39ae0f0e66dc257ebb]) successfully deleted
I20260620 07:01:11.915447 1169 rpcz_store.cc:276] 0620 07:01:10.357167 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.357272 (+ 105us) service_pool.cc:227] Handling call
0620 07:01:11.915156 (+1557884us) ts_tablet_manager.cc:1145] Deleting tablet a594df0df6ad48cab77cc1deed22bff0
0620 07:01:11.915170 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.915294 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1545766}
I20260620 07:01:11.915861 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 707) took 1476 ms. Trace:
W20260620 07:01:11.915956 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a594df0df6ad48cab77cc1deed22bff0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a594df0df6ad48cab77cc1deed22bff0 already in progress: creating tablet
I20260620 07:01:11.915949 1169 rpcz_store.cc:276] 0620 07:01:10.439637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.439721 (+ 84us) service_pool.cc:227] Handling call
0620 07:01:11.915732 (+1476011us) ts_tablet_manager.cc:1145] Deleting tablet 4260b0c953c14a198dbf9b64a30e7e05
0620 07:01:11.915743 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.915847 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1471475}
I20260620 07:01:11.916216 1169 tablet_replica.cc:330] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:11.876899 998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 733) took 1062 ms. Trace:
I20260620 07:01:11.916474 1169 raft_consensus.cc:2229] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.916460 998 rpcz_store.cc:276] 0620 07:01:10.814393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.814469 (+ 76us) service_pool.cc:227] Handling call
0620 07:01:10.871534 (+ 57065us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:10.871565 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:11.750378 (+878813us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.876756 (+126378us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:11.876884 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 07:01:11.916625 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 4260b0c953c14a198dbf9b64a30e7e05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4260b0c953c14a198dbf9b64a30e7e05 already in progress: creating tablet
I20260620 07:01:11.916656 1169 raft_consensus.cc:2258] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.917697 1170 tablet_bootstrap.cc:492] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:11.917852 1168 tablet_bootstrap.cc:654] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.918072 1170 ts_tablet_manager.cc:1397] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260620 07:01:11.918987 1170 raft_consensus.cc:348] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.919234 1170 raft_consensus.cc:374] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.919301 1170 raft_consensus.cc:729] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.919562 1170 consensus_queue.cc:260] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.895429 1167 tablet_bootstrap.cc:492] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:11.920089 1170 ts_tablet_manager.cc:1428] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:11.920349 1170 tablet_bootstrap.cc:492] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:11.920339 1167 ts_tablet_manager.cc:1397] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.450s user 0.004s sys 0.012s
I20260620 07:01:11.921311 1167 raft_consensus.cc:348] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.921581 1167 raft_consensus.cc:374] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:11.921666 1167 raft_consensus.cc:729] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:11.921911 1167 consensus_queue.cc:260] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.922260 1169 ts_tablet_manager.cc:1905] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.932466 1170 tablet_bootstrap.cc:654] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.903683 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 4302edba0ec04d7abc2789bc7be1beca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:11.904031 999 tablet_service.cc:1467] Processing CreateTablet for tablet 5773d09ad37c45198d62886624c87eea (DEFAULT_TABLE table=default.Table_b112301348ea4d389930b5ecdc98183d [id=fbe4f139f91143049259f3d0aaca5323]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.904490 994 tablet_service.cc:1467] Processing CreateTablet for tablet a93395ecdc41414bb9491a44788d144b (DEFAULT_TABLE table=default.Table_94bc617747744718a7f1037868df1790 [id=d42b6c9e1b094436bec36ede5faf3d14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.934099 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a93395ecdc41414bb9491a44788d144b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.943181 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5773d09ad37c45198d62886624c87eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.943913 1169 ts_tablet_manager.cc:1918] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:11.944526 413 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:33455: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20260620 07:01:11.946442 1169 log.cc:1196] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/d15ea9529afe40b6b4a702035479aef3
I20260620 07:01:11.947427 1169 ts_tablet_manager.cc:1939] T d15ea9529afe40b6b4a702035479aef3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:11.948909 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 709) took 1495 ms. Trace:
I20260620 07:01:11.904834 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 45358f467b864c3284040893d7351b03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:11.905085 996 tablet_service.cc:1467] Processing CreateTablet for tablet 0532a5d9ae484bd186f5c64bebd1b66c (DEFAULT_TABLE table=default.Table_d3219442b0f145f7b2e94b234889b7de [id=f9fe6caf41ce4c9a87f7e33e9f06a789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.949774 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0532a5d9ae484bd186f5c64bebd1b66c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.950510 1169 rpcz_store.cc:276] 0620 07:01:10.453226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.457035 (+ 3809us) service_pool.cc:227] Handling call
0620 07:01:11.916156 (+1459121us) ts_tablet_manager.cc:1145] Deleting tablet d15ea9529afe40b6b4a702035479aef3
0620 07:01:11.916168 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.928260 (+ 12092us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.943782 (+ 15522us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.948879 (+ 5097us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1458752}
I20260620 07:01:11.951623 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 706) took 1521 ms. Trace:
I20260620 07:01:11.951717 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet d15ea9529afe40b6b4a702035479aef3 (table default.Table_70cd2b21da3a42e99c045dd88f19eb5e [id=2a5c1580e22042528f939deff8b4a80f]) successfully deleted
I20260620 07:01:11.952172 1169 rpcz_store.cc:276] 0620 07:01:10.430658 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.430751 (+ 93us) service_pool.cc:227] Handling call
0620 07:01:11.951478 (+1520727us) ts_tablet_manager.cc:1145] Deleting tablet 5883a8466d0c4e45aba3b4095ced91a4
0620 07:01:11.951490 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.951606 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1473598}
I20260620 07:01:11.952484 1169 tablet_replica.cc:330] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:01:11.952961 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5883a8466d0c4e45aba3b4095ced91a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5883a8466d0c4e45aba3b4095ced91a4 already in progress: creating tablet
I20260620 07:01:11.953207 1169 raft_consensus.cc:2229] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.953395 1169 raft_consensus.cc:2258] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.954384 1169 ts_tablet_manager.cc:1905] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.905524 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0b0969fb784dba96459ea441f88ae9 (DEFAULT_TABLE table=default.Table_a9daa65902764470b46116dd8693e062 [id=b091c6f29b82472da2f0c8b8af967aaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.958640 2016 raft_consensus.cc:482] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:11.905694 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b8ce279cfe4684bd296a48e8783e1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:11.958806 2016 raft_consensus.cc:504] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.959231 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c0b0969fb784dba96459ea441f88ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.959508 2016 leader_election.cc:288] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:11.906028 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet f8ec1e179a704e5480f3deaf856156e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c7f0513df34ddb8104b06e5733fb62) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:11.906198 1013 tablet_service.cc:1467] Processing CreateTablet for tablet d67c46962e4240fc9137a5c8ce2fddee (DEFAULT_TABLE table=default.Table_440c27829a3b42a8b452c15509a150bd [id=ba7c8fdf76b9443595693568793679ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.959977 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d67c46962e4240fc9137a5c8ce2fddee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:11.960124 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261f0d97e1084e828b9562cb30ea422b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:11.960439 1031 raft_consensus.cc:2454] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:11.961022 681 leader_election.cc:302] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
W20260620 07:01:11.963816 683 leader_election.cc:341] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 261f0d97e1084e828b9562cb30ea422b
I20260620 07:01:11.964244 2016 raft_consensus.cc:2781] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:11.964326 2016 raft_consensus.cc:482] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:11.964387 2016 raft_consensus.cc:3037] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:11.965693 1008 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41218 (request call id 740) took 1115 ms. Trace:
I20260620 07:01:11.965809 1008 rpcz_store.cc:276] 0620 07:01:10.850226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.850850 (+ 624us) service_pool.cc:227] Handling call
0620 07:01:10.860827 (+ 9977us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0620 07:01:10.860843 (+ 16us) ts_tablet_manager.cc:676] Creating new metadata...
0620 07:01:11.880716 (+1019873us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.965511 (+ 84795us) tablet_replica.cc:205] Creating consensus instance
0620 07:01:11.965671 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:11.966645 1167 ts_tablet_manager.cc:1428] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.046s user 0.001s sys 0.001s
I20260620 07:01:11.967041 1167 tablet_bootstrap.cc:492] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:11.969038 1167 tablet_bootstrap.cc:654] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:11.970683 1169 ts_tablet_manager.cc:1918] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260620 07:01:11.971951 1169 log.cc:1196] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f0e54f1185cd4c5c8e5d2ed289b61650
I20260620 07:01:11.906029 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet d612e9caa8b540b4b96860491d653f11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:11.971985 2016 raft_consensus.cc:504] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.972716 1169 ts_tablet_manager.cc:1939] T f0e54f1185cd4c5c8e5d2ed289b61650 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:11.974377 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 710) took 1521 ms. Trace:
I20260620 07:01:11.975371 1169 rpcz_store.cc:276] 0620 07:01:10.453350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.456794 (+ 3444us) service_pool.cc:227] Handling call
0620 07:01:11.952440 (+1495646us) ts_tablet_manager.cc:1145] Deleting tablet f0e54f1185cd4c5c8e5d2ed289b61650
0620 07:01:11.952450 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.962821 (+ 10371us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.970573 (+ 7752us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:11.974351 (+ 3778us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1473889}
W20260620 07:01:11.975921 683 leader_election.cc:341] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 261f0d97e1084e828b9562cb30ea422b
I20260620 07:01:11.976118 1169 tablet_replica.cc:330] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:11.976307 1169 raft_consensus.cc:2229] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:11.976477 1920 raft_consensus.cc:482] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:11.976629 1920 raft_consensus.cc:504] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:11.976488 1169 raft_consensus.cc:2258] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:11.977290 1920 leader_election.cc:288] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:11.978449 683 leader_election.cc:341] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b4ee5c79e2a6419ea3847cbebdeced79
I20260620 07:01:11.978655 1169 ts_tablet_manager.cc:1905] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:11.978809 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_811e4d61e71e47ab80ad8c0488b3183c [id=2abd0f99a3034a0e8824bcb0002c91bd]) successfully deleted
I20260620 07:01:11.979360 2016 leader_election.cc:288] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:11.906711 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 0435678022914e6991c974e116d1a9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:11.906855 1012 tablet_service.cc:1467] Processing CreateTablet for tablet afddbb6bbbbf40f9b466ebcd06083fc2 (DEFAULT_TABLE table=default.Table_bf10ad0aef124efa8d14687eb39c572e [id=7b1a0565bcb54b72ac287ccc8cb71a64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.908558 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 969b451c02594e029f1522af54d5a8cd (DEFAULT_TABLE table=default.Table_fbcc45a7e4864cd49c799eb03fcd64ff [id=83e2439a30b44745a1f7527a635d244d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.908836 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 0eaa780687e1479eb165b6dfa7e32023 (DEFAULT_TABLE table=default.Table_5089bff86b114c6e8beaa9be1dec9854 [id=12048e9dd9204beba16542fe67618456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.979846 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261f0d97e1084e828b9562cb30ea422b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:11.912360 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 4e71110c1bd247c1b6afa43e3361534b (DEFAULT_TABLE table=default.Table_638b93421e824f669670b9bd1cac3389 [id=4a598c714b2e40ba8bb1a9fe0372ea4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.914116 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 812b1e2457374feabb9c3692f81488b0 (DEFAULT_TABLE table=default.Table_c3e2020a90174ee1a722e88d9580e69e [id=ce2868d50af24783b8644b52921214a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:11.903353 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 80a83948f0424b47889f4be7fee15706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:11.977824 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4ee5c79e2a6419ea3847cbebdeced79" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:11.980052 1028 raft_consensus.cc:3037] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:11.983223 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afddbb6bbbbf40f9b466ebcd06083fc2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:11.988456 681 leader_election.cc:341] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:11.988610 681 leader_election.cc:302] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:11.988837 2016 raft_consensus.cc:2726] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:11.993067 1028 raft_consensus.cc:2454] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:11.993721 681 leader_election.cc:302] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:11.994017 2016 raft_consensus.cc:2781] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:11.994124 2016 raft_consensus.cc:686] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:11.994351 2016 consensus_queue.cc:237] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:12.001117 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a2d6f7f2b5b3473aa010b8982a03aa5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2d6f7f2b5b3473aa010b8982a03aa5e already in progress: creating tablet
W20260620 07:01:12.002501 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7b781d0578834708ae64b24419959cca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b781d0578834708ae64b24419959cca already in progress: creating tablet
W20260620 07:01:12.003054 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d0f7e6245c074c82a5a72be79ab1987f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0f7e6245c074c82a5a72be79ab1987f already in progress: creating tablet
W20260620 07:01:12.003504 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 816218c726a9473e9849b7a97c820678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 816218c726a9473e9849b7a97c820678 already in progress: creating tablet
W20260620 07:01:12.005476 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c06bf6c4d1af40479c81bd1d85e2848f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c06bf6c4d1af40479c81bd1d85e2848f already in progress: creating tablet
W20260620 07:01:12.005892 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1d9d4b5a69484176a7b0f4fded010867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d9d4b5a69484176a7b0f4fded010867 already in progress: creating tablet
I20260620 07:01:12.006342 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 812b1e2457374feabb9c3692f81488b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.008069 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969b451c02594e029f1522af54d5a8cd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:12.010445 830 leader_election.cc:341] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.010573 830 leader_election.cc:302] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.010872 1935 raft_consensus.cc:2726] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.011256 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eaa780687e1479eb165b6dfa7e32023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.011859 1920 raft_consensus.cc:482] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.011996 1920 raft_consensus.cc:504] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.012616 1920 leader_election.cc:288] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.013386 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 89f5e2f055fb469dbbb935bba724dcb5
W20260620 07:01:12.014076 830 leader_election.cc:341] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.014204 830 leader_election.cc:302] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:12.014348 830 raft_consensus.cc:2670] T 04db48e910514d46bb4deb9acf54f7c0 P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:12.014364 683 leader_election.cc:341] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8088fadabff64c35aa96a1ede17318c3
I20260620 07:01:12.014910 1168 tablet_bootstrap.cc:492] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.015031 1168 ts_tablet_manager.cc:1397] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.104s user 0.016s sys 0.051s
I20260620 07:01:12.015023 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f5e2f055fb469dbbb935bba724dcb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.015409 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f5e2f055fb469dbbb935bba724dcb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.015875 1165 tablet_replica.cc:330] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.016067 1165 raft_consensus.cc:2229] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.016201 1165 raft_consensus.cc:2258] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.016278 1168 raft_consensus.cc:348] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.016523 1168 raft_consensus.cc:374] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.016574 1168 raft_consensus.cc:729] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.016794 1168 consensus_queue.cc:260] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.016927 1165 ts_tablet_manager.cc:1905] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.017326 1168 ts_tablet_manager.cc:1428] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:12.017565 1168 tablet_bootstrap.cc:492] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.019176 1168 tablet_bootstrap.cc:654] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:12.020258 830 leader_election.cc:341] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.020779 1166 ts_tablet_manager.cc:1918] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.020961 1166 log.cc:1196] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/d17c49eecec741cdbd592c94b7f84c67
I20260620 07:01:12.021268 830 leader_election.cc:302] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.021366 1166 ts_tablet_manager.cc:1939] T d17c49eecec741cdbd592c94b7f84c67 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:12.021492 830 raft_consensus.cc:2670] T eea1525b54cc42b78180ba6867957f76 P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:12.022112 830 leader_election.cc:341] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.022359 830 leader_election.cc:302] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.022614 1935 raft_consensus.cc:2726] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.022965 1999 raft_consensus.cc:482] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.023119 1999 raft_consensus.cc:504] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.023728 1999 leader_election.cc:288] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.024173 1999 raft_consensus.cc:482] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.024271 1999 raft_consensus.cc:504] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:12.024529 968 leader_election.cc:341] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: f9df1d52393e47ce991b5295d03624e8
I20260620 07:01:12.024746 1999 leader_election.cc:288] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.024978 969 leader_election.cc:302] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:12.025353 968 leader_election.cc:341] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 3c2f865b06ca4b9c8fc9d8d0b4aa0dad
I20260620 07:01:12.025415 1999 raft_consensus.cc:2781] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:12.025475 1999 raft_consensus.cc:482] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:12.025532 1999 raft_consensus.cc:3037] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.027511 1165 ts_tablet_manager.cc:1918] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.027812 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8088fadabff64c35aa96a1ede17318c3" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:12.028347 1999 raft_consensus.cc:504] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:12.028568 681 leader_election.cc:341] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.028843 681 leader_election.cc:302] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.029409 1920 raft_consensus.cc:2726] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.029903 1999 leader_election.cc:288] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.029918 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c64df83a18a470c98a9c1fd6bb38918" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:12.030105 751 raft_consensus.cc:3037] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.030318 1999 raft_consensus.cc:482] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.030330 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet e7d1e4719cd441dd8054b24861cbd8a2 (table default.Table_705dc245b225442eb3ba5fc4731c8e12 [id=b9301ede677241efa94753841070351a]) successfully deleted
W20260620 07:01:12.030591 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6229a52adf8d4b17bdf89347e01621ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6229a52adf8d4b17bdf89347e01621ed already in progress: creating tablet
I20260620 07:01:12.030512 1999 raft_consensus.cc:504] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:12.030830 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c9d344f9e4b444e4b6018fdf0cf762fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9d344f9e4b444e4b6018fdf0cf762fd already in progress: creating tablet
W20260620 07:01:12.031854 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5926946427294a5ca6fbc72d3e1b612d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5926946427294a5ca6fbc72d3e1b612d already in progress: creating tablet
W20260620 07:01:12.032196 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3651ef9790d342ec96f554134ae714dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3651ef9790d342ec96f554134ae714dc already in progress: creating tablet
W20260620 07:01:12.032447 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8d2c706414684bb1bacc6f9b870fc9c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d2c706414684bb1bacc6f9b870fc9c1 already in progress: creating tablet
W20260620 07:01:12.032958 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ab60101b34144f85b0afd2e8c4846e48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab60101b34144f85b0afd2e8c4846e48 already in progress: creating tablet
I20260620 07:01:12.032974 751 raft_consensus.cc:2454] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:12.033452 968 leader_election.cc:302] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:12.033695 1925 raft_consensus.cc:2781] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:12.033797 1925 raft_consensus.cc:686] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:12.033990 1925 consensus_queue.cc:237] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.035254 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 431) took 7742 ms. Trace:
I20260620 07:01:12.035403 1166 rpcz_store.cc:276] 0620 07:01:04.292772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.292860 (+ 88us) service_pool.cc:227] Handling call
0620 07:01:11.865610 (+7572750us) ts_tablet_manager.cc:1145] Deleting tablet d17c49eecec741cdbd592c94b7f84c67
0620 07:01:11.865620 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:11.919810 (+ 54190us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.020671 (+100861us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.035235 (+ 14564us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13060,"tablet-delete.queue_time_us":7562527}
W20260620 07:01:12.035650 968 leader_election.cc:341] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e14db4e3394046e49ecc69c9ca4dc840
I20260620 07:01:12.035763 1166 tablet_replica.cc:330] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:12.038538 1999 leader_election.cc:288] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.038784 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e71110c1bd247c1b6afa43e3361534b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.043076 1166 raft_consensus.cc:2229] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.043371 1166 raft_consensus.cc:2258] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.043632 1165 log.cc:1196] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/89f5e2f055fb469dbbb935bba724dcb5
I20260620 07:01:12.044107 1165 ts_tablet_manager.cc:1939] T 89f5e2f055fb469dbbb935bba724dcb5 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.044121 1166 ts_tablet_manager.cc:1905] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.045428 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 89f5e2f055fb469dbbb935bba724dcb5 (table default.Table_361c16a82c8b4f518117b6747d4aa3bc [id=24b0b6eb9f944dbb971530ee8f603c0e]) successfully deleted
W20260620 07:01:12.052134 969 leader_election.cc:341] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: add9e860802d4edebcfbc9fa3c4a6b24
I20260620 07:01:12.052899 1167 tablet_bootstrap.cc:492] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:12.053454 1167 ts_tablet_manager.cc:1397] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.087s user 0.000s sys 0.004s
I20260620 07:01:12.053974 1170 tablet_bootstrap.cc:492] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.054141 1167 raft_consensus.cc:348] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.055583 1168 tablet_bootstrap.cc:492] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.055719 1168 ts_tablet_manager.cc:1397] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20260620 07:01:12.055581 1167 raft_consensus.cc:374] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.055891 1167 raft_consensus.cc:729] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.056216 1170 ts_tablet_manager.cc:1397] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.136s user 0.006s sys 0.012s
I20260620 07:01:12.056161 1167 consensus_queue.cc:260] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.056386 1168 raft_consensus.cc:348] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.056579 1168 raft_consensus.cc:374] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.056638 1168 raft_consensus.cc:729] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.056715 1167 ts_tablet_manager.cc:1428] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:12.056846 1168 consensus_queue.cc:260] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.057361 1168 ts_tablet_manager.cc:1428] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:12.057291 1170 raft_consensus.cc:348] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.057482 1170 raft_consensus.cc:374] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.057531 1170 raft_consensus.cc:729] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.057615 1168 tablet_bootstrap.cc:492] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.058012 1167 tablet_bootstrap.cc:492] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:12.059317 1168 tablet_bootstrap.cc:654] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.062510 1170 consensus_queue.cc:260] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.052625 969 leader_election.cc:302] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.063620 1170 ts_tablet_manager.cc:1428] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20260620 07:01:12.064232 969 leader_election.cc:341] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ed69a44c466047d298cf7653b2a2bb23
I20260620 07:01:12.064885 969 leader_election.cc:302] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.065075 1166 ts_tablet_manager.cc:1918] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.068145 1170 tablet_bootstrap.cc:492] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.069875 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3f2c7508dd9c4328ae411c21691ee9a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.070505 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f2c7508dd9c4328ae411c21691ee9a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.065169 1925 raft_consensus.cc:2726] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.070992 1166 log.cc:1196] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/e2b0faf91f2f469f9b06e17caa4709e4
I20260620 07:01:12.071035 1167 tablet_bootstrap.cc:654] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.071328 1166 ts_tablet_manager.cc:1939] T e2b0faf91f2f469f9b06e17caa4709e4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:12.068192 2019 raft_consensus.cc:2726] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.072357 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3d81d05b4b1646b4b1fa6577c149a7ad
I20260620 07:01:12.073124 421 master_service.cc:946] ReplaceTablet: received request to replace tablet 033c8b817757441ea7ebc2dbf77aa2dd from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:12.073769 421 master_service.cc:946] ReplaceTablet: received request to replace tablet 39504144a623423c873ded7d6839367a from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:12.074860 423 catalog_manager.cc:5495] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:12.075320 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet c11f2678559c41d3bc71d4fa04efd0ac (table default.Table_13403c45f0a94678999f62954a653d5f [id=9b7cbb1400d7413ca5debb997aeade9c]). Expected version 3 got 0
I20260620 07:01:12.075366 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 432) took 7778 ms. Trace:
I20260620 07:01:12.075454 1166 rpcz_store.cc:276] 0620 07:01:04.296861 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.296957 (+ 96us) service_pool.cc:227] Handling call
0620 07:01:12.035710 (+7738753us) ts_tablet_manager.cc:1145] Deleting tablet e2b0faf91f2f469f9b06e17caa4709e4
0620 07:01:12.035725 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.048163 (+ 12438us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.064975 (+ 16812us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.075342 (+ 10367us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6896,"tablet-delete.queue_time_us":7732085}
I20260620 07:01:12.075799 1166 tablet_replica.cc:330] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:12.076385 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_315a6e60255641079c24df8d2bc90df4" } modify_external_catalogs: true
I20260620 07:01:12.076582 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_315a6e60255641079c24df8d2bc90df4" } modify_external_catalogs: true
I20260620 07:01:12.079401 1166 raft_consensus.cc:2229] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.079563 1166 raft_consensus.cc:2258] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.080050 1166 ts_tablet_manager.cc:1905] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.080555 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f1abb9b767ea4a9b9c8f3c8b03e0d1ec" } modify_external_catalogs: true
I20260620 07:01:12.080734 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f1abb9b767ea4a9b9c8f3c8b03e0d1ec" } modify_external_catalogs: true
W20260620 07:01:12.083254 969 consensus_peers.cc:487] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69113a64960d4aee9a2a4fcb28570bf2. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:12.083590 969 consensus_peers.cc:487] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46689d13712842bf9145ad2bc3fc2acf. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:12.083736 969 leader_election.cc:341] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 203ba3933d3a4fb2a4978b29cad614e6
I20260620 07:01:12.083884 969 leader_election.cc:302] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.084082 1999 raft_consensus.cc:2726] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:12.084470 969 leader_election.cc:341] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3f53f0302d1a4fb3a0fe3e1d98583550
I20260620 07:01:12.084553 969 leader_election.cc:302] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.084739 1999 raft_consensus.cc:2726] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 07:01:12.085045 969 consensus_peers.cc:487] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f0e54f1185cd4c5c8e5d2ed289b61650. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:12.085672 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d81d05b4b1646b4b1fa6577c149a7ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.086185 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6b062b6459e8486c88d38312f5078599"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:12.086542 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c64df83a18a470c98a9c1fd6bb38918" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
W20260620 07:01:12.086681 969 consensus_peers.cc:487] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da1e30385ed44c7f8b7db868f2e2bc29. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:12.086743 894 raft_consensus.cc:3037] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:12.086772 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b062b6459e8486c88d38312f5078599 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.088343 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d81d05b4b1646b4b1fa6577c149a7ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.090201 894 raft_consensus.cc:2454] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:12.090543 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 261f0d97e1084e828b9562cb30ea422b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.091107 1168 tablet_bootstrap.cc:492] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.091245 1168 ts_tablet_manager.cc:1397] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260620 07:01:12.091295 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 70e7fada94584d68b287c2318e21d345
W20260620 07:01:12.092275 969 consensus_peers.cc:487] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5757e05e9a2403a86ca98f455e11754. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:12.092466 969 leader_election.cc:341] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3c2f865b06ca4b9c8fc9d8d0b4aa0dad
I20260620 07:01:12.092402 1168 raft_consensus.cc:348] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.092547 969 leader_election.cc:302] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.092676 1168 raft_consensus.cc:374] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.092749 1168 raft_consensus.cc:729] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:12.092877 969 leader_election.cc:341] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e14db4e3394046e49ecc69c9ca4dc840
I20260620 07:01:12.092969 969 leader_election.cc:302] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.092962 1168 consensus_queue.cc:260] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.093067 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 70e7fada94584d68b287c2318e21d345 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.093466 1168 ts_tablet_manager.cc:1428] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:12.093605 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 70e7fada94584d68b287c2318e21d345 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.093820 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 13c7f0513df34ddb8104b06e5733fb62 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:12.093991 1999 raft_consensus.cc:2726] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.094113 1999 raft_consensus.cc:2726] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.094339 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet d17c49eecec741cdbd592c94b7f84c67 (table default.Table_e21acc07ea2349cc9a821839ff680062 [id=f28fed67d2244a1694c6688535cc5213]) successfully deleted
I20260620 07:01:12.094739 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet e2b0faf91f2f469f9b06e17caa4709e4 (table default.Table_e31ff399ff5e4a309b29286a69aea7f0 [id=cfbc4dc349434379b3eaabd5dc948327]) successfully deleted
W20260620 07:01:12.095279 969 leader_election.cc:341] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f9df1d52393e47ce991b5295d03624e8
I20260620 07:01:12.095427 969 leader_election.cc:302] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.095695 1167 tablet_bootstrap.cc:492] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:12.095827 1167 ts_tablet_manager.cc:1397] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.002s
I20260620 07:01:12.096045 2019 raft_consensus.cc:2726] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.096705 1167 raft_consensus.cc:348] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.096935 1167 raft_consensus.cc:374] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.096990 1167 raft_consensus.cc:729] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.097195 1167 consensus_queue.cc:260] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.097702 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 70e7fada94584d68b287c2318e21d345 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.103147 1168 tablet_bootstrap.cc:492] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.104090 1935 raft_consensus.cc:482] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.104228 1935 raft_consensus.cc:504] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.104795 1168 tablet_bootstrap.cc:654] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.104761 1935 leader_election.cc:288] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.105811 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8be5f41f1d64d918b727e3eef18738e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:12.106436 831 leader_election.cc:341] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.107836 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8be5f41f1d64d918b727e3eef18738e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:12.108237 1167 ts_tablet_manager.cc:1428] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
W20260620 07:01:12.108450 830 leader_election.cc:341] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.108568 830 leader_election.cc:302] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.109119 1935 raft_consensus.cc:2726] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.109553 1167 tablet_bootstrap.cc:492] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:12.111989 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3d81d05b4b1646b4b1fa6577c149a7ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d81d05b4b1646b4b1fa6577c149a7ad already in progress: creating tablet
W20260620 07:01:12.112680 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 70e7fada94584d68b287c2318e21d345 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70e7fada94584d68b287c2318e21d345 already in progress: creating tablet
I20260620 07:01:12.114831 2019 raft_consensus.cc:482] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.115021 2019 raft_consensus.cc:504] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.115527 1167 tablet_bootstrap.cc:654] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.115746 2019 leader_election.cc:288] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.116891 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96453f82ff3048beabeb188fb27dee42" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:12.117594 968 leader_election.cc:341] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.118301 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96453f82ff3048beabeb188fb27dee42" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:12.118538 894 raft_consensus.cc:2454] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:12.118983 969 leader_election.cc:302] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.119295 2019 raft_consensus.cc:2781] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:12.119374 2019 raft_consensus.cc:482] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:12.119439 2019 raft_consensus.cc:3037] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.122489 2019 raft_consensus.cc:504] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.124589 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96453f82ff3048beabeb188fb27dee42" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
W20260620 07:01:12.125173 968 leader_election.cc:341] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.125521 2019 leader_election.cc:288] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.126502 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96453f82ff3048beabeb188fb27dee42" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:12.126693 894 raft_consensus.cc:3037] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.129691 894 raft_consensus.cc:2454] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:12.129803 1935 raft_consensus.cc:482] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.129927 1935 raft_consensus.cc:504] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.130163 969 leader_election.cc:302] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.130504 1935 leader_election.cc:288] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.130507 2019 raft_consensus.cc:2781] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:12.130635 2019 raft_consensus.cc:686] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:12.131014 2019 consensus_queue.cc:237] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.131374 1168 tablet_bootstrap.cc:492] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.131497 1168 ts_tablet_manager.cc:1397] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.001s
I20260620 07:01:12.131482 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39e682e71ed4776a786f7d30158e7e0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:12.132201 1167 tablet_bootstrap.cc:492] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:01:12.132155 831 leader_election.cc:341] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.132321 1167 ts_tablet_manager.cc:1397] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260620 07:01:12.132228 1168 raft_consensus.cc:348] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.132405 1168 raft_consensus.cc:374] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.132458 1168 raft_consensus.cc:729] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.132664 1168 consensus_queue.cc:260] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.132995 1167 raft_consensus.cc:348] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.133176 1168 ts_tablet_manager.cc:1428] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:12.133189 1167 raft_consensus.cc:374] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.133245 1167 raft_consensus.cc:729] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.133426 1168 tablet_bootstrap.cc:492] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.133410 1167 consensus_queue.cc:260] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.134377 1166 ts_tablet_manager.cc:1918] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.134511 1166 log.cc:1196] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/369c205d7f7841598cb99f661b25736f
I20260620 07:01:12.134871 1166 ts_tablet_manager.cc:1939] T 369c205d7f7841598cb99f661b25736f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:12.134819 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39e682e71ed4776a786f7d30158e7e0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:12.135267 830 leader_election.cc:341] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.135382 830 leader_election.cc:302] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.135737 1935 raft_consensus.cc:2726] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.136180 1170 tablet_bootstrap.cc:654] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.136528 1167 ts_tablet_manager.cc:1428] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:12.136762 1167 tablet_bootstrap.cc:492] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:12.138408 1167 tablet_bootstrap.cc:654] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.138479 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 434) took 7836 ms. Trace:
I20260620 07:01:12.138558 1166 rpcz_store.cc:276] 0620 07:01:04.302389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.302447 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:12.075752 (+7773305us) ts_tablet_manager.cc:1145] Deleting tablet 369c205d7f7841598cb99f661b25736f
0620 07:01:12.075763 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.110819 (+ 35056us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.134231 (+ 23412us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.138465 (+ 4234us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7754045}
I20260620 07:01:12.139117 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 369c205d7f7841598cb99f661b25736f (table default.Table_f655e04dd3f446debfb3219c289dcadb [id=6654082b40084682b5bf224e82c955df]) successfully deleted
I20260620 07:01:12.140098 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f5e2f055fb469dbbb935bba724dcb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.141968 1168 tablet_bootstrap.cc:654] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.142001 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d81d05b4b1646b4b1fa6577c149a7ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.144939 2059 tablet.cc:1722] T 1b98711dfb114a2985c5153e9b44147a P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:12.147729 1166 tablet_replica.cc:330] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:12.148012 1166 raft_consensus.cc:2229] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.148185 1166 raft_consensus.cc:2258] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.150215 1166 ts_tablet_manager.cc:1905] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.153067 1170 tablet_bootstrap.cc:492] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.153211 1170 ts_tablet_manager.cc:1397] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.086s user 0.002s sys 0.002s
W20260620 07:01:12.162171 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ed042bdf10a2453eab5175f21d1184c1 (table default.Table_e3cfd3eb18ae43ce9c2265792904718f [id=af10c4d2a07c4903b72cd142200e6ba3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ed042bdf10a2453eab5175f21d1184c1 consensus state has no leader
I20260620 07:01:12.164160 1170 raft_consensus.cc:348] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.164376 1170 raft_consensus.cc:374] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.164435 1170 raft_consensus.cc:729] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.165988 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bf10ad0aef124efa8d14687eb39c572e" } new_table_name: "default.Table_e54be7e2434a4108a8f577b22c85672b" modify_external_catalogs: true
I20260620 07:01:12.167063 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e072e4e1eeab47a081ee70a95e9f13f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.168048 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e072e4e1eeab47a081ee70a95e9f13f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.169469 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_146feffa684d4d3cbf8835807e85bcd4" } new_table_name: "default.Table_4fc5c9bdafac430eb6c1141686f585d2" modify_external_catalogs: true
I20260620 07:01:12.169739 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 71977c69b29143eebfcc8ece39daf78e
I20260620 07:01:12.170337 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 4655d289c94c4bce9707be375fc4b850 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:12.170503 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 71977c69b29143eebfcc8ece39daf78e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.170934 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_171ec3d5af68477aa002548e814e04d2" } new_table_name: "default.Table_cd26e2f41da14aa487dfe1f8d1971127" modify_external_catalogs: true
I20260620 07:01:12.172143 1167 tablet_bootstrap.cc:492] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:12.172309 1167 ts_tablet_manager.cc:1397] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260620 07:01:12.173260 1167 raft_consensus.cc:348] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.173516 1167 raft_consensus.cc:374] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.173573 1167 raft_consensus.cc:729] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.175463 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 71977c69b29143eebfcc8ece39daf78e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.175908 1167 consensus_queue.cc:260] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.176949 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 71977c69b29143eebfcc8ece39daf78e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.177706 1168 tablet_bootstrap.cc:492] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.178372 1168 ts_tablet_manager.cc:1397] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.004s
W20260620 07:01:12.179658 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 71977c69b29143eebfcc8ece39daf78e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71977c69b29143eebfcc8ece39daf78e already in progress: creating tablet
I20260620 07:01:12.179642 1168 raft_consensus.cc:348] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.181738 1167 ts_tablet_manager.cc:1428] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20260620 07:01:12.182210 1168 raft_consensus.cc:374] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.182348 1166 ts_tablet_manager.cc:1918] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.182356 1168 raft_consensus.cc:729] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.182459 1166 log.cc:1196] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ed69a44c466047d298cf7653b2a2bb23
I20260620 07:01:12.182899 1168 consensus_queue.cc:260] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.184167 1167 tablet_bootstrap.cc:492] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:12.187608 1168 ts_tablet_manager.cc:1428] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260620 07:01:12.189635 1167 tablet_bootstrap.cc:654] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.192142 1168 tablet_bootstrap.cc:492] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.182755 1166 ts_tablet_manager.cc:1939] T ed69a44c466047d298cf7653b2a2bb23 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:12.194743 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 433) took 7894 ms. Trace:
I20260620 07:01:12.194888 1166 rpcz_store.cc:276] 0620 07:01:04.300272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.300368 (+ 96us) service_pool.cc:227] Handling call
0620 07:01:12.140417 (+7840049us) ts_tablet_manager.cc:1145] Deleting tablet ed69a44c466047d298cf7653b2a2bb23
0620 07:01:12.140432 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.153991 (+ 13559us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.182242 (+ 28251us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.194718 (+ 12476us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7814711}
I20260620 07:01:12.195353 1168 tablet_bootstrap.cc:654] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.195446 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ed69a44c466047d298cf7653b2a2bb23 (table default.Table_f99b2d2b64ca4a6b8acb835f5dbbc740 [id=e0814f1fc9264eae8150af51e6ede5f1]) successfully deleted
I20260620 07:01:12.196102 1170 consensus_queue.cc:260] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.198988 2019 raft_consensus.cc:482] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.199143 2019 raft_consensus.cc:504] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.199689 2019 leader_election.cc:288] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.201467 1170 ts_tablet_manager.cc:1428] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.048s user 0.001s sys 0.001s
W20260620 07:01:12.201587 968 leader_election.cc:341] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ca380134173e42f6b562b56375f2ccad
I20260620 07:01:12.201759 1170 tablet_bootstrap.cc:492] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:12.202023 969 leader_election.cc:341] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ca380134173e42f6b562b56375f2ccad
I20260620 07:01:12.202059 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 437) took 7876 ms. Trace:
I20260620 07:01:12.202107 969 leader_election.cc:302] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.202548 2019 raft_consensus.cc:2726] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:12.203306 1166 rpcz_store.cc:276] 0620 07:01:04.329610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.329883 (+ 273us) service_pool.cc:227] Handling call
0620 07:01:12.201925 (+7872042us) ts_tablet_manager.cc:1145] Deleting tablet 3eda988492234d6aaeaee87f84f99d06
0620 07:01:12.201938 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.202037 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7870034}
W20260620 07:01:12.204028 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3eda988492234d6aaeaee87f84f99d06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eda988492234d6aaeaee87f84f99d06 already in progress: creating tablet
I20260620 07:01:12.204777 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 436) took 7894 ms. Trace:
I20260620 07:01:12.204895 1166 rpcz_store.cc:276] 0620 07:01:04.310810 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.310919 (+ 109us) service_pool.cc:227] Handling call
0620 07:01:12.204631 (+7893712us) ts_tablet_manager.cc:1145] Deleting tablet f793a91ab247408bbe4a9f7cb370fffe
0620 07:01:12.204647 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.204751 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7870669}
W20260620 07:01:12.205624 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f793a91ab247408bbe4a9f7cb370fffe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f793a91ab247408bbe4a9f7cb370fffe already in progress: creating tablet
I20260620 07:01:12.205708 2017 raft_consensus.cc:482] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.205855 2017 raft_consensus.cc:504] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.206542 1168 tablet_bootstrap.cc:492] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.206559 2017 leader_election.cc:288] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.206682 1168 ts_tablet_manager.cc:1397] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.008s
I20260620 07:01:12.207196 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f690e150839a4d23860932712f61e7c8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:12.207451 1028 raft_consensus.cc:2454] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:12.208156 681 leader_election.cc:302] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
W20260620 07:01:12.208617 683 leader_election.cc:341] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f690e150839a4d23860932712f61e7c8
I20260620 07:01:12.208935 2017 raft_consensus.cc:2781] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:12.208879 1168 raft_consensus.cc:348] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.209022 2017 raft_consensus.cc:482] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:12.209092 2017 raft_consensus.cc:3037] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.209086 1168 raft_consensus.cc:374] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.209142 1168 raft_consensus.cc:729] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.209384 1168 consensus_queue.cc:260] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.210299 1166 tablet_replica.cc:330] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:12.210502 1166 raft_consensus.cc:2229] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:12.212133 1168 ts_tablet_manager.cc:1428] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260620 07:01:12.212428 1168 tablet_bootstrap.cc:492] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.213044 1166 pending_rounds.cc:62] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:12.212996 2017 raft_consensus.cc:504] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.213124 1166 pending_rounds.cc:68] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821593224749056 op_type: NO_OP noop_request { }
I20260620 07:01:12.213259 1166 raft_consensus.cc:2866] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:12.213364 1166 raft_consensus.cc:2258] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.213959 1166 ts_tablet_manager.cc:1905] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.215301 1168 tablet_bootstrap.cc:654] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:12.216070 683 leader_election.cc:341] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f690e150839a4d23860932712f61e7c8
I20260620 07:01:12.217144 2017 leader_election.cc:288] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.217469 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f690e150839a4d23860932712f61e7c8" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:12.217689 1028 raft_consensus.cc:3037] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.220172 1028 raft_consensus.cc:2454] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:12.221009 681 leader_election.cc:302] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:12.223230 2017 raft_consensus.cc:2781] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:12.223520 2017 raft_consensus.cc:686] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:12.223790 2017 consensus_queue.cc:237] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.225994 1168 tablet_bootstrap.cc:492] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.226118 1168 ts_tablet_manager.cc:1397] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260620 07:01:12.226768 1168 raft_consensus.cc:348] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.227022 1168 raft_consensus.cc:374] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.227075 1168 raft_consensus.cc:729] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.229561 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_514c9eb90e114a17a13236a3372c2731"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.230214 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_514c9eb90e114a17a13236a3372c2731 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.227257 1168 consensus_queue.cc:260] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:12.236016 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39b2a190b3094aa09f2488768ff1c347 has no consensus state
I20260620 07:01:12.236227 420 master_service.cc:946] ReplaceTablet: received request to replace tablet b1aed58dc714451b94fc9a6c14b7d734 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:12.236558 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6107f40b9dc844919004d6f61a1e07ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.237133 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6107f40b9dc844919004d6f61a1e07ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:12.237913 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cce8fe9c323b49f9b5bc876d88f2e47f consensus state has no leader
I20260620 07:01:12.237869 1935 raft_consensus.cc:482] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.238026 1935 raft_consensus.cc:504] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.238301 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4e24db178c47408ea6e773cebddc3ddf" } new_table_name: "default.Table_c89bab52a82c4a8faed799b663c0fc47" modify_external_catalogs: true
W20260620 07:01:12.238488 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet afddbb6bbbbf40f9b466ebcd06083fc2 consensus state has no leader
I20260620 07:01:12.238683 1935 leader_election.cc:288] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.239447 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2f0c28057b4534a8a400d1ca7f3991" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:12.239533 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0d696424e47747e8aff9258ac6a3dec4" } new_table_name: "default.Table_429878e6e23b45ddb2516c8cae448bf2" modify_external_catalogs: true
I20260620 07:01:12.239666 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2f0c28057b4534a8a400d1ca7f3991" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:12.240001 831 leader_election.cc:341] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:12.240729 830 leader_election.cc:341] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.240859 830 leader_election.cc:302] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.241604 1935 raft_consensus.cc:2726] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.244549 1168 ts_tablet_manager.cc:1428] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
I20260620 07:01:12.245021 1168 tablet_bootstrap.cc:492] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.246519 1168 tablet_bootstrap.cc:654] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.247344 1169 ts_tablet_manager.cc:1918] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:12.250804 1168 tablet_bootstrap.cc:492] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.250942 1168 ts_tablet_manager.cc:1397] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260620 07:01:12.251910 1169 log.cc:1196] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/46689d13712842bf9145ad2bc3fc2acf
I20260620 07:01:12.251354 1170 tablet_bootstrap.cc:654] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.252630 1168 raft_consensus.cc:348] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.252903 1168 raft_consensus.cc:374] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260620 07:01:12.252907 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5672e784e8b14e2bb540a68b0ee991ed consensus state has no leader
I20260620 07:01:12.252952 1168 raft_consensus.cc:729] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.253124 1168 consensus_queue.cc:260] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.254535 1169 ts_tablet_manager.cc:1939] T 46689d13712842bf9145ad2bc3fc2acf P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:12.254638 1168 ts_tablet_manager.cc:1428] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260620 07:01:12.255159 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2fa21eaf565847aa9ede7f122ac6fefe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:12.256052 1168 tablet_bootstrap.cc:492] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:12.256129 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2fa21eaf565847aa9ede7f122ac6fefe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.258018 1935 raft_consensus.cc:482] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.258451 1168 tablet_bootstrap.cc:654] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.258162 1935 raft_consensus.cc:504] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.259191 1935 leader_election.cc:288] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.260488 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54bb495eea4c49b7ad7bf2300ad0e60a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:12.260733 1168 tablet_bootstrap.cc:492] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.260843 1168 ts_tablet_manager.cc:1397] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260620 07:01:12.261003 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 708) took 1808 ms. Trace:
W20260620 07:01:12.261117 830 leader_election.cc:341] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.261093 1169 rpcz_store.cc:276] 0620 07:01:10.453028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.461042 (+ 8014us) service_pool.cc:227] Handling call
0620 07:01:11.976074 (+1515032us) ts_tablet_manager.cc:1145] Deleting tablet 46689d13712842bf9145ad2bc3fc2acf
0620 07:01:11.976085 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.151639 (+175554us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.247238 (+ 95599us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.260977 (+ 13739us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1491546}
I20260620 07:01:12.261492 1168 raft_consensus.cc:348] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.261677 1168 raft_consensus.cc:374] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.261718 1168 raft_consensus.cc:729] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.261842 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 46689d13712842bf9145ad2bc3fc2acf (table default.Table_eedf4e35718843d2bb59ddbb3c085feb [id=00c840fc683c4a4491fe102554b4bc2a]) successfully deleted
I20260620 07:01:12.261893 1168 consensus_queue.cc:260] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.262398 1168 ts_tablet_manager.cc:1428] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260620 07:01:12.262466 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54bb495eea4c49b7ad7bf2300ad0e60a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:12.262631 1168 tablet_bootstrap.cc:492] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.262773 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 711) took 1805 ms. Trace:
I20260620 07:01:12.262880 1169 rpcz_store.cc:276] 0620 07:01:10.456995 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.461402 (+ 4407us) service_pool.cc:227] Handling call
0620 07:01:12.262656 (+1801254us) ts_tablet_manager.cc:1145] Deleting tablet a13a60f7f3e74f7dbf5204c974e0e346
0620 07:01:12.262666 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.262757 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1775528}
W20260620 07:01:12.263499 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a13a60f7f3e74f7dbf5204c974e0e346 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a13a60f7f3e74f7dbf5204c974e0e346 already in progress: creating tablet
I20260620 07:01:12.263907 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 723) took 1490 ms. Trace:
I20260620 07:01:12.263995 1169 rpcz_store.cc:276] 0620 07:01:10.773517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.783768 (+ 10251us) service_pool.cc:227] Handling call
0620 07:01:12.263774 (+1480006us) ts_tablet_manager.cc:1145] Deleting tablet 7294e5678ad44622a3249c1113b5e297
0620 07:01:12.263786 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.263888 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1478235}
I20260620 07:01:12.264123 1168 tablet_bootstrap.cc:654] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:12.264432 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7294e5678ad44622a3249c1113b5e297 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7294e5678ad44622a3249c1113b5e297 already in progress: creating tablet
W20260620 07:01:12.264720 831 leader_election.cc:341] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.264799 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 724) took 1484 ms. Trace:
I20260620 07:01:12.264819 831 leader_election.cc:302] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.264869 1169 rpcz_store.cc:276] 0620 07:01:10.780181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.780299 (+ 118us) service_pool.cc:227] Handling call
0620 07:01:12.264663 (+1484364us) ts_tablet_manager.cc:1145] Deleting tablet 36f1fc6123cd40cb839d47de316502b3
0620 07:01:12.264673 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.264783 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1465185}
I20260620 07:01:12.265008 2106 raft_consensus.cc:2726] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:12.265231 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 36f1fc6123cd40cb839d47de316502b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36f1fc6123cd40cb839d47de316502b3 already in progress: creating tablet
I20260620 07:01:12.265580 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 725) took 1480 ms. Trace:
I20260620 07:01:12.265669 1169 rpcz_store.cc:276] 0620 07:01:10.785198 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.786341 (+ 1143us) service_pool.cc:227] Handling call
0620 07:01:12.265468 (+1479127us) ts_tablet_manager.cc:1145] Deleting tablet 09eddf4734144bdaba24759647553020
0620 07:01:12.265477 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.265561 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1459731}
W20260620 07:01:12.266229 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 09eddf4734144bdaba24759647553020 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09eddf4734144bdaba24759647553020 already in progress: creating tablet
I20260620 07:01:12.266623 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 726) took 1476 ms. Trace:
I20260620 07:01:12.266754 1169 rpcz_store.cc:276] 0620 07:01:10.789782 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.789922 (+ 140us) service_pool.cc:227] Handling call
0620 07:01:12.266517 (+1476595us) ts_tablet_manager.cc:1145] Deleting tablet 960fca9c94764f3d8d2daae20a0f8388
0620 07:01:12.266525 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.266607 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1460420}
W20260620 07:01:12.267267 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 960fca9c94764f3d8d2daae20a0f8388 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 960fca9c94764f3d8d2daae20a0f8388 already in progress: creating tablet
I20260620 07:01:12.267639 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 727) took 1455 ms. Trace:
I20260620 07:01:12.267771 1169 rpcz_store.cc:276] 0620 07:01:10.812394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.812562 (+ 168us) service_pool.cc:227] Handling call
0620 07:01:12.267533 (+1454971us) ts_tablet_manager.cc:1145] Deleting tablet 63525282e222490687713a92e5371a5c
0620 07:01:12.267544 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.267625 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1445553}
W20260620 07:01:12.268226 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 63525282e222490687713a92e5371a5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63525282e222490687713a92e5371a5c already in progress: creating tablet
I20260620 07:01:12.268661 1170 tablet_bootstrap.cc:492] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.268826 1170 ts_tablet_manager.cc:1397] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.001s
I20260620 07:01:12.270090 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:12.270264 1170 raft_consensus.cc:348] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.270474 1170 raft_consensus.cc:374] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.270516 1170 raft_consensus.cc:729] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.270684 1170 consensus_queue.cc:260] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.271522 1170 ts_tablet_manager.cc:1428] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:12.271842 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 1c64df83a18a470c98a9c1fd6bb38918 (table default.Table_0317c7d3f556484385f6af21f10cbc97 [id=4896f23e711941b988db4ea9f22ce625]). Expected version 4 got 0
I20260620 07:01:12.271991 1170 tablet_bootstrap.cc:492] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.276732 1170 tablet_bootstrap.cc:654] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.280061 424 catalog_manager.cc:5495] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:12.280551 424 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 1c64df83a18a470c98a9c1fd6bb38918 (table default.Table_0317c7d3f556484385f6af21f10cbc97 [id=4896f23e711941b988db4ea9f22ce625]). Expected version 4 got 0
I20260620 07:01:12.281766 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 004d4e59a5e6403cbeeebdf69214bfb6 (DEFAULT_TABLE table=default.Table_924b0013b02d4626ac48d394c68f6183 [id=f54fa50940aa4a8ea2f9a13981e55075]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.282119 858 tablet_service.cc:1467] Processing CreateTablet for tablet 7401e8cbac62479b9cca9c8af78d5b6a (DEFAULT_TABLE table=default.Table_6497405bcc42404db11302f413834ec1 [id=be6b67307a9e4164a3e448a3b207bd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.282313 862 tablet_service.cc:1467] Processing CreateTablet for tablet 004d4e59a5e6403cbeeebdf69214bfb6 (DEFAULT_TABLE table=default.Table_924b0013b02d4626ac48d394c68f6183 [id=f54fa50940aa4a8ea2f9a13981e55075]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.282498 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7401e8cbac62479b9cca9c8af78d5b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.282778 872 tablet_service.cc:1467] Processing CreateTablet for tablet e8f66e10cb4f4037a5997a5c33e3f117 (DEFAULT_TABLE table=default.Table_2f5cab7043db44b18d164d5864ce8b51 [id=747074e38e3841b586634ffb3e6e736c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.283102 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f66e10cb4f4037a5997a5c33e3f117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.286258 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_155f286726eb4befbc18214b304e1db8" } modify_external_catalogs: true
I20260620 07:01:12.286460 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_155f286726eb4befbc18214b304e1db8" } modify_external_catalogs: true
I20260620 07:01:12.288472 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 004d4e59a5e6403cbeeebdf69214bfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.290230 1166 ts_tablet_manager.cc:1918] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:12.290352 1166 log.cc:1196] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/81704d3a3cf648d987d4b40a270f7508
W20260620 07:01:12.293939 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b9222f1374e4e96bd760af1a52f3a1c consensus state has no leader
I20260620 07:01:12.293856 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ad5730ccf942456cac948b6a2a12fb4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.294454 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad5730ccf942456cac948b6a2a12fb4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.294382 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_798b7a996b564c84bdb6643fe57309df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.294947 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_798b7a996b564c84bdb6643fe57309df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.296783 1170 tablet_bootstrap.cc:492] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.296924 1170 ts_tablet_manager.cc:1397] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.003s
I20260620 07:01:12.298099 1170 raft_consensus.cc:348] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.298313 1170 raft_consensus.cc:374] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.298372 1170 raft_consensus.cc:729] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.298558 1170 consensus_queue.cc:260] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.298774 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 004d4e59a5e6403cbeeebdf69214bfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.299773 858 tablet_service.cc:1467] Processing CreateTablet for tablet 2823c6f6ab334550bbcff7eee49810c1 (DEFAULT_TABLE table=default.Table_80ea7d8d27774de9944d7ceec99cf8a2 [id=c0604854186a4babb887249205e243da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.300079 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2823c6f6ab334550bbcff7eee49810c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.300153 1168 tablet_bootstrap.cc:492] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.300257 1168 ts_tablet_manager.cc:1397] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.001s
I20260620 07:01:12.300915 1168 raft_consensus.cc:348] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.301095 1168 raft_consensus.cc:374] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.301136 1168 raft_consensus.cc:729] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.301311 1168 consensus_queue.cc:260] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.302040 1168 ts_tablet_manager.cc:1428] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:12.303961 724 tablet_service.cc:1467] Processing CreateTablet for tablet e8f66e10cb4f4037a5997a5c33e3f117 (DEFAULT_TABLE table=default.Table_2f5cab7043db44b18d164d5864ce8b51 [id=747074e38e3841b586634ffb3e6e736c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.304174 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 8088fadabff64c35aa96a1ede17318c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.304363 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f66e10cb4f4037a5997a5c33e3f117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.304383 717 tablet_service.cc:1514] Processing DeleteTablet for tablet b4ee5c79e2a6419ea3847cbebdeced79 with delete_type TABLET_DATA_DELETED (replaced by tablet 63525282e222490687713a92e5371a5c) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.304539 721 tablet_service.cc:1514] Processing DeleteTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.304703 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 46689d13712842bf9145ad2bc3fc2acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.304862 719 tablet_service.cc:1514] Processing DeleteTablet for tablet f690e150839a4d23860932712f61e7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.305156 723 tablet_service.cc:1467] Processing CreateTablet for tablet 004d4e59a5e6403cbeeebdf69214bfb6 (DEFAULT_TABLE table=default.Table_924b0013b02d4626ac48d394c68f6183 [id=f54fa50940aa4a8ea2f9a13981e55075]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.305437 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 004d4e59a5e6403cbeeebdf69214bfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.309638 1168 tablet_bootstrap.cc:492] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.310709 728 tablet_service.cc:1467] Processing CreateTablet for tablet 7401e8cbac62479b9cca9c8af78d5b6a (DEFAULT_TABLE table=default.Table_6497405bcc42404db11302f413834ec1 [id=be6b67307a9e4164a3e448a3b207bd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.311092 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7401e8cbac62479b9cca9c8af78d5b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.311380 1168 tablet_bootstrap.cc:654] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.316213 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a4c32d61de2e4fedb9d78f86570948fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.316869 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4c32d61de2e4fedb9d78f86570948fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.318655 1168 tablet_bootstrap.cc:492] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.318584 1010 tablet_service.cc:1467] Processing CreateTablet for tablet e8f66e10cb4f4037a5997a5c33e3f117 (DEFAULT_TABLE table=default.Table_2f5cab7043db44b18d164d5864ce8b51 [id=747074e38e3841b586634ffb3e6e736c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.318830 1168 ts_tablet_manager.cc:1397] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260620 07:01:12.319017 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f66e10cb4f4037a5997a5c33e3f117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.319629 1166 ts_tablet_manager.cc:1939] T 81704d3a3cf648d987d4b40a270f7508 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:12.319767 1168 raft_consensus.cc:348] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.319968 1168 raft_consensus.cc:374] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.320019 1168 raft_consensus.cc:729] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.320225 1168 consensus_queue.cc:260] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.321020 1168 ts_tablet_manager.cc:1428] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:12.321291 1168 tablet_bootstrap.cc:492] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.321599 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b1aed58dc714451b94fc9a6c14b7d734
I20260620 07:01:12.322062 420 catalog_manager.cc:6565] ReplaceTablet: tablet b1aed58dc714451b94fc9a6c14b7d734 deleted and replaced by tablet d5a365f13ede4357ac3d18014c58fa54
I20260620 07:01:12.322157 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 20fc99f79e7b4df2b74a79468656b6ab
I20260620 07:01:12.323042 2106 raft_consensus.cc:482] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.323171 2106 raft_consensus.cc:504] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.323642 1168 tablet_bootstrap.cc:654] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.323786 2106 leader_election.cc:288] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.324391 857 tablet_service.cc:1514] Processing DeleteTablet for tablet b1aed58dc714451b94fc9a6c14b7d734 with delete_type TABLET_DATA_DELETED (replaced by tablet d5a365f13ede4357ac3d18014c58fa54) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.324782 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 20fc99f79e7b4df2b74a79468656b6ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.323246 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet b1aed58dc714451b94fc9a6c14b7d734 with delete_type TABLET_DATA_DELETED (replaced by tablet d5a365f13ede4357ac3d18014c58fa54) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.325420 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 7401e8cbac62479b9cca9c8af78d5b6a (DEFAULT_TABLE table=default.Table_6497405bcc42404db11302f413834ec1 [id=be6b67307a9e4164a3e448a3b207bd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.325824 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7401e8cbac62479b9cca9c8af78d5b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.325794 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba93e22c4720417c99d471b9c8b49b86" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:12.327205 831 leader_election.cc:341] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:12.327934 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b1aed58dc714451b94fc9a6c14b7d734 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1aed58dc714451b94fc9a6c14b7d734 already in progress: creating tablet
W20260620 07:01:12.328346 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 20fc99f79e7b4df2b74a79468656b6ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20fc99f79e7b4df2b74a79468656b6ab already in progress: creating tablet
I20260620 07:01:12.329044 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_80ea7d8d27774de9944d7ceec99cf8a2" } modify_external_catalogs: true
I20260620 07:01:12.329298 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_80ea7d8d27774de9944d7ceec99cf8a2" } modify_external_catalogs: true
I20260620 07:01:12.329872 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 39504144a623423c873ded7d6839367a
I20260620 07:01:12.330267 421 catalog_manager.cc:6565] ReplaceTablet: tablet 39504144a623423c873ded7d6839367a deleted and replaced by tablet 32526994e93c46a3b5b37f6dc7fd3069
I20260620 07:01:12.330876 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3047443c44374ec98f280f73cbe2e6f6" } modify_external_catalogs: true
I20260620 07:01:12.331094 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3047443c44374ec98f280f73cbe2e6f6" } modify_external_catalogs: true
I20260620 07:01:12.331720 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 20fc99f79e7b4df2b74a79468656b6ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.337144 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_05fe644ddbaf4a9abfbdd884b9153056"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.338014 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05fe644ddbaf4a9abfbdd884b9153056 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.343014 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 39504144a623423c873ded7d6839367a with delete_type TABLET_DATA_DELETED (replaced by tablet 32526994e93c46a3b5b37f6dc7fd3069) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.343644 1165 tablet_replica.cc:330] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.343875 1165 raft_consensus.cc:2229] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.344043 1165 raft_consensus.cc:2258] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.344942 1165 ts_tablet_manager.cc:1905] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.347221 2019 raft_consensus.cc:482] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.347430 2019 raft_consensus.cc:504] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.348287 2019 leader_election.cc:288] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.348917 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a46df2909bf43f297b412c33f18a329" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:12.349357 1170 ts_tablet_manager.cc:1428] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.052s user 0.016s sys 0.001s
I20260620 07:01:12.351967 719 tablet_service.cc:1514] Processing DeleteTablet for tablet b1aed58dc714451b94fc9a6c14b7d734 with delete_type TABLET_DATA_DELETED (replaced by tablet d5a365f13ede4357ac3d18014c58fa54) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.352210 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 20fc99f79e7b4df2b74a79468656b6ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.352198 1170 tablet_bootstrap.cc:492] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.354297 1170 tablet_bootstrap.cc:654] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:12.357113 968 leader_election.cc:341] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.359447 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba93e22c4720417c99d471b9c8b49b86" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:12.359795 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet f690e150839a4d23860932712f61e7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.359812 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a46df2909bf43f297b412c33f18a329" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:12.359799 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 39504144a623423c873ded7d6839367a with delete_type TABLET_DATA_DELETED (replaced by tablet 32526994e93c46a3b5b37f6dc7fd3069) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.360078 894 raft_consensus.cc:2454] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
W20260620 07:01:12.360013 830 leader_election.cc:341] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.360327 830 leader_election.cc:302] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.360636 2106 raft_consensus.cc:2726] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.360980 969 leader_election.cc:302] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters: 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.361364 2019 raft_consensus.cc:2781] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:12.361449 2019 raft_consensus.cc:482] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:12.361524 2019 raft_consensus.cc:3037] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.362778 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ba907170f2df4bd0b5e42d4c2d29b21e
I20260620 07:01:12.363965 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 438) took 8004 ms. Trace:
I20260620 07:01:12.364589 857 tablet_service.cc:1514] Processing DeleteTablet for tablet ba907170f2df4bd0b5e42d4c2d29b21e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.368330 1170 tablet_bootstrap.cc:492] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.368496 1170 ts_tablet_manager.cc:1397] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.002s
I20260620 07:01:12.369347 1170 raft_consensus.cc:348] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.369642 1170 raft_consensus.cc:374] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.369696 1170 raft_consensus.cc:729] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.369897 1170 consensus_queue.cc:260] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.372607 2017 raft_consensus.cc:482] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.372751 2017 raft_consensus.cc:504] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.373317 2017 leader_election.cc:288] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.373482 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 4b565f418cc54d77ba9d405a7d024646 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:12.373701 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 39504144a623423c873ded7d6839367a with delete_type TABLET_DATA_DELETED (replaced by tablet 32526994e93c46a3b5b37f6dc7fd3069) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.374176 721 tablet_service.cc:1514] Processing DeleteTablet for tablet f8ec1e179a704e5480f3deaf856156e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c7f0513df34ddb8104b06e5733fb62) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:12.374305 683 leader_election.cc:341] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cfff2a14b1184d39bd7ac1091ef749c9
I20260620 07:01:12.374481 721 tablet_service.cc:1514] Processing DeleteTablet for tablet cfff2a14b1184d39bd7ac1091ef749c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.374816 721 tablet_service.cc:1514] Processing DeleteTablet for tablet ba907170f2df4bd0b5e42d4c2d29b21e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.374847 1170 ts_tablet_manager.cc:1428] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260620 07:01:12.380656 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_079ba68269814e1ebd7439714bcf4fee" } modify_external_catalogs: true
I20260620 07:01:12.380888 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_079ba68269814e1ebd7439714bcf4fee" } modify_external_catalogs: true
I20260620 07:01:12.384944 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]). Expected version 3 got 0
I20260620 07:01:12.385237 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet f8be5f41f1d64d918b727e3eef18738e (table default.Table_3122a50618184dc7bf7cb696dca2a55b [id=d55d6c70a1b34227b4820944e280fde8]). Expected version 1 got 0
I20260620 07:01:12.385429 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet d51c7488711b4db697b48025a5ba6e9d (table default.Table_8bb5c7631c6145c49b7b09fcda4e4554 [id=ca832808e4a449deab0a9c100d5ead0b]). Expected version 1 got 0
I20260620 07:01:12.387156 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3eb70a87d7cb4c31a43bd0e4f84c769d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.387919 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3eb70a87d7cb4c31a43bd0e4f84c769d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.364082 1166 rpcz_store.cc:276] 0620 07:01:04.359561 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.359845 (+ 284us) service_pool.cc:227] Handling call
0620 07:01:12.210250 (+7850405us) ts_tablet_manager.cc:1145] Deleting tablet 81704d3a3cf648d987d4b40a270f7508
0620 07:01:12.210262 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.217189 (+ 6927us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.290129 (+ 72940us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.363942 (+ 73813us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7837565}
I20260620 07:01:12.391160 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 443) took 7998 ms. Trace:
I20260620 07:01:12.391330 1166 rpcz_store.cc:276] 0620 07:01:04.392658 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.392823 (+ 165us) service_pool.cc:227] Handling call
0620 07:01:12.391016 (+7998193us) ts_tablet_manager.cc:1145] Deleting tablet 125e8a5e20bf484cade408f0358489a1
0620 07:01:12.391031 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.391139 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7997307}
I20260620 07:01:12.391754 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 452) took 7803 ms. Trace:
I20260620 07:01:12.364282 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet ba907170f2df4bd0b5e42d4c2d29b21e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.375523 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfff2a14b1184d39bd7ac1091ef749c9" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:12.386344 2019 raft_consensus.cc:504] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:12.393240 681 leader_election.cc:341] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.393392 681 leader_election.cc:302] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.393627 2019 leader_election.cc:288] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.393762 2017 raft_consensus.cc:2726] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.394362 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a46df2909bf43f297b412c33f18a329" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:12.394572 894 raft_consensus.cc:3037] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.397362 721 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb2d5c0f6d24969a0fea05a34fea00f (DEFAULT_TABLE table=default.Table_0d0e1d25b4b4481c836dfb048e9c1604 [id=4e50d6a0c50240ee9b86edb3d845f61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.397970 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 2823c6f6ab334550bbcff7eee49810c1 (DEFAULT_TABLE table=default.Table_80ea7d8d27774de9944d7ceec99cf8a2 [id=c0604854186a4babb887249205e243da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.398602 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 81704d3a3cf648d987d4b40a270f7508 (table default.Table_90ae8d7513c948f8b7840964f5601249 [id=e7c8a5a3411f485abeddf596a8584e99]) successfully deleted
I20260620 07:01:12.399811 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2823c6f6ab334550bbcff7eee49810c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.401058 727 tablet_service.cc:1467] Processing CreateTablet for tablet 615faa64a3594be5b7dbc2412d27f84d (DEFAULT_TABLE table=default.Table_78748b90376d4d5086c8ef2429c3cb29 [id=0485a6a783b445bb84986307cc856f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.403509 719 tablet_service.cc:1467] Processing CreateTablet for tablet 39f1e3760868420d82ccf925e739e121 (DEFAULT_TABLE table=default.Table_079ba68269814e1ebd7439714bcf4fee [id=ccca86dd988742758e1a2e5504c7d366]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.403656 894 raft_consensus.cc:2454] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:12.391829 1166 rpcz_store.cc:276] 0620 07:01:04.587912 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.588476 (+ 564us) service_pool.cc:227] Handling call
0620 07:01:12.391617 (+7803141us) ts_tablet_manager.cc:1145] Deleting tablet d53c90eff33044479838ff67dea93057
0620 07:01:12.391632 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.391738 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7800487}
I20260620 07:01:12.404548 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 451) took 7817 ms. Trace:
I20260620 07:01:12.404713 1166 rpcz_store.cc:276] 0620 07:01:04.587722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.588802 (+ 1080us) service_pool.cc:227] Handling call
0620 07:01:12.404360 (+7815558us) ts_tablet_manager.cc:1145] Deleting tablet d0c41bf6a8a448ad809292d66ebf9c0e
0620 07:01:12.404373 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.404530 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7784691}
I20260620 07:01:12.405182 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 466) took 7505 ms. Trace:
I20260620 07:01:12.405316 1166 rpcz_store.cc:276] 0620 07:01:04.899614 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.901727 (+ 2113us) service_pool.cc:227] Handling call
0620 07:01:12.405076 (+7503349us) ts_tablet_manager.cc:1145] Deleting tablet 2057b7689b1c4c65901ed8ec04279568
0620 07:01:12.405086 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.405168 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7495206}
I20260620 07:01:12.405706 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 469) took 7503 ms. Trace:
I20260620 07:01:12.404150 969 leader_election.cc:302] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:12.406692 2019 raft_consensus.cc:2781] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:12.406877 2019 raft_consensus.cc:686] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:12.406925 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a46df2909bf43f297b412c33f18a329" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:12.407090 2019 consensus_queue.cc:237] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.407611 1170 tablet_bootstrap.cc:492] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:12.408741 968 leader_election.cc:341] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.409088 1170 tablet_bootstrap.cc:654] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.409624 1166 rpcz_store.cc:276] 0620 07:01:04.902119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.909919 (+ 7800us) service_pool.cc:227] Handling call
0620 07:01:12.405599 (+7495680us) ts_tablet_manager.cc:1145] Deleting tablet 48726d9a3aa745fca3bcd9b6e8807c49
0620 07:01:12.405611 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.405693 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7495392}
I20260620 07:01:12.414805 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb2d5c0f6d24969a0fea05a34fea00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.415313 717 tablet_service.cc:1514] Processing DeleteTablet for tablet ed69a44c466047d298cf7653b2a2bb23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.418479 419 catalog_manager.cc:5495] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:12.418993 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f1e3760868420d82ccf925e739e121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.418982 419 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 96453f82ff3048beabeb188fb27dee42 (table default.Table_7e1bd0d27961486986559381614efd38 [id=7c6337d452d64674bd95e1738caa4345]). Expected version 2 got 0
I20260620 07:01:12.422326 857 tablet_service.cc:1514] Processing DeleteTablet for tablet c8f81fa4e88945f1a392fbacfd031392 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.422564 858 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e08a38c42d4e3da20292343bf085b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.422881 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 467) took 7523 ms. Trace:
I20260620 07:01:12.422976 1166 rpcz_store.cc:276] 0620 07:01:04.899756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.900132 (+ 376us) service_pool.cc:227] Handling call
0620 07:01:12.409944 (+7509812us) ts_tablet_manager.cc:1145] Deleting tablet 7cf81c5c0d9744f5a8c3f0866a435ae3
0620 07:01:12.409953 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.422852 (+ 12899us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7486743}
I20260620 07:01:12.423115 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 615faa64a3594be5b7dbc2412d27f84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.425638 1165 ts_tablet_manager.cc:1918] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.425733 1165 log.cc:1196] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/39504144a623423c873ded7d6839367a
I20260620 07:01:12.425946 1165 ts_tablet_manager.cc:1939] T 39504144a623423c873ded7d6839367a P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.426604 1165 tablet_replica.cc:330] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.426854 1165 raft_consensus.cc:2229] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.427047 1165 raft_consensus.cc:2258] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.427647 1165 ts_tablet_manager.cc:1905] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.428172 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb2d5c0f6d24969a0fea05a34fea00f (DEFAULT_TABLE table=default.Table_0d0e1d25b4b4481c836dfb048e9c1604 [id=4e50d6a0c50240ee9b86edb3d845f61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.428565 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb2d5c0f6d24969a0fea05a34fea00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.432672 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 615faa64a3594be5b7dbc2412d27f84d (DEFAULT_TABLE table=default.Table_78748b90376d4d5086c8ef2429c3cb29 [id=0485a6a783b445bb84986307cc856f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.433147 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 615faa64a3594be5b7dbc2412d27f84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.434854 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 39f1e3760868420d82ccf925e739e121 (DEFAULT_TABLE table=default.Table_079ba68269814e1ebd7439714bcf4fee [id=ccca86dd988742758e1a2e5504c7d366]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.435211 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f1e3760868420d82ccf925e739e121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.435360 1165 ts_tablet_manager.cc:1918] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:12.435460 1165 log.cc:1196] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ba907170f2df4bd0b5e42d4c2d29b21e
I20260620 07:01:12.435791 1165 ts_tablet_manager.cc:1939] T ba907170f2df4bd0b5e42d4c2d29b21e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.436261 1165 tablet_replica.cc:330] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.436447 1165 raft_consensus.cc:2229] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.436578 1165 raft_consensus.cc:2258] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.437150 1165 ts_tablet_manager.cc:1905] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.438737 2017 raft_consensus.cc:482] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.438932 1170 tablet_bootstrap.cc:492] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.438892 2017 raft_consensus.cc:504] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.439056 1170 ts_tablet_manager.cc:1397] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260620 07:01:12.439482 2017 leader_election.cc:288] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.439889 1170 raft_consensus.cc:348] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.440088 1170 raft_consensus.cc:374] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.440133 1170 raft_consensus.cc:729] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.440312 1170 consensus_queue.cc:260] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:12.442498 681 leader_election.cc:341] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: ed69a44c466047d298cf7653b2a2bb23
I20260620 07:01:12.447562 1165 ts_tablet_manager.cc:1918] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.447799 1170 ts_tablet_manager.cc:1428] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260620 07:01:12.447855 1165 log.cc:1196] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/c8f81fa4e88945f1a392fbacfd031392
I20260620 07:01:12.448192 1165 ts_tablet_manager.cc:1939] T c8f81fa4e88945f1a392fbacfd031392 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.448724 1165 tablet_replica.cc:330] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.448920 1165 raft_consensus.cc:2229] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.449087 1165 raft_consensus.cc:2258] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.449729 1165 ts_tablet_manager.cc:1905] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.450531 1170 tablet_bootstrap.cc:492] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.456260 1165 ts_tablet_manager.cc:1918] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.456439 1165 log.cc:1196] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/b5e08a38c42d4e3da20292343bf085b9
I20260620 07:01:12.456727 1165 ts_tablet_manager.cc:1939] T b5e08a38c42d4e3da20292343bf085b9 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.460858 2106 raft_consensus.cc:482] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.461004 2106 raft_consensus.cc:504] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.461539 2106 leader_election.cc:288] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.465814 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f1244539cb0347b9ac10cd187df81019" } new_table_name: "default.Table_2fdaf5217bb741faa11eb980163dfe21" modify_external_catalogs: true
I20260620 07:01:12.465863 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1fe9925a618f4f8bbfc3f27e7bd9b52e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.466486 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fe9925a618f4f8bbfc3f27e7bd9b52e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.467612 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ee94c1a799a47f997469f96005167dc" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:12.468182 830 leader_election.cc:341] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.469635 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 468) took 7569 ms. Trace:
I20260620 07:01:12.472474 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ee94c1a799a47f997469f96005167dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.476208 1170 tablet_bootstrap.cc:654] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.479151 724 tablet_service.cc:1467] Processing CreateTablet for tablet 2823c6f6ab334550bbcff7eee49810c1 (DEFAULT_TABLE table=default.Table_80ea7d8d27774de9944d7ceec99cf8a2 [id=c0604854186a4babb887249205e243da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.479535 1166 rpcz_store.cc:276] 0620 07:01:04.899858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:04.907778 (+ 7920us) service_pool.cc:227] Handling call
0620 07:01:12.469498 (+7561720us) ts_tablet_manager.cc:1145] Deleting tablet 6a36a5319a044e9da7dc7b666484e257
0620 07:01:12.469509 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.469615 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7482633}
I20260620 07:01:12.476615 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 54bb495eea4c49b7ad7bf2300ad0e60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.479238 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a46df2909bf43f297b412c33f18a329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.479426 864 tablet_service.cc:1514] Processing DeleteTablet for tablet a9daee42d5c748ceaed7dc94f551c0d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.479652 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2f0c28057b4534a8a400d1ca7f3991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:12.480434 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d53c90eff33044479838ff67dea93057 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d53c90eff33044479838ff67dea93057 already in progress: creating tablet
I20260620 07:01:12.480674 872 tablet_service.cc:1514] Processing DeleteTablet for tablet b39e682e71ed4776a786f7d30158e7e0 with delete_type TABLET_DATA_DELETED (replaced by tablet d9a7fab4d1684604be1b81d4d4bbe560) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.481909 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 482) took 7314 ms. Trace:
I20260620 07:01:12.482441 874 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb2d5c0f6d24969a0fea05a34fea00f (DEFAULT_TABLE table=default.Table_0d0e1d25b4b4481c836dfb048e9c1604 [id=4e50d6a0c50240ee9b86edb3d845f61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.482944 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb2d5c0f6d24969a0fea05a34fea00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.486686 1165 tablet_replica.cc:330] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.486931 1165 raft_consensus.cc:2229] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.487119 1165 raft_consensus.cc:2258] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.488168 1165 ts_tablet_manager.cc:1905] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:12.481407 412 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 49892.8us
W20260620 07:01:12.489971 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2057b7689b1c4c65901ed8ec04279568 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2057b7689b1c4c65901ed8ec04279568 already in progress: creating tablet
W20260620 07:01:12.490223 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 48726d9a3aa745fca3bcd9b6e8807c49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48726d9a3aa745fca3bcd9b6e8807c49 already in progress: creating tablet
W20260620 07:01:12.490432 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 already in progress: creating tablet
W20260620 07:01:12.491139 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6a36a5319a044e9da7dc7b666484e257 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a36a5319a044e9da7dc7b666484e257 already in progress: creating tablet
I20260620 07:01:12.492093 874 tablet_service.cc:1467] Processing CreateTablet for tablet 615faa64a3594be5b7dbc2412d27f84d (DEFAULT_TABLE table=default.Table_78748b90376d4d5086c8ef2429c3cb29 [id=0485a6a783b445bb84986307cc856f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.492093 862 tablet_service.cc:1467] Processing CreateTablet for tablet 39f1e3760868420d82ccf925e739e121 (DEFAULT_TABLE table=default.Table_079ba68269814e1ebd7439714bcf4fee [id=ccca86dd988742758e1a2e5504c7d366]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:12.492168 872 tablet_service.cc:1514] Processing DeleteTablet for tablet c2e38178b9244152915d4c0a9dcf59dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.492668 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 615faa64a3594be5b7dbc2412d27f84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.493839 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f1e3760868420d82ccf925e739e121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.489635 1170 tablet_bootstrap.cc:492] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.494990 1170 ts_tablet_manager.cc:1397] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.000s
I20260620 07:01:12.495047 1165 ts_tablet_manager.cc:1918] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.495136 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2823c6f6ab334550bbcff7eee49810c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:12.495169 1165 log.cc:1196] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/54bb495eea4c49b7ad7bf2300ad0e60a
I20260620 07:01:12.496290 1166 rpcz_store.cc:276] 0620 07:01:05.167534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.178695 (+ 11161us) service_pool.cc:227] Handling call
0620 07:01:12.481725 (+7303030us) ts_tablet_manager.cc:1145] Deleting tablet 777a6b981b7f43a4ba8978ba6f3971e1
0620 07:01:12.481741 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.481884 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7302623}
I20260620 07:01:12.497238 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 39504144a623423c873ded7d6839367a (table default.Table_7146361681104709b5dfbac7fcecd7cd [id=07dc49586074421fa6e3b6ee862b8216]) successfully deleted
I20260620 07:01:12.497510 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ba907170f2df4bd0b5e42d4c2d29b21e (table default.Table_155f286726eb4befbc18214b304e1db8 [id=156f143b869542dbac1e92fd120f0f36]) successfully deleted
I20260620 07:01:12.497694 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet c8f81fa4e88945f1a392fbacfd031392 (table default.Table_a3dece319ace4b3c8341417bad1846e4 [id=0828a7e1651a4a46926570ca443cf647]) successfully deleted
I20260620 07:01:12.497916 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet b5e08a38c42d4e3da20292343bf085b9 (table default.Table_17a1cb1a99834485911d40165811a7f1 [id=7ce4d1b95a984ccabd629f933ccaff8c]) successfully deleted
I20260620 07:01:12.496104 1170 raft_consensus.cc:348] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.497785 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ee94c1a799a47f997469f96005167dc" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:12.498457 1170 raft_consensus.cc:374] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.498636 1170 raft_consensus.cc:729] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.498975 1170 consensus_queue.cc:260] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.500375 1165 ts_tablet_manager.cc:1939] T 54bb495eea4c49b7ad7bf2300ad0e60a P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.500536 1170 ts_tablet_manager.cc:1428] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260620 07:01:12.496933 858 tablet_service.cc:1514] Processing DeleteTablet for tablet eeb082e189304f13909d115f7197c5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.500083 1999 raft_consensus.cc:482] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.500964 1999 raft_consensus.cc:504] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.501192 1989 raft_consensus.cc:482] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.501251 1170 tablet_bootstrap.cc:492] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.501312 1989 raft_consensus.cc:504] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.501639 1999 leader_election.cc:288] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.501807 1989 leader_election.cc:288] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.503101 1170 tablet_bootstrap.cc:654] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.503199 1165 tablet_replica.cc:330] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:12.503165 969 leader_election.cc:341] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 360880717af145628606b5b9fb26e350
W20260620 07:01:12.503345 969 leader_election.cc:341] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 076926f7dffe4a7b80c25ea3c18e9958
I20260620 07:01:12.503394 1165 raft_consensus.cc:2229] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.503539 1165 raft_consensus.cc:2258] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.505116 1165 ts_tablet_manager.cc:1905] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:12.505278 968 leader_election.cc:341] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 360880717af145628606b5b9fb26e350
I20260620 07:01:12.505402 968 leader_election.cc:302] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:12.505761 968 leader_election.cc:341] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 076926f7dffe4a7b80c25ea3c18e9958
I20260620 07:01:12.505857 968 leader_election.cc:302] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.506209 1989 raft_consensus.cc:2726] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.506356 1989 raft_consensus.cc:2726] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.506938 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 470) took 7473 ms. Trace:
I20260620 07:01:12.507747 1166 rpcz_store.cc:276] 0620 07:01:05.033880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.034375 (+ 495us) service_pool.cc:227] Handling call
0620 07:01:12.506772 (+7472397us) ts_tablet_manager.cc:1145] Deleting tablet a6c7b3977b604cb69df671318fae1212
0620 07:01:12.506812 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.506921 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7298088}
I20260620 07:01:12.508345 2106 raft_consensus.cc:482] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.508491 2106 raft_consensus.cc:504] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.509131 2106 leader_election.cc:288] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.509697 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "134f76587b6147afaf4e94fde5574efc" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:12.510281 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 54bb495eea4c49b7ad7bf2300ad0e60a (table default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]) successfully deleted
W20260620 07:01:12.510864 830 leader_election.cc:341] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.510778 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "134f76587b6147afaf4e94fde5574efc" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:12.512540 1165 ts_tablet_manager.cc:1918] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.512653 1165 log.cc:1196] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/9a46df2909bf43f297b412c33f18a329
I20260620 07:01:12.512933 1165 ts_tablet_manager.cc:1939] T 9a46df2909bf43f297b412c33f18a329 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.513953 1165 tablet_replica.cc:330] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.514617 1165 raft_consensus.cc:2229] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.514997 1165 raft_consensus.cc:2258] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.515733 1165 ts_tablet_manager.cc:1905] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:12.519305 683 leader_election.cc:341] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ed69a44c466047d298cf7653b2a2bb23
I20260620 07:01:12.519476 683 leader_election.cc:302] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.519977 2017 raft_consensus.cc:2726] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.520442 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 471) took 7482 ms. Trace:
W20260620 07:01:12.520824 831 leader_election.cc:341] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.521123 1166 rpcz_store.cc:276] 0620 07:01:05.037834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.038855 (+ 1021us) service_pool.cc:227] Handling call
0620 07:01:12.514203 (+7475348us) ts_tablet_manager.cc:1145] Deleting tablet f2426d52b8ff40f39887545e0341a91a
0620 07:01:12.514215 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.520404 (+ 6189us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7298948}
I20260620 07:01:12.521605 831 leader_election.cc:302] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.522594 1165 ts_tablet_manager.cc:1918] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.524772 1165 log.cc:1196] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/a9daee42d5c748ceaed7dc94f551c0d1
I20260620 07:01:12.525075 2106 raft_consensus.cc:2726] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.525441 1165 ts_tablet_manager.cc:1939] T a9daee42d5c748ceaed7dc94f551c0d1 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.525774 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 481) took 7358 ms. Trace:
W20260620 07:01:12.526132 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 777a6b981b7f43a4ba8978ba6f3971e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 777a6b981b7f43a4ba8978ba6f3971e1 already in progress: creating tablet
I20260620 07:01:12.526430 1165 tablet_replica.cc:330] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.526705 1165 raft_consensus.cc:2229] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.526927 1165 raft_consensus.cc:2258] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:12.527942 831 leader_election.cc:341] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.528225 1166 rpcz_store.cc:276] 0620 07:01:05.167402 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.168495 (+ 1093us) service_pool.cc:227] Handling call
0620 07:01:12.524843 (+7356348us) ts_tablet_manager.cc:1145] Deleting tablet 2c0bb50405d0446488272384523c2deb
0620 07:01:12.525595 (+ 752us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.525753 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7299596}
I20260620 07:01:12.528614 1169 tablet_replica.cc:330] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:01:12.528978 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a6c7b3977b604cb69df671318fae1212 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6c7b3977b604cb69df671318fae1212 already in progress: creating tablet
I20260620 07:01:12.529250 831 leader_election.cc:302] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.529512 2106 raft_consensus.cc:2726] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.528379 1165 ts_tablet_manager.cc:1905] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.531105 1169 raft_consensus.cc:2229] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.529208 1167 tablet_bootstrap.cc:492] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:12.532541 1167 ts_tablet_manager.cc:1397] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.348s user 0.010s sys 0.006s
I20260620 07:01:12.529994 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 9a46df2909bf43f297b412c33f18a329 (table default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]) successfully deleted
I20260620 07:01:12.532968 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet a9daee42d5c748ceaed7dc94f551c0d1 (table default.Table_659d4f17a45b47f5a065e40e30ab00b7 [id=88c48077ab69456c9d5241e3cd750089]) successfully deleted
W20260620 07:01:12.533356 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f2426d52b8ff40f39887545e0341a91a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2426d52b8ff40f39887545e0341a91a already in progress: creating tablet
I20260620 07:01:12.534209 1167 raft_consensus.cc:348] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.534574 1167 raft_consensus.cc:374] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.534749 1167 raft_consensus.cc:729] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.535086 1167 consensus_queue.cc:260] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.536095 1167 ts_tablet_manager.cc:1428] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:12.536437 1167 tablet_bootstrap.cc:492] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:12.538494 1167 tablet_bootstrap.cc:654] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.540918 1165 ts_tablet_manager.cc:1918] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.541133 1165 log.cc:1196] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/9b2f0c28057b4534a8a400d1ca7f3991
I20260620 07:01:12.541652 1165 ts_tablet_manager.cc:1939] T 9b2f0c28057b4534a8a400d1ca7f3991 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.541900 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 484) took 7374 ms. Trace:
I20260620 07:01:12.542269 1169 raft_consensus.cc:2258] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.543010 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 9b2f0c28057b4534a8a400d1ca7f3991 (table default.Table_8e6e4c363d6f44828436c4fca5227174 [id=e2675f19e2dd4de2b88dca72b4b16a97]) successfully deleted
I20260620 07:01:12.543576 1165 tablet_replica.cc:330] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.544103 1165 raft_consensus.cc:2229] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.544343 1165 raft_consensus.cc:2258] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.544926 1165 ts_tablet_manager.cc:1905] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.551399 1165 ts_tablet_manager.cc:1918] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.551621 1165 log.cc:1196] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/2ee94c1a799a47f997469f96005167dc
I20260620 07:01:12.552057 1165 ts_tablet_manager.cc:1939] T 2ee94c1a799a47f997469f96005167dc P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.553535 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 2ee94c1a799a47f997469f96005167dc (table default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]) successfully deleted
I20260620 07:01:12.553961 1165 tablet_replica.cc:330] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.554191 1165 raft_consensus.cc:2229] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.554422 1165 raft_consensus.cc:2258] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.555055 1165 ts_tablet_manager.cc:1905] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:12.555208 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2c0bb50405d0446488272384523c2deb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c0bb50405d0446488272384523c2deb already in progress: creating tablet
I20260620 07:01:12.557034 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9e07325dc3f649aca9c5fc21c47d360f
I20260620 07:01:12.558341 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e07325dc3f649aca9c5fc21c47d360f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.559368 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2823c6f6ab334550bbcff7eee49810c1
I20260620 07:01:12.563108 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 2823c6f6ab334550bbcff7eee49810c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.569418 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e07325dc3f649aca9c5fc21c47d360f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.570962 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 2823c6f6ab334550bbcff7eee49810c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.573321 1165 ts_tablet_manager.cc:1918] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.576310 1165 log.cc:1196] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/b39e682e71ed4776a786f7d30158e7e0
I20260620 07:01:12.576937 1165 ts_tablet_manager.cc:1939] T b39e682e71ed4776a786f7d30158e7e0 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.578317 1165 tablet_replica.cc:330] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.578610 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet b39e682e71ed4776a786f7d30158e7e0 (table default.Table_982eb8abebd34542b51573e542ad6085 [id=a7902aafbaad4905a6b5b03ad669eeae]) successfully deleted
I20260620 07:01:12.578778 1165 raft_consensus.cc:2229] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.579367 1165 raft_consensus.cc:2258] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.580960 1165 ts_tablet_manager.cc:1905] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.591619 1165 ts_tablet_manager.cc:1918] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.542371 1167 tablet_bootstrap.cc:492] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:12.567950 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e07325dc3f649aca9c5fc21c47d360f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.568183 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 2823c6f6ab334550bbcff7eee49810c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.596318 1167 ts_tablet_manager.cc:1397] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.001s
I20260620 07:01:12.597508 1165 log.cc:1196] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/c2e38178b9244152915d4c0a9dcf59dc
I20260620 07:01:12.597410 1167 raft_consensus.cc:348] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.597648 1167 raft_consensus.cc:374] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.597723 1167 raft_consensus.cc:729] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.597955 1167 consensus_queue.cc:260] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.598551 1165 ts_tablet_manager.cc:1939] T c2e38178b9244152915d4c0a9dcf59dc P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.598601 1167 ts_tablet_manager.cc:1428] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:12.599355 1167 tablet_bootstrap.cc:492] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:12.600642 1165 tablet_replica.cc:330] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.601091 1165 raft_consensus.cc:2229] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.601228 1167 tablet_bootstrap.cc:654] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.601656 1165 raft_consensus.cc:2258] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.602547 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet c2e38178b9244152915d4c0a9dcf59dc (table default.Table_1016b85ff6404fc0aff750ab23813534 [id=202a9df145344ba48e0563ba13f1849f]) successfully deleted
I20260620 07:01:12.609768 1999 raft_consensus.cc:482] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.609999 1999 raft_consensus.cc:504] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.610852 1999 leader_election.cc:288] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.611327 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfff2a14b1184d39bd7ac1091ef749c9" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:12.611562 754 raft_consensus.cc:2454] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
W20260620 07:01:12.612010 969 leader_election.cc:341] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cfff2a14b1184d39bd7ac1091ef749c9
I20260620 07:01:12.612114 969 leader_election.cc:302] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:12.612665 1999 raft_consensus.cc:2781] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:12.612784 1999 raft_consensus.cc:482] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:12.612882 1999 raft_consensus.cc:3037] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.614173 2017 raft_consensus.cc:482] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.614302 2017 raft_consensus.cc:504] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.614885 2017 leader_election.cc:288] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.615504 1165 ts_tablet_manager.cc:1905] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.615988 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "168fb1666e2c41358213240d34ef9572" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:12.616205 683 leader_election.cc:341] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 168fb1666e2c41358213240d34ef9572
I20260620 07:01:12.616235 1028 raft_consensus.cc:2454] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:12.616554 681 leader_election.cc:302] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:12.616994 2017 raft_consensus.cc:2781] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:12.617066 2017 raft_consensus.cc:482] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:12.617122 2017 raft_consensus.cc:3037] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.616995 1999 raft_consensus.cc:504] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.618531 1999 leader_election.cc:288] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.620117 2017 raft_consensus.cc:504] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.621157 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfff2a14b1184d39bd7ac1091ef749c9" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:12.621332 754 raft_consensus.cc:3037] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.621601 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b35c1b131d2246a7858fcb8cba1ac3f5" } new_table_name: "default.Table_d813286aa59b40d58c24c8f081155d38" modify_external_catalogs: true
I20260620 07:01:12.622965 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4b565f418cc54d77ba9d405a7d024646
I20260620 07:01:12.623466 420 catalog_manager.cc:6565] ReplaceTablet: tablet 4b565f418cc54d77ba9d405a7d024646 deleted and replaced by tablet 4d15ee88d2814b2e8055f4ca8be415ad
I20260620 07:01:12.623798 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dadaa11698914f6bb6243fb3b922f23b" } new_table_name: "default.Table_dd64d961ce8f4ce7a9ad5110749d872c" modify_external_catalogs: true
W20260620 07:01:12.623936 683 leader_election.cc:341] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 168fb1666e2c41358213240d34ef9572
W20260620 07:01:12.624639 969 leader_election.cc:341] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cfff2a14b1184d39bd7ac1091ef749c9
I20260620 07:01:12.624832 2017 leader_election.cc:288] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.625689 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "168fb1666e2c41358213240d34ef9572" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:12.625873 1028 raft_consensus.cc:3037] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.626135 754 raft_consensus.cc:2454] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:12.628405 1028 raft_consensus.cc:2454] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:12.628892 681 leader_election.cc:302] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:12.628935 968 leader_election.cc:302] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:12.629429 1925 raft_consensus.cc:2781] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:12.629581 1925 raft_consensus.cc:686] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:12.629846 1925 consensus_queue.cc:237] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.630021 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b565f418cc54d77ba9d405a7d024646 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d15ee88d2814b2e8055f4ca8be415ad) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.630599 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b565f418cc54d77ba9d405a7d024646 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d15ee88d2814b2e8055f4ca8be415ad) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.630926 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fa9e987611db4bab92fcf3ed727698be" } new_table_name: "default.Table_4219a4e0a6264d9cb92fdc6b656de6bc" modify_external_catalogs: true
I20260620 07:01:12.631616 2017 raft_consensus.cc:2781] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:12.632182 2017 raft_consensus.cc:686] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:12.632416 2017 consensus_queue.cc:237] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.633234 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d585435b81584257bc9dedfa4a0cca74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.633880 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d585435b81584257bc9dedfa4a0cca74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.637028 1169 ts_tablet_manager.cc:1905] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.641803 2106 raft_consensus.cc:482] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.641961 2106 raft_consensus.cc:504] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.642555 2106 leader_election.cc:288] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.643062 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d51c7488711b4db697b48025a5ba6e9d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:12.644649 831 leader_election.cc:341] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:12.645486 968 consensus_peers.cc:487] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:12.645802 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d51c7488711b4db697b48025a5ba6e9d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:12.646402 830 leader_election.cc:341] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.646513 830 leader_election.cc:302] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.646891 2106 raft_consensus.cc:2726] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.649020 1166 rpcz_store.cc:276] 0620 07:01:05.167735 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.190730 (+ 22995us) service_pool.cc:227] Handling call
0620 07:01:12.541720 (+7350990us) ts_tablet_manager.cc:1145] Deleting tablet ee90d961729b4088b0a312ec770d3cd0
0620 07:01:12.541735 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.541877 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7311706}
W20260620 07:01:12.649883 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ee90d961729b4088b0a312ec770d3cd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee90d961729b4088b0a312ec770d3cd0 already in progress: creating tablet
I20260620 07:01:12.650375 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 483) took 7482 ms. Trace:
I20260620 07:01:12.650498 1166 rpcz_store.cc:276] 0620 07:01:05.167638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.179117 (+ 11479us) service_pool.cc:227] Handling call
0620 07:01:12.650235 (+7471118us) ts_tablet_manager.cc:1145] Deleting tablet fbf912f51bfd4df0afe7aa28815a897e
0620 07:01:12.650248 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.650354 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7414542}
W20260620 07:01:12.651016 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fbf912f51bfd4df0afe7aa28815a897e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbf912f51bfd4df0afe7aa28815a897e already in progress: creating tablet
I20260620 07:01:12.651351 1166 tablet_replica.cc:330] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:12.651572 1166 raft_consensus.cc:2229] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.651763 1166 raft_consensus.cc:2258] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.652438 1166 ts_tablet_manager.cc:1905] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:12.658962 968 consensus_peers.cc:487] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f0e54f1185cd4c5c8e5d2ed289b61650. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:12.677992 427 master_service.cc:946] ReplaceTablet: received request to replace tablet f2f5004b6e28431db1a2b9d1e8c0cfcf from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:12.678988 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 39f1e3760868420d82ccf925e739e121
I20260620 07:01:12.684450 1170 tablet_bootstrap.cc:492] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.684620 1170 ts_tablet_manager.cc:1397] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.184s user 0.012s sys 0.054s
I20260620 07:01:12.685760 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d9e8ecee8fe44fc28cfb00326864ced1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:12.686050 1170 raft_consensus.cc:348] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.686237 1170 raft_consensus.cc:374] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.686288 1170 raft_consensus.cc:729] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
W20260620 07:01:12.686403 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9e8ecee8fe44fc28cfb00326864ced1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.687726 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 39f1e3760868420d82ccf925e739e121 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.689646 1169 ts_tablet_manager.cc:1918] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:12.689765 1169 log.cc:1196] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/69113a64960d4aee9a2a4fcb28570bf2
I20260620 07:01:12.690104 1169 ts_tablet_manager.cc:1939] T 69113a64960d4aee9a2a4fcb28570bf2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:12.690445 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 39f1e3760868420d82ccf925e739e121 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.691493 1168 tablet_bootstrap.cc:492] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.691623 1168 ts_tablet_manager.cc:1397] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.370s user 0.048s sys 0.080s
I20260620 07:01:12.692397 1168 raft_consensus.cc:348] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.692602 1168 raft_consensus.cc:374] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.692651 1168 raft_consensus.cc:729] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.692865 1168 consensus_queue.cc:260] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.695292 1168 ts_tablet_manager.cc:1428] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:12.695555 1168 tablet_bootstrap.cc:492] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.697202 1168 tablet_bootstrap.cc:654] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.707561 1170 consensus_queue.cc:260] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.709501 1170 ts_tablet_manager.cc:1428] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260620 07:01:12.715073 1170 tablet_bootstrap.cc:492] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.715889 1168 tablet_bootstrap.cc:492] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.716032 1168 ts_tablet_manager.cc:1397] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.001s
I20260620 07:01:12.716889 1170 tablet_bootstrap.cc:654] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.724213 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 729) took 1902 ms. Trace:
I20260620 07:01:12.724812 1169 rpcz_store.cc:276] 0620 07:01:10.821729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.821786 (+ 57us) service_pool.cc:227] Handling call
0620 07:01:12.526755 (+1704969us) ts_tablet_manager.cc:1145] Deleting tablet 69113a64960d4aee9a2a4fcb28570bf2
0620 07:01:12.526772 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.673324 (+146552us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.689527 (+ 16203us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.724186 (+ 34659us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1678751}
I20260620 07:01:12.726537 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 728) took 1909 ms. Trace:
I20260620 07:01:12.727546 1169 rpcz_store.cc:276] 0620 07:01:10.817376 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.817541 (+ 165us) service_pool.cc:227] Handling call
0620 07:01:12.726386 (+1908845us) ts_tablet_manager.cc:1145] Deleting tablet 8aa92aae55ef4527a1e8f98945e1e833
0620 07:01:12.726403 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.726516 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1871583}
I20260620 07:01:12.728870 1168 raft_consensus.cc:348] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.729099 1168 raft_consensus.cc:374] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.729163 1168 raft_consensus.cc:729] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.731426 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b565f418cc54d77ba9d405a7d024646 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d15ee88d2814b2e8055f4ca8be415ad) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.734123 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 730) took 1877 ms. Trace:
I20260620 07:01:12.734385 1169 rpcz_store.cc:276] 0620 07:01:10.851350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.851461 (+ 111us) service_pool.cc:227] Handling call
0620 07:01:12.728950 (+1877489us) ts_tablet_manager.cc:1145] Deleting tablet 9dbfd0959737438e8508b96777afb8e1
0620 07:01:12.728961 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.729062 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1859092}
I20260620 07:01:12.729369 1168 consensus_queue.cc:260] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.735383 1168 ts_tablet_manager.cc:1428] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260620 07:01:12.735692 1168 tablet_bootstrap.cc:492] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.735950 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 755) took 1460 ms. Trace:
I20260620 07:01:12.737061 1169 rpcz_store.cc:276] 0620 07:01:11.275976 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.353049 (+ 77073us) service_pool.cc:227] Handling call
0620 07:01:12.735798 (+1382749us) ts_tablet_manager.cc:1145] Deleting tablet 80138f3919f34d5d8163fdfc89d5c52b
0620 07:01:12.735812 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.735933 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381938}
I20260620 07:01:12.737784 1168 tablet_bootstrap.cc:654] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.737825 1169 tablet_replica.cc:330] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:12.738263 1169 raft_consensus.cc:2229] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:12.740412 1169 raft_consensus.cc:2258] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.740829 1170 tablet_bootstrap.cc:492] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.741936 1170 ts_tablet_manager.cc:1397] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260620 07:01:12.745186 1170 raft_consensus.cc:348] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.749081 1168 tablet_bootstrap.cc:492] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:12.749475 1168 ts_tablet_manager.cc:1397] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260620 07:01:12.750450 1168 raft_consensus.cc:348] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.751119 1170 raft_consensus.cc:374] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.751397 1170 raft_consensus.cc:729] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.745903 1169 ts_tablet_manager.cc:1905] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.753104 1170 consensus_queue.cc:260] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.753671 1168 raft_consensus.cc:374] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.758924 1168 raft_consensus.cc:729] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.760484 1168 consensus_queue.cc:260] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.761201 1170 ts_tablet_manager.cc:1428] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260620 07:01:12.761757 1170 tablet_bootstrap.cc:492] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.762566 1168 ts_tablet_manager.cc:1428] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260620 07:01:12.767486 1170 tablet_bootstrap.cc:654] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.754338 1165 ts_tablet_manager.cc:1918] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.768224 1165 log.cc:1196] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/eeb082e189304f13909d115f7197c5a1
I20260620 07:01:12.768362 1168 tablet_bootstrap.cc:492] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:12.763355 2106 raft_consensus.cc:482] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.768492 2106 raft_consensus.cc:504] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.768677 1165 ts_tablet_manager.cc:1939] T eeb082e189304f13909d115f7197c5a1 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.769029 2106 leader_election.cc:288] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.769852 1168 tablet_bootstrap.cc:654] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.770578 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d4ef3ba51e432f889fb927a6af8b49" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:12.771273 830 leader_election.cc:341] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.771987 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet eeb082e189304f13909d115f7197c5a1 (table default.Table_a40bbf24d40c42a693a3c8694f7dac84 [id=6bf90216e3494e01b7d8c51f68a83db0]) successfully deleted
W20260620 07:01:12.772259 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9e07325dc3f649aca9c5fc21c47d360f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e07325dc3f649aca9c5fc21c47d360f already in progress: creating tablet
W20260620 07:01:12.772451 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2823c6f6ab334550bbcff7eee49810c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2823c6f6ab334550bbcff7eee49810c1 already in progress: creating tablet
W20260620 07:01:12.772604 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 4b565f418cc54d77ba9d405a7d024646 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b565f418cc54d77ba9d405a7d024646 already in progress: creating tablet
W20260620 07:01:12.772821 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 39f1e3760868420d82ccf925e739e121 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39f1e3760868420d82ccf925e739e121 already in progress: creating tablet
I20260620 07:01:12.769788 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d4ef3ba51e432f889fb927a6af8b49" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:12.775810 831 leader_election.cc:341] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.776029 831 leader_election.cc:302] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:12.776410 2106 raft_consensus.cc:2726] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.784068 1169 ts_tablet_manager.cc:1918] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260620 07:01:12.788118 1169 log.cc:1196] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/610a25c729cf41b4bd71372bc36365a8
I20260620 07:01:12.788966 1169 ts_tablet_manager.cc:1939] T 610a25c729cf41b4bd71372bc36365a8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:12.790033 1167 tablet_bootstrap.cc:492] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:12.790491 1167 ts_tablet_manager.cc:1397] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.191s user 0.004s sys 0.005s
I20260620 07:01:12.790853 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 756) took 1514 ms. Trace:
I20260620 07:01:12.786692 1170 tablet_bootstrap.cc:492] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.792847 1167 raft_consensus.cc:348] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.793210 1170 ts_tablet_manager.cc:1397] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.001s
I20260620 07:01:12.794093 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 39f1e3760868420d82ccf925e739e121 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:12.794356 1170 raft_consensus.cc:348] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.794730 1170 raft_consensus.cc:374] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.794874 1170 raft_consensus.cc:729] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.795253 1170 consensus_queue.cc:260] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.796032 1170 ts_tablet_manager.cc:1428] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:12.796439 1170 tablet_bootstrap.cc:492] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.797188 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8d56988a28214a3cb3c2acec75bde794" } new_table_name: "default.Table_fad68c6e6cfc4535a522d7ffe529d11a" modify_external_catalogs: true
I20260620 07:01:12.797502 1169 rpcz_store.cc:276] 0620 07:01:11.276141 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.353336 (+ 77195us) service_pool.cc:227] Handling call
0620 07:01:12.737779 (+1384443us) ts_tablet_manager.cc:1145] Deleting tablet 610a25c729cf41b4bd71372bc36365a8
0620 07:01:12.737790 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.756500 (+ 18710us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.783945 (+ 27445us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:12.790780 (+ 6835us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1384268}
I20260620 07:01:12.798563 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 96453f82ff3048beabeb188fb27dee42 (table default.Table_7e1bd0d27961486986559381614efd38 [id=7c6337d452d64674bd95e1738caa4345]). Expected version 2 got 0
I20260620 07:01:12.799160 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 761) took 1425 ms. Trace:
I20260620 07:01:12.799317 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e9c55413664544dc92da5198f9de26be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.799881 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9c55413664544dc92da5198f9de26be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.801340 1169 rpcz_store.cc:276] 0620 07:01:11.373866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.416323 (+ 42457us) service_pool.cc:227] Handling call
0620 07:01:12.799003 (+1382680us) ts_tablet_manager.cc:1145] Deleting tablet d612e9caa8b540b4b96860491d653f11
0620 07:01:12.799020 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.799143 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382368}
I20260620 07:01:12.802271 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 764) took 1419 ms. Trace:
I20260620 07:01:12.803346 1169 rpcz_store.cc:276] 0620 07:01:11.389487 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.425874 (+ 36387us) service_pool.cc:227] Handling call
0620 07:01:12.802078 (+1376204us) ts_tablet_manager.cc:1145] Deleting tablet 4302edba0ec04d7abc2789bc7be1beca
0620 07:01:12.802094 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.802249 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1375728}
I20260620 07:01:12.800907 1170 tablet_bootstrap.cc:654] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.805567 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 765) took 1415 ms. Trace:
I20260620 07:01:12.806290 1169 rpcz_store.cc:276] 0620 07:01:11.389674 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.426398 (+ 36724us) service_pool.cc:227] Handling call
0620 07:01:12.805443 (+1379045us) ts_tablet_manager.cc:1145] Deleting tablet 45358f467b864c3284040893d7351b03
0620 07:01:12.805454 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.805549 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1365197}
I20260620 07:01:12.807662 1169 tablet_replica.cc:330] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:12.808709 1169 raft_consensus.cc:2229] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:12.809870 1169 pending_rounds.cc:62] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:12.810596 1169 pending_rounds.cc:68] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821619691626496 op_type: NO_OP noop_request { }
I20260620 07:01:12.811209 1169 raft_consensus.cc:2866] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:12.811672 1169 raft_consensus.cc:2258] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.814128 1170 tablet_bootstrap.cc:492] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.814329 1170 ts_tablet_manager.cc:1397] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.001s
I20260620 07:01:12.815275 1170 raft_consensus.cc:348] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.815518 1170 raft_consensus.cc:374] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.820178 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]) successfully deleted
I20260620 07:01:12.803380 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a46df2909bf43f297b412c33f18a329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:12.820627 1167 raft_consensus.cc:374] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260620 07:01:12.812883 968 consensus_peers.cc:487] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46689d13712842bf9145ad2bc3fc2acf. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:12.820940 1170 raft_consensus.cc:729] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.821252 1170 consensus_queue.cc:260] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.820716 1167 raft_consensus.cc:729] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.823714 1170 ts_tablet_manager.cc:1428] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260620 07:01:12.824101 1170 tablet_bootstrap.cc:492] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.826440 1170 tablet_bootstrap.cc:654] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.838307 1170 tablet_bootstrap.cc:492] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:12.838672 1170 ts_tablet_manager.cc:1397] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.003s
I20260620 07:01:12.839778 1170 raft_consensus.cc:348] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.840189 1170 raft_consensus.cc:374] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:12.840312 1170 raft_consensus.cc:729] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:12.840653 1170 consensus_queue.cc:260] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.842919 1170 ts_tablet_manager.cc:1428] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 07:01:12.844554 1170 tablet_bootstrap.cc:492] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:12.846979 1170 tablet_bootstrap.cc:654] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.851148 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:12.851421 1165 tablet_replica.cc:330] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:12.851676 1165 raft_consensus.cc:2229] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:12.851861 1165 raft_consensus.cc:2258] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:12.852546 1169 ts_tablet_manager.cc:1905] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.852632 1165 ts_tablet_manager.cc:1905] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:12.823047 1167 consensus_queue.cc:260] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.855499 1167 ts_tablet_manager.cc:1428] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.063s user 0.001s sys 0.001s
I20260620 07:01:12.859390 1165 ts_tablet_manager.cc:1918] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:12.859613 1165 log.cc:1196] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/7cf81c5c0d9744f5a8c3f0866a435ae3
I20260620 07:01:12.860008 1165 ts_tablet_manager.cc:1939] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:12.861446 2130 raft_consensus.cc:482] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.861584 2130 raft_consensus.cc:504] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.862188 2130 leader_election.cc:288] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:12.862308 2130 raft_consensus.cc:482] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.862412 2130 raft_consensus.cc:504] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.862883 2130 leader_election.cc:288] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:12.863165 969 leader_election.cc:341] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a292d66ee14a48959c1f6a63e0a0f492
W20260620 07:01:12.864319 969 leader_election.cc:341] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8088fadabff64c35aa96a1ede17318c3
I20260620 07:01:12.863976 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a292d66ee14a48959c1f6a63e0a0f492" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:12.867756 754 raft_consensus.cc:2454] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:12.863994 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8088fadabff64c35aa96a1ede17318c3" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:12.868062 751 raft_consensus.cc:2454] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:12.868499 968 leader_election.cc:302] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:12.868846 968 leader_election.cc:302] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:12.869199 2130 raft_consensus.cc:2781] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:12.869269 2130 raft_consensus.cc:482] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:12.869328 2130 raft_consensus.cc:3037] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.871820 2130 raft_consensus.cc:504] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.872924 1028 raft_consensus.cc:3037] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.873085 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a292d66ee14a48959c1f6a63e0a0f492" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:12.873293 751 raft_consensus.cc:3037] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.875880 751 raft_consensus.cc:2454] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:12.872315 2130 leader_election.cc:288] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:12.876559 969 leader_election.cc:341] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a292d66ee14a48959c1f6a63e0a0f492
I20260620 07:01:12.876753 968 leader_election.cc:302] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:12.876886 2017 consensus_queue.cc:1035] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:12.877352 1989 raft_consensus.cc:2781] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:12.877453 1989 raft_consensus.cc:686] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:12.877648 1989 consensus_queue.cc:237] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.876559 2130 raft_consensus.cc:2781] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:12.882247 2130 raft_consensus.cc:482] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:12.882339 2130 raft_consensus.cc:3037] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.885347 890 raft_consensus.cc:1261] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Refusing update from remote peer 06a32ef63b2b495a9ade1de48c024ae9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:01:12.886076 1925 consensus_queue.cc:1035] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:12.895964 751 raft_consensus.cc:1261] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Refusing update from remote peer 06a32ef63b2b495a9ade1de48c024ae9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:01:12.896832 1999 consensus_queue.cc:1035] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:12.899014 2130 raft_consensus.cc:504] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.901057 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8088fadabff64c35aa96a1ede17318c3" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:12.901227 754 raft_consensus.cc:3037] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.904549 754 raft_consensus.cc:2454] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:12.905305 968 leader_election.cc:302] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:12.905778 1999 raft_consensus.cc:2781] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:12.905933 1999 raft_consensus.cc:686] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:12.906215 1999 consensus_queue.cc:237] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.913233 2150 tablet.cc:1722] T c11f2678559c41d3bc71d4fa04efd0ac P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:12.917065 2130 leader_election.cc:288] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:12.917901 969 leader_election.cc:341] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8088fadabff64c35aa96a1ede17318c3
I20260620 07:01:12.925854 1920 consensus_queue.cc:1035] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:12.850507 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 9dbfd0959737438e8508b96777afb8e1 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:12.861159 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 (table default.Table_9dd2793fba0e423ab605fac4be9fc8c9 [id=441ab9871f3141a28fb5f7c8c26e41bb]) successfully deleted
W20260620 07:01:12.931305 414 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 70131.3us
W20260620 07:01:12.927999 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef4e6fda73ba45c6892273b33b37a688 consensus state has no leader
W20260620 07:01:12.939836 413 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 119630us
W20260620 07:01:12.940266 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8aa92aae55ef4527a1e8f98945e1e833 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aa92aae55ef4527a1e8f98945e1e833 already in progress: creating tablet
W20260620 07:01:12.940595 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 9dbfd0959737438e8508b96777afb8e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9dbfd0959737438e8508b96777afb8e1 already in progress: creating tablet
W20260620 07:01:12.940914 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 80138f3919f34d5d8163fdfc89d5c52b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80138f3919f34d5d8163fdfc89d5c52b already in progress: creating tablet
I20260620 07:01:12.941181 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 610a25c729cf41b4bd71372bc36365a8 (table default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3]) successfully deleted
W20260620 07:01:12.941432 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d612e9caa8b540b4b96860491d653f11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d612e9caa8b540b4b96860491d653f11 already in progress: creating tablet
W20260620 07:01:12.941716 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 4302edba0ec04d7abc2789bc7be1beca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4302edba0ec04d7abc2789bc7be1beca already in progress: creating tablet
W20260620 07:01:12.941990 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 45358f467b864c3284040893d7351b03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45358f467b864c3284040893d7351b03 already in progress: creating tablet
I20260620 07:01:12.942638 1167 tablet_bootstrap.cc:492] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:12.963830 2155 tablet.cc:1722] T c11f2678559c41d3bc71d4fa04efd0ac P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:12.964953 2157 tablet.cc:1722] T c11f2678559c41d3bc71d4fa04efd0ac P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:12.967900 1167 tablet_bootstrap.cc:654] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:12.973027 2106 raft_consensus.cc:482] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.973171 2106 raft_consensus.cc:504] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:12.973709 2106 leader_election.cc:288] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.974596 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9d7421b549468e8a7782f467473bdb" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:12.975895 830 leader_election.cc:341] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.945240 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b405207e53ca410c8533a25dc80500c3" } modify_external_catalogs: true
I20260620 07:01:12.983484 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b405207e53ca410c8533a25dc80500c3" } modify_external_catalogs: true
I20260620 07:01:12.946286 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_16f776af75174366b8650fdeb7578ebf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.986070 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16f776af75174366b8650fdeb7578ebf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:12.953860 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52d2a46f972e45f5aeadb09101a68149 consensus state has no leader
W20260620 07:01:12.977499 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b54ee547016d41d9abeb94ea26d0960f consensus state has no leader
I20260620 07:01:12.988870 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9d7421b549468e8a7782f467473bdb" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:12.989611 831 leader_election.cc:341] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:12.989779 831 leader_election.cc:302] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:12.989877 413 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 47858us
I20260620 07:01:12.990252 2106 raft_consensus.cc:2726] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:12.992576 2017 raft_consensus.cc:482] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:12.992741 2017 raft_consensus.cc:504] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:12.993819 2017 leader_election.cc:288] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:12.993961 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96453f82ff3048beabeb188fb27dee42" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:12.994542 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96453f82ff3048beabeb188fb27dee42" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:12.994872 894 raft_consensus.cc:2379] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 06a32ef63b2b495a9ade1de48c024ae9 in this term.
I20260620 07:01:12.995342 683 leader_election.cc:302] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:12.995426 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_aef745e818a14008a6e35cd29c256c42" } modify_external_catalogs: true
I20260620 07:01:12.995739 2017 raft_consensus.cc:3037] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:12.995714 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_aef745e818a14008a6e35cd29c256c42" } modify_external_catalogs: true
I20260620 07:01:12.996618 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_05121e91944b48c78974295fb7f281eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:12.997494 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05121e91944b48c78974295fb7f281eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:12.998670 2017 raft_consensus.cc:2726] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:13.007705 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a96030064de046e5873bdaab6f3dff60 consensus state has no leader
I20260620 07:01:13.012847 2017 raft_consensus.cc:482] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.013065 2017 raft_consensus.cc:504] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.013907 2017 leader_election.cc:288] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.014834 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5014cf5cc70466bafb6921c9d46ba72" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:13.015214 683 leader_election.cc:341] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b5014cf5cc70466bafb6921c9d46ba72
W20260620 07:01:13.015520 681 leader_election.cc:341] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.015654 681 leader_election.cc:302] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:13.016175 2017 raft_consensus.cc:2726] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:13.043041 2017 raft_consensus.cc:482] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.043233 2017 raft_consensus.cc:504] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.044037 2017 leader_election.cc:288] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.045445 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8ec1e179a704e5480f3deaf856156e7" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:13.045542 683 leader_election.cc:341] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f8ec1e179a704e5480f3deaf856156e7
I20260620 07:01:13.045819 1028 raft_consensus.cc:2454] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:13.046094 2130 raft_consensus.cc:482] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.046252 681 leader_election.cc:302] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:13.046343 2130 raft_consensus.cc:504] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.046867 2017 raft_consensus.cc:2781] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:13.046972 2017 raft_consensus.cc:482] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:13.047055 2017 raft_consensus.cc:3037] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:13.048286 969 leader_election.cc:341] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: bea895c735c847f59794ab8c3282447d
I20260620 07:01:13.048604 2130 leader_election.cc:288] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:13.049650 2017 raft_consensus.cc:504] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.050503 2017 leader_election.cc:288] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.051666 1168 tablet_bootstrap.cc:492] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.051822 1168 ts_tablet_manager.cc:1397] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.284s user 0.023s sys 0.059s
I20260620 07:01:13.052032 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8ec1e179a704e5480f3deaf856156e7" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:13.052475 1028 raft_consensus.cc:3037] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:13.052553 1168 raft_consensus.cc:348] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.052752 1168 raft_consensus.cc:374] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.052814 1168 raft_consensus.cc:729] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.053030 1168 consensus_queue.cc:260] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.053539 1168 ts_tablet_manager.cc:1428] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:13.053788 1168 tablet_bootstrap.cc:492] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:13.056134 683 leader_election.cc:341] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f8ec1e179a704e5480f3deaf856156e7
I20260620 07:01:13.056397 1028 raft_consensus.cc:2454] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:13.056854 968 leader_election.cc:341] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: bea895c735c847f59794ab8c3282447d
I20260620 07:01:13.057643 2150 tablet.cc:1722] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:13.061468 1168 tablet_bootstrap.cc:654] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.063248 968 leader_election.cc:302] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:13.064026 2019 raft_consensus.cc:2726] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:13.064536 681 leader_election.cc:302] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:13.064973 2017 raft_consensus.cc:2781] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:13.065122 2017 raft_consensus.cc:686] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:13.065358 2017 consensus_queue.cc:237] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.066470 2157 tablet.cc:1722] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:13.075568 2155 tablet.cc:1722] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:13.080755 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_361fa70850d54eb291b21f9da97fbdb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.081362 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_361fa70850d54eb291b21f9da97fbdb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.083690 1168 tablet_bootstrap.cc:492] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.083863 1168 ts_tablet_manager.cc:1397] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260620 07:01:13.084740 1168 raft_consensus.cc:348] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.085055 1168 raft_consensus.cc:374] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.085129 1168 raft_consensus.cc:729] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.085366 1168 consensus_queue.cc:260] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.086010 1168 ts_tablet_manager.cc:1428] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:13.086437 1168 tablet_bootstrap.cc:492] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.087162 1170 tablet_bootstrap.cc:492] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:13.087311 1170 ts_tablet_manager.cc:1397] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.244s user 0.010s sys 0.070s
I20260620 07:01:13.088104 1168 tablet_bootstrap.cc:654] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.088040 1170 raft_consensus.cc:348] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.088243 1170 raft_consensus.cc:374] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.088296 1170 raft_consensus.cc:729] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.088510 1170 consensus_queue.cc:260] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.089126 1167 tablet_bootstrap.cc:492] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:13.089146 1170 ts_tablet_manager.cc:1428] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:13.089268 1167 ts_tablet_manager.cc:1397] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.147s user 0.003s sys 0.000s
I20260620 07:01:13.089380 1170 tablet_bootstrap.cc:492] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:13.089994 1167 raft_consensus.cc:348] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.090224 1167 raft_consensus.cc:374] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.090273 1167 raft_consensus.cc:729] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.090459 1167 consensus_queue.cc:260] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.090992 1167 ts_tablet_manager.cc:1428] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:13.091284 1167 tablet_bootstrap.cc:492] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:13.092015 1170 tablet_bootstrap.cc:654] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.092777 1167 tablet_bootstrap.cc:654] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.097187 2017 raft_consensus.cc:482] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.097352 2017 raft_consensus.cc:504] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.097929 2017 leader_election.cc:288] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:13.099138 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e08a38c42d4e3da20292343bf085b9" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:13.099241 683 leader_election.cc:341] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b5e08a38c42d4e3da20292343bf085b9
I20260620 07:01:13.099763 1168 tablet_bootstrap.cc:492] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
W20260620 07:01:13.099771 681 leader_election.cc:341] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.099880 681 leader_election.cc:302] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:13.099913 1168 ts_tablet_manager.cc:1397] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260620 07:01:13.100170 1166 ts_tablet_manager.cc:1918] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.100306 2017 raft_consensus.cc:2726] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:13.100345 1166 log.cc:1196] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/169b93c38e59435db218152f2d25bdfa
I20260620 07:01:13.100817 1166 ts_tablet_manager.cc:1939] T 169b93c38e59435db218152f2d25bdfa P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:13.100688 1168 raft_consensus.cc:348] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.100935 1168 raft_consensus.cc:374] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.101011 1168 raft_consensus.cc:729] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.101243 1168 consensus_queue.cc:260] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.101871 1168 ts_tablet_manager.cc:1428] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:13.101907 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 485) took 7934 ms. Trace:
I20260620 07:01:13.102187 1168 tablet_bootstrap.cc:492] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.102073 1166 rpcz_store.cc:276] 0620 07:01:05.167829 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.208810 (+ 40981us) service_pool.cc:227] Handling call
0620 07:01:12.651309 (+7442499us) ts_tablet_manager.cc:1145] Deleting tablet 169b93c38e59435db218152f2d25bdfa
0620 07:01:12.651319 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:12.818012 (+166693us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.100051 (+282039us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.101887 (+ 1836us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7388432}
I20260620 07:01:13.102742 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 169b93c38e59435db218152f2d25bdfa (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]) successfully deleted
I20260620 07:01:13.103251 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 492) took 7329 ms. Trace:
I20260620 07:01:13.103399 1166 rpcz_store.cc:276] 0620 07:01:05.774100 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.775264 (+ 1164us) service_pool.cc:227] Handling call
0620 07:01:13.103121 (+7327857us) ts_tablet_manager.cc:1145] Deleting tablet e37f336c01974ba79caeb25f4781667a
0620 07:01:13.103133 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.103236 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7327661}
W20260620 07:01:13.103914 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet e37f336c01974ba79caeb25f4781667a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e37f336c01974ba79caeb25f4781667a already in progress: creating tablet
I20260620 07:01:13.104255 1168 tablet_bootstrap.cc:654] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.104396 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 491) took 7330 ms. Trace:
I20260620 07:01:13.104524 1166 rpcz_store.cc:276] 0620 07:01:05.773554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.773601 (+ 47us) service_pool.cc:227] Handling call
0620 07:01:13.104217 (+7330616us) ts_tablet_manager.cc:1145] Deleting tablet 88c01c4e10f345fc84e3e253e8501aff
0620 07:01:13.104227 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.104313 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7326143}
I20260620 07:01:13.110212 425 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 1c64df83a18a470c98a9c1fd6bb38918 (table default.Table_0317c7d3f556484385f6af21f10cbc97 [id=4896f23e711941b988db4ea9f22ce625]). Expected version 4 got 0
I20260620 07:01:13.120163 1170 tablet_bootstrap.cc:492] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:13.120318 1170 ts_tablet_manager.cc:1397] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.012s
I20260620 07:01:13.121100 1170 raft_consensus.cc:348] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.121347 1170 raft_consensus.cc:374] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.121410 1170 raft_consensus.cc:729] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.121647 1170 consensus_queue.cc:260] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.122164 1168 tablet_bootstrap.cc:492] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.122331 1168 ts_tablet_manager.cc:1397] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260620 07:01:13.123330 1168 raft_consensus.cc:348] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.123616 1168 raft_consensus.cc:374] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.123687 1168 raft_consensus.cc:729] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.123919 1168 consensus_queue.cc:260] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.124392 1168 ts_tablet_manager.cc:1428] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:13.125039 1170 ts_tablet_manager.cc:1428] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260620 07:01:13.125649 1170 tablet_bootstrap.cc:492] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:13.127221 2159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:33455 every 8 connection(s)
I20260620 07:01:13.127655 1170 tablet_bootstrap.cc:654] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.129041 1853 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:33455
I20260620 07:01:13.131055 1168 tablet_bootstrap.cc:492] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.132261 1989 consensus_queue.cc:1035] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:13.132751 1168 tablet_bootstrap.cc:654] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.134487 1853 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-1/data/info.pb
I20260620 07:01:13.134909 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4u_93S/build/asan/bin/kudu as pid 1853
I20260620 07:01:13.140617 1169 ts_tablet_manager.cc:1918] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260620 07:01:13.142067 969 consensus_peers.cc:487] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba907170f2df4bd0b5e42d4c2d29b21e. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:13.147603 1168 tablet_bootstrap.cc:492] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.147789 1168 ts_tablet_manager.cc:1397] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20260620 07:01:13.148844 1168 raft_consensus.cc:348] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.149148 1168 raft_consensus.cc:374] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.149253 1168 raft_consensus.cc:729] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.149518 1168 consensus_queue.cc:260] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.150228 1168 ts_tablet_manager.cc:1428] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:13.150556 1168 tablet_bootstrap.cc:492] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.147332 1170 tablet_bootstrap.cc:492] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:13.157475 1170 ts_tablet_manager.cc:1397] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.004s
I20260620 07:01:13.157714 1169 log.cc:1196] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/261f0d97e1084e828b9562cb30ea422b
I20260620 07:01:13.158474 1169 ts_tablet_manager.cc:1939] T 261f0d97e1084e828b9562cb30ea422b P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:13.158566 1168 tablet_bootstrap.cc:654] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.158972 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 490) took 7385 ms. Trace:
I20260620 07:01:13.161924 1166 rpcz_store.cc:276] 0620 07:01:05.773434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.773847 (+ 413us) service_pool.cc:227] Handling call
0620 07:01:13.158817 (+7384970us) ts_tablet_manager.cc:1145] Deleting tablet 0a4bebaa8ed1431d8c775f4856a3d808
0620 07:01:13.158832 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.158950 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7379902}
I20260620 07:01:13.158418 1170 raft_consensus.cc:348] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.162400 1170 raft_consensus.cc:374] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.162492 1170 raft_consensus.cc:729] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.162742 1170 consensus_queue.cc:260] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.163405 1170 ts_tablet_manager.cc:1428] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260620 07:01:13.163704 1170 tablet_bootstrap.cc:492] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:13.164148 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 494) took 7371 ms. Trace:
I20260620 07:01:13.164975 1166 rpcz_store.cc:276] 0620 07:01:05.792650 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.793565 (+ 915us) service_pool.cc:227] Handling call
0620 07:01:13.163681 (+7370116us) ts_tablet_manager.cc:1145] Deleting tablet b4ee5c79e2a6419ea3847cbebdeced79
0620 07:01:13.163691 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.164123 (+ 432us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7347837}
I20260620 07:01:13.165390 1170 tablet_bootstrap.cc:654] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.165881 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 763) took 1782 ms. Trace:
W20260620 07:01:13.166568 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet b54ee547016d41d9abeb94ea26d0960f (table default.Table_dd64d961ce8f4ce7a9ad5110749d872c [id=fd6f24da5f4e41eeb651510137682aef], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b54ee547016d41d9abeb94ea26d0960f consensus state has no leader
I20260620 07:01:13.167183 1166 tablet_replica.cc:330] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
W20260620 07:01:13.167613 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0a4bebaa8ed1431d8c775f4856a3d808 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a4bebaa8ed1431d8c775f4856a3d808 already in progress: creating tablet
W20260620 07:01:13.167891 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b4ee5c79e2a6419ea3847cbebdeced79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ee5c79e2a6419ea3847cbebdeced79 already in progress: creating tablet
I20260620 07:01:13.170846 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f2f5004b6e28431db1a2b9d1e8c0cfcf
I20260620 07:01:13.171340 427 catalog_manager.cc:6565] ReplaceTablet: tablet f2f5004b6e28431db1a2b9d1e8c0cfcf deleted and replaced by tablet 45788e873c3a4e27b2db531cd02fbbdb
W20260620 07:01:13.172648 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d42118f181da4fa489a919a9b4c6664b consensus state has no leader
I20260620 07:01:13.173221 862 tablet_service.cc:1514] Processing DeleteTablet for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf with delete_type TABLET_DATA_DELETED (replaced by tablet 45788e873c3a4e27b2db531cd02fbbdb) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:13.173921 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f5004b6e28431db1a2b9d1e8c0cfcf already in progress: creating tablet
I20260620 07:01:13.188170 1168 tablet_bootstrap.cc:492] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.188362 1168 ts_tablet_manager.cc:1397] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.002s
I20260620 07:01:13.189342 1168 raft_consensus.cc:348] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.189617 1168 raft_consensus.cc:374] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.189682 1168 raft_consensus.cc:729] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.189932 1168 consensus_queue.cc:260] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.190726 1168 ts_tablet_manager.cc:1428] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:13.191411 1168 tablet_bootstrap.cc:492] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.193553 1168 tablet_bootstrap.cc:654] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.197688 426 master_service.cc:946] ReplaceTablet: received request to replace tablet 62ef9a12e3684d27b6696f631c68a5af from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:13.174779 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf with delete_type TABLET_DATA_DELETED (replaced by tablet 45788e873c3a4e27b2db531cd02fbbdb) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.198982 1166 raft_consensus.cc:2229] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.199152 1166 raft_consensus.cc:2258] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.199674 1166 ts_tablet_manager.cc:1905] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.201414 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2c0d1cfae0064292a4b21ec4f3e28be8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.201990 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c0d1cfae0064292a4b21ec4f3e28be8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.202021 2019 consensus_queue.cc:1035] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:13.175305 1167 tablet_bootstrap.cc:492] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:13.204022 1167 ts_tablet_manager.cc:1397] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.000s
I20260620 07:01:13.151684 2017 raft_consensus.cc:482] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.204357 2017 raft_consensus.cc:504] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.204772 1167 raft_consensus.cc:348] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.204926 2017 leader_election.cc:288] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:13.180260 724 tablet_service.cc:1514] Processing DeleteTablet for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf with delete_type TABLET_DATA_DELETED (replaced by tablet 45788e873c3a4e27b2db531cd02fbbdb) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.204998 1167 raft_consensus.cc:374] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.205057 1167 raft_consensus.cc:729] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.205230 1167 consensus_queue.cc:260] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.205323 1169 rpcz_store.cc:276] 0620 07:01:11.383046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.424238 (+ 41192us) service_pool.cc:227] Handling call
0620 07:01:12.807596 (+1383358us) ts_tablet_manager.cc:1145] Deleting tablet 261f0d97e1084e828b9562cb30ea422b
0620 07:01:12.807613 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.035808 (+228195us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.140471 (+104663us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.165858 (+ 25387us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1363948}
I20260620 07:01:13.205775 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 261f0d97e1084e828b9562cb30ea422b (table default.Table_49629c65f95a46ff815a7d39c7143227 [id=466c737c0047420081fddb786a8093f3]) successfully deleted
I20260620 07:01:13.205729 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34dc2af503684aaba8388a4611fab48e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:13.205945 890 raft_consensus.cc:2454] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:13.206135 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 766) took 1816 ms. Trace:
I20260620 07:01:13.206208 1169 rpcz_store.cc:276] 0620 07:01:11.389788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.440310 (+ 50522us) service_pool.cc:227] Handling call
0620 07:01:13.206011 (+1765701us) ts_tablet_manager.cc:1145] Deleting tablet 80a83948f0424b47889f4be7fee15706
0620 07:01:13.206021 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.206118 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1761052}
I20260620 07:01:13.206362 683 leader_election.cc:302] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:13.206598 2017 raft_consensus.cc:2781] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:13.206660 2017 raft_consensus.cc:482] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:13.206715 2017 raft_consensus.cc:3037] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:13.207141 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 80a83948f0424b47889f4be7fee15706 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80a83948f0424b47889f4be7fee15706 already in progress: creating tablet
I20260620 07:01:13.207523 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 771) took 1781 ms. Trace:
I20260620 07:01:13.207605 1169 rpcz_store.cc:276] 0620 07:01:11.425807 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.453406 (+ 27599us) service_pool.cc:227] Handling call
0620 07:01:13.207379 (+1753973us) ts_tablet_manager.cc:1145] Deleting tablet 29b8ce279cfe4684bd296a48e8783e1b
0620 07:01:13.207391 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.207504 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1749528}
W20260620 07:01:13.208014 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 29b8ce279cfe4684bd296a48e8783e1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29b8ce279cfe4684bd296a48e8783e1b already in progress: creating tablet
I20260620 07:01:13.208405 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 774) took 1523 ms. Trace:
I20260620 07:01:13.208478 1169 rpcz_store.cc:276] 0620 07:01:11.685446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.685504 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:13.208305 (+1522801us) ts_tablet_manager.cc:1145] Deleting tablet 0435678022914e6991c974e116d1a9f7
0620 07:01:13.208313 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.208390 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1496451}
I20260620 07:01:13.208923 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34dc2af503684aaba8388a4611fab48e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.209185 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 775) took 1194 ms. Trace:
I20260620 07:01:13.209353 1169 rpcz_store.cc:276] 0620 07:01:12.014907 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.014963 (+ 56us) service_pool.cc:227] Handling call
0620 07:01:13.209010 (+1194047us) ts_tablet_manager.cc:1145] Deleting tablet 89f5e2f055fb469dbbb935bba724dcb5
0620 07:01:13.209044 (+ 34us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.209144 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1193861}
W20260620 07:01:13.208863 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 0435678022914e6991c974e116d1a9f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0435678022914e6991c974e116d1a9f7 already in progress: creating tablet
W20260620 07:01:13.209983 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 89f5e2f055fb469dbbb935bba724dcb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89f5e2f055fb469dbbb935bba724dcb5 already in progress: creating tablet
I20260620 07:01:13.209890 2017 raft_consensus.cc:504] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:13.209532 681 leader_election.cc:341] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.210309 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 776) took 1122 ms. Trace:
I20260620 07:01:13.210382 1169 rpcz_store.cc:276] 0620 07:01:12.088172 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.088266 (+ 94us) service_pool.cc:227] Handling call
0620 07:01:13.210201 (+1121935us) ts_tablet_manager.cc:1145] Deleting tablet 3d81d05b4b1646b4b1fa6577c149a7ad
0620 07:01:13.210210 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.210293 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1121711}
W20260620 07:01:13.210986 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3d81d05b4b1646b4b1fa6577c149a7ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d81d05b4b1646b4b1fa6577c149a7ad already in progress: creating tablet
I20260620 07:01:13.211301 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 777) took 1117 ms. Trace:
I20260620 07:01:13.211524 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34dc2af503684aaba8388a4611fab48e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:13.211704 894 raft_consensus.cc:3037] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:13.211771 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34dc2af503684aaba8388a4611fab48e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:13.214269 1167 ts_tablet_manager.cc:1428] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260620 07:01:13.214289 894 raft_consensus.cc:2454] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:13.211382 1169 rpcz_store.cc:276] 0620 07:01:12.093461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.093519 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:13.211184 (+1117665us) ts_tablet_manager.cc:1145] Deleting tablet 70e7fada94584d68b287c2318e21d345
0620 07:01:13.211193 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.211286 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1117451}
I20260620 07:01:13.214883 1167 tablet_bootstrap.cc:492] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:13.214850 2158 raft_consensus.cc:482] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.214967 2158 raft_consensus.cc:504] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:13.215087 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 70e7fada94584d68b287c2318e21d345 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70e7fada94584d68b287c2318e21d345 already in progress: creating tablet
I20260620 07:01:13.215510 2158 leader_election.cc:288] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:13.212425 681 leader_election.cc:341] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.216238 683 leader_election.cc:302] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:13.216923 2158 raft_consensus.cc:2781] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:13.216961 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a4390225af348f89c934f0f179ddab5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:13.217064 2158 raft_consensus.cc:686] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:13.217144 894 raft_consensus.cc:2454] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:13.217331 2158 consensus_queue.cc:237] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.218255 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a4390225af348f89c934f0f179ddab5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.218431 1028 raft_consensus.cc:2454] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:13.218919 681 leader_election.cc:302] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:13.211422 2017 leader_election.cc:288] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:13.219895 2017 raft_consensus.cc:2781] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:13.220028 2017 raft_consensus.cc:482] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:13.220170 2017 raft_consensus.cc:3037] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:13.196990 1170 tablet_bootstrap.cc:492] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:13.225562 1170 ts_tablet_manager.cc:1397] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.009s
I20260620 07:01:13.226384 1170 raft_consensus.cc:348] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.226581 1170 raft_consensus.cc:374] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.226637 1170 raft_consensus.cc:729] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.226826 1170 consensus_queue.cc:260] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.227349 1170 ts_tablet_manager.cc:1428] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:13.227631 1170 tablet_bootstrap.cc:492] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:13.228828 1167 tablet_bootstrap.cc:654] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.229224 1170 tablet_bootstrap.cc:654] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.230482 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 778) took 1060 ms. Trace:
I20260620 07:01:13.230576 1169 rpcz_store.cc:276] 0620 07:01:12.170380 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.170441 (+ 61us) service_pool.cc:227] Handling call
0620 07:01:13.230331 (+1059890us) ts_tablet_manager.cc:1145] Deleting tablet 71977c69b29143eebfcc8ece39daf78e
0620 07:01:13.230342 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.230462 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1059682}
W20260620 07:01:13.231427 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 71977c69b29143eebfcc8ece39daf78e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71977c69b29143eebfcc8ece39daf78e already in progress: creating tablet
I20260620 07:01:13.231806 1169 tablet_replica.cc:330] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:13.231988 1169 raft_consensus.cc:2229] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.232138 1169 raft_consensus.cc:2258] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.232501 2017 raft_consensus.cc:504] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.233705 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a4390225af348f89c934f0f179ddab5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:13.233911 894 raft_consensus.cc:3037] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:13.234102 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a4390225af348f89c934f0f179ddab5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:13.234294 1028 raft_consensus.cc:3037] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:13.234571 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fa0b581de06149cf93b469a4a095573b
I20260620 07:01:13.235168 421 master_service.cc:946] ReplaceTablet: received request to replace tablet 5f04603a2fe84988ac9c9975e94ce9ae from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:13.236572 894 raft_consensus.cc:2454] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:13.236929 1028 raft_consensus.cc:2454] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:13.237461 681 leader_election.cc:302] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:13.237710 1920 raft_consensus.cc:2781] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:13.238090 724 tablet_service.cc:1514] Processing DeleteTablet for tablet fa0b581de06149cf93b469a4a095573b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.238503 1169 ts_tablet_manager.cc:1905] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.239902 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet fa0b581de06149cf93b469a4a095573b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.240340 862 tablet_service.cc:1514] Processing DeleteTablet for tablet fa0b581de06149cf93b469a4a095573b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:13.240991 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fa0b581de06149cf93b469a4a095573b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa0b581de06149cf93b469a4a095573b already in progress: creating tablet
I20260620 07:01:13.244131 1166 ts_tablet_manager.cc:1918] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.244263 1166 log.cc:1196] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/e14db4e3394046e49ecc69c9ca4dc840
I20260620 07:01:13.244625 1166 ts_tablet_manager.cc:1939] T e14db4e3394046e49ecc69c9ca4dc840 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:13.245370 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 502) took 7360 ms. Trace:
I20260620 07:01:13.245473 1166 rpcz_store.cc:276] 0620 07:01:05.885330 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.885383 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:13.167129 (+7281746us) ts_tablet_manager.cc:1145] Deleting tablet e14db4e3394046e49ecc69c9ca4dc840
0620 07:01:13.167150 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.232916 (+ 65766us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.244024 (+ 11108us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.245349 (+ 1325us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7272012}
I20260620 07:01:13.245971 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet e14db4e3394046e49ecc69c9ca4dc840 (table default.Table_b6b971bcac4546f18c57e342e7f4c804 [id=6f4392721f754cce90275aa5e1f094ab]) successfully deleted
I20260620 07:01:13.252022 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_02dd512d8cdb48e98679252eee51b6bd" } modify_external_catalogs: true
I20260620 07:01:13.252257 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_02dd512d8cdb48e98679252eee51b6bd" } modify_external_catalogs: true
I20260620 07:01:13.252915 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_92260deae314470797bd29ca83c08e68" } modify_external_catalogs: true
I20260620 07:01:13.253118 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_92260deae314470797bd29ca83c08e68" } modify_external_catalogs: true
I20260620 07:01:13.253573 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ac2df841f29b4ea287cce829a29ba718"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.254139 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac2df841f29b4ea287cce829a29ba718 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.256233 2017 leader_election.cc:288] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.258991 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 507) took 7281 ms. Trace:
I20260620 07:01:13.259137 1168 tablet_bootstrap.cc:492] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.259256 1168 ts_tablet_manager.cc:1397] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.001s
I20260620 07:01:13.259105 1166 rpcz_store.cc:276] 0620 07:01:05.977128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.978834 (+ 1706us) service_pool.cc:227] Handling call
0620 07:01:13.252607 (+7273773us) ts_tablet_manager.cc:1145] Deleting tablet 8b8659e903084f15ac3d9ea8c4c0dc0f
0620 07:01:13.258809 (+ 6202us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.258963 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7273498}
W20260620 07:01:13.259721 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b8659e903084f15ac3d9ea8c4c0dc0f already in progress: creating tablet
I20260620 07:01:13.259977 1168 raft_consensus.cc:348] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.260175 1168 raft_consensus.cc:374] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.260253 1168 raft_consensus.cc:729] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.260488 1168 consensus_queue.cc:260] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.261021 1168 ts_tablet_manager.cc:1428] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:13.261268 1168 tablet_bootstrap.cc:492] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.262022 1169 ts_tablet_manager.cc:1918] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.262704 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 508) took 7285 ms. Trace:
I20260620 07:01:13.263176 1168 tablet_bootstrap.cc:654] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.263995 1166 rpcz_store.cc:276] 0620 07:01:05.977239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.982860 (+ 5621us) service_pool.cc:227] Handling call
0620 07:01:13.262577 (+7279717us) ts_tablet_manager.cc:1145] Deleting tablet af743ffd2eb2427caa3779c7fceb8f30
0620 07:01:13.262589 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.262685 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7279499}
W20260620 07:01:13.264885 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet af743ffd2eb2427caa3779c7fceb8f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af743ffd2eb2427caa3779c7fceb8f30 already in progress: creating tablet
I20260620 07:01:13.265851 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 510) took 7288 ms. Trace:
I20260620 07:01:13.266479 1166 rpcz_store.cc:276] 0620 07:01:05.977497 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.987157 (+ 9660us) service_pool.cc:227] Handling call
0620 07:01:13.265713 (+7278556us) ts_tablet_manager.cc:1145] Deleting tablet 4308d1a5bec34588844920fa89a5db26
0620 07:01:13.265727 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.265829 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7278374}
W20260620 07:01:13.267278 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4308d1a5bec34588844920fa89a5db26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4308d1a5bec34588844920fa89a5db26 already in progress: creating tablet
I20260620 07:01:13.267810 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 517) took 7289 ms. Trace:
I20260620 07:01:13.268232 1166 rpcz_store.cc:276] 0620 07:01:05.978257 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.993642 (+ 15385us) service_pool.cc:227] Handling call
0620 07:01:13.267693 (+7274051us) ts_tablet_manager.cc:1145] Deleting tablet 74eaa712962245b4bb14d17e4cdd8485
0620 07:01:13.267705 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.267793 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7273818}
I20260620 07:01:13.268850 1169 log.cc:1196] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/8088fadabff64c35aa96a1ede17318c3
I20260620 07:01:13.272786 2173 sys_catalog.cc:263] Verifying existing consensus state
I20260620 07:01:13.280723 2106 raft_consensus.cc:482] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.280910 2106 raft_consensus.cc:504] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.281613 2106 leader_election.cc:288] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.286135 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 62ef9a12e3684d27b6696f631c68a5af
I20260620 07:01:13.286666 426 catalog_manager.cc:6565] ReplaceTablet: tablet 62ef9a12e3684d27b6696f631c68a5af deleted and replaced by tablet 35feb5b4dbc34f5d88620bc1327d86e6
I20260620 07:01:13.287576 2106 raft_consensus.cc:482] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.287712 2106 raft_consensus.cc:504] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.288331 2106 leader_election.cc:288] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.289659 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 62ef9a12e3684d27b6696f631c68a5af with delete_type TABLET_DATA_DELETED (replaced by tablet 35feb5b4dbc34f5d88620bc1327d86e6) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.289757 1168 tablet_bootstrap.cc:492] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.289891 1168 ts_tablet_manager.cc:1397] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.003s
I20260620 07:01:13.290192 1165 tablet_replica.cc:330] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:13.290408 1165 raft_consensus.cc:2229] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:13.290711 1168 raft_consensus.cc:348] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.290989 1168 raft_consensus.cc:374] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.291042 1168 raft_consensus.cc:729] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.291230 1168 consensus_queue.cc:260] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.290709 1165 raft_consensus.cc:2258] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.291700 1168 ts_tablet_manager.cc:1428] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:13.291937 1168 tablet_bootstrap.cc:492] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.292037 1165 ts_tablet_manager.cc:1905] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.293821 1168 tablet_bootstrap.cc:654] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.298676 2106 raft_consensus.cc:482] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.298858 2106 raft_consensus.cc:504] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.299679 2106 leader_election.cc:288] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.300580 423 master_service.cc:946] ReplaceTablet: received request to replace tablet f4f77b677ab34d9b8554de0da6564fb1 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:13.304246 2173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: Bootstrap starting.
I20260620 07:01:13.320683 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:13.329301 1165 ts_tablet_manager.cc:1918] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:13.330051 1165 log.cc:1196] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/62ef9a12e3684d27b6696f631c68a5af
I20260620 07:01:13.287381 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27da98f96a2245c5b4210b7cf084886d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.289254 2130 raft_consensus.cc:482] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.289286 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ebdb3ef844adf82b99a6d3b6c61c2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.298875 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 62ef9a12e3684d27b6696f631c68a5af with delete_type TABLET_DATA_DELETED (replaced by tablet 35feb5b4dbc34f5d88620bc1327d86e6) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.300367 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e8cd4ec5619416a8983e1bc1b6b6a09" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.331404 2130 raft_consensus.cc:504] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.300853 1080 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:13.332130 1169 ts_tablet_manager.cc:1939] T 8088fadabff64c35aa96a1ede17318c3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:13.332171 2130 leader_election.cc:288] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:13.332794 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 524) took 7353 ms. Trace:
I20260620 07:01:13.332935 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5014cf5cc70466bafb6921c9d46ba72" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:13.332953 1166 rpcz_store.cc:276] 0620 07:01:05.979003 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:05.993757 (+ 14754us) service_pool.cc:227] Handling call
0620 07:01:13.332672 (+7338915us) ts_tablet_manager.cc:1145] Deleting tablet 91f8c4955c164e6b9061ac607bbe081c
0620 07:01:13.332685 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.332777 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7338761}
I20260620 07:01:13.333210 752 raft_consensus.cc:2454] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:13.333333 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 531) took 7353 ms. Trace:
I20260620 07:01:13.333405 1166 rpcz_store.cc:276] 0620 07:01:05.979663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.073938 (+ 94275us) service_pool.cc:227] Handling call
0620 07:01:13.333230 (+7259292us) ts_tablet_manager.cc:1145] Deleting tablet 26719543504847389de3c3102efcc9b2
0620 07:01:13.333241 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.333317 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7244594}
I20260620 07:01:13.333721 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 532) took 7353 ms. Trace:
I20260620 07:01:13.333727 968 leader_election.cc:302] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:13.334295 2130 raft_consensus.cc:2781] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:13.334398 2130 raft_consensus.cc:482] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:13.334478 2130 raft_consensus.cc:3037] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:13.334535 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 779) took 1031 ms. Trace:
I20260620 07:01:13.283507 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27da98f96a2245c5b4210b7cf084886d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:13.286985 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 62ef9a12e3684d27b6696f631c68a5af with delete_type TABLET_DATA_DELETED (replaced by tablet 35feb5b4dbc34f5d88620bc1327d86e6) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:13.335873 831 leader_election.cc:341] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:13.336350 830 leader_election.cc:341] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.336450 830 leader_election.cc:302] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:13.336814 830 leader_election.cc:341] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:13.337025 830 leader_election.cc:341] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.337332 2130 raft_consensus.cc:504] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:13.337581 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 74eaa712962245b4bb14d17e4cdd8485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74eaa712962245b4bb14d17e4cdd8485 already in progress: creating tablet
I20260620 07:01:13.289373 1920 raft_consensus.cc:686] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:13.291170 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ebdb3ef844adf82b99a6d3b6c61c2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:13.337896 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 91f8c4955c164e6b9061ac607bbe081c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91f8c4955c164e6b9061ac607bbe081c already in progress: creating tablet
I20260620 07:01:13.338162 1920 consensus_queue.cc:237] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:13.338347 831 leader_election.cc:341] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.338438 831 leader_election.cc:302] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:13.338558 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 26719543504847389de3c3102efcc9b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26719543504847389de3c3102efcc9b2 already in progress: creating tablet
W20260620 07:01:13.339015 969 leader_election.cc:341] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b5014cf5cc70466bafb6921c9d46ba72
I20260620 07:01:13.300175 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e8cd4ec5619416a8983e1bc1b6b6a09" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:13.300663 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:13.306432 1170 tablet_bootstrap.cc:492] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:13.339397 751 raft_consensus.cc:2454] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:13.339483 1170 ts_tablet_manager.cc:1397] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.112s user 0.002s sys 0.004s
I20260620 07:01:13.340157 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5014cf5cc70466bafb6921c9d46ba72" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:13.340327 751 raft_consensus.cc:3037] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:13.340270 1170 raft_consensus.cc:348] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.340508 1170 raft_consensus.cc:374] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.340562 1170 raft_consensus.cc:729] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.340786 1170 consensus_queue.cc:260] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.341089 2106 raft_consensus.cc:2726] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:13.341313 2106 raft_consensus.cc:2726] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:13.341375 1170 ts_tablet_manager.cc:1428] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:13.335886 1168 tablet_bootstrap.cc:492] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.341672 1170 tablet_bootstrap.cc:492] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:13.341691 1168 ts_tablet_manager.cc:1397] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.050s user 0.023s sys 0.002s
I20260620 07:01:13.331204 1167 tablet_bootstrap.cc:492] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:13.342005 1167 ts_tablet_manager.cc:1397] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.127s user 0.006s sys 0.000s
I20260620 07:01:13.342332 1165 ts_tablet_manager.cc:1939] T 62ef9a12e3684d27b6696f631c68a5af P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:13.343515 1170 tablet_bootstrap.cc:654] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.343647 1168 raft_consensus.cc:348] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.344317 1168 raft_consensus.cc:374] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.344388 1168 raft_consensus.cc:729] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.345546 1167 raft_consensus.cc:348] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.345849 1167 raft_consensus.cc:374] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.345920 1167 raft_consensus.cc:729] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.347754 751 raft_consensus.cc:2454] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:13.348683 1080 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:13.349146 968 leader_election.cc:302] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:13.349406 1989 raft_consensus.cc:2781] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:13.349496 1989 raft_consensus.cc:686] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:13.349684 1989 consensus_queue.cc:237] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.334640 1169 rpcz_store.cc:276] 0620 07:01:12.303035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.304115 (+ 1080us) service_pool.cc:227] Handling call
0620 07:01:13.231766 (+927651us) ts_tablet_manager.cc:1145] Deleting tablet 8088fadabff64c35aa96a1ede17318c3
0620 07:01:13.231776 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.250850 (+ 19074us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.261892 (+ 11042us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.334515 (+ 72623us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":927478}
I20260620 07:01:13.352407 1169 tablet_replica.cc:330] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:13.352598 1169 raft_consensus.cc:2229] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.352602 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 8088fadabff64c35aa96a1ede17318c3 (table default.Table_2aa5bfb35aed447f8788be438410abc7 [id=cce39caa12524890aa7c670b5d0aa8af]) successfully deleted
I20260620 07:01:13.352738 1169 raft_consensus.cc:2258] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.353365 1169 ts_tablet_manager.cc:1905] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.354220 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_44d2bbefe6b14ed29a35f1c1b6a3a9d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.355168 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44d2bbefe6b14ed29a35f1c1b6a3a9d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.333812 1166 rpcz_store.cc:276] 0620 07:01:05.979745 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.088667 (+108922us) service_pool.cc:227] Handling call
0620 07:01:13.333626 (+7244959us) ts_tablet_manager.cc:1145] Deleting tablet 5d69ca4ae7434ca5b647e9135b5108ee
0620 07:01:13.333636 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.333707 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7227322}
W20260620 07:01:13.356199 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5d69ca4ae7434ca5b647e9135b5108ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d69ca4ae7434ca5b647e9135b5108ee already in progress: creating tablet
I20260620 07:01:13.357002 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f6260fcb4d6a4889a69e4d7a2538d20c" } modify_external_catalogs: true
I20260620 07:01:13.357241 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f6260fcb4d6a4889a69e4d7a2538d20c" } modify_external_catalogs: true
I20260620 07:01:13.358150 2130 leader_election.cc:288] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:13.359202 969 leader_election.cc:341] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b5014cf5cc70466bafb6921c9d46ba72
I20260620 07:01:13.360368 1167 consensus_queue.cc:260] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.361313 1167 ts_tablet_manager.cc:1428] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260620 07:01:13.361982 1168 consensus_queue.cc:260] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.362653 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 533) took 7382 ms. Trace:
I20260620 07:01:13.362747 1166 rpcz_store.cc:276] 0620 07:01:05.979855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.106339 (+126484us) service_pool.cc:227] Handling call
0620 07:01:13.356977 (+7250638us) ts_tablet_manager.cc:1145] Deleting tablet 94e5ddcaf596455289fab50876c27dce
0620 07:01:13.356993 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.362633 (+ 5640us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7250306}
I20260620 07:01:13.363170 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 534) took 7383 ms. Trace:
I20260620 07:01:13.363248 1166 rpcz_store.cc:276] 0620 07:01:05.979967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.106715 (+126748us) service_pool.cc:227] Handling call
0620 07:01:13.363074 (+7256359us) ts_tablet_manager.cc:1145] Deleting tablet d4988c5cbb3a4818bc024da7472b96ff
0620 07:01:13.363085 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.363157 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7256005}
W20260620 07:01:13.363318 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 94e5ddcaf596455289fab50876c27dce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94e5ddcaf596455289fab50876c27dce already in progress: creating tablet
I20260620 07:01:13.363540 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 535) took 7383 ms. Trace:
I20260620 07:01:13.363617 1166 rpcz_store.cc:276] 0620 07:01:05.980042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.107167 (+127125us) service_pool.cc:227] Handling call
0620 07:01:13.363448 (+7256281us) ts_tablet_manager.cc:1145] Deleting tablet f591ba26b91b47f9a8933878d478655d
0620 07:01:13.363456 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.363528 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7255987}
W20260620 07:01:13.363833 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d4988c5cbb3a4818bc024da7472b96ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4988c5cbb3a4818bc024da7472b96ff already in progress: creating tablet
I20260620 07:01:13.363943 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 536) took 7383 ms. Trace:
I20260620 07:01:13.364022 1166 rpcz_store.cc:276] 0620 07:01:05.980125 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.107507 (+127382us) service_pool.cc:227] Handling call
0620 07:01:13.363839 (+7256332us) ts_tablet_manager.cc:1145] Deleting tablet 5208f3136bcd45579de49b8b10745122
0620 07:01:13.363862 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.363930 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7256033}
I20260620 07:01:13.364331 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 539) took 7234 ms. Trace:
W20260620 07:01:13.364348 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f591ba26b91b47f9a8933878d478655d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f591ba26b91b47f9a8933878d478655d already in progress: creating tablet
I20260620 07:01:13.364410 1166 rpcz_store.cc:276] 0620 07:01:06.130268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.141101 (+ 10833us) service_pool.cc:227] Handling call
0620 07:01:13.364247 (+7223146us) ts_tablet_manager.cc:1145] Deleting tablet b8e2d451eb1f48ff81828d7070a20027
0620 07:01:13.364257 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.364316 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7216739}
I20260620 07:01:13.364689 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 543) took 6784 ms. Trace:
I20260620 07:01:13.364753 1166 rpcz_store.cc:276] 0620 07:01:06.580221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.580402 (+ 181us) service_pool.cc:227] Handling call
0620 07:01:13.364600 (+6784198us) ts_tablet_manager.cc:1145] Deleting tablet c9ad0680f1da4504b87d9d0d6bcbabcb
0620 07:01:13.364609 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.364678 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6783993}
I20260620 07:01:13.365002 1166 tablet_replica.cc:330] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:13.365193 1166 raft_consensus.cc:2229] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:13.365413 1166 pending_rounds.cc:62] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
W20260620 07:01:13.365469 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c9ad0680f1da4504b87d9d0d6bcbabcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9ad0680f1da4504b87d9d0d6bcbabcb already in progress: creating tablet
I20260620 07:01:13.365468 1166 pending_rounds.cc:68] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821623427493888 op_type: NO_OP noop_request { }
I20260620 07:01:13.365574 1166 raft_consensus.cc:2866] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:13.365648 1166 raft_consensus.cc:2258] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.372926 1168 ts_tablet_manager.cc:1428] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20260620 07:01:13.373399 1168 tablet_bootstrap.cc:492] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.375686 424 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 34dc2af503684aaba8388a4611fab48e (table default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9]). Expected version 1 got 0
I20260620 07:01:13.376022 424 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 1c64df83a18a470c98a9c1fd6bb38918 (table default.Table_0317c7d3f556484385f6af21f10cbc97 [id=4896f23e711941b988db4ea9f22ce625]). Expected version 4 got 0
I20260620 07:01:13.376506 424 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 5a4390225af348f89c934f0f179ddab5 (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]). Expected version 1 got 0
I20260620 07:01:13.376789 424 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]). Expected version 3 got 0
I20260620 07:01:13.377084 2158 consensus_queue.cc:1035] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:13.377614 425 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_13403c45f0a94678999f62954a653d5f [id=9b7cbb1400d7413ca5debb997aeade9c] alter complete (version 3)
I20260620 07:01:13.377708 2158 raft_consensus.cc:482] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.377820 2158 raft_consensus.cc:504] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.378294 2158 leader_election.cc:288] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.379683 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8bc65d975d544ad5b8dfc8aea392bc27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:13.380039 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a46df2909bf43f297b412c33f18a329" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.381208 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.381587 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet cfff2a14b1184d39bd7ac1091ef749c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.397961 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_25928fd276674c5e968f012013d868b6" } new_table_name: "default.Table_a7bc0f9c571046cc89d97876e34d23cd" modify_external_catalogs: true
I20260620 07:01:13.406548 1169 ts_tablet_manager.cc:1918] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.407888 1169 log.cc:1196] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/b4ee5c79e2a6419ea3847cbebdeced79
W20260620 07:01:13.415895 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bc65d975d544ad5b8dfc8aea392bc27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.418596 1169 ts_tablet_manager.cc:1939] T b4ee5c79e2a6419ea3847cbebdeced79 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:13.419515 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 168fb1666e2c41358213240d34ef9572 with delete_type TABLET_DATA_DELETED (replaced by tablet 8dad7e6437ab4328b9b88d5e6febe8a0) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.419548 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a46df2909bf43f297b412c33f18a329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.419741 721 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e08a38c42d4e3da20292343bf085b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.419899 727 tablet_service.cc:1514] Processing DeleteTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.435801 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 780) took 1132 ms. Trace:
I20260620 07:01:13.435918 1169 rpcz_store.cc:276] 0620 07:01:12.303180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.304323 (+ 1143us) service_pool.cc:227] Handling call
0620 07:01:13.352352 (+1048029us) ts_tablet_manager.cc:1145] Deleting tablet b4ee5c79e2a6419ea3847cbebdeced79
0620 07:01:13.352367 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.378816 (+ 26449us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.405258 (+ 26442us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.435774 (+ 30516us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1047881}
I20260620 07:01:13.436347 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet b4ee5c79e2a6419ea3847cbebdeced79 (table default.Table_34eaeb05ad0243cb9f083eb279a8ba73 [id=5a23c89228964939bd74b5079dd25881]) successfully deleted
I20260620 07:01:13.436622 1169 tablet_replica.cc:330] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:13.436934 1169 raft_consensus.cc:2229] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.437083 1169 raft_consensus.cc:2258] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.437563 1169 ts_tablet_manager.cc:1905] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.437849 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 27da98f96a2245c5b4210b7cf084886d (table default.Table_cf36f7d3d2ac457e8097e25c5b39730b [id=6d5b03179de540539513cab6cd39da39]). Expected version 1 got 0
I20260620 07:01:13.438223 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 96453f82ff3048beabeb188fb27dee42 (table default.Table_7e1bd0d27961486986559381614efd38 [id=7c6337d452d64674bd95e1738caa4345]). Expected version 2 got 0
I20260620 07:01:13.438530 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet cf0bae39e1634710af12de493f7f58d5 (table default.Table_dd975c3c465e439db363c170ba3e4147 [id=c5d6638ed0bf48e1b8339e21c50f9a0a]). Expected version 1 got 0
I20260620 07:01:13.454829 1166 ts_tablet_manager.cc:1905] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.465080 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5f04603a2fe84988ac9c9975e94ce9ae
I20260620 07:01:13.465669 421 catalog_manager.cc:6565] ReplaceTablet: tablet 5f04603a2fe84988ac9c9975e94ce9ae deleted and replaced by tablet 354937ee58ca4970b9ac211a369f1030
I20260620 07:01:13.470109 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 64addb9379b247dfa678e2a0ae1af0cf
I20260620 07:01:13.474994 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b40e1ea4d1c74be2906381064c73f8c5
I20260620 07:01:13.476853 724 tablet_service.cc:1514] Processing DeleteTablet for tablet b40e1ea4d1c74be2906381064c73f8c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.479696 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f4f77b677ab34d9b8554de0da6564fb1
I20260620 07:01:13.480217 423 catalog_manager.cc:6565] ReplaceTablet: tablet f4f77b677ab34d9b8554de0da6564fb1 deleted and replaced by tablet 9a8a5da81fac4c17ac60d4c87f844f8f
I20260620 07:01:13.481473 724 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f77b677ab34d9b8554de0da6564fb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a8a5da81fac4c17ac60d4c87f844f8f) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.483256 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 64addb9379b247dfa678e2a0ae1af0cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.483700 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f04603a2fe84988ac9c9975e94ce9ae with delete_type TABLET_DATA_DELETED (replaced by tablet 354937ee58ca4970b9ac211a369f1030) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.484470 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 5a4390225af348f89c934f0f179ddab5 (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]). Expected version 1 got 0
I20260620 07:01:13.484877 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 96453f82ff3048beabeb188fb27dee42 (table default.Table_7e1bd0d27961486986559381614efd38 [id=7c6337d452d64674bd95e1738caa4345]). Expected version 2 got 0
I20260620 07:01:13.486483 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ff68e2419ecb4968bd4e87c0a1d30b8b" } new_table_name: "default.Table_6040d82ea52842d4b13f03833c939b36" modify_external_catalogs: true
I20260620 07:01:13.489266 1169 ts_tablet_manager.cc:1918] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.489390 1169 log.cc:1196] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/b5014cf5cc70466bafb6921c9d46ba72
I20260620 07:01:13.489688 1169 ts_tablet_manager.cc:1939] T b5014cf5cc70466bafb6921c9d46ba72 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:13.490398 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 781) took 1187 ms. Trace:
I20260620 07:01:13.490500 1169 rpcz_store.cc:276] 0620 07:01:12.303278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.304494 (+ 1216us) service_pool.cc:227] Handling call
0620 07:01:13.436579 (+1132085us) ts_tablet_manager.cc:1145] Deleting tablet b5014cf5cc70466bafb6921c9d46ba72
0620 07:01:13.436590 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.440707 (+ 4117us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.489075 (+ 48368us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.490379 (+ 1304us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1131957}
I20260620 07:01:13.490938 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet b5014cf5cc70466bafb6921c9d46ba72 (table default.Table_833694b1c9684acb97bca68ebefecb45 [id=0d5d9534e45441a290f21fca41209793]) successfully deleted
I20260620 07:01:13.491297 1166 ts_tablet_manager.cc:1918] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:13.491421 1166 log.cc:1196] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/8088fadabff64c35aa96a1ede17318c3
I20260620 07:01:13.491750 1166 ts_tablet_manager.cc:1939] T 8088fadabff64c35aa96a1ede17318c3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:13.492501 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 544) took 6912 ms. Trace:
I20260620 07:01:13.492584 1166 rpcz_store.cc:276] 0620 07:01:06.580358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.581005 (+ 647us) service_pool.cc:227] Handling call
0620 07:01:13.364967 (+6783962us) ts_tablet_manager.cc:1145] Deleting tablet 8088fadabff64c35aa96a1ede17318c3
0620 07:01:13.364976 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.468330 (+103354us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.491190 (+ 22860us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.492482 (+ 1292us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6783754}
I20260620 07:01:13.493659 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 782) took 1190 ms. Trace:
I20260620 07:01:13.493737 1169 rpcz_store.cc:276] 0620 07:01:12.303354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.304651 (+ 1297us) service_pool.cc:227] Handling call
0620 07:01:13.493557 (+1188906us) ts_tablet_manager.cc:1145] Deleting tablet 46689d13712842bf9145ad2bc3fc2acf
0620 07:01:13.493570 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.493642 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1188755}
I20260620 07:01:13.494261 1169 tablet_replica.cc:330] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:13.494473 1169 raft_consensus.cc:2229] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:13.494652 1169 raft_consensus.cc:2258] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.495014 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 545) took 6913 ms. Trace:
I20260620 07:01:13.495106 1166 rpcz_store.cc:276] 0620 07:01:06.581377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.581574 (+ 197us) service_pool.cc:227] Handling call
0620 07:01:13.494896 (+6913322us) ts_tablet_manager.cc:1145] Deleting tablet 366d713325f84c8b9b1c1f4296513a20
0620 07:01:13.494907 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.494997 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6913151}
I20260620 07:01:13.496286 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 546) took 6914 ms. Trace:
I20260620 07:01:13.496387 1166 rpcz_store.cc:276] 0620 07:01:06.581875 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.582203 (+ 328us) service_pool.cc:227] Handling call
0620 07:01:13.496189 (+6913986us) ts_tablet_manager.cc:1145] Deleting tablet 09886cbd967549118d3b1ba116f7834f
0620 07:01:13.496199 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.496272 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6913782}
I20260620 07:01:13.496699 1169 ts_tablet_manager.cc:1905] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.497368 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 547) took 6914 ms. Trace:
I20260620 07:01:13.497465 1166 rpcz_store.cc:276] 0620 07:01:06.582548 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.582725 (+ 177us) service_pool.cc:227] Handling call
0620 07:01:13.497271 (+6914546us) ts_tablet_manager.cc:1145] Deleting tablet 0efec7113a5b44f296e756dde466b82f
0620 07:01:13.497280 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.497354 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6914327}
I20260620 07:01:13.498643 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f04603a2fe84988ac9c9975e94ce9ae with delete_type TABLET_DATA_DELETED (replaced by tablet 354937ee58ca4970b9ac211a369f1030) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.498868 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f77b677ab34d9b8554de0da6564fb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a8a5da81fac4c17ac60d4c87f844f8f) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.499001 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet b40e1ea4d1c74be2906381064c73f8c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.498823 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 64addb9379b247dfa678e2a0ae1af0cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.504948 1169 ts_tablet_manager.cc:1918] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:13.505069 1169 log.cc:1196] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f690e150839a4d23860932712f61e7c8
I20260620 07:01:13.505416 1169 ts_tablet_manager.cc:1939] T f690e150839a4d23860932712f61e7c8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:13.506135 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 783) took 1202 ms. Trace:
I20260620 07:01:13.506230 1169 rpcz_store.cc:276] 0620 07:01:12.303428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.304825 (+ 1397us) service_pool.cc:227] Handling call
0620 07:01:13.494219 (+1189394us) ts_tablet_manager.cc:1145] Deleting tablet f690e150839a4d23860932712f61e7c8
0620 07:01:13.494229 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.501798 (+ 7569us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.504855 (+ 3057us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.506116 (+ 1261us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189274}
W20260620 07:01:13.507520 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 46689d13712842bf9145ad2bc3fc2acf because the tablet was not found. No further retry: Not found: Tablet not found: 46689d13712842bf9145ad2bc3fc2acf
I20260620 07:01:13.508121 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f690e150839a4d23860932712f61e7c8 (table default.Table_52bd8cf613ad458b8436906e69e4cbd8 [id=72036a5a731244a4a1f797ec8663aef8]) successfully deleted
I20260620 07:01:13.506845 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 548) took 6923 ms. Trace:
I20260620 07:01:13.511281 1166 rpcz_store.cc:276] 0620 07:01:06.583077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.583248 (+ 171us) service_pool.cc:227] Handling call
0620 07:01:13.506694 (+6923446us) ts_tablet_manager.cc:1145] Deleting tablet 40c9d2d029434f37ba23d65f6662893b
0620 07:01:13.506707 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.506823 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6923225}
I20260620 07:01:13.511888 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 551) took 6927 ms. Trace:
I20260620 07:01:13.512071 1166 rpcz_store.cc:276] 0620 07:01:06.584765 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.585594 (+ 829us) service_pool.cc:227] Handling call
0620 07:01:13.511769 (+6926175us) ts_tablet_manager.cc:1145] Deleting tablet d3823954542a4928a99c1602c4f01ee2
0620 07:01:13.511780 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.511871 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6846595}
I20260620 07:01:13.512610 1166 tablet_replica.cc:330] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:13.512844 1166 raft_consensus.cc:2229] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.513044 1166 raft_consensus.cc:2258] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.513806 1166 ts_tablet_manager.cc:1905] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.517321 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet cf978ab301954866aeb77b7abaf2c77e
I20260620 07:01:13.518748 727 tablet_service.cc:1514] Processing DeleteTablet for tablet cf978ab301954866aeb77b7abaf2c77e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.521695 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 8088fadabff64c35aa96a1ede17318c3 (table default.Table_2aa5bfb35aed447f8788be438410abc7 [id=cce39caa12524890aa7c670b5d0aa8af]) successfully deleted
I20260620 07:01:13.522235 2130 consensus_queue.cc:1035] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:13.523123 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3f4ce8cf64704cde86845513a33699a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.523921 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f4ce8cf64704cde86845513a33699a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.524677 1166 ts_tablet_manager.cc:1918] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.524786 1166 log.cc:1196] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/7fc63351f767447c99b819fe7848d381
I20260620 07:01:13.525127 1166 ts_tablet_manager.cc:1939] T 7fc63351f767447c99b819fe7848d381 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:13.526800 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:13.527100 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 788) took 1175 ms. Trace:
I20260620 07:01:13.527191 1169 rpcz_store.cc:276] 0620 07:01:12.351553 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.351864 (+ 311us) service_pool.cc:227] Handling call
0620 07:01:13.526977 (+1175113us) ts_tablet_manager.cc:1145] Deleting tablet b1aed58dc714451b94fc9a6c14b7d734
0620 07:01:13.526988 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.527082 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1174874}
I20260620 07:01:13.527799 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 789) took 1176 ms. Trace:
I20260620 07:01:13.527879 1169 rpcz_store.cc:276] 0620 07:01:12.351685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.352165 (+ 480us) service_pool.cc:227] Handling call
0620 07:01:13.527699 (+1175534us) ts_tablet_manager.cc:1145] Deleting tablet 20fc99f79e7b4df2b74a79468656b6ab
0620 07:01:13.527709 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.527784 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1175363}
I20260620 07:01:13.528268 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 790) took 1176 ms. Trace:
I20260620 07:01:13.528357 1169 rpcz_store.cc:276] 0620 07:01:12.351815 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.373625 (+ 21810us) service_pool.cc:227] Handling call
0620 07:01:13.528177 (+1154552us) ts_tablet_manager.cc:1145] Deleting tablet 39504144a623423c873ded7d6839367a
0620 07:01:13.528189 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.528255 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154358}
I20260620 07:01:13.528748 1169 tablet_replica.cc:330] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:13.528963 1169 raft_consensus.cc:2229] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:13.529186 1169 pending_rounds.cc:62] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:13.529237 1169 pending_rounds.cc:68] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821624078393344 op_type: NO_OP noop_request { }
I20260620 07:01:13.529368 1169 raft_consensus.cc:2866] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:13.529709 1169 raft_consensus.cc:2258] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.529578 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 556) took 6660 ms. Trace:
I20260620 07:01:13.530073 1166 rpcz_store.cc:276] 0620 07:01:06.869233 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.869296 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:13.512567 (+6643271us) ts_tablet_manager.cc:1145] Deleting tablet 7fc63351f767447c99b819fe7848d381
0620 07:01:13.512578 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.516990 (+ 4412us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.524568 (+ 7578us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.529551 (+ 4983us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6638348}
I20260620 07:01:13.531561 1169 ts_tablet_manager.cc:1905] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.531971 1166 tablet_replica.cc:330] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:13.527380 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7
I20260620 07:01:13.532215 1166 raft_consensus.cc:2229] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.533192 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_58581d650c544165bfe1d9b23cb0af2a" } new_table_name: "default.Table_078c21840d2f416da60744754f4b25b2" modify_external_catalogs: true
I20260620 07:01:13.533515 1166 raft_consensus.cc:2258] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.534154 1166 ts_tablet_manager.cc:1905] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:13.535080 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1083593cd8d4852a8e3a4a7c9180778 consensus state has no leader
I20260620 07:01:13.535717 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4c854ad3f6644658bc1f28a9655a94a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.538581 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c854ad3f6644658bc1f28a9655a94a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.540832 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2c0d1cfae0064292a4b21ec4f3e28be8" } new_table_name: "default.Table_bad00db5e978459b99678e894e6859fb" modify_external_catalogs: true
I20260620 07:01:13.541417 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d3f33f9c70c74d9a9a03f81497ba6bf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.542337 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3f33f9c70c74d9a9a03f81497ba6bf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:13.542671 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 366d713325f84c8b9b1c1f4296513a20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 366d713325f84c8b9b1c1f4296513a20 already in progress: creating tablet
W20260620 07:01:13.543179 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 09886cbd967549118d3b1ba116f7834f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09886cbd967549118d3b1ba116f7834f already in progress: creating tablet
W20260620 07:01:13.543607 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0efec7113a5b44f296e756dde466b82f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0efec7113a5b44f296e756dde466b82f already in progress: creating tablet
W20260620 07:01:13.543944 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 40c9d2d029434f37ba23d65f6662893b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40c9d2d029434f37ba23d65f6662893b already in progress: creating tablet
W20260620 07:01:13.544135 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b1aed58dc714451b94fc9a6c14b7d734 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1aed58dc714451b94fc9a6c14b7d734 already in progress: creating tablet
W20260620 07:01:13.544401 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 20fc99f79e7b4df2b74a79468656b6ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20fc99f79e7b4df2b74a79468656b6ab already in progress: creating tablet
W20260620 07:01:13.544632 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 39504144a623423c873ded7d6839367a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39504144a623423c873ded7d6839367a already in progress: creating tablet
I20260620 07:01:13.545554 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:13.546108 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d3823954542a4928a99c1602c4f01ee2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3823954542a4928a99c1602c4f01ee2 already in progress: creating tablet
I20260620 07:01:13.546335 1166 ts_tablet_manager.cc:1918] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.546701 1169 ts_tablet_manager.cc:1918] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:13.546886 1169 log.cc:1196] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f8ec1e179a704e5480f3deaf856156e7
I20260620 07:01:13.547015 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 7fc63351f767447c99b819fe7848d381 (table default.Table_e84e884648ed447c91e20b4a2be65197 [id=38f5978d6a7945c9aec7b78d789241ce]) successfully deleted
I20260620 07:01:13.547288 1169 ts_tablet_manager.cc:1939] T f8ec1e179a704e5480f3deaf856156e7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:13.547601 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 791) took 1173 ms. Trace:
I20260620 07:01:13.547706 1169 rpcz_store.cc:276] 0620 07:01:12.374075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.374123 (+ 48us) service_pool.cc:227] Handling call
0620 07:01:13.528707 (+1154584us) ts_tablet_manager.cc:1145] Deleting tablet f8ec1e179a704e5480f3deaf856156e7
0620 07:01:13.528716 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.537442 (+ 8726us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.546614 (+ 9172us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.547587 (+ 973us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154421}
I20260620 07:01:13.548280 1166 log.cc:1196] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/3c2f865b06ca4b9c8fc9d8d0b4aa0dad
I20260620 07:01:13.548592 1166 ts_tablet_manager.cc:1939] T 3c2f865b06ca4b9c8fc9d8d0b4aa0dad P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:13.549316 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 557) took 6669 ms. Trace:
I20260620 07:01:13.551365 1169 tablet_replica.cc:330] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:13.551697 1169 raft_consensus.cc:2229] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.551842 1169 pending_rounds.cc:62] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:13.551879 1169 pending_rounds.cc:68] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821622294765568 op_type: NO_OP noop_request { }
I20260620 07:01:13.551994 1169 raft_consensus.cc:2866] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:13.552088 1169 raft_consensus.cc:2258] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.552233 1166 rpcz_store.cc:276] 0620 07:01:06.880313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.880368 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:13.531924 (+6651556us) ts_tablet_manager.cc:1145] Deleting tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad
0620 07:01:13.531937 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.543163 (+ 11226us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.546227 (+ 3064us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.549289 (+ 3062us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6647292}
I20260620 07:01:13.552722 1166 tablet_replica.cc:330] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:13.552923 1166 raft_consensus.cc:2229] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.553090 1166 raft_consensus.cc:2258] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.553637 1169 ts_tablet_manager.cc:1905] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.554206 1166 ts_tablet_manager.cc:1905] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.548133 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f8ec1e179a704e5480f3deaf856156e7 (table default.Table_09cc34c1ecf8432980b9247bf2be1e8d [id=0597dd0aeaa9466b8804375281de13b6]) successfully deleted
I20260620 07:01:13.556125 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet cf978ab301954866aeb77b7abaf2c77e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:13.557403 968 consensus_peers.cc:487] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:13.558120 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.558684 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 3c2f865b06ca4b9c8fc9d8d0b4aa0dad (table default.Table_b043963ee56e4494be5b5a95ea01d158 [id=1aa84262b2da494d8f47bd49a6348733]) successfully deleted
W20260620 07:01:13.559747 969 consensus_peers.cc:487] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfff2a14b1184d39bd7ac1091ef749c9. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:13.532014 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:13.532083 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_55ba5d893268477bb780b81c97f3440e" } new_table_name: "default.Table_f685512372ee4f2b8b1d318cba1b4ef1" modify_external_catalogs: true
I20260620 07:01:13.563741 421 catalog_manager.cc:5495] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:13.565076 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 34dc2af503684aaba8388a4611fab48e (table default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9]). Expected version 1 got 0
I20260620 07:01:13.565764 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 96453f82ff3048beabeb188fb27dee42 (table default.Table_7e1bd0d27961486986559381614efd38 [id=7c6337d452d64674bd95e1738caa4345]). Expected version 2 got 0
I20260620 07:01:13.566335 421 catalog_manager.cc:5495] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:13.567071 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 5a4390225af348f89c934f0f179ddab5 (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]). Expected version 1 got 0
I20260620 07:01:13.575013 1166 ts_tablet_manager.cc:1918] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:13.576346 1166 log.cc:1196] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/3f53f0302d1a4fb3a0fe3e1d98583550
I20260620 07:01:13.576830 1166 ts_tablet_manager.cc:1939] T 3f53f0302d1a4fb3a0fe3e1d98583550 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:13.577215 1169 ts_tablet_manager.cc:1918] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:13.578094 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 558) took 6690 ms. Trace:
I20260620 07:01:13.578280 1169 log.cc:1196] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/cfff2a14b1184d39bd7ac1091ef749c9
I20260620 07:01:13.578707 1169 ts_tablet_manager.cc:1939] T cfff2a14b1184d39bd7ac1091ef749c9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:13.579576 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 792) took 1205 ms. Trace:
I20260620 07:01:13.579731 1166 rpcz_store.cc:276] 0620 07:01:06.888076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.888137 (+ 61us) service_pool.cc:227] Handling call
0620 07:01:13.552676 (+6664539us) ts_tablet_manager.cc:1145] Deleting tablet 3f53f0302d1a4fb3a0fe3e1d98583550
0620 07:01:13.552689 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.557760 (+ 5071us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.574893 (+ 17133us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.578073 (+ 3180us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6663114}
I20260620 07:01:13.580713 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 559) took 6667 ms. Trace:
I20260620 07:01:13.580862 1169 rpcz_store.cc:276] 0620 07:01:12.374406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.374446 (+ 40us) service_pool.cc:227] Handling call
0620 07:01:13.551299 (+1176853us) ts_tablet_manager.cc:1145] Deleting tablet cfff2a14b1184d39bd7ac1091ef749c9
0620 07:01:13.551323 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.562171 (+ 10848us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.577106 (+ 14935us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.579553 (+ 2447us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1176718}
I20260620 07:01:13.581147 1166 rpcz_store.cc:276] 0620 07:01:06.913217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:06.913272 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:13.580571 (+6667299us) ts_tablet_manager.cc:1145] Deleting tablet f5072c573ce54477881cafb63e18b030
0620 07:01:13.580585 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.580695 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6662602}
I20260620 07:01:13.581945 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 575) took 6237 ms. Trace:
I20260620 07:01:13.582208 1169 tablet_replica.cc:330] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:13.582450 1169 raft_consensus.cc:2229] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.582574 1166 rpcz_store.cc:276] 0620 07:01:07.344450 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.344495 (+ 45us) service_pool.cc:227] Handling call
0620 07:01:13.581816 (+6237321us) ts_tablet_manager.cc:1145] Deleting tablet 030b90899c3c4c7e82807a61234f223e
0620 07:01:13.581828 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.581929 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6237082}
I20260620 07:01:13.583065 1169 raft_consensus.cc:2258] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.583539 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 576) took 6238 ms. Trace:
I20260620 07:01:13.584203 1169 ts_tablet_manager.cc:1905] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.584334 1166 rpcz_store.cc:276] 0620 07:01:07.344863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.344902 (+ 39us) service_pool.cc:227] Handling call
0620 07:01:13.583420 (+6238518us) ts_tablet_manager.cc:1145] Deleting tablet 602f6d47f23e4d7f80f372a6a507d095
0620 07:01:13.583431 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.583520 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6238353}
I20260620 07:01:13.584926 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 577) took 6239 ms. Trace:
I20260620 07:01:13.585062 1166 rpcz_store.cc:276] 0620 07:01:07.345196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.345361 (+ 165us) service_pool.cc:227] Handling call
0620 07:01:13.584814 (+6239453us) ts_tablet_manager.cc:1145] Deleting tablet 08ec769f903c4438bc1186d5fc1c5108
0620 07:01:13.584825 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.584912 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6239235}
I20260620 07:01:13.587167 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 579) took 6202 ms. Trace:
I20260620 07:01:13.587328 1166 rpcz_store.cc:276] 0620 07:01:07.384420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.384509 (+ 89us) service_pool.cc:227] Handling call
0620 07:01:13.586027 (+6201518us) ts_tablet_manager.cc:1145] Deleting tablet 3d9da1b03aae4cd9976109291ea43b4e
0620 07:01:13.587050 (+ 1023us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.587150 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6191199}
I20260620 07:01:13.592044 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 578) took 6219 ms. Trace:
I20260620 07:01:13.592239 1166 rpcz_store.cc:276] 0620 07:01:07.373057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.373395 (+ 338us) service_pool.cc:227] Handling call
0620 07:01:13.587762 (+6214367us) ts_tablet_manager.cc:1145] Deleting tablet 18d08c30bf7e4c04b01368b9b4a6273c
0620 07:01:13.591870 (+ 4108us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.592017 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6180706}
I20260620 07:01:13.592844 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 580) took 6163 ms. Trace:
I20260620 07:01:13.593057 1166 rpcz_store.cc:276] 0620 07:01:07.429911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.434954 (+ 5043us) service_pool.cc:227] Handling call
0620 07:01:13.592737 (+6157783us) ts_tablet_manager.cc:1145] Deleting tablet 1d09745353ef46b9b68397f48f391bcd
0620 07:01:13.592747 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.592829 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6130469}
I20260620 07:01:13.593493 1166 tablet_replica.cc:330] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:13.593731 1166 raft_consensus.cc:2229] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.593932 1166 raft_consensus.cc:2258] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.594519 1166 ts_tablet_manager.cc:1905] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.580349 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 3f53f0302d1a4fb3a0fe3e1d98583550 (table default.Table_1b34f21beb944ba6a991b5bf4a8acecd [id=bce36d2915e7478ebbfcf02633f64563]) successfully deleted
W20260620 07:01:13.599399 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f5072c573ce54477881cafb63e18b030 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5072c573ce54477881cafb63e18b030 already in progress: creating tablet
W20260620 07:01:13.599690 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 030b90899c3c4c7e82807a61234f223e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 030b90899c3c4c7e82807a61234f223e already in progress: creating tablet
W20260620 07:01:13.599973 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 602f6d47f23e4d7f80f372a6a507d095 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 602f6d47f23e4d7f80f372a6a507d095 already in progress: creating tablet
W20260620 07:01:13.600198 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 08ec769f903c4438bc1186d5fc1c5108 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08ec769f903c4438bc1186d5fc1c5108 already in progress: creating tablet
W20260620 07:01:13.600425 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3d9da1b03aae4cd9976109291ea43b4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d9da1b03aae4cd9976109291ea43b4e already in progress: creating tablet
W20260620 07:01:13.600657 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 18d08c30bf7e4c04b01368b9b4a6273c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18d08c30bf7e4c04b01368b9b4a6273c already in progress: creating tablet
W20260620 07:01:13.600891 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1d09745353ef46b9b68397f48f391bcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d09745353ef46b9b68397f48f391bcd already in progress: creating tablet
I20260620 07:01:13.582059 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet cfff2a14b1184d39bd7ac1091ef749c9 (table default.Table_625f2cf95ae74282910b8556035bc856 [id=dfd2898601854be0ba91e18aca844d9f]) successfully deleted
I20260620 07:01:13.602890 1169 ts_tablet_manager.cc:1918] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:13.603024 1169 log.cc:1196] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ba907170f2df4bd0b5e42d4c2d29b21e
I20260620 07:01:13.603495 1169 ts_tablet_manager.cc:1939] T ba907170f2df4bd0b5e42d4c2d29b21e P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:13.604385 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 793) took 1229 ms. Trace:
I20260620 07:01:13.604518 1169 rpcz_store.cc:276] 0620 07:01:12.374707 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.374743 (+ 36us) service_pool.cc:227] Handling call
0620 07:01:13.582159 (+1207416us) ts_tablet_manager.cc:1145] Deleting tablet ba907170f2df4bd0b5e42d4c2d29b21e
0620 07:01:13.582173 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.589853 (+ 7680us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.602744 (+ 12891us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.604362 (+ 1618us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1207242}
I20260620 07:01:13.604939 1166 ts_tablet_manager.cc:1918] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.605429 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ba907170f2df4bd0b5e42d4c2d29b21e (table default.Table_155f286726eb4befbc18214b304e1db8 [id=156f143b869542dbac1e92fd120f0f36]) successfully deleted
I20260620 07:01:13.605823 1169 tablet_replica.cc:330] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:13.605985 1166 log.cc:1196] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/168fb1666e2c41358213240d34ef9572
I20260620 07:01:13.606422 1166 ts_tablet_manager.cc:1939] T 168fb1666e2c41358213240d34ef9572 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:13.606678 1169 raft_consensus.cc:2229] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.606935 1169 raft_consensus.cc:2258] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.607355 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 581) took 6078 ms. Trace:
I20260620 07:01:13.608104 1169 ts_tablet_manager.cc:1905] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.608232 1166 rpcz_store.cc:276] 0620 07:01:07.529674 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.530799 (+ 1125us) service_pool.cc:227] Handling call
0620 07:01:13.593452 (+6062653us) ts_tablet_manager.cc:1145] Deleting tablet 168fb1666e2c41358213240d34ef9572
0620 07:01:13.593464 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.597680 (+ 4216us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.600666 (+ 2986us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.607338 (+ 6672us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6049538}
I20260620 07:01:13.608858 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 168fb1666e2c41358213240d34ef9572 (table default.Table_83d56d1245704fd3935391f2558b3e89 [id=2920611d71ce4939bc2e2201f2e411ac]) successfully deleted
I20260620 07:01:13.606778 1167 tablet_bootstrap.cc:492] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:13.610868 1167 tablet_bootstrap.cc:654] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:13.383029 831 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 44681.7us
I20260620 07:01:13.503966 2195 raft_consensus.cc:482] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.557029 2106 raft_consensus.cc:482] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.565685 2203 raft_consensus.cc:482] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.612047 2195 raft_consensus.cc:504] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.612080 2203 raft_consensus.cc:504] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.612669 2203 leader_election.cc:288] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.612788 2203 raft_consensus.cc:482] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.612882 2203 raft_consensus.cc:504] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.612675 2195 leader_election.cc:288] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.613411 2203 leader_election.cc:288] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.612080 2106 raft_consensus.cc:504] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.614063 2106 leader_election.cc:288] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.614464 727 tablet_service.cc:1467] Processing CreateTablet for tablet 8257f3843b9f45739f9395d38f0f4fe3 (DEFAULT_TABLE table=default.Table_798b7a996b564c84bdb6643fe57309df [id=2864455718454837bef12327be153d82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.614931 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8257f3843b9f45739f9395d38f0f4fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.619515 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 62ef9a12e3684d27b6696f631c68a5af (table default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]) successfully deleted
I20260620 07:01:13.620416 723 tablet_service.cc:1467] Processing CreateTablet for tablet 56fef8d33c4a4693a1ec8450382ef053 (DEFAULT_TABLE table=default.Table_83fba3799d694596940b78ff2610c8c9 [id=55ea0672e64042b6a0e1975e20b33d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.620609 721 tablet_service.cc:1467] Processing CreateTablet for tablet a4f4ca1a88154011a917e953fd6a759b (DEFAULT_TABLE table=default.Table_ad5730ccf942456cac948b6a2a12fb4b [id=31af65b6333a44e8b558ff2919ebc894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.620939 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56fef8d33c4a4693a1ec8450382ef053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.621184 728 tablet_service.cc:1467] Processing CreateTablet for tablet 728e7997b9e442669f9b5bda602311ce (DEFAULT_TABLE table=default.Table_514c9eb90e114a17a13236a3372c2731 [id=5ad10cca878b4699a05b8891cbdb9510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.621544 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728e7997b9e442669f9b5bda602311ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.624545 1168 tablet_bootstrap.cc:654] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.626200 719 tablet_service.cc:1467] Processing CreateTablet for tablet 6e41b3c6afb94142ba62f38948b6a355 (DEFAULT_TABLE table=default.Table_6b062b6459e8486c88d38312f5078599 [id=cf04f0613da74cbb8b86a9772efb0cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.626633 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e41b3c6afb94142ba62f38948b6a355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.630996 717 tablet_service.cc:1467] Processing CreateTablet for tablet 2ff10ed196984f1b8b1295a17f49f420 (DEFAULT_TABLE table=default.Table_c41bac2c663c4696912c8121d03cfbb3 [id=01cd70a3a7a04888a98ed3929244a4b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.631486 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ff10ed196984f1b8b1295a17f49f420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.634460 716 tablet_service.cc:1467] Processing CreateTablet for tablet 42bab85faeae42a9bb136c6fb1a5d247 (DEFAULT_TABLE table=default.Table_830d9712bacd489bb685565167ded664 [id=f8bcfb52d5d14dc5bdf6fa908a32825c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.634864 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42bab85faeae42a9bb136c6fb1a5d247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.639173 731 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce25c8fd7334d1c9d35e33122d58a19 (DEFAULT_TABLE table=default.Table_2056d596b0ae4f398e6c525a8016ff09 [id=9a43e8711da749c4b12a203e34ee343c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.639652 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce25c8fd7334d1c9d35e33122d58a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.645959 1168 tablet_bootstrap.cc:492] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.646078 1170 tablet_bootstrap.cc:492] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:13.646116 1168 ts_tablet_manager.cc:1397] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.273s user 0.000s sys 0.004s
I20260620 07:01:13.646206 1170 ts_tablet_manager.cc:1397] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.305s user 0.074s sys 0.185s
I20260620 07:01:13.647018 1168 raft_consensus.cc:348] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.647255 1168 raft_consensus.cc:374] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.647311 1168 raft_consensus.cc:729] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.647220 1170 raft_consensus.cc:348] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.647441 1170 raft_consensus.cc:374] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.647532 1170 raft_consensus.cc:729] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.647784 1170 consensus_queue.cc:260] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.647946 753 raft_consensus.cc:3037] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:13.650331 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4f4ca1a88154011a917e953fd6a759b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.647485 1168 consensus_queue.cc:260] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.653870 1170 ts_tablet_manager.cc:1428] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260620 07:01:13.654163 1170 tablet_bootstrap.cc:492] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:13.654477 724 tablet_service.cc:1467] Processing CreateTablet for tablet 2de9d54736ec49c49adda482d1f603ca (DEFAULT_TABLE table=default.Table_6107f40b9dc844919004d6f61a1e07ab [id=8db941b529c441b490ab72075d7235e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.654567 1168 ts_tablet_manager.cc:1428] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260620 07:01:13.654899 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2de9d54736ec49c49adda482d1f603ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.655990 1170 tablet_bootstrap.cc:654] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.659319 1168 tablet_bootstrap.cc:492] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.660364 424 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_0317c7d3f556484385f6af21f10cbc97 [id=4896f23e711941b988db4ea9f22ce625] alter complete (version 4)
I20260620 07:01:13.662400 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e1384dba2785444ea6cdb6dec7fd171d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.663076 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1384dba2785444ea6cdb6dec7fd171d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.663978 723 tablet_service.cc:1467] Processing CreateTablet for tablet ceb24f7e7be24b6f97b3c00f6552bbaa (DEFAULT_TABLE table=default.Table_2fa21eaf565847aa9ede7f122ac6fefe [id=2717322e13f2432197953dc62ff802ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.664412 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb24f7e7be24b6f97b3c00f6552bbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.665198 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5e3c8ac39ee542c6acdd0d2b790e2502"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.665712 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e3c8ac39ee542c6acdd0d2b790e2502 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.666142 733 tablet_service.cc:1467] Processing CreateTablet for tablet c4c3caa432594630bf6b5c35ff81c55c (DEFAULT_TABLE table=default.Table_e072e4e1eeab47a081ee70a95e9f13f8 [id=25414b9d73ce4b04a52d27811e898aa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.666586 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c3caa432594630bf6b5c35ff81c55c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.667172 722 tablet_service.cc:1467] Processing CreateTablet for tablet 702e78bcd01f41c1846294deadca1b54 (DEFAULT_TABLE table=default.Table_b6ae67323cd248cd93143c8bdcf3187e [id=cfc2cbf76ff74afd84e2c0b329fe4ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.667505 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 702e78bcd01f41c1846294deadca1b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.671042 729 tablet_service.cc:1467] Processing CreateTablet for tablet bed7eba8256c4d85b6fa3a4be0c27635 (DEFAULT_TABLE table=default.Table_3f2c7508dd9c4328ae411c21691ee9a6 [id=799c1515380046c4ad839ad4d3c62401]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.671268 725 tablet_service.cc:1467] Processing CreateTablet for tablet 10419e7146784cd7805f839650962781 (DEFAULT_TABLE table=default.Table_e71e331ae68345a9b88c2e93ecb5d73d [id=0a7837948bb549f280caab9130ea1cbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.671449 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed7eba8256c4d85b6fa3a4be0c27635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.671772 732 tablet_service.cc:1467] Processing CreateTablet for tablet 32526994e93c46a3b5b37f6dc7fd3069 (DEFAULT_TABLE table=default.Table_7146361681104709b5dfbac7fcecd7cd [id=07dc49586074421fa6e3b6ee862b8216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.672088 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32526994e93c46a3b5b37f6dc7fd3069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.675027 720 tablet_service.cc:1467] Processing CreateTablet for tablet d5a365f13ede4357ac3d18014c58fa54 (DEFAULT_TABLE table=default.Table_0f0fb9d00a3343ffa74ad89bd28dc251 [id=e35f4f5df74544fc83864687526164d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.675398 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a365f13ede4357ac3d18014c58fa54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.675738 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10419e7146784cd7805f839650962781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.671064 726 tablet_service.cc:1467] Processing CreateTablet for tablet 9f4cb1dd491c4533809474375c5467b1 (DEFAULT_TABLE table=default.Table_865d7722c6fc4b1c8fec64adfc18d9e2 [id=33cd8bf3556e4006b86e6ab4c17f394e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.685132 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.685391 1165 tablet_replica.cc:330] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:13.685576 1165 raft_consensus.cc:2229] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.685719 1165 raft_consensus.cc:2258] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.686283 1165 ts_tablet_manager.cc:1905] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:13.686442 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a064674792b42d49e9ff20a7496f820 consensus state has no leader
I20260620 07:01:13.686708 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.686866 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_daf0a27dab6a4b18b63b0dbd7bffa56c" } modify_external_catalogs: true
I20260620 07:01:13.687098 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_daf0a27dab6a4b18b63b0dbd7bffa56c" } modify_external_catalogs: true
I20260620 07:01:13.687194 862 tablet_service.cc:1514] Processing DeleteTablet for tablet ab60101b34144f85b0afd2e8c4846e48 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fc99f79e7b4df2b74a79468656b6ab) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.687867 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f04603a2fe84988ac9c9975e94ce9ae with delete_type TABLET_DATA_DELETED (replaced by tablet 354937ee58ca4970b9ac211a369f1030) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.687969 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_33849761b0d646b38ef15cb33a98f362"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:13.688272 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 64addb9379b247dfa678e2a0ae1af0cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:13.688557 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33849761b0d646b38ef15cb33a98f362 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.688607 862 tablet_service.cc:1514] Processing DeleteTablet for tablet b40e1ea4d1c74be2906381064c73f8c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.689002 862 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f77b677ab34d9b8554de0da6564fb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a8a5da81fac4c17ac60d4c87f844f8f) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.688928 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e14a8ee0f38e44c3977154c6d6a3279c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:13.689339 862 tablet_service.cc:1514] Processing DeleteTablet for tablet cf978ab301954866aeb77b7abaf2c77e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:13.689451 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e14a8ee0f38e44c3977154c6d6a3279c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.689697 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:13.689922 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca86563e5b014bb88ccb74c628670c46 consensus state has no leader
I20260620 07:01:13.690294 862 tablet_service.cc:1467] Processing CreateTablet for tablet 8257f3843b9f45739f9395d38f0f4fe3 (DEFAULT_TABLE table=default.Table_798b7a996b564c84bdb6643fe57309df [id=2864455718454837bef12327be153d82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.611229 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 584) took 5994 ms. Trace:
I20260620 07:01:13.690343 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ea0b0e0b727347258f2ffdbfbc42459e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.690613 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c7d55a43f5c4b2db637a0319b8a3c90 has no consensus state
I20260620 07:01:13.690498 1166 rpcz_store.cc:276] 0620 07:01:07.616502 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.616551 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:13.611080 (+5994529us) ts_tablet_manager.cc:1145] Deleting tablet fe3b70b1674e43768b29dea84b09a1a0
0620 07:01:13.611091 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.611213 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5994297}
I20260620 07:01:13.690901 427 master_service.cc:946] ReplaceTablet: received request to replace tablet ba93e22c4720417c99d471b9c8b49b86 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:13.691128 874 tablet_service.cc:1467] Processing CreateTablet for tablet a4f4ca1a88154011a917e953fd6a759b (DEFAULT_TABLE table=default.Table_ad5730ccf942456cac948b6a2a12fb4b [id=31af65b6333a44e8b558ff2919ebc894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.691383 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 585) took 6062 ms. Trace:
I20260620 07:01:13.691432 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3306fa38cf3a46f984a8fcde184d39a1" } modify_external_catalogs: true
I20260620 07:01:13.691607 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3306fa38cf3a46f984a8fcde184d39a1" } modify_external_catalogs: true
I20260620 07:01:13.691521 1166 rpcz_store.cc:276] 0620 07:01:07.628517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.628582 (+ 65us) service_pool.cc:227] Handling call
0620 07:01:13.691099 (+6062517us) ts_tablet_manager.cc:1145] Deleting tablet 6363d1d9233d4938ba40abff452ed147
0620 07:01:13.691111 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.691361 (+ 250us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6062216}
I20260620 07:01:13.692039 1166 tablet_replica.cc:330] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:13.692348 872 tablet_service.cc:1467] Processing CreateTablet for tablet 728e7997b9e442669f9b5bda602311ce (DEFAULT_TABLE table=default.Table_514c9eb90e114a17a13236a3372c2731 [id=5ad10cca878b4699a05b8891cbdb9510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.612522 1999 raft_consensus.cc:482] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.626273 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704e8aaabe6d40138b6611bdc30abf16" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.626760 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0bae39e1634710af12de493f7f58d5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.692575 1166 raft_consensus.cc:2229] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.627569 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1c683a2169e4938b6941f83308cd392" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:13.650897 969 consensus_peers.cc:487] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a46df2909bf43f297b412c33f18a329. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:13.654008 1989 consensus_queue.cc:1035] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:13.692973 2106 raft_consensus.cc:482] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.692600 1999 raft_consensus.cc:504] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.693080 2106 raft_consensus.cc:504] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.693462 1999 leader_election.cc:288] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:13.693565 2106 leader_election.cc:288] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:13.693897 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6c6ac49e30e441396c7c29f950fed31 consensus state has no leader
I20260620 07:01:13.693836 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 8257f3843b9f45739f9395d38f0f4fe3 (DEFAULT_TABLE table=default.Table_798b7a996b564c84bdb6643fe57309df [id=2864455718454837bef12327be153d82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.694245 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8257f3843b9f45739f9395d38f0f4fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.694281 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d5fc8ec0b1424625b98c20f4b8b78249" } modify_external_catalogs: true
I20260620 07:01:13.694422 1010 tablet_service.cc:1467] Processing CreateTablet for tablet a4f4ca1a88154011a917e953fd6a759b (DEFAULT_TABLE table=default.Table_ad5730ccf942456cac948b6a2a12fb4b [id=31af65b6333a44e8b558ff2919ebc894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.694463 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d5fc8ec0b1424625b98c20f4b8b78249" } modify_external_catalogs: true
I20260620 07:01:13.694821 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 728e7997b9e442669f9b5bda602311ce (DEFAULT_TABLE table=default.Table_514c9eb90e114a17a13236a3372c2731 [id=5ad10cca878b4699a05b8891cbdb9510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.690187 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5c1567e0c9448dca870bd3d8502bf02" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.695552 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 2ff10ed196984f1b8b1295a17f49f420 (DEFAULT_TABLE table=default.Table_c41bac2c663c4696912c8121d03cfbb3 [id=01cd70a3a7a04888a98ed3929244a4b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.695897 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce25c8fd7334d1c9d35e33122d58a19 (DEFAULT_TABLE table=default.Table_2056d596b0ae4f398e6c525a8016ff09 [id=9a43e8711da749c4b12a203e34ee343c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.695974 997 tablet_service.cc:1467] Processing CreateTablet for tablet 42bab85faeae42a9bb136c6fb1a5d247 (DEFAULT_TABLE table=default.Table_830d9712bacd489bb685565167ded664 [id=f8bcfb52d5d14dc5bdf6fa908a32825c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.696156 1166 raft_consensus.cc:2258] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.695158 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 6e41b3c6afb94142ba62f38948b6a355 (DEFAULT_TABLE table=default.Table_6b062b6459e8486c88d38312f5078599 [id=cf04f0613da74cbb8b86a9772efb0cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.696931 999 tablet_service.cc:1467] Processing CreateTablet for tablet ceb24f7e7be24b6f97b3c00f6552bbaa (DEFAULT_TABLE table=default.Table_2fa21eaf565847aa9ede7f122ac6fefe [id=2717322e13f2432197953dc62ff802ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.696638 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 2de9d54736ec49c49adda482d1f603ca (DEFAULT_TABLE table=default.Table_6107f40b9dc844919004d6f61a1e07ab [id=8db941b529c441b490ab72075d7235e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.697973 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb24f7e7be24b6f97b3c00f6552bbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.698130 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2de9d54736ec49c49adda482d1f603ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.698071 858 tablet_service.cc:1467] Processing CreateTablet for tablet 2de9d54736ec49c49adda482d1f603ca (DEFAULT_TABLE table=default.Table_6107f40b9dc844919004d6f61a1e07ab [id=8db941b529c441b490ab72075d7235e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.698613 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728e7997b9e442669f9b5bda602311ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:13.699229 830 leader_election.cc:341] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.699455 1166 ts_tablet_manager.cc:1905] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:13.699863 830 leader_election.cc:341] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.696378 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 56fef8d33c4a4693a1ec8450382ef053 (DEFAULT_TABLE table=default.Table_83fba3799d694596940b78ff2610c8c9 [id=55ea0672e64042b6a0e1975e20b33d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.701133 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 702e78bcd01f41c1846294deadca1b54 (DEFAULT_TABLE table=default.Table_b6ae67323cd248cd93143c8bdcf3187e [id=cfc2cbf76ff74afd84e2c0b329fe4ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.701339 864 tablet_service.cc:1467] Processing CreateTablet for tablet 6e41b3c6afb94142ba62f38948b6a355 (DEFAULT_TABLE table=default.Table_6b062b6459e8486c88d38312f5078599 [id=cf04f0613da74cbb8b86a9772efb0cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.701428 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 9f4cb1dd491c4533809474375c5467b1 (DEFAULT_TABLE table=default.Table_865d7722c6fc4b1c8fec64adfc18d9e2 [id=33cd8bf3556e4006b86e6ab4c17f394e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.701643 859 tablet_service.cc:1467] Processing CreateTablet for tablet 42bab85faeae42a9bb136c6fb1a5d247 (DEFAULT_TABLE table=default.Table_830d9712bacd489bb685565167ded664 [id=f8bcfb52d5d14dc5bdf6fa908a32825c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.701822 857 tablet_service.cc:1467] Processing CreateTablet for tablet 56fef8d33c4a4693a1ec8450382ef053 (DEFAULT_TABLE table=default.Table_83fba3799d694596940b78ff2610c8c9 [id=55ea0672e64042b6a0e1975e20b33d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.702109 865 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce25c8fd7334d1c9d35e33122d58a19 (DEFAULT_TABLE table=default.Table_2056d596b0ae4f398e6c525a8016ff09 [id=9a43e8711da749c4b12a203e34ee343c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.702278 868 tablet_service.cc:1467] Processing CreateTablet for tablet 2ff10ed196984f1b8b1295a17f49f420 (DEFAULT_TABLE table=default.Table_c41bac2c663c4696912c8121d03cfbb3 [id=01cd70a3a7a04888a98ed3929244a4b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.702616 871 tablet_service.cc:1467] Processing CreateTablet for tablet 702e78bcd01f41c1846294deadca1b54 (DEFAULT_TABLE table=default.Table_b6ae67323cd248cd93143c8bdcf3187e [id=cfc2cbf76ff74afd84e2c0b329fe4ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.702942 861 tablet_service.cc:1467] Processing CreateTablet for tablet 9f4cb1dd491c4533809474375c5467b1 (DEFAULT_TABLE table=default.Table_865d7722c6fc4b1c8fec64adfc18d9e2 [id=33cd8bf3556e4006b86e6ab4c17f394e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.703073 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ff10ed196984f1b8b1295a17f49f420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.702627 860 tablet_service.cc:1467] Processing CreateTablet for tablet ceb24f7e7be24b6f97b3c00f6552bbaa (DEFAULT_TABLE table=default.Table_2fa21eaf565847aa9ede7f122ac6fefe [id=2717322e13f2432197953dc62ff802ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.703270 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e41b3c6afb94142ba62f38948b6a355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.703455 867 tablet_service.cc:1467] Processing CreateTablet for tablet 10419e7146784cd7805f839650962781 (DEFAULT_TABLE table=default.Table_e71e331ae68345a9b88c2e93ecb5d73d [id=0a7837948bb549f280caab9130ea1cbd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:13.690901 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea0b0e0b727347258f2ffdbfbc42459e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:13.705194 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fe3b70b1674e43768b29dea84b09a1a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe3b70b1674e43768b29dea84b09a1a0 already in progress: creating tablet
W20260620 07:01:13.705458 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6363d1d9233d4938ba40abff452ed147 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6363d1d9233d4938ba40abff452ed147 already in progress: creating tablet
I20260620 07:01:13.706900 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f4cb1dd491c4533809474375c5467b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.707095 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce25c8fd7334d1c9d35e33122d58a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.707301 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 702e78bcd01f41c1846294deadca1b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.710965 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4f4ca1a88154011a917e953fd6a759b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.714963 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42bab85faeae42a9bb136c6fb1a5d247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.716490 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56fef8d33c4a4693a1ec8450382ef053. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:13.720245 968 leader_election.cc:341] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: b4ee5c79e2a6419ea3847cbebdeced79
I20260620 07:01:13.724982 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ce6aa6be59cb406db47a6b3202ccc571"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:13.725664 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce6aa6be59cb406db47a6b3202ccc571 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.725896 994 tablet_service.cc:1467] Processing CreateTablet for tablet 10419e7146784cd7805f839650962781 (DEFAULT_TABLE table=default.Table_e71e331ae68345a9b88c2e93ecb5d73d [id=0a7837948bb549f280caab9130ea1cbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.726289 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10419e7146784cd7805f839650962781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.727439 718 tablet_service.cc:1514] Processing DeleteTablet for tablet f8ec1e179a704e5480f3deaf856156e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c7f0513df34ddb8104b06e5733fb62) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.740465 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f4cb1dd491c4533809474375c5467b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.741364 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb24f7e7be24b6f97b3c00f6552bbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.741540 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42bab85faeae42a9bb136c6fb1a5d247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.742611 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 702e78bcd01f41c1846294deadca1b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.745916 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 5208f3136bcd45579de49b8b10745122 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d9875dde7b4455b24b053781993234) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.746454 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f4cb1dd491c4533809474375c5467b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.746752 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4f4ca1a88154011a917e953fd6a759b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.748195 1003 tablet_service.cc:1467] Processing CreateTablet for tablet d5a365f13ede4357ac3d18014c58fa54 (DEFAULT_TABLE table=default.Table_0f0fb9d00a3343ffa74ad89bd28dc251 [id=e35f4f5df74544fc83864687526164d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.748589 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a365f13ede4357ac3d18014c58fa54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.750694 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e41b3c6afb94142ba62f38948b6a355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.750958 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 2910da33bbdb4410a4a90ff9747a7de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.751966 1011 tablet_service.cc:1467] Processing CreateTablet for tablet bed7eba8256c4d85b6fa3a4be0c27635 (DEFAULT_TABLE table=default.Table_3f2c7508dd9c4328ae411c21691ee9a6 [id=799c1515380046c4ad839ad4d3c62401]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.752358 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed7eba8256c4d85b6fa3a4be0c27635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.752897 715 tablet_service.cc:1514] Processing DeleteTablet for tablet eea1525b54cc42b78180ba6867957f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.753278 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728e7997b9e442669f9b5bda602311ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.756511 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ff10ed196984f1b8b1295a17f49f420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.759007 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce25c8fd7334d1c9d35e33122d58a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.763132 2158 raft_consensus.cc:482] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.763298 2158 raft_consensus.cc:504] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:13.764438 1007 tablet_service.cc:1467] Processing CreateTablet for tablet c4c3caa432594630bf6b5c35ff81c55c (DEFAULT_TABLE table=default.Table_e072e4e1eeab47a081ee70a95e9f13f8 [id=25414b9d73ce4b04a52d27811e898aa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.764957 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56fef8d33c4a4693a1ec8450382ef053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.767024 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8257f3843b9f45739f9395d38f0f4fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.767745 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10419e7146784cd7805f839650962781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.770172 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2de9d54736ec49c49adda482d1f603ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.781538 1989 raft_consensus.cc:482] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.781733 1989 raft_consensus.cc:504] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.782341 1989 leader_election.cc:288] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:13.785948 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 6229a52adf8d4b17bdf89347e01621ed with delete_type TABLET_DATA_DELETED (replaced by tablet 883d1959ed484c58935db467aa2dc50a) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.786227 2158 leader_election.cc:288] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:13.786381 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c95b908674e4f8425d765444c281b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.786589 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 333eef8b98da4a279acceaead9405149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.786585 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.786844 732 tablet_service.cc:1514] Processing DeleteTablet for tablet f690e150839a4d23860932712f61e7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:13.786964 968 leader_election.cc:341] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 95f9a6b2f2cb41e6b74715b2618d8a70
I20260620 07:01:13.787309 871 tablet_service.cc:1514] Processing DeleteTablet for tablet 4302edba0ec04d7abc2789bc7be1beca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.787899 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d4ef3ba51e432f889fb927a6af8b49" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:13.788120 890 raft_consensus.cc:2454] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:13.789111 1165 ts_tablet_manager.cc:1918] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.789286 1165 log.cc:1196] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/9e8cd4ec5619416a8983e1bc1b6b6a09
I20260620 07:01:13.789808 1165 ts_tablet_manager.cc:1939] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:13.790283 1165 tablet_replica.cc:330] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:13.790512 1165 raft_consensus.cc:2229] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.790712 1165 raft_consensus.cc:2258] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.788476 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d4ef3ba51e432f889fb927a6af8b49" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.791937 831 leader_election.cc:302] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
W20260620 07:01:13.792976 831 raft_consensus.cc:2670] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:13.793026 681 leader_election.cc:341] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.791976 1165 ts_tablet_manager.cc:1905] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.792270 858 tablet_service.cc:1467] Processing CreateTablet for tablet bed7eba8256c4d85b6fa3a4be0c27635 (DEFAULT_TABLE table=default.Table_3f2c7508dd9c4328ae411c21691ee9a6 [id=799c1515380046c4ad839ad4d3c62401]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.794085 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed7eba8256c4d85b6fa3a4be0c27635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.795125 867 tablet_service.cc:1467] Processing CreateTablet for tablet 32526994e93c46a3b5b37f6dc7fd3069 (DEFAULT_TABLE table=default.Table_7146361681104709b5dfbac7fcecd7cd [id=07dc49586074421fa6e3b6ee862b8216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.795400 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 704e8aaabe6d40138b6611bdc30abf16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.795574 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32526994e93c46a3b5b37f6dc7fd3069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.795686 865 tablet_service.cc:1467] Processing CreateTablet for tablet c4c3caa432594630bf6b5c35ff81c55c (DEFAULT_TABLE table=default.Table_e072e4e1eeab47a081ee70a95e9f13f8 [id=25414b9d73ce4b04a52d27811e898aa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.796115 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c3caa432594630bf6b5c35ff81c55c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.797278 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c3caa432594630bf6b5c35ff81c55c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.795182 857 tablet_service.cc:1467] Processing CreateTablet for tablet d5a365f13ede4357ac3d18014c58fa54 (DEFAULT_TABLE table=default.Table_0f0fb9d00a3343ffa74ad89bd28dc251 [id=e35f4f5df74544fc83864687526164d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.797746 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a365f13ede4357ac3d18014c58fa54. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:13.798199 830 leader_election.cc:341] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:13.798408 830 leader_election.cc:341] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.804744 1165 ts_tablet_manager.cc:1918] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.804924 1165 log.cc:1196] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/7d3ebdb3ef844adf82b99a6d3b6c61c2
I20260620 07:01:13.805294 1165 ts_tablet_manager.cc:1939] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:13.805759 1165 tablet_replica.cc:330] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:13.806000 1165 raft_consensus.cc:2229] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.806231 1165 raft_consensus.cc:2258] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.806898 1165 ts_tablet_manager.cc:1905] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.807300 2204 raft_consensus.cc:482] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.807478 2204 raft_consensus.cc:504] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.808190 2204 leader_election.cc:288] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:13.809818 969 leader_election.cc:341] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b4ee5c79e2a6419ea3847cbebdeced79
I20260620 07:01:13.809805 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5c1567e0c9448dca870bd3d8502bf02" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:13.810818 681 consensus_peers.cc:487] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 168fb1666e2c41358213240d34ef9572. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:13.810981 2158 raft_consensus.cc:482] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.811080 2158 raft_consensus.cc:504] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.794312 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:13.811581 968 consensus_peers.cc:487] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba907170f2df4bd0b5e42d4c2d29b21e. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:13.811617 2158 leader_election.cc:288] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.811384 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet b4ee5c79e2a6419ea3847cbebdeced79 with delete_type TABLET_DATA_DELETED (replaced by tablet 63525282e222490687713a92e5371a5c) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.809947 969 leader_election.cc:302] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:13.811969 1999 raft_consensus.cc:2726] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:13.812310 969 leader_election.cc:341] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 95f9a6b2f2cb41e6b74715b2618d8a70
I20260620 07:01:13.812399 969 leader_election.cc:302] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:13.812556 2130 raft_consensus.cc:2726] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:13.815480 1168 tablet_bootstrap.cc:654] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.817260 997 tablet_service.cc:1467] Processing CreateTablet for tablet 32526994e93c46a3b5b37f6dc7fd3069 (DEFAULT_TABLE table=default.Table_7146361681104709b5dfbac7fcecd7cd [id=07dc49586074421fa6e3b6ee862b8216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.817641 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32526994e93c46a3b5b37f6dc7fd3069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.818703 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab60101b34144f85b0afd2e8c4846e48" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.819475 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_375531d855b14594830e688497474a2c" } modify_external_catalogs: true
I20260620 07:01:13.819669 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_375531d855b14594830e688497474a2c" } modify_external_catalogs: true
W20260620 07:01:13.822067 830 leader_election.cc:341] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.822518 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 (table default.Table_2411c7dd68274c07a75cd0b3ae3e2d32 [id=804a023058a643b189246bf7c6a98af6]) successfully deleted
I20260620 07:01:13.828006 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 (table default.Table_642c62b94c31483480661843e4bcbe5c [id=aec61ada90ac43b6b4ca3d6c297c8bd3]) successfully deleted
W20260620 07:01:13.828229 683 leader_election.cc:341] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 9a46df2909bf43f297b412c33f18a329
I20260620 07:01:13.828354 683 leader_election.cc:302] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:13.828985 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704e8aaabe6d40138b6611bdc30abf16" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:13.830380 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_94d4f67fb7384726ab2dbdf2db2138d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:13.831540 731 tablet_service.cc:1467] Processing CreateTablet for tablet cb1833d3e3f646809d204736ef038d67 (DEFAULT_TABLE table=default.Table_a4c32d61de2e4fedb9d78f86570948fc [id=c832dd3b83eb41e7b9d6edf0ed059e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.831939 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb1833d3e3f646809d204736ef038d67. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:13.832269 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94d4f67fb7384726ab2dbdf2db2138d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.833281 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 39b2a190b3094aa09f2488768ff1c347 (DEFAULT_TABLE table=default.Table_4fc5c9bdafac430eb6c1141686f585d2 [id=47cc10c1c550424a98727bf4302f5bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.835826 732 tablet_service.cc:1467] Processing CreateTablet for tablet 39b2a190b3094aa09f2488768ff1c347 (DEFAULT_TABLE table=default.Table_4fc5c9bdafac430eb6c1141686f585d2 [id=47cc10c1c550424a98727bf4302f5bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.836194 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39b2a190b3094aa09f2488768ff1c347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.838573 1165 ts_tablet_manager.cc:1918] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.838877 1165 log.cc:1196] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ab60101b34144f85b0afd2e8c4846e48
I20260620 07:01:13.839447 1165 ts_tablet_manager.cc:1939] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:13.841652 683 consensus_peers.cc:487] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 168fb1666e2c41358213240d34ef9572. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:13.841861 683 leader_election.cc:302] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:13.842372 2204 raft_consensus.cc:482] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.842579 1165 tablet_replica.cc:330] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:13.842602 2204 raft_consensus.cc:504] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.842808 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0bae39e1634710af12de493f7f58d5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:13.842969 1165 raft_consensus.cc:2229] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.843212 1165 raft_consensus.cc:2258] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.843886 2204 leader_election.cc:288] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:13.844281 1165 ts_tablet_manager.cc:1905] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.842567 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1c683a2169e4938b6941f83308cd392" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:13.852284 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6229a52adf8d4b17bdf89347e01621ed" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.842175 1920 raft_consensus.cc:2781] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:13.858968 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2910da33bbdb4410a4a90ff9747a7de1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.859678 1013 tablet_service.cc:1467] Processing CreateTablet for tablet cb1833d3e3f646809d204736ef038d67 (DEFAULT_TABLE table=default.Table_a4c32d61de2e4fedb9d78f86570948fc [id=c832dd3b83eb41e7b9d6edf0ed059e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.860183 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39b2a190b3094aa09f2488768ff1c347. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:13.860844 830 leader_election.cc:341] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.860945 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "333eef8b98da4a279acceaead9405149" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:13.861858 1166 ts_tablet_manager.cc:1918] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:13.862004 1166 log.cc:1196] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/203ba3933d3a4fb2a4978b29cad614e6
I20260620 07:01:13.855264 1920 raft_consensus.cc:482] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:13.865056 1920 raft_consensus.cc:3037] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:13.856171 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab60101b34144f85b0afd2e8c4846e48" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:13.859586 681 leader_election.cc:341] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.864687 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6229a52adf8d4b17bdf89347e01621ed" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:13.866825 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb1833d3e3f646809d204736ef038d67. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:13.867384 830 leader_election.cc:341] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.866868 861 tablet_service.cc:1467] Processing CreateTablet for tablet 39b2a190b3094aa09f2488768ff1c347 (DEFAULT_TABLE table=default.Table_4fc5c9bdafac430eb6c1141686f585d2 [id=47cc10c1c550424a98727bf4302f5bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:13.870064 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ab60101b34144f85b0afd2e8c4846e48 (table default.Table_22154b88a133429f981e2e3a4d1fd4aa [id=76b0e45d4d264794a80b3293898b6064]) successfully deleted
W20260620 07:01:13.875169 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5f04603a2fe84988ac9c9975e94ce9ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f04603a2fe84988ac9c9975e94ce9ae already in progress: creating tablet
W20260620 07:01:13.876474 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 64addb9379b247dfa678e2a0ae1af0cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64addb9379b247dfa678e2a0ae1af0cf already in progress: creating tablet
I20260620 07:01:13.877548 857 tablet_service.cc:1467] Processing CreateTablet for tablet cb1833d3e3f646809d204736ef038d67 (DEFAULT_TABLE table=default.Table_a4c32d61de2e4fedb9d78f86570948fc [id=c832dd3b83eb41e7b9d6edf0ed059e22]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:13.879933 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b40e1ea4d1c74be2906381064c73f8c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b40e1ea4d1c74be2906381064c73f8c5 already in progress: creating tablet
W20260620 07:01:13.880928 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f4f77b677ab34d9b8554de0da6564fb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4f77b677ab34d9b8554de0da6564fb1 already in progress: creating tablet
W20260620 07:01:13.881886 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet cf978ab301954866aeb77b7abaf2c77e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf978ab301954866aeb77b7abaf2c77e already in progress: creating tablet
W20260620 07:01:13.889623 831 leader_election.cc:341] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:13.890074 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 already in progress: creating tablet
I20260620 07:01:13.892889 831 leader_election.cc:302] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:13.893765 2204 raft_consensus.cc:2726] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:13.895182 831 leader_election.cc:341] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.895880 831 leader_election.cc:302] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:13.897830 2204 raft_consensus.cc:2726] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:13.903520 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39b2a190b3094aa09f2488768ff1c347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.907979 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb1833d3e3f646809d204736ef038d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:13.911700 1166 ts_tablet_manager.cc:1939] T 203ba3933d3a4fb2a4978b29cad614e6 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:13.912504 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 597) took 5985 ms. Trace:
I20260620 07:01:13.912602 1166 rpcz_store.cc:276] 0620 07:01:07.927138 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.928171 (+ 1033us) service_pool.cc:227] Handling call
0620 07:01:13.691969 (+5763798us) ts_tablet_manager.cc:1145] Deleting tablet 203ba3933d3a4fb2a4978b29cad614e6
0620 07:01:13.691979 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.710273 (+ 18294us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.861727 (+151454us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.912487 (+ 50760us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5763505}
I20260620 07:01:13.913002 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 598) took 5985 ms. Trace:
I20260620 07:01:13.913091 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 203ba3933d3a4fb2a4978b29cad614e6 (table default.Table_52bd8cf613ad458b8436906e69e4cbd8 [id=72036a5a731244a4a1f797ec8663aef8]) successfully deleted
I20260620 07:01:13.900367 2188 raft_consensus.cc:482] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.913096 1166 rpcz_store.cc:276] 0620 07:01:07.927311 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.928472 (+ 1161us) service_pool.cc:227] Handling call
0620 07:01:13.912898 (+5984426us) ts_tablet_manager.cc:1145] Deleting tablet 63dfade71c254d7e908e00acada93638
0620 07:01:13.912907 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.912987 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5984259}
I20260620 07:01:13.918352 2188 raft_consensus.cc:504] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:13.922029 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 63dfade71c254d7e908e00acada93638 because the tablet was not found. No further retry: Not found: Tablet not found: 63dfade71c254d7e908e00acada93638
I20260620 07:01:13.924765 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 599) took 5990 ms. Trace:
W20260620 07:01:13.902343 831 leader_election.cc:341] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.927155 831 leader_election.cc:302] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:13.927589 2204 raft_consensus.cc:2726] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:13.928164 831 leader_election.cc:341] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.928414 831 leader_election.cc:302] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:13.928941 2204 raft_consensus.cc:2726] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:13.929593 831 leader_election.cc:341] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.930681 831 leader_election.cc:302] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:13.931229 831 raft_consensus.cc:2670] T ab60101b34144f85b0afd2e8c4846e48 P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:13.931216 1166 rpcz_store.cc:276] 0620 07:01:07.933895 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.933946 (+ 51us) service_pool.cc:227] Handling call
0620 07:01:13.923183 (+5989237us) ts_tablet_manager.cc:1145] Deleting tablet 033c8b817757441ea7ebc2dbf77aa2dd
0620 07:01:13.923198 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.924743 (+ 1545us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5988980}
W20260620 07:01:13.931872 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 033c8b817757441ea7ebc2dbf77aa2dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033c8b817757441ea7ebc2dbf77aa2dd already in progress: creating tablet
W20260620 07:01:13.932531 831 leader_election.cc:341] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:13.932818 831 leader_election.cc:302] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:13.936447 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 600) took 5977 ms. Trace:
I20260620 07:01:13.936580 1166 rpcz_store.cc:276] 0620 07:01:07.959063 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.968847 (+ 9784us) service_pool.cc:227] Handling call
0620 07:01:13.936286 (+5967439us) ts_tablet_manager.cc:1145] Deleting tablet a0a5967c84434000a51fe7d819fac439
0620 07:01:13.936302 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.936424 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5962251}
W20260620 07:01:13.937114 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a0a5967c84434000a51fe7d819fac439 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a5967c84434000a51fe7d819fac439 already in progress: creating tablet
I20260620 07:01:13.943743 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 601) took 5968 ms. Trace:
W20260620 07:01:13.933228 831 raft_consensus.cc:2670] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:13.945673 393 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 146718us
I20260620 07:01:13.946436 1166 rpcz_store.cc:276] 0620 07:01:07.974969 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:07.975014 (+ 45us) service_pool.cc:227] Handling call
0620 07:01:13.943573 (+5968559us) ts_tablet_manager.cc:1145] Deleting tablet 6801c84abfa54f6983fae4b66aca8fd0
0620 07:01:13.943590 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.943718 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5968284}
W20260620 07:01:13.947551 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6801c84abfa54f6983fae4b66aca8fd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6801c84abfa54f6983fae4b66aca8fd0 already in progress: creating tablet
I20260620 07:01:13.948055 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 607) took 5952 ms. Trace:
I20260620 07:01:13.948529 1166 rpcz_store.cc:276] 0620 07:01:07.995454 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.000826 (+ 5372us) service_pool.cc:227] Handling call
0620 07:01:13.947912 (+5947086us) ts_tablet_manager.cc:1145] Deleting tablet 1252d1dd03bd4a27983eb89d489b09d3
0620 07:01:13.947925 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.948038 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5946675}
I20260620 07:01:13.951828 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 02584f8ac08f4759a5f9a5aa699d0039
I20260620 07:01:13.953437 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 608) took 5811 ms. Trace:
I20260620 07:01:13.953526 1166 rpcz_store.cc:276] 0620 07:01:08.141709 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.150046 (+ 8337us) service_pool.cc:227] Handling call
0620 07:01:13.953296 (+5803250us) ts_tablet_manager.cc:1145] Deleting tablet a4e8c06f3f8544ecafb63dd7d04fdf05
0620 07:01:13.953309 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.953422 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5802944}
I20260620 07:01:13.954483 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 609) took 5801 ms. Trace:
I20260620 07:01:13.954561 1166 rpcz_store.cc:276] 0620 07:01:08.153254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.171407 (+ 18153us) service_pool.cc:227] Handling call
0620 07:01:13.954384 (+5782977us) ts_tablet_manager.cc:1145] Deleting tablet 113dd3d57c144088ae7204dc5229f883
0620 07:01:13.954394 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.954470 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5782035}
I20260620 07:01:13.957670 2130 raft_consensus.cc:482] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:13.957806 2130 raft_consensus.cc:504] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.958410 2130 leader_election.cc:288] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:13.958448 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1252d1dd03bd4a27983eb89d489b09d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1252d1dd03bd4a27983eb89d489b09d3 already in progress: creating tablet
W20260620 07:01:13.958719 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a4e8c06f3f8544ecafb63dd7d04fdf05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4e8c06f3f8544ecafb63dd7d04fdf05 already in progress: creating tablet
W20260620 07:01:13.958963 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 113dd3d57c144088ae7204dc5229f883 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 113dd3d57c144088ae7204dc5229f883 already in progress: creating tablet
I20260620 07:01:13.959906 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8bb5c7631c6145c49b7b09fcda4e4554" } modify_external_catalogs: true
W20260620 07:01:13.959985 969 leader_election.cc:341] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 82020156f3e44a1e84a9435d1f994124
I20260620 07:01:13.959617 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 02584f8ac08f4759a5f9a5aa699d0039 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.960191 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8bb5c7631c6145c49b7b09fcda4e4554" } modify_external_catalogs: true
I20260620 07:01:13.960309 1168 tablet_bootstrap.cc:492] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:13.960813 1168 ts_tablet_manager.cc:1397] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.302s user 0.000s sys 0.006s
I20260620 07:01:13.961714 1168 raft_consensus.cc:348] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.962077 1166 tablet_replica.cc:330] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:13.962289 1166 raft_consensus.cc:2229] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:13.962446 1166 raft_consensus.cc:2258] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:13.963019 1166 ts_tablet_manager.cc:1905] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:13.963020 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet de6ccea1cd074afb9fef17c8e07f444f
I20260620 07:01:13.965657 1168 raft_consensus.cc:374] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:13.965595 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_394931c572964938b1a601ca97ea4a2d" } new_table_name: "default.Table_e8a4d50205544bcf9ad06609ef06f7fb" modify_external_catalogs: true
I20260620 07:01:13.965967 1168 raft_consensus.cc:729] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:13.966297 1168 consensus_queue.cc:260] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:13.966802 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet de6ccea1cd074afb9fef17c8e07f444f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.968987 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 02584f8ac08f4759a5f9a5aa699d0039 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.969363 1168 ts_tablet_manager.cc:1428] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260620 07:01:13.969710 867 tablet_service.cc:1514] Processing DeleteTablet for tablet de6ccea1cd074afb9fef17c8e07f444f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.973157 1168 tablet_bootstrap.cc:492] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:13.973536 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 95a109e7871241ec9467858dca467bbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.974650 426 master_service.cc:946] ReplaceTablet: received request to replace tablet ebd9df1a33ed4e7b997a386158460a9a from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:13.976030 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6
I20260620 07:01:13.977344 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.977846 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2320c8254c394144bae71f5e762a1764"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:13.979352 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:13.979894 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2320c8254c394144bae71f5e762a1764 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:13.987046 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8aa5c040d5e84006935e9f06424a34b4
I20260620 07:01:13.988185 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa5c040d5e84006935e9f06424a34b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:13.990916 1168 tablet_bootstrap.cc:654] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:13.991310 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa5c040d5e84006935e9f06424a34b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:13.993350 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3eb134c36c8746dc9cbeb8c11a9063c8" } new_table_name: "default.Table_bbadfae915284228b94e490802bdfe40" modify_external_catalogs: true
I20260620 07:01:13.996428 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ba93e22c4720417c99d471b9c8b49b86
I20260620 07:01:13.999392 427 catalog_manager.cc:6565] ReplaceTablet: tablet ba93e22c4720417c99d471b9c8b49b86 deleted and replaced by tablet b8e6ca6c0a0e40a68e8c6501af7d28c5
I20260620 07:01:13.999791 857 tablet_service.cc:1514] Processing DeleteTablet for tablet ba93e22c4720417c99d471b9c8b49b86 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e6ca6c0a0e40a68e8c6501af7d28c5) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.000226 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a1c5db7b75ec4aedb7bba0695c4c8bf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.001060 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1c5db7b75ec4aedb7bba0695c4c8bf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.001709 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet ba93e22c4720417c99d471b9c8b49b86 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e6ca6c0a0e40a68e8c6501af7d28c5) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.004741 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d51c7488711b4db697b48025a5ba6e9d
I20260620 07:01:14.005832 857 tablet_service.cc:1514] Processing DeleteTablet for tablet d51c7488711b4db697b48025a5ba6e9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:14.005880 969 consensus_peers.cc:487] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a292d66ee14a48959c1f6a63e0a0f492. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:14.006265 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_209bda59817e4eaeadbd831379bfe659" } new_table_name: "default.Table_838622ef1a2949ed98ee8ab3f8106c8a" modify_external_catalogs: true
I20260620 07:01:14.007007 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet d51c7488711b4db697b48025a5ba6e9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.008091 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4041cd9b1bdd4a96ad17ef5a4130d238" } new_table_name: "default.Table_9994964c3fd7481eb79d3bc938bbb20f" modify_external_catalogs: true
I20260620 07:01:14.009030 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a9daa65902764470b46116dd8693e062" } new_table_name: "default.Table_09712bb36f174af99f0b9e0e77871459" modify_external_catalogs: true
I20260620 07:01:14.010200 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_918635bc15074fb5a3389b58a96575cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.010955 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_918635bc15074fb5a3389b58a96575cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.014451 1080 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:14.015368 1168 tablet_bootstrap.cc:492] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.015729 1168 ts_tablet_manager.cc:1397] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.006s
I20260620 07:01:14.016726 1168 raft_consensus.cc:348] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.023788 1168 raft_consensus.cc:374] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.024127 1168 raft_consensus.cc:729] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.024642 1168 consensus_queue.cc:260] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.025298 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 02584f8ac08f4759a5f9a5aa699d0039 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.025879 2188 leader_election.cc:288] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:14.026592 968 leader_election.cc:341] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 82020156f3e44a1e84a9435d1f994124
I20260620 07:01:14.027205 968 leader_election.cc:302] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.027982 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "134f76587b6147afaf4e94fde5574efc" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:14.028729 1999 raft_consensus.cc:2726] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 07:01:14.029341 681 leader_election.cc:341] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.030288 1168 ts_tablet_manager.cc:1428] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260620 07:01:14.031210 1168 tablet_bootstrap.cc:492] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.033689 732 tablet_service.cc:1514] Processing DeleteTablet for tablet ba93e22c4720417c99d471b9c8b49b86 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e6ca6c0a0e40a68e8c6501af7d28c5) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.034644 1168 tablet_bootstrap.cc:654] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.038125 719 tablet_service.cc:1514] Processing DeleteTablet for tablet de6ccea1cd074afb9fef17c8e07f444f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.038733 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa5c040d5e84006935e9f06424a34b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:13.888245 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "333eef8b98da4a279acceaead9405149" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:14.039664 719 tablet_service.cc:1514] Processing DeleteTablet for tablet d51c7488711b4db697b48025a5ba6e9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.040465 1999 consensus_queue.cc:1035] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:14.046576 1920 raft_consensus.cc:504] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.047303 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.049229 1920 leader_election.cc:288] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:14.050074 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d4ef3ba51e432f889fb927a6af8b49" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:14.050850 681 leader_election.cc:341] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.053815 1170 tablet_bootstrap.cc:492] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:14.053997 1170 ts_tablet_manager.cc:1397] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.400s user 0.001s sys 0.006s
I20260620 07:01:14.054831 1170 raft_consensus.cc:348] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.060966 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "134f76587b6147afaf4e94fde5574efc" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:14.061190 894 raft_consensus.cc:2454] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
W20260620 07:01:14.061260 831 leader_election.cc:341] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.061371 831 leader_election.cc:302] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:14.061843 2204 raft_consensus.cc:2726] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.062434 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d4ef3ba51e432f889fb927a6af8b49" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:14.062650 890 raft_consensus.cc:3037] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:14.065817 890 raft_consensus.cc:2454] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:14.060389 2158 raft_consensus.cc:2726] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:14.062706 683 leader_election.cc:341] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 2910da33bbdb4410a4a90ff9747a7de1
I20260620 07:01:14.066272 683 leader_election.cc:302] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.066498 2158 raft_consensus.cc:2726] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.066632 683 leader_election.cc:302] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:14.066852 2158 raft_consensus.cc:2781] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:14.066908 2158 raft_consensus.cc:482] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:14.066962 2158 raft_consensus.cc:3037] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:14.067051 683 leader_election.cc:302] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:14.067795 2204 raft_consensus.cc:482] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.067899 2204 raft_consensus.cc:504] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.068398 2204 leader_election.cc:288] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:14.069067 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4302edba0ec04d7abc2789bc7be1beca" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:14.069308 2158 raft_consensus.cc:504] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:14.069579 830 leader_election.cc:341] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.069801 2158 leader_election.cc:288] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:14.069953 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4302edba0ec04d7abc2789bc7be1beca" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:14.070065 2158 raft_consensus.cc:2781] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:14.070183 2158 raft_consensus.cc:686] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:14.070351 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "134f76587b6147afaf4e94fde5574efc" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:14.070381 2158 consensus_queue.cc:237] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.070501 890 raft_consensus.cc:3037] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:14.066123 2210 raft_consensus.cc:482] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.070883 2210 raft_consensus.cc:504] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.071277 2210 leader_election.cc:288] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:14.074191 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "134f76587b6147afaf4e94fde5574efc" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:14.074363 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5208f3136bcd45579de49b8b10745122" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:14.074097 890 raft_consensus.cc:2454] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:14.074760 831 leader_election.cc:341] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.074884 831 leader_election.cc:302] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:14.075313 2204 raft_consensus.cc:2726] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.075924 683 leader_election.cc:302] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:14.076290 1920 raft_consensus.cc:2781] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:14.076412 1920 raft_consensus.cc:686] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
W20260620 07:01:14.076599 683 leader_election.cc:341] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 5208f3136bcd45579de49b8b10745122
I20260620 07:01:14.076628 1920 consensus_queue.cc:237] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.077559 2188 consensus_queue.cc:1035] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:14.078039 681 leader_election.cc:341] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:14.078414 681 leader_election.cc:341] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.078490 681 leader_election.cc:302] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.078859 2210 raft_consensus.cc:2726] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.096113 1170 raft_consensus.cc:374] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.096336 1170 raft_consensus.cc:729] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.096622 1170 consensus_queue.cc:260] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.097368 1170 ts_tablet_manager.cc:1428] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.043s user 0.002s sys 0.000s
I20260620 07:01:14.097689 1170 tablet_bootstrap.cc:492] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:14.099171 1170 tablet_bootstrap.cc:654] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.100026 1169 ts_tablet_manager.cc:1918] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.100194 1169 log.cc:1196] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ed69a44c466047d298cf7653b2a2bb23
I20260620 07:01:14.100613 1169 ts_tablet_manager.cc:1939] T ed69a44c466047d298cf7653b2a2bb23 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.101190 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 797) took 1686 ms. Trace:
I20260620 07:01:14.101358 1169 rpcz_store.cc:276] 0620 07:01:12.415185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.415244 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:13.605771 (+1190527us) ts_tablet_manager.cc:1145] Deleting tablet ed69a44c466047d298cf7653b2a2bb23
0620 07:01:13.605785 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.730020 (+124235us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:13.919757 (+189737us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.101172 (+181415us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190326}
I20260620 07:01:14.102016 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ed69a44c466047d298cf7653b2a2bb23 (table default.Table_f99b2d2b64ca4a6b8acb835f5dbbc740 [id=e0814f1fc9264eae8150af51e6ede5f1]) successfully deleted
I20260620 07:01:14.102546 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 798) took 1533 ms. Trace:
I20260620 07:01:14.102689 1169 rpcz_store.cc:276] 0620 07:01:12.569292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.569351 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:14.102418 (+1533067us) ts_tablet_manager.cc:1145] Deleting tablet 9e07325dc3f649aca9c5fc21c47d360f
0620 07:01:14.102429 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.102529 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1532819}
W20260620 07:01:14.103266 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 9e07325dc3f649aca9c5fc21c47d360f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e07325dc3f649aca9c5fc21c47d360f already in progress: creating tablet
I20260620 07:01:14.103668 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 799) took 1534 ms. Trace:
I20260620 07:01:14.103827 1169 rpcz_store.cc:276] 0620 07:01:12.569433 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.570871 (+ 1438us) service_pool.cc:227] Handling call
0620 07:01:14.103552 (+1532681us) ts_tablet_manager.cc:1145] Deleting tablet 2823c6f6ab334550bbcff7eee49810c1
0620 07:01:14.103562 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.103652 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1532415}
W20260620 07:01:14.104323 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2823c6f6ab334550bbcff7eee49810c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2823c6f6ab334550bbcff7eee49810c1 already in progress: creating tablet
I20260620 07:01:14.104691 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 800) took 1373 ms. Trace:
I20260620 07:01:14.104815 1169 rpcz_store.cc:276] 0620 07:01:12.731297 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.731346 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:14.104589 (+1373243us) ts_tablet_manager.cc:1145] Deleting tablet 4b565f418cc54d77ba9d405a7d024646
0620 07:01:14.104599 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.104675 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1373032}
W20260620 07:01:14.105235 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 4b565f418cc54d77ba9d405a7d024646 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b565f418cc54d77ba9d405a7d024646 already in progress: creating tablet
I20260620 07:01:14.105595 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 802) took 1311 ms. Trace:
I20260620 07:01:14.105751 1169 rpcz_store.cc:276] 0620 07:01:12.793955 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.794012 (+ 57us) service_pool.cc:227] Handling call
0620 07:01:14.105505 (+1311493us) ts_tablet_manager.cc:1145] Deleting tablet 39f1e3760868420d82ccf925e739e121
0620 07:01:14.105514 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.105580 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1311284}
I20260620 07:01:14.125310 1167 tablet_bootstrap.cc:492] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:14.125461 1165 ts_tablet_manager.cc:1918] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.125574 1165 log.cc:1196] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/6229a52adf8d4b17bdf89347e01621ed
I20260620 07:01:14.125747 1167 ts_tablet_manager.cc:1397] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.519s user 0.013s sys 0.004s
I20260620 07:01:14.125864 1165 ts_tablet_manager.cc:1939] T 6229a52adf8d4b17bdf89347e01621ed P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.126729 1167 raft_consensus.cc:348] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.127074 1167 raft_consensus.cc:374] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.127167 1167 raft_consensus.cc:729] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.127442 1167 consensus_queue.cc:260] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.128041 1167 ts_tablet_manager.cc:1428] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:14.129429 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 6229a52adf8d4b17bdf89347e01621ed (table default.Table_7eafc8e838624e3e9873bc01998b5daa [id=e4ea9f9e77f74312a2ead7c22390b268]) successfully deleted
I20260620 07:01:14.129781 1165 tablet_replica.cc:330] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.129982 1165 raft_consensus.cc:2229] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.130141 1165 raft_consensus.cc:2258] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.130852 1165 ts_tablet_manager.cc:1905] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:14.115159 681 consensus_peers.cc:487] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:14.120452 2188 raft_consensus.cc:482] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.132232 2188 raft_consensus.cc:504] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.132856 2188 leader_election.cc:288] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:14.133791 683 leader_election.cc:341] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8cca283f4d2645c0b59f750949b7e263
W20260620 07:01:14.134156 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 39f1e3760868420d82ccf925e739e121 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39f1e3760868420d82ccf925e739e121 already in progress: creating tablet
W20260620 07:01:14.134864 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f5004b6e28431db1a2b9d1e8c0cfcf already in progress: creating tablet
W20260620 07:01:14.135438 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet fa0b581de06149cf93b469a4a095573b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa0b581de06149cf93b469a4a095573b already in progress: creating tablet
I20260620 07:01:14.135732 1169 tablet_replica.cc:330] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.135953 1169 raft_consensus.cc:2229] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.136168 1169 raft_consensus.cc:2258] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.136736 1169 ts_tablet_manager.cc:1905] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.145840 1165 ts_tablet_manager.cc:1918] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.145988 1165 log.cc:1196] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/864c95b908674e4f8425d765444c281b
I20260620 07:01:14.146301 1165 ts_tablet_manager.cc:1939] T 864c95b908674e4f8425d765444c281b P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.146894 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 864c95b908674e4f8425d765444c281b (table default.Table_3af42fa4c4614dab89c7853707b243cb [id=f3a3145cdeb841329b0b4af9d9aa4235]) successfully deleted
I20260620 07:01:14.147733 1989 raft_consensus.cc:482] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.147862 1989 raft_consensus.cc:504] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.148420 1989 leader_election.cc:288] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:14.149161 969 leader_election.cc:341] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 2910da33bbdb4410a4a90ff9747a7de1
I20260620 07:01:14.149114 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2910da33bbdb4410a4a90ff9747a7de1" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:14.149324 752 raft_consensus.cc:2454] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:14.149454 1165 tablet_replica.cc:330] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.149654 1165 raft_consensus.cc:2229] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.149809 1165 raft_consensus.cc:2258] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.150002 968 leader_election.cc:302] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:14.150278 1989 raft_consensus.cc:2781] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:14.150346 1989 raft_consensus.cc:482] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:14.150352 1165 ts_tablet_manager.cc:1905] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.150413 1989 raft_consensus.cc:3037] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:14.153096 1989 raft_consensus.cc:504] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.153647 1989 leader_election.cc:288] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:14.154443 969 leader_election.cc:341] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 2910da33bbdb4410a4a90ff9747a7de1
I20260620 07:01:14.155160 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2910da33bbdb4410a4a90ff9747a7de1" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:14.155413 752 raft_consensus.cc:3037] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:14.158252 752 raft_consensus.cc:2454] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:14.159535 968 leader_election.cc:302] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:14.159997 1989 raft_consensus.cc:2781] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:14.160238 1989 raft_consensus.cc:686] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:14.160516 1989 consensus_queue.cc:237] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.165596 2188 raft_consensus.cc:482] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.165747 2188 raft_consensus.cc:504] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.166252 2188 leader_election.cc:288] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:14.167495 683 leader_election.cc:341] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: eea1525b54cc42b78180ba6867957f76
I20260620 07:01:14.168314 1165 ts_tablet_manager.cc:1918] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.168423 1165 log.cc:1196] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/333eef8b98da4a279acceaead9405149
I20260620 07:01:14.168718 1165 ts_tablet_manager.cc:1939] T 333eef8b98da4a279acceaead9405149 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.169729 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 333eef8b98da4a279acceaead9405149 (table default.Table_e032d39a4bb74ed18c922fb3ba622d07 [id=1135222d9b5f4d14bb527056194a68cd]) successfully deleted
W20260620 07:01:14.171110 414 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 52d2a46f972e45f5aeadb09101a68149 (table default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 52d2a46f972e45f5aeadb09101a68149 consensus state has no leader
I20260620 07:01:14.179658 1165 tablet_replica.cc:330] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.180006 1165 raft_consensus.cc:2229] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.180264 1165 raft_consensus.cc:2258] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.180919 1165 ts_tablet_manager.cc:1905] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.184808 2204 raft_consensus.cc:482] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.184990 2204 raft_consensus.cc:504] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.185721 2204 leader_election.cc:288] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:14.188043 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:14.188716 831 leader_election.cc:341] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.190749 1165 ts_tablet_manager.cc:1918] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.190913 1165 log.cc:1196] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/4302edba0ec04d7abc2789bc7be1beca
I20260620 07:01:14.191232 1165 ts_tablet_manager.cc:1939] T 4302edba0ec04d7abc2789bc7be1beca P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.191505 1170 tablet_bootstrap.cc:492] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:14.192308 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 4302edba0ec04d7abc2789bc7be1beca (table default.Table_4d3d2172df004ee39d7e56f81179364f [id=d553eceadb64462ba38a1e7026cb0a83]) successfully deleted
I20260620 07:01:14.194762 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cca283f4d2645c0b59f750949b7e263" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:14.194965 1165 tablet_replica.cc:330] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.195148 1165 raft_consensus.cc:2229] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.195314 1165 raft_consensus.cc:2258] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.195319 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea1525b54cc42b78180ba6867957f76" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:14.195731 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:14.196465 1167 tablet_bootstrap.cc:492] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:14.196393 830 leader_election.cc:341] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.196543 830 leader_election.cc:302] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:14.195880 681 leader_election.cc:341] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.196795 681 leader_election.cc:302] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.197006 2204 raft_consensus.cc:2726] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.195840 1165 ts_tablet_manager.cc:1905] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:14.197184 681 leader_election.cc:341] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.197273 681 leader_election.cc:302] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.197780 2188 raft_consensus.cc:2726] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.197913 2188 raft_consensus.cc:2726] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.199360 1170 ts_tablet_manager.cc:1397] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.102s user 0.003s sys 0.001s
I20260620 07:01:14.204540 1170 raft_consensus.cc:348] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.208804 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ebd9df1a33ed4e7b997a386158460a9a
I20260620 07:01:14.209312 426 catalog_manager.cc:6565] ReplaceTablet: tablet ebd9df1a33ed4e7b997a386158460a9a deleted and replaced by tablet 7cae8b9bbb0e4a7d89b1c970e73d1405
I20260620 07:01:14.210644 1167 tablet_bootstrap.cc:654] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:14.210968 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3513341e1b664af1813f2b4ffbce1535 consensus state has no leader
I20260620 07:01:14.211050 1170 raft_consensus.cc:374] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.211068 1168 tablet_bootstrap.cc:492] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.211118 1170 raft_consensus.cc:729] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.211268 1168 ts_tablet_manager.cc:1397] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.180s user 0.012s sys 0.020s
I20260620 07:01:14.211443 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_98730c8b3adc487e872a10c6df721a4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.211987 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98730c8b3adc487e872a10c6df721a4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.212014 1168 raft_consensus.cc:348] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.212214 1168 raft_consensus.cc:374] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.212271 1168 raft_consensus.cc:729] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.212523 1168 consensus_queue.cc:260] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.212561 1170 consensus_queue.cc:260] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.213091 857 tablet_service.cc:1514] Processing DeleteTablet for tablet ebd9df1a33ed4e7b997a386158460a9a with delete_type TABLET_DATA_DELETED (replaced by tablet 7cae8b9bbb0e4a7d89b1c970e73d1405) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.213182 1170 ts_tablet_manager.cc:1428] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260620 07:01:14.214730 1168 ts_tablet_manager.cc:1428] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:14.214756 725 tablet_service.cc:1514] Processing DeleteTablet for tablet ebd9df1a33ed4e7b997a386158460a9a with delete_type TABLET_DATA_DELETED (replaced by tablet 7cae8b9bbb0e4a7d89b1c970e73d1405) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.215008 1168 tablet_bootstrap.cc:492] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.215950 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet ebd9df1a33ed4e7b997a386158460a9a with delete_type TABLET_DATA_DELETED (replaced by tablet 7cae8b9bbb0e4a7d89b1c970e73d1405) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.218218 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:14.218626 1168 tablet_bootstrap.cc:654] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.221035 1165 ts_tablet_manager.cc:1918] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.221148 1165 log.cc:1196] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/704e8aaabe6d40138b6611bdc30abf16
I20260620 07:01:14.221451 1165 ts_tablet_manager.cc:1939] T 704e8aaabe6d40138b6611bdc30abf16 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.223484 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 704e8aaabe6d40138b6611bdc30abf16 (table default.Table_5345217f0b8545a29bddb73746b3d846 [id=6a49cf444e3b409bbf2fc6a73764cfe6]) successfully deleted
I20260620 07:01:14.235145 1169 ts_tablet_manager.cc:1918] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:14.235293 1169 log.cc:1196] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/62ef9a12e3684d27b6696f631c68a5af
W20260620 07:01:14.236698 1006 consensus_meta.cc:287] T 1ce25c8fd7334d1c9d35e33122d58a19 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent flushing consensus metadata: real 0.526s user 0.016s sys 0.003s
I20260620 07:01:14.237103 1166 ts_tablet_manager.cc:1918] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.239070 1166 log.cc:1196] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/360880717af145628606b5b9fb26e350
I20260620 07:01:14.239784 1166 ts_tablet_manager.cc:1939] T 360880717af145628606b5b9fb26e350 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:14.242182 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 610) took 5823 ms. Trace:
I20260620 07:01:14.242261 1166 rpcz_store.cc:276] 0620 07:01:08.416851 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.417192 (+ 341us) service_pool.cc:227] Handling call
0620 07:01:13.962029 (+5544837us) ts_tablet_manager.cc:1145] Deleting tablet 360880717af145628606b5b9fb26e350
0620 07:01:13.962041 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:13.996096 (+ 34055us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.237016 (+240920us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.240495 (+ 3479us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5544624}
I20260620 07:01:14.242606 2173 log.cc:824] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: Log is configured to *not* fsync() on all Append() calls
I20260620 07:01:14.242697 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 360880717af145628606b5b9fb26e350 (table default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]) successfully deleted
I20260620 07:01:14.243076 1166 tablet_replica.cc:330] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:14.243283 1166 raft_consensus.cc:2229] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.243423 1166 raft_consensus.cc:2258] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.244242 1166 ts_tablet_manager.cc:1905] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.248140 1168 tablet_bootstrap.cc:492] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.248309 1168 ts_tablet_manager.cc:1397] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.001s
I20260620 07:01:14.249145 1168 raft_consensus.cc:348] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.249429 1168 raft_consensus.cc:374] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.249500 1168 raft_consensus.cc:729] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.249778 1168 consensus_queue.cc:260] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:14.250283 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 02584f8ac08f4759a5f9a5aa699d0039 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02584f8ac08f4759a5f9a5aa699d0039 already in progress: creating tablet
W20260620 07:01:14.251255 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet de6ccea1cd074afb9fef17c8e07f444f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de6ccea1cd074afb9fef17c8e07f444f already in progress: creating tablet
I20260620 07:01:14.251622 1165 tablet_replica.cc:330] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.251871 1168 ts_tablet_manager.cc:1428] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:14.252121 1168 tablet_bootstrap.cc:492] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.252410 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_713f54def2154a459120edcb5208b0e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.253019 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_713f54def2154a459120edcb5208b0e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.253448 1168 tablet_bootstrap.cc:654] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.254216 1165 raft_consensus.cc:2229] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.254374 1165 raft_consensus.cc:2258] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.255119 1165 ts_tablet_manager.cc:1905] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.258260 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1e69a691960c4df38749120eed30b12e" } modify_external_catalogs: true
I20260620 07:01:14.258476 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1e69a691960c4df38749120eed30b12e" } modify_external_catalogs: true
I20260620 07:01:14.263710 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_40893b674e3c45f897680cef510a227d" } modify_external_catalogs: true
I20260620 07:01:14.263947 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_40893b674e3c45f897680cef510a227d" } modify_external_catalogs: true
W20260620 07:01:14.265565 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 228af95ef5b24823a4a98b876a50d9af consensus state has no leader
I20260620 07:01:14.266062 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_18967e0d91a4466bb91f79226d99cca5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.266594 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18967e0d91a4466bb91f79226d99cca5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.269680 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_76c9c7cd30ad48e1ae0eca9e170fd5d5" } modify_external_catalogs: true
I20260620 07:01:14.269920 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_76c9c7cd30ad48e1ae0eca9e170fd5d5" } modify_external_catalogs: true
I20260620 07:01:14.277333 1165 ts_tablet_manager.cc:1918] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.277462 1165 log.cc:1196] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/95a109e7871241ec9467858dca467bbe
I20260620 07:01:14.277763 1165 ts_tablet_manager.cc:1939] T 95a109e7871241ec9467858dca467bbe P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.278373 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 95a109e7871241ec9467858dca467bbe (table default.Table_61fb27a9ecc44d718bdfa4051514a36a [id=2f50ee8c71f8435aad169b0637348a30]) successfully deleted
I20260620 07:01:14.278537 1165 tablet_replica.cc:330] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.278715 1165 raft_consensus.cc:2229] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.278884 1165 raft_consensus.cc:2258] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:14.279045 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 already in progress: creating tablet
W20260620 07:01:14.279340 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8aa5c040d5e84006935e9f06424a34b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aa5c040d5e84006935e9f06424a34b4 already in progress: creating tablet
I20260620 07:01:14.279397 1165 ts_tablet_manager.cc:1905] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:14.285077 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d28b8e8db31a49838bf47c79856bec41 consensus state has no leader
W20260620 07:01:14.286558 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30a29b251bfd419c93e0e2dac8693937 consensus state has no leader
I20260620 07:01:14.291922 1167 tablet_bootstrap.cc:492] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:14.292245 1167 ts_tablet_manager.cc:1397] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.000s
I20260620 07:01:14.293437 1167 raft_consensus.cc:348] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.296470 1167 raft_consensus.cc:374] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.296800 1167 raft_consensus.cc:729] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.297130 1167 consensus_queue.cc:260] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.301792 1165 ts_tablet_manager.cc:1918] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.301931 1165 log.cc:1196] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ba93e22c4720417c99d471b9c8b49b86
I20260620 07:01:14.302229 1165 ts_tablet_manager.cc:1939] T ba93e22c4720417c99d471b9c8b49b86 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.302888 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ba93e22c4720417c99d471b9c8b49b86 (table default.Table_222fe401283741dfbd8316b30e97e70d [id=f974e84fd3e44839bf7da901087aa984]) successfully deleted
I20260620 07:01:14.303335 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 96453f82ff3048beabeb188fb27dee42 (table default.Table_7e1bd0d27961486986559381614efd38 [id=7c6337d452d64674bd95e1738caa4345]). Expected version 2 got 0
I20260620 07:01:14.305338 1165 tablet_replica.cc:330] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.305539 1165 raft_consensus.cc:2229] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.305689 1165 raft_consensus.cc:2258] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.306200 1165 ts_tablet_manager.cc:1905] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.309038 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6d2275d5f69744859ef7115f74c45781" } modify_external_catalogs: true
I20260620 07:01:14.309346 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6d2275d5f69744859ef7115f74c45781" } modify_external_catalogs: true
I20260620 07:01:14.311901 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 2910da33bbdb4410a4a90ff9747a7de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.315615 1167 ts_tablet_manager.cc:1428] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260620 07:01:14.242012 2188 consensus_queue.cc:1035] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:14.316203 1169 ts_tablet_manager.cc:1939] T 62ef9a12e3684d27b6696f631c68a5af P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.317009 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 805) took 1030 ms. Trace:
I20260620 07:01:14.317103 1169 rpcz_store.cc:276] 0620 07:01:13.286870 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.286930 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:14.135685 (+848755us) ts_tablet_manager.cc:1145] Deleting tablet 62ef9a12e3684d27b6696f631c68a5af
0620 07:01:14.135694 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.232058 (+ 96364us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.235041 (+ 2983us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.316987 (+ 81946us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":800076}
I20260620 07:01:14.317559 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 62ef9a12e3684d27b6696f631c68a5af (table default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]) successfully deleted
I20260620 07:01:14.319063 1169 tablet_replica.cc:330] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.319320 1169 raft_consensus.cc:2229] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:14.319656 1169 pending_rounds.cc:62] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:14.319762 1169 pending_rounds.cc:68] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821622307966976 op_type: NO_OP noop_request { }
I20260620 07:01:14.319942 1169 raft_consensus.cc:2866] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:14.320245 1169 raft_consensus.cc:2258] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.321897 1169 ts_tablet_manager.cc:1905] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.249716 1170 tablet_bootstrap.cc:492] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:14.276171 725 tablet_service.cc:1514] Processing DeleteTablet for tablet c38c628514c44c6fa5aff64928e515d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.328722 1170 tablet_bootstrap.cc:654] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.332935 1165 ts_tablet_manager.cc:1918] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.333065 1165 log.cc:1196] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/d51c7488711b4db697b48025a5ba6e9d
I20260620 07:01:14.335119 1169 ts_tablet_manager.cc:1918] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:14.335260 1165 ts_tablet_manager.cc:1939] T d51c7488711b4db697b48025a5ba6e9d P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.335804 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet d51c7488711b4db697b48025a5ba6e9d (table default.Table_8bb5c7631c6145c49b7b09fcda4e4554 [id=ca832808e4a449deab0a9c100d5ead0b]) successfully deleted
W20260620 07:01:14.336108 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ebd9df1a33ed4e7b997a386158460a9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebd9df1a33ed4e7b997a386158460a9a already in progress: creating tablet
I20260620 07:01:14.339083 1167 tablet_bootstrap.cc:492] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:14.340914 1167 tablet_bootstrap.cc:654] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.335166 1920 consensus_queue.cc:1035] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:14.345146 1169 log.cc:1196] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/168fb1666e2c41358213240d34ef9572
I20260620 07:01:14.345561 1169 ts_tablet_manager.cc:1939] T 168fb1666e2c41358213240d34ef9572 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.350229 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 168fb1666e2c41358213240d34ef9572 (table default.Table_83d56d1245704fd3935391f2558b3e89 [id=2920611d71ce4939bc2e2201f2e411ac]) successfully deleted
I20260620 07:01:14.351075 1169 tablet_replica.cc:330] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.351531 1169 raft_consensus.cc:2229] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.352042 1169 raft_consensus.cc:2258] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.353251 1169 ts_tablet_manager.cc:1905] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.371191 1169 ts_tablet_manager.cc:1918] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:14.376113 1169 log.cc:1196] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/9a46df2909bf43f297b412c33f18a329
I20260620 07:01:14.376621 1169 ts_tablet_manager.cc:1939] T 9a46df2909bf43f297b412c33f18a329 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.376896 1167 tablet_bootstrap.cc:492] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:14.377039 1167 ts_tablet_manager.cc:1397] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.015s
I20260620 07:01:14.377969 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 9a46df2909bf43f297b412c33f18a329 (table default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]) successfully deleted
I20260620 07:01:14.377807 1167 raft_consensus.cc:348] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.378182 1167 raft_consensus.cc:374] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.378247 1167 raft_consensus.cc:729] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.378472 1167 consensus_queue.cc:260] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.379266 1169 tablet_replica.cc:330] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.379477 1169 raft_consensus.cc:2229] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.380712 1169 raft_consensus.cc:2258] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.380767 1167 ts_tablet_manager.cc:1428] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 07:01:14.381034 1167 tablet_bootstrap.cc:492] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:14.381397 1169 ts_tablet_manager.cc:1905] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.384640 1167 tablet_bootstrap.cc:654] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.394289 1170 tablet_bootstrap.cc:492] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:14.394441 1170 ts_tablet_manager.cc:1397] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.145s user 0.002s sys 0.005s
I20260620 07:01:14.395182 1170 raft_consensus.cc:348] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.395401 1170 raft_consensus.cc:374] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.395459 1170 raft_consensus.cc:729] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.395650 1170 consensus_queue.cc:260] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.397718 2204 raft_consensus.cc:482] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.397850 2204 raft_consensus.cc:504] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.398449 2204 leader_election.cc:288] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:14.400111 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:14.400293 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:14.400658 831 leader_election.cc:341] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:14.401062 830 leader_election.cc:341] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.401160 830 leader_election.cc:302] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:14.401592 2204 raft_consensus.cc:2726] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.404326 1168 tablet_bootstrap.cc:492] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.404452 1168 ts_tablet_manager.cc:1397] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.152s user 0.026s sys 0.039s
I20260620 07:01:14.405119 1168 raft_consensus.cc:348] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.405328 1168 raft_consensus.cc:374] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.405388 1168 raft_consensus.cc:729] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.405561 1168 consensus_queue.cc:260] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.406433 1170 ts_tablet_manager.cc:1428] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260620 07:01:14.407266 1167 tablet_bootstrap.cc:492] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:14.406771 1170 tablet_bootstrap.cc:492] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:14.409714 1170 tablet_bootstrap.cc:654] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.410380 1168 ts_tablet_manager.cc:1428] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260620 07:01:14.410802 1168 tablet_bootstrap.cc:492] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.412153 1167 ts_tablet_manager.cc:1397] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.002s
I20260620 07:01:14.414752 1168 tablet_bootstrap.cc:654] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.408154 1169 ts_tablet_manager.cc:1918] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.421604 1169 log.cc:1196] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/b5e08a38c42d4e3da20292343bf085b9
I20260620 07:01:14.421953 1169 ts_tablet_manager.cc:1939] T b5e08a38c42d4e3da20292343bf085b9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.422760 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 807) took 1003 ms. Trace:
I20260620 07:01:14.422888 1169 rpcz_store.cc:276] 0620 07:01:13.419264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.419702 (+ 438us) service_pool.cc:227] Handling call
0620 07:01:14.378571 (+958869us) ts_tablet_manager.cc:1145] Deleting tablet b5e08a38c42d4e3da20292343bf085b9
0620 07:01:14.378582 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.392897 (+ 14315us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.408050 (+ 15153us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.422707 (+ 14657us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":958735}
I20260620 07:01:14.423209 1169 tablet_replica.cc:330] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.423344 1168 tablet_bootstrap.cc:492] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.423393 1169 raft_consensus.cc:2229] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.423480 1168 ts_tablet_manager.cc:1397] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260620 07:01:14.423563 1169 raft_consensus.cc:2258] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.423795 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet b5e08a38c42d4e3da20292343bf085b9 (table default.Table_17a1cb1a99834485911d40165811a7f1 [id=7ce4d1b95a984ccabd629f933ccaff8c]) successfully deleted
I20260620 07:01:14.424434 1168 raft_consensus.cc:348] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.424642 1168 raft_consensus.cc:374] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.424691 1168 raft_consensus.cc:729] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.424901 1168 consensus_queue.cc:260] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.426671 1167 raft_consensus.cc:348] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.429687 1168 ts_tablet_manager.cc:1428] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:14.429996 1168 tablet_bootstrap.cc:492] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.431293 1169 ts_tablet_manager.cc:1905] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.435815 1168 tablet_bootstrap.cc:654] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.447445 1170 tablet_bootstrap.cc:492] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:14.447858 1170 ts_tablet_manager.cc:1397] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.003s
I20260620 07:01:14.449534 1170 raft_consensus.cc:348] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.450066 1170 raft_consensus.cc:374] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.450230 1170 raft_consensus.cc:729] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.450706 1170 consensus_queue.cc:260] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.454824 1169 ts_tablet_manager.cc:1918] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260620 07:01:14.471367 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c0b0969fb784dba96459ea441f88ae9 consensus state has no leader
I20260620 07:01:14.474129 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7f85c8a0ea484b57bb50425867e2774e
I20260620 07:01:14.456615 1170 ts_tablet_manager.cc:1428] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260620 07:01:14.475028 1169 log.cc:1196] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/a292d66ee14a48959c1f6a63e0a0f492
I20260620 07:01:14.475484 1169 ts_tablet_manager.cc:1939] T a292d66ee14a48959c1f6a63e0a0f492 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.475528 1170 tablet_bootstrap.cc:492] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:14.477581 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f85c8a0ea484b57bb50425867e2774e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.478526 1170 tablet_bootstrap.cc:654] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.481600 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f85c8a0ea484b57bb50425867e2774e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.483155 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 809) took 1063 ms. Trace:
I20260620 07:01:14.483345 1169 rpcz_store.cc:276] 0620 07:01:13.419451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.419861 (+ 410us) service_pool.cc:227] Handling call
0620 07:01:14.423164 (+1003303us) ts_tablet_manager.cc:1145] Deleting tablet a292d66ee14a48959c1f6a63e0a0f492
0620 07:01:14.423174 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.434418 (+ 11244us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.454638 (+ 20220us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.483128 (+ 28490us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1005440,"tablet-delete.queue_time_us":1003165}
W20260620 07:01:14.483695 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7f85c8a0ea484b57bb50425867e2774e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f85c8a0ea484b57bb50425867e2774e already in progress: creating tablet
I20260620 07:01:14.484094 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet a292d66ee14a48959c1f6a63e0a0f492 (table default.Table_a31b6fbb7c36401aae31f37d6bcb978e [id=f178692be04f4e4db4933fb296012ddd]) successfully deleted
I20260620 07:01:14.484555 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 812) took 1007 ms. Trace:
I20260620 07:01:14.484701 1169 rpcz_store.cc:276] 0620 07:01:13.476705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.476776 (+ 71us) service_pool.cc:227] Handling call
0620 07:01:14.484419 (+1007643us) ts_tablet_manager.cc:1145] Deleting tablet b40e1ea4d1c74be2906381064c73f8c5
0620 07:01:14.484435 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.484536 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1007343}
W20260620 07:01:14.485282 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b40e1ea4d1c74be2906381064c73f8c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b40e1ea4d1c74be2906381064c73f8c5 already in progress: creating tablet
I20260620 07:01:14.485706 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 813) took 1004 ms. Trace:
I20260620 07:01:14.485850 1169 rpcz_store.cc:276] 0620 07:01:13.481358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.481418 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:14.485592 (+1004174us) ts_tablet_manager.cc:1145] Deleting tablet f4f77b677ab34d9b8554de0da6564fb1
0620 07:01:14.485603 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.485690 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1003925}
W20260620 07:01:14.486837 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f4f77b677ab34d9b8554de0da6564fb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4f77b677ab34d9b8554de0da6564fb1 already in progress: creating tablet
I20260620 07:01:14.487185 2204 raft_consensus.cc:482] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.487254 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 811) took 1014 ms. Trace:
I20260620 07:01:14.487375 1167 raft_consensus.cc:374] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.487335 1169 rpcz_store.cc:276] 0620 07:01:13.472707 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.472818 (+ 111us) service_pool.cc:227] Handling call
0620 07:01:14.487144 (+1014326us) ts_tablet_manager.cc:1145] Deleting tablet 64addb9379b247dfa678e2a0ae1af0cf
0620 07:01:14.487155 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.487239 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1003758}
I20260620 07:01:14.487447 1167 raft_consensus.cc:729] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.487375 2204 raft_consensus.cc:504] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.415285 1166 ts_tablet_manager.cc:1918] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.480124 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f85c8a0ea484b57bb50425867e2774e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.487746 1166 log.cc:1196] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/add9e860802d4edebcfbc9fa3c4a6b24
W20260620 07:01:14.487747 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 64addb9379b247dfa678e2a0ae1af0cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64addb9379b247dfa678e2a0ae1af0cf already in progress: creating tablet
I20260620 07:01:14.488076 2204 leader_election.cc:288] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:14.488610 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e70b585def4a4a9081a0938af8ce5b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:14.488741 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e70b585def4a4a9081a0938af8ce5b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:14.489310 831 leader_election.cc:341] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:14.489662 830 leader_election.cc:341] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.489722 1166 ts_tablet_manager.cc:1939] T add9e860802d4edebcfbc9fa3c4a6b24 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:14.489774 830 leader_election.cc:302] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:14.490224 2204 raft_consensus.cc:2726] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.490625 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 810) took 1022 ms. Trace:
I20260620 07:01:14.490661 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 611) took 6073 ms. Trace:
I20260620 07:01:14.490846 1169 rpcz_store.cc:276] 0620 07:01:13.467888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.467973 (+ 85us) service_pool.cc:227] Handling call
0620 07:01:14.490498 (+1022525us) ts_tablet_manager.cc:1145] Deleting tablet 5f04603a2fe84988ac9c9975e94ce9ae
0620 07:01:14.490512 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.490608 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1006657}
W20260620 07:01:14.491384 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5f04603a2fe84988ac9c9975e94ce9ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f04603a2fe84988ac9c9975e94ce9ae already in progress: creating tablet
I20260620 07:01:14.491631 1166 rpcz_store.cc:276] 0620 07:01:08.416964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.417442 (+ 478us) service_pool.cc:227] Handling call
0620 07:01:14.243031 (+5825589us) ts_tablet_manager.cc:1145] Deleting tablet add9e860802d4edebcfbc9fa3c4a6b24
0620 07:01:14.243040 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.371831 (+128791us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.415177 (+ 43346us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.490640 (+ 75463us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5825437}
W20260620 07:01:14.492146 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet cf978ab301954866aeb77b7abaf2c77e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf978ab301954866aeb77b7abaf2c77e already in progress: creating tablet
I20260620 07:01:14.491181 1167 consensus_queue.cc:260] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.492705 1167 ts_tablet_manager.cc:1428] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.067s user 0.002s sys 0.000s
W20260620 07:01:14.492779 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 already in progress: creating tablet
I20260620 07:01:14.493044 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet add9e860802d4edebcfbc9fa3c4a6b24 (table default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]) successfully deleted
W20260620 07:01:14.493422 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f8ec1e179a704e5480f3deaf856156e7 because the tablet was not found. No further retry: Not found: Tablet not found: f8ec1e179a704e5480f3deaf856156e7
I20260620 07:01:14.493858 1169 tablet_replica.cc:330] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.494572 1169 raft_consensus.cc:2229] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.494899 1169 raft_consensus.cc:2258] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.495620 1169 ts_tablet_manager.cc:1905] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.499125 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ddd53657848a4ab291d48956d5778d7b
I20260620 07:01:14.499428 1168 tablet_bootstrap.cc:492] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.499640 1168 ts_tablet_manager.cc:1397] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.070s user 0.012s sys 0.017s
I20260620 07:01:14.500276 725 tablet_service.cc:1514] Processing DeleteTablet for tablet ddd53657848a4ab291d48956d5778d7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.501135 857 tablet_service.cc:1514] Processing DeleteTablet for tablet ddd53657848a4ab291d48956d5778d7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.502017 1170 tablet_bootstrap.cc:492] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:01:14.502002 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ddd53657848a4ab291d48956d5778d7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddd53657848a4ab291d48956d5778d7b already in progress: creating tablet
I20260620 07:01:14.502261 1170 ts_tablet_manager.cc:1397] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.001s
I20260620 07:01:14.503140 1170 raft_consensus.cc:348] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.503440 1170 raft_consensus.cc:374] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.503559 1170 raft_consensus.cc:729] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.503886 1170 consensus_queue.cc:260] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.504732 1170 ts_tablet_manager.cc:1428] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:14.505069 1170 tablet_bootstrap.cc:492] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:14.505864 1168 raft_consensus.cc:348] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.507841 1168 raft_consensus.cc:374] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.508059 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7c9fc0dca645486199a3d5593b381587"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:14.508551 1168 raft_consensus.cc:729] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:14.508932 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c9fc0dca645486199a3d5593b381587 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.509207 1170 tablet_bootstrap.cc:654] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.510241 1168 consensus_queue.cc:260] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.513123 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fa6b987ef48b4d669fbb2ff3ca718174"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.513871 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa6b987ef48b4d669fbb2ff3ca718174 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.514386 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2482ab78f5ea4572853295626b0aea5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.514850 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2482ab78f5ea4572853295626b0aea5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.515561 1168 ts_tablet_manager.cc:1428] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.015s user 0.001s sys 0.002s
I20260620 07:01:14.516134 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_71e114b78b5540daa771e5ade0eacfa7" } modify_external_catalogs: true
I20260620 07:01:14.516327 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_71e114b78b5540daa771e5ade0eacfa7" } modify_external_catalogs: true
I20260620 07:01:14.517750 1168 tablet_bootstrap.cc:492] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.518332 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_08264d5097d844c88353d8eb8d79c256"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:14.520195 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_094460eef3254b5a83363b9b4700dabf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.520761 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_094460eef3254b5a83363b9b4700dabf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:14.523056 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08264d5097d844c88353d8eb8d79c256 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.496575 1166 tablet_replica.cc:330] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:14.501662 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet ddd53657848a4ab291d48956d5778d7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:14.526525 969 consensus_peers.cc:487] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5014cf5cc70466bafb6921c9d46ba72. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:14.531572 1166 raft_consensus.cc:2229] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.531903 1166 raft_consensus.cc:2258] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.533093 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:14.534148 1168 tablet_bootstrap.cc:654] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.535156 1166 ts_tablet_manager.cc:1905] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.537364 1167 tablet_bootstrap.cc:492] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:14.540678 1167 tablet_bootstrap.cc:654] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.543403 1169 ts_tablet_manager.cc:1918] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.544071 1169 log.cc:1196] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/2910da33bbdb4410a4a90ff9747a7de1
I20260620 07:01:14.544587 1169 ts_tablet_manager.cc:1939] T 2910da33bbdb4410a4a90ff9747a7de1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.546080 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 2910da33bbdb4410a4a90ff9747a7de1 (table default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]) successfully deleted
I20260620 07:01:14.547345 1169 tablet_replica.cc:330] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.547824 1169 raft_consensus.cc:2229] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.553658 1168 tablet_bootstrap.cc:492] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.553882 1168 ts_tablet_manager.cc:1397] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.003s
I20260620 07:01:14.551425 1170 tablet_bootstrap.cc:492] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:14.554176 1170 ts_tablet_manager.cc:1397] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.003s
I20260620 07:01:14.555409 1170 raft_consensus.cc:348] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.555306 1168 raft_consensus.cc:348] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.555702 1168 raft_consensus.cc:374] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.555735 1170 raft_consensus.cc:374] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.555836 1168 raft_consensus.cc:729] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.555904 1170 raft_consensus.cc:729] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.556202 1170 consensus_queue.cc:260] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.556254 1168 consensus_queue.cc:260] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.557049 1170 ts_tablet_manager.cc:1428] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:14.557930 1170 tablet_bootstrap.cc:492] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:14.553967 1169 raft_consensus.cc:2258] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.559118 1169 ts_tablet_manager.cc:1905] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.561456 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:14.562122 1168 ts_tablet_manager.cc:1428] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260620 07:01:14.564493 1168 tablet_bootstrap.cc:492] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.565588 1170 tablet_bootstrap.cc:654] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.573417 1167 tablet_bootstrap.cc:492] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:14.573709 1167 ts_tablet_manager.cc:1397] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260620 07:01:14.574540 1167 raft_consensus.cc:348] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.574901 1167 raft_consensus.cc:374] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.575039 1167 raft_consensus.cc:729] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.575320 1167 consensus_queue.cc:260] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.576016 1167 ts_tablet_manager.cc:1428] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:14.576366 1989 raft_consensus.cc:482] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.576465 1989 raft_consensus.cc:504] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.577008 1989 leader_election.cc:288] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:14.577562 1168 tablet_bootstrap.cc:654] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:14.579257 968 leader_election.cc:341] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: f4e3145a872348b6a85a19d1678636bc
W20260620 07:01:14.581192 969 leader_election.cc:341] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f4e3145a872348b6a85a19d1678636bc
I20260620 07:01:14.581311 969 leader_election.cc:302] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.581741 1989 raft_consensus.cc:2726] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.582031 1167 tablet_bootstrap.cc:492] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:14.585500 1167 tablet_bootstrap.cc:654] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.588020 1080 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:14.585999 1166 ts_tablet_manager.cc:1918] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:14.589314 968 consensus_peers.cc:487] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5014cf5cc70466bafb6921c9d46ba72. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:14.589551 1166 log.cc:1196] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f9df1d52393e47ce991b5295d03624e8
I20260620 07:01:14.582921 2210 raft_consensus.cc:482] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.589857 2210 raft_consensus.cc:504] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.590466 2210 leader_election.cc:288] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:14.591261 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39504144a623423c873ded7d6839367a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:14.591893 683 leader_election.cc:341] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 39504144a623423c873ded7d6839367a
I20260620 07:01:14.595197 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5d72ef54fe32494391f31d295db01e4a" } new_table_name: "default.Table_ef330d445a3f4a0ab598b9f4ac61993e" modify_external_catalogs: true
I20260620 07:01:14.596717 425 master_service.cc:946] ReplaceTablet: received request to replace tablet b17bbf2f844b4c01ad5d6dc36e096ee5 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:14.597071 426 master_service.cc:946] ReplaceTablet: received request to replace tablet f0e6ef65b5f44f6d9f2100dd404b2e5f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:14.597859 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2056d596b0ae4f398e6c525a8016ff09" } new_table_name: "default.Table_b5e40adb30234141a83c1dbbe20db68b" modify_external_catalogs: true
W20260620 07:01:14.600821 681 leader_election.cc:341] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.600962 681 leader_election.cc:302] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.601464 2210 raft_consensus.cc:2726] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.604225 1169 ts_tablet_manager.cc:1918] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.605180 1168 tablet_bootstrap.cc:492] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.605135 1170 tablet_bootstrap.cc:492] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:14.605342 1168 ts_tablet_manager.cc:1397] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.004s
I20260620 07:01:14.605458 1170 ts_tablet_manager.cc:1397] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.003s
I20260620 07:01:14.606046 1168 raft_consensus.cc:348] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.606304 1168 raft_consensus.cc:374] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.606366 1168 raft_consensus.cc:729] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.606195 1170 raft_consensus.cc:348] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.606616 1170 raft_consensus.cc:374] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.606585 1168 consensus_queue.cc:260] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.606715 1170 raft_consensus.cc:729] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.609328 1168 ts_tablet_manager.cc:1428] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 07:01:14.609824 1168 tablet_bootstrap.cc:492] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.611537 1170 consensus_queue.cc:260] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:14.615767 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95d4f7dc014e40e8a749b40418831efb consensus state has no leader
I20260620 07:01:14.617444 2210 raft_consensus.cc:482] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.617594 2210 raft_consensus.cc:504] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:14.618049 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ce25c8fd7334d1c9d35e33122d58a19 consensus state has no leader
I20260620 07:01:14.618171 2210 leader_election.cc:288] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:14.618451 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cf36f7d3d2ac457e8097e25c5b39730b" } new_table_name: "default.Table_96e0a2412a5040ba8c91876d7263de57" modify_external_catalogs: true
I20260620 07:01:14.618357 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_930aed9ced5a425ab5fd1f3e6a7ee4e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.619006 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_930aed9ced5a425ab5fd1f3e6a7ee4e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:14.622279 683 leader_election.cc:341] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c38c628514c44c6fa5aff64928e515d9
I20260620 07:01:14.622692 1168 tablet_bootstrap.cc:654] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.624166 1170 ts_tablet_manager.cc:1428] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260620 07:01:14.624948 1170 tablet_bootstrap.cc:492] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:14.626624 1170 tablet_bootstrap.cc:654] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.626772 1169 log.cc:1196] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/eea1525b54cc42b78180ba6867957f76
I20260620 07:01:14.627988 1169 ts_tablet_manager.cc:1939] T eea1525b54cc42b78180ba6867957f76 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.628955 1169 tablet_replica.cc:330] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.629215 1169 raft_consensus.cc:2229] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.629534 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet eea1525b54cc42b78180ba6867957f76 (table default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6 [id=9ccc7eaea2334670b3c18570de5dcb3b]) successfully deleted
I20260620 07:01:14.631158 427 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 34dc2af503684aaba8388a4611fab48e (table default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9]). Expected version 1 got 0
I20260620 07:01:14.631474 427 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 2 got 0
I20260620 07:01:14.632781 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ddc492bc0f3749f4b49444e9f6f76689" } new_table_name: "default.Table_8d053cfb76e143659a645e3f8eaba768" modify_external_catalogs: true
W20260620 07:01:14.633787 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 27da98f96a2245c5b4210b7cf084886d consensus state has no leader
I20260620 07:01:14.634220 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cf1dac024eb44810b66df64acb8efa84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.634711 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf1dac024eb44810b66df64acb8efa84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.637499 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 4655d289c94c4bce9707be375fc4b850 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.637728 1165 tablet_replica.cc:330] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.637928 1165 raft_consensus.cc:2229] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.638075 1165 raft_consensus.cc:2258] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.638597 1165 ts_tablet_manager.cc:1905] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.635803 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 96453f82ff3048beabeb188fb27dee42 (table default.Table_7e1bd0d27961486986559381614efd38 [id=7c6337d452d64674bd95e1738caa4345]). Expected version 2 got 0
I20260620 07:01:14.639431 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 34dc2af503684aaba8388a4611fab48e (table default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9]). Expected version 1 got 0
I20260620 07:01:14.639595 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 5a4390225af348f89c934f0f179ddab5 (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]). Expected version 1 got 0
I20260620 07:01:14.640467 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 34dc2af503684aaba8388a4611fab48e (table default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9]). Expected version 1 got 0
I20260620 07:01:14.640659 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:14.640883 421 catalog_manager.cc:5495] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:14.641297 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:14.641673 421 catalog_manager.cc:5495] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:14.642050 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]). Expected version 3 got 0
I20260620 07:01:14.644704 1165 ts_tablet_manager.cc:1918] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.644838 1165 log.cc:1196] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/4655d289c94c4bce9707be375fc4b850
I20260620 07:01:14.645215 1165 ts_tablet_manager.cc:1939] T 4655d289c94c4bce9707be375fc4b850 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.645550 420 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 5a4390225af348f89c934f0f179ddab5 (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]). Expected version 1 got 0
I20260620 07:01:14.645735 420 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a9e70b585def4a4a9081a0938af8ce5b (table default.Table_3b7824f8ca9245a4808576761591080d [id=a876d134592d456ea2e7b8336037020f]). Expected version 2 got 0
I20260620 07:01:14.645854 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet eea1525b54cc42b78180ba6867957f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.645934 420 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:14.646317 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 4655d289c94c4bce9707be375fc4b850 (table default.Table_4b0078a40169404eb33b169cdb5f08df [id=8f652552eba04d87aad349983184c524]) successfully deleted
I20260620 07:01:14.646437 1169 raft_consensus.cc:2258] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.646993 423 master_service.cc:946] ReplaceTablet: received request to replace tablet ceb24f7e7be24b6f97b3c00f6552bbaa from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:14.647053 1169 ts_tablet_manager.cc:1905] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.648434 1168 tablet_bootstrap.cc:492] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.648644 1168 ts_tablet_manager.cc:1397] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.005s
I20260620 07:01:14.649735 1168 raft_consensus.cc:348] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.650154 1168 raft_consensus.cc:374] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.650308 1168 raft_consensus.cc:729] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.650684 1168 consensus_queue.cc:260] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.651731 725 tablet_service.cc:1467] Processing CreateTablet for tablet fbb2fd1a8bb14f3e883a2efb6560d184 (DEFAULT_TABLE table=default.Table_5e3c8ac39ee542c6acdd0d2b790e2502 [id=895abc42be5c4fbf9378b0ffe8afd783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.652143 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb2fd1a8bb14f3e883a2efb6560d184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.653117 1169 ts_tablet_manager.cc:1918] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.653231 1169 log.cc:1196] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/5208f3136bcd45579de49b8b10745122
I20260620 07:01:14.653522 1169 ts_tablet_manager.cc:1939] T 5208f3136bcd45579de49b8b10745122 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.654680 857 tablet_service.cc:1514] Processing DeleteTablet for tablet cd75e318982a4fb9bf28cb35b030642f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.654969 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da80903ac124d1aae937c2329f9b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 95ba8444d70342f781bd84edefbca71f) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.655145 1165 tablet_replica.cc:330] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.655180 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fbd069552314f2c9ee010c054386644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.655328 1165 raft_consensus.cc:2229] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.655486 1165 raft_consensus.cc:2258] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.656256 1165 ts_tablet_manager.cc:1905] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.656543 1168 ts_tablet_manager.cc:1428] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260620 07:01:14.657286 1168 tablet_bootstrap.cc:492] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.657444 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1d7cec62aea048d3bbe38ab2f83f7656
I20260620 07:01:14.658054 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d7cec62aea048d3bbe38ab2f83f7656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.658125 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b17bbf2f844b4c01ad5d6dc36e096ee5
I20260620 07:01:14.658914 425 catalog_manager.cc:6565] ReplaceTablet: tablet b17bbf2f844b4c01ad5d6dc36e096ee5 deleted and replaced by tablet 0d02b00437d04192bfd7fb7e7a6b55f3
I20260620 07:01:14.659243 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 294f8a632f9d4191b925d1da605bd80e
I20260620 07:01:14.659351 720 tablet_service.cc:1514] Processing DeleteTablet for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d02b00437d04192bfd7fb7e7a6b55f3) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.659947 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d7cec62aea048d3bbe38ab2f83f7656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.659974 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 294f8a632f9d4191b925d1da605bd80e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.660130 861 tablet_service.cc:1514] Processing DeleteTablet for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d02b00437d04192bfd7fb7e7a6b55f3) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.660256 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 294f8a632f9d4191b925d1da605bd80e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.660885 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d7cec62aea048d3bbe38ab2f83f7656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.660859 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet 294f8a632f9d4191b925d1da605bd80e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.662191 1012 tablet_service.cc:1467] Processing CreateTablet for tablet fbb2fd1a8bb14f3e883a2efb6560d184 (DEFAULT_TABLE table=default.Table_5e3c8ac39ee542c6acdd0d2b790e2502 [id=895abc42be5c4fbf9378b0ffe8afd783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.662379 857 tablet_service.cc:1467] Processing CreateTablet for tablet fbb2fd1a8bb14f3e883a2efb6560d184 (DEFAULT_TABLE table=default.Table_5e3c8ac39ee542c6acdd0d2b790e2502 [id=895abc42be5c4fbf9378b0ffe8afd783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.662632 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb2fd1a8bb14f3e883a2efb6560d184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.662711 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb2fd1a8bb14f3e883a2efb6560d184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.664158 725 tablet_service.cc:1467] Processing CreateTablet for tablet f5d4c2626e6e438695afcb052bbf4e0a (DEFAULT_TABLE table=default.Table_d3f33f9c70c74d9a9a03f81497ba6bf4 [id=cfbc24e9607a403480e844e224d85b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.664539 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5d4c2626e6e438695afcb052bbf4e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.665567 1165 ts_tablet_manager.cc:1918] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.665659 1165 log.cc:1196] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/cd75e318982a4fb9bf28cb35b030642f
I20260620 07:01:14.665977 1165 ts_tablet_manager.cc:1939] T cd75e318982a4fb9bf28cb35b030642f P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.667479 2210 raft_consensus.cc:482] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.667608 2210 raft_consensus.cc:504] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.668165 2210 leader_election.cc:288] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:14.668645 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:14.668854 894 raft_consensus.cc:2454] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:14.669166 1006 tablet_service.cc:1467] Processing CreateTablet for tablet f5d4c2626e6e438695afcb052bbf4e0a (DEFAULT_TABLE table=default.Table_d3f33f9c70c74d9a9a03f81497ba6bf4 [id=cfbc24e9607a403480e844e224d85b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.669176 857 tablet_service.cc:1467] Processing CreateTablet for tablet f5d4c2626e6e438695afcb052bbf4e0a (DEFAULT_TABLE table=default.Table_d3f33f9c70c74d9a9a03f81497ba6bf4 [id=cfbc24e9607a403480e844e224d85b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.669553 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5d4c2626e6e438695afcb052bbf4e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.669602 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5d4c2626e6e438695afcb052bbf4e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.670908 683 leader_election.cc:302] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:14.671175 2210 raft_consensus.cc:2781] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:14.671250 2210 raft_consensus.cc:482] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:14.671305 2210 raft_consensus.cc:3037] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:14.672596 720 tablet_service.cc:1467] Processing CreateTablet for tablet 96ff206179a84e0f949023048f2433a4 (DEFAULT_TABLE table=default.Table_8bc65d975d544ad5b8dfc8aea392bc27 [id=5a0a9aea7ef34355b7515a27334837c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.672987 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ff206179a84e0f949023048f2433a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.673686 2210 raft_consensus.cc:504] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.675076 2210 leader_election.cc:288] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:14.676064 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:14.677143 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet cd75e318982a4fb9bf28cb35b030642f (table default.Table_7d53dfa17a784fa08192e52f450ee287 [id=5af5baece18749bdbccb48b3a793fbe9]) successfully deleted
I20260620 07:01:14.677145 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:14.677331 894 raft_consensus.cc:3037] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:14.679898 894 raft_consensus.cc:2454] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:14.680570 1165 tablet_replica.cc:330] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.680689 720 tablet_service.cc:1467] Processing CreateTablet for tablet 67db15f4e6194c0695b253d2dbcb3928 (DEFAULT_TABLE table=default.Table_d9e8ecee8fe44fc28cfb00326864ced1 [id=60328cd9bef44a0188241c7e165d8bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.681044 1165 raft_consensus.cc:2229] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.681473 1165 raft_consensus.cc:2258] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.682803 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_01c7359d6f2b482b93aed480983cd31b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:14.682999 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f0e6ef65b5f44f6d9f2100dd404b2e5f
I20260620 07:01:14.683473 426 catalog_manager.cc:6565] ReplaceTablet: tablet f0e6ef65b5f44f6d9f2100dd404b2e5f deleted and replaced by tablet d1b347b220184e238760e03197d81014
W20260620 07:01:14.683586 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01c7359d6f2b482b93aed480983cd31b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.683879 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e6881c5b6560467c8b8e52777976b5da
I20260620 07:01:14.684914 1165 ts_tablet_manager.cc:1905] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.685132 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67db15f4e6194c0695b253d2dbcb3928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.684930 861 tablet_service.cc:1467] Processing CreateTablet for tablet 96ff206179a84e0f949023048f2433a4 (DEFAULT_TABLE table=default.Table_8bc65d975d544ad5b8dfc8aea392bc27 [id=5a0a9aea7ef34355b7515a27334837c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.685622 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ff206179a84e0f949023048f2433a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.685606 683 leader_election.cc:302] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:14.685855 2210 raft_consensus.cc:2781] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:14.685979 2210 raft_consensus.cc:686] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:14.686187 2210 consensus_queue.cc:237] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:14.688645 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d02b00437d04192bfd7fb7e7a6b55f3 has no consensus state
I20260620 07:01:14.688669 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ceb24f7e7be24b6f97b3c00f6552bbaa
I20260620 07:01:14.689411 423 catalog_manager.cc:6565] ReplaceTablet: tablet ceb24f7e7be24b6f97b3c00f6552bbaa deleted and replaced by tablet 27570f4ff9bd4da89fa20113467709dd
I20260620 07:01:14.689756 862 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb24f7e7be24b6f97b3c00f6552bbaa with delete_type TABLET_DATA_DELETED (replaced by tablet 27570f4ff9bd4da89fa20113467709dd) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.685027 867 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f with delete_type TABLET_DATA_DELETED (replaced by tablet d1b347b220184e238760e03197d81014) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.685154 858 tablet_service.cc:1514] Processing DeleteTablet for tablet e6881c5b6560467c8b8e52777976b5da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.693740 719 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f with delete_type TABLET_DATA_DELETED (replaced by tablet d1b347b220184e238760e03197d81014) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.694023 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cca283f4d2645c0b59f750949b7e263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.694285 731 tablet_service.cc:1514] Processing DeleteTablet for tablet e6881c5b6560467c8b8e52777976b5da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.694468 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a46df2909bf43f297b412c33f18a329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.694669 726 tablet_service.cc:1514] Processing DeleteTablet for tablet a292d66ee14a48959c1f6a63e0a0f492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:58 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.694684 1168 tablet_bootstrap.cc:654] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.694934 719 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb24f7e7be24b6f97b3c00f6552bbaa with delete_type TABLET_DATA_DELETED (replaced by tablet 27570f4ff9bd4da89fa20113467709dd) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.695649 861 tablet_service.cc:1467] Processing CreateTablet for tablet 67db15f4e6194c0695b253d2dbcb3928 (DEFAULT_TABLE table=default.Table_d9e8ecee8fe44fc28cfb00326864ced1 [id=60328cd9bef44a0188241c7e165d8bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.689160 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0d78714a2610473a9e0c46db9d2d89fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:14.696158 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67db15f4e6194c0695b253d2dbcb3928. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:14.696514 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d78714a2610473a9e0c46db9d2d89fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.697888 858 tablet_service.cc:1467] Processing CreateTablet for tablet 6dde8878079a4a67bcb91ed58bc66563 (DEFAULT_TABLE table=default.Table_d585435b81584257bc9dedfa4a0cca74 [id=fc1a2e2da32e49fd9eab38bf55f032e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.698235 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dde8878079a4a67bcb91ed58bc66563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.704475 862 tablet_service.cc:1467] Processing CreateTablet for tablet 1776f6361710465ba5036c3bb84740a8 (DEFAULT_TABLE table=default.Table_361fa70850d54eb291b21f9da97fbdb0 [id=7de42b09cc5844288d091524f1355379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.705605 865 tablet_service.cc:1467] Processing CreateTablet for tablet 4d15ee88d2814b2e8055f4ca8be415ad (DEFAULT_TABLE table=default.Table_c17256b58e4540fca63f3c14356e0d27 [id=fac903daa14e4a7abf1e0b5933c3c58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.707041 867 tablet_service.cc:1467] Processing CreateTablet for tablet c2a1e6f386db42e6ba9e4aa29d9f986f (DEFAULT_TABLE table=default.Table_4c854ad3f6644658bc1f28a9655a94a2 [id=fe8b0a3b6e6f464e84dca07ae7bd50a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.712046 872 tablet_service.cc:1467] Processing CreateTablet for tablet 2a850b95532446ea9007478fce7c23ea (DEFAULT_TABLE table=default.Table_1fe9925a618f4f8bbfc3f27e7bd9b52e [id=6daa3b6259fa46b2bf7d186a83455944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.712129 864 tablet_service.cc:1467] Processing CreateTablet for tablet 3ebca13b8fb646778c1e8b9db404904f (DEFAULT_TABLE table=default.Table_3eb70a87d7cb4c31a43bd0e4f84c769d [id=fab2fe37fee34f40b89a7409e0dd07fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.712430 874 tablet_service.cc:1467] Processing CreateTablet for tablet 19b0d00db64b4114876bf4acf300919a (DEFAULT_TABLE table=default.Table_e1384dba2785444ea6cdb6dec7fd171d [id=d88a9b90057949099afaf26a7ef10823]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.712693 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 0532a5d9ae484bd186f5c64bebd1b66c from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:14.715449 719 tablet_service.cc:1467] Processing CreateTablet for tablet 1776f6361710465ba5036c3bb84740a8 (DEFAULT_TABLE table=default.Table_361fa70850d54eb291b21f9da97fbdb0 [id=7de42b09cc5844288d091524f1355379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.715862 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1776f6361710465ba5036c3bb84740a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.716487 725 tablet_service.cc:1467] Processing CreateTablet for tablet c2a1e6f386db42e6ba9e4aa29d9f986f (DEFAULT_TABLE table=default.Table_4c854ad3f6644658bc1f28a9655a94a2 [id=fe8b0a3b6e6f464e84dca07ae7bd50a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.716780 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2a1e6f386db42e6ba9e4aa29d9f986f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.719183 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1776f6361710465ba5036c3bb84740a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.719406 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d15ee88d2814b2e8055f4ca8be415ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.719697 726 tablet_service.cc:1467] Processing CreateTablet for tablet 4d15ee88d2814b2e8055f4ca8be415ad (DEFAULT_TABLE table=default.Table_c17256b58e4540fca63f3c14356e0d27 [id=fac903daa14e4a7abf1e0b5933c3c58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.720464 732 tablet_service.cc:1467] Processing CreateTablet for tablet 2a850b95532446ea9007478fce7c23ea (DEFAULT_TABLE table=default.Table_1fe9925a618f4f8bbfc3f27e7bd9b52e [id=6daa3b6259fa46b2bf7d186a83455944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.721096 731 tablet_service.cc:1467] Processing CreateTablet for tablet 19b0d00db64b4114876bf4acf300919a (DEFAULT_TABLE table=default.Table_e1384dba2785444ea6cdb6dec7fd171d [id=d88a9b90057949099afaf26a7ef10823]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.721810 733 tablet_service.cc:1467] Processing CreateTablet for tablet 3ebca13b8fb646778c1e8b9db404904f (DEFAULT_TABLE table=default.Table_3eb70a87d7cb4c31a43bd0e4f84c769d [id=fab2fe37fee34f40b89a7409e0dd07fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.722388 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c17256b58e4540fca63f3c14356e0d27" } new_table_name: "default.Table_33a035b548274b128372fc94c2dd645a" modify_external_catalogs: true
I20260620 07:01:14.723851 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_46b1d7a0877845ddbdf9a709bf123b5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.724727 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46b1d7a0877845ddbdf9a709bf123b5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.726054 1165 ts_tablet_manager.cc:1918] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.726168 1165 log.cc:1196] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/9da80903ac124d1aae937c2329f9b13e
I20260620 07:01:14.726172 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_064fe848c6a04392901aeeb0168f99b4" } modify_external_catalogs: true
I20260620 07:01:14.726364 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_064fe848c6a04392901aeeb0168f99b4" } modify_external_catalogs: true
I20260620 07:01:14.726490 1165 ts_tablet_manager.cc:1939] T 9da80903ac124d1aae937c2329f9b13e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.726953 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 9da80903ac124d1aae937c2329f9b13e (table default.Table_703c2ae2881649669e2d23335bf7d54c [id=2943ebfc86e54b75a06a5727fdcc6190]) successfully deleted
I20260620 07:01:14.727830 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d15ee88d2814b2e8055f4ca8be415ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.728667 720 tablet_service.cc:1467] Processing CreateTablet for tablet 6dde8878079a4a67bcb91ed58bc66563 (DEFAULT_TABLE table=default.Table_d585435b81584257bc9dedfa4a0cca74 [id=fc1a2e2da32e49fd9eab38bf55f032e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.732007 1165 tablet_replica.cc:330] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.732206 1165 raft_consensus.cc:2229] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.732355 1165 raft_consensus.cc:2258] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.735496 1165 ts_tablet_manager.cc:1905] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.736935 862 tablet_service.cc:1467] Processing CreateTablet for tablet 048ff2d75f0347ffae42cfe921417008 (DEFAULT_TABLE table=default.Table_05121e91944b48c78974295fb7f281eb [id=ccd7458b30e444e3bbb17af8714b9feb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.737303 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048ff2d75f0347ffae42cfe921417008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.738451 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ebca13b8fb646778c1e8b9db404904f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.738961 857 tablet_service.cc:1467] Processing CreateTablet for tablet 354937ee58ca4970b9ac211a369f1030 (DEFAULT_TABLE table=default.Table_f2f0727404f240818c87ef3b6e2c28de [id=dff36693882c439eae5d7a2fe79719ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.739495 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 354937ee58ca4970b9ac211a369f1030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.740324 865 tablet_service.cc:1467] Processing CreateTablet for tablet fdcfe152ff9a4436b344d662fcdcb671 (DEFAULT_TABLE table=default.Table_16f776af75174366b8650fdeb7578ebf [id=72142d83b3b34f259c99a8899ab776c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.741088 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdcfe152ff9a4436b344d662fcdcb671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.742374 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a850b95532446ea9007478fce7c23ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.750893 862 tablet_service.cc:1467] Processing CreateTablet for tablet 45788e873c3a4e27b2db531cd02fbbdb (DEFAULT_TABLE table=default.Table_f45dda87379a48449ff996a365bf8802 [id=4c59e2d54ce74e5a888ff6f649daa841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.751901 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45788e873c3a4e27b2db531cd02fbbdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.751978 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6f307d70fb934b379cdbbdabbc992f99" } modify_external_catalogs: true
I20260620 07:01:14.752280 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6f307d70fb934b379cdbbdabbc992f99" } modify_external_catalogs: true
I20260620 07:01:14.754745 861 tablet_service.cc:1467] Processing CreateTablet for tablet e0c27f9ca93741919eb4cbe8a8e6443d (DEFAULT_TABLE table=default.Table_3f4ce8cf64704cde86845513a33699a4 [id=a5fc4a20926f40d68c5e42092b4260bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.756464 1165 ts_tablet_manager.cc:1918] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.756575 1165 log.cc:1196] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/6fbd069552314f2c9ee010c054386644
I20260620 07:01:14.756922 1165 ts_tablet_manager.cc:1939] T 6fbd069552314f2c9ee010c054386644 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.757545 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2a1e6f386db42e6ba9e4aa29d9f986f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.757723 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a850b95532446ea9007478fce7c23ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.757895 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ebca13b8fb646778c1e8b9db404904f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.758080 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19b0d00db64b4114876bf4acf300919a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.759922 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 27da98f96a2245c5b4210b7cf084886d (table default.Table_96e0a2412a5040ba8c91876d7263de57 [id=6d5b03179de540539513cab6cd39da39]). Expected version 2 got 0
I20260620 07:01:14.760176 426 catalog_manager.cc:5495] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:14.760588 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:14.760867 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 5a4390225af348f89c934f0f179ddab5 (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]). Expected version 1 got 0
I20260620 07:01:14.762831 729 tablet_service.cc:1467] Processing CreateTablet for tablet 354937ee58ca4970b9ac211a369f1030 (DEFAULT_TABLE table=default.Table_f2f0727404f240818c87ef3b6e2c28de [id=dff36693882c439eae5d7a2fe79719ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.763136 734 tablet_service.cc:1467] Processing CreateTablet for tablet fdcfe152ff9a4436b344d662fcdcb671 (DEFAULT_TABLE table=default.Table_16f776af75174366b8650fdeb7578ebf [id=72142d83b3b34f259c99a8899ab776c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.763237 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 354937ee58ca4970b9ac211a369f1030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.763180 716 tablet_service.cc:1467] Processing CreateTablet for tablet 45788e873c3a4e27b2db531cd02fbbdb (DEFAULT_TABLE table=default.Table_f45dda87379a48449ff996a365bf8802 [id=4c59e2d54ce74e5a888ff6f649daa841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.763221 865 tablet_service.cc:1467] Processing CreateTablet for tablet 8fcb1830334a4bb082283d56247a551e (DEFAULT_TABLE table=default.Table_e9c55413664544dc92da5198f9de26be [id=897fb4c783684792a0819406ec8c26c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.763429 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdcfe152ff9a4436b344d662fcdcb671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.763532 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fcb1830334a4bb082283d56247a551e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.763605 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45788e873c3a4e27b2db531cd02fbbdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.767640 715 tablet_service.cc:1467] Processing CreateTablet for tablet e0c27f9ca93741919eb4cbe8a8e6443d (DEFAULT_TABLE table=default.Table_3f4ce8cf64704cde86845513a33699a4 [id=a5fc4a20926f40d68c5e42092b4260bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.767977 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c27f9ca93741919eb4cbe8a8e6443d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.769691 2204 raft_consensus.cc:482] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.769804 2204 raft_consensus.cc:504] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.770392 2204 leader_election.cc:288] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:14.771077 722 tablet_service.cc:1467] Processing CreateTablet for tablet 8fcb1830334a4bb082283d56247a551e (DEFAULT_TABLE table=default.Table_e9c55413664544dc92da5198f9de26be [id=897fb4c783684792a0819406ec8c26c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.771179 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dac4a1434751433488eb2913b1ddfd23" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:14.771472 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fcb1830334a4bb082283d56247a551e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:14.772137 831 leader_election.cc:341] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.776319 733 tablet_service.cc:1467] Processing CreateTablet for tablet 048ff2d75f0347ffae42cfe921417008 (DEFAULT_TABLE table=default.Table_05121e91944b48c78974295fb7f281eb [id=ccd7458b30e444e3bbb17af8714b9feb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.776695 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048ff2d75f0347ffae42cfe921417008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.779791 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 6fbd069552314f2c9ee010c054386644 (table default.Table_6b7421166e034804801bd91c1a520a3d [id=ee69fd0e35dd410b9193d36a7d7e1c5a]) successfully deleted
W20260620 07:01:14.781262 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1d7cec62aea048d3bbe38ab2f83f7656 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d7cec62aea048d3bbe38ab2f83f7656 already in progress: creating tablet
I20260620 07:01:14.781417 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0532a5d9ae484bd186f5c64bebd1b66c
W20260620 07:01:14.781755 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b17bbf2f844b4c01ad5d6dc36e096ee5 already in progress: creating tablet
I20260620 07:01:14.781850 418 catalog_manager.cc:6565] ReplaceTablet: tablet 0532a5d9ae484bd186f5c64bebd1b66c deleted and replaced by tablet 4ce786042d8641c08e5e3b2c048a5c03
I20260620 07:01:14.782326 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 0532a5d9ae484bd186f5c64bebd1b66c with delete_type TABLET_DATA_DELETED (replaced by tablet 4ce786042d8641c08e5e3b2c048a5c03) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:14.782528 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 294f8a632f9d4191b925d1da605bd80e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 294f8a632f9d4191b925d1da605bd80e already in progress: creating tablet
W20260620 07:01:14.783046 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d15ee88d2814b2e8055f4ca8be415ad consensus state has no leader
W20260620 07:01:14.783607 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ceb24f7e7be24b6f97b3c00f6552bbaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ceb24f7e7be24b6f97b3c00f6552bbaa already in progress: creating tablet
W20260620 07:01:14.783900 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0e6ef65b5f44f6d9f2100dd404b2e5f already in progress: creating tablet
I20260620 07:01:14.784626 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 0532a5d9ae484bd186f5c64bebd1b66c with delete_type TABLET_DATA_DELETED (replaced by tablet 4ce786042d8641c08e5e3b2c048a5c03) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:14.784754 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e6881c5b6560467c8b8e52777976b5da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6881c5b6560467c8b8e52777976b5da already in progress: creating tablet
I20260620 07:01:14.785519 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b5c1567e0c9448dca870bd3d8502bf02
I20260620 07:01:14.786487 872 tablet_service.cc:1514] Processing DeleteTablet for tablet b5c1567e0c9448dca870bd3d8502bf02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.786586 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c27f9ca93741919eb4cbe8a8e6443d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:14.787235 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0532a5d9ae484bd186f5c64bebd1b66c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0532a5d9ae484bd186f5c64bebd1b66c already in progress: creating tablet
I20260620 07:01:14.787462 1165 tablet_replica.cc:330] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:14.787671 1165 raft_consensus.cc:2229] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.787837 1165 raft_consensus.cc:2258] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.788357 1165 ts_tablet_manager.cc:1905] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.790453 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 04db48e910514d46bb4deb9acf54f7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.790704 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f5e2f055fb469dbbb935bba724dcb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.790964 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ee94c1a799a47f997469f96005167dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.791747 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 39504144a623423c873ded7d6839367a with delete_type TABLET_DATA_DELETED (replaced by tablet 32526994e93c46a3b5b37f6dc7fd3069) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.791472 722 tablet_service.cc:1514] Processing DeleteTablet for tablet b5c1567e0c9448dca870bd3d8502bf02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.792600 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4d23f06461284d6cb950b258e8b39540
I20260620 07:01:14.793342 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d23f06461284d6cb950b258e8b39540 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:14.793642 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d23f06461284d6cb950b258e8b39540 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:14.795254 725 tablet_service.cc:1467] Processing CreateTablet for tablet 35feb5b4dbc34f5d88620bc1327d86e6 (DEFAULT_TABLE table=default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.795670 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35feb5b4dbc34f5d88620bc1327d86e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.799467 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19b0d00db64b4114876bf4acf300919a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.799799 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d02b00437d04192bfd7fb7e7a6b55f3) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.800141 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_28037a8bfe2d4a36bca9c899f6dd515c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.800696 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28037a8bfe2d4a36bca9c899f6dd515c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.799640 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c38c628514c44c6fa5aff64928e515d9" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:14.801841 997 tablet_service.cc:1514] Processing DeleteTablet for tablet e6881c5b6560467c8b8e52777976b5da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.802241 1166 ts_tablet_manager.cc:1939] T f9df1d52393e47ce991b5295d03624e8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:14.802526 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 612) took 6385 ms. Trace:
I20260620 07:01:14.802641 1166 rpcz_store.cc:276] 0620 07:01:08.417071 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.417619 (+ 548us) service_pool.cc:227] Handling call
0620 07:01:14.493329 (+6075710us) ts_tablet_manager.cc:1145] Deleting tablet f9df1d52393e47ce991b5295d03624e8
0620 07:01:14.496523 (+ 3194us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.562583 (+ 66060us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.585911 (+ 23328us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.802512 (+216601us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":82688,"tablet-delete.queue_time_us":6075545}
I20260620 07:01:14.803014 1166 tablet_replica.cc:330] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:14.803202 1166 raft_consensus.cc:2229] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.803356 1166 raft_consensus.cc:2258] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.803900 1166 ts_tablet_manager.cc:1905] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.804419 1165 ts_tablet_manager.cc:1918] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.804522 1165 log.cc:1196] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/b5c1567e0c9448dca870bd3d8502bf02
I20260620 07:01:14.804517 2019 raft_consensus.cc:482] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.804848 1165 ts_tablet_manager.cc:1939] T b5c1567e0c9448dca870bd3d8502bf02 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:14.807773 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet b5c1567e0c9448dca870bd3d8502bf02 (table default.Table_064fe848c6a04392901aeeb0168f99b4 [id=4315970d1a304e3d8d41ff5b0e452ebd]) successfully deleted
I20260620 07:01:14.811216 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f with delete_type TABLET_DATA_DELETED (replaced by tablet d1b347b220184e238760e03197d81014) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.812742 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2e9e8136a5e44b90a465ce0fee7fcb65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.812992 681 leader_election.cc:341] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.813112 681 leader_election.cc:302] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.813361 2210 raft_consensus.cc:2726] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:14.813381 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e9e8136a5e44b90a465ce0fee7fcb65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.813766 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 96ff206179a84e0f949023048f2433a4 (DEFAULT_TABLE table=default.Table_8bc65d975d544ad5b8dfc8aea392bc27 [id=5a0a9aea7ef34355b7515a27334837c4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:14.814046 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 4d23f06461284d6cb950b258e8b39540 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d23f06461284d6cb950b258e8b39540 already in progress: creating tablet
I20260620 07:01:14.814158 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ff206179a84e0f949023048f2433a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.815980 2204 raft_consensus.cc:482] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.816111 2204 raft_consensus.cc:504] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.816730 2204 leader_election.cc:288] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:14.818890 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e2c297072741eb927dff9bcf6a573f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:14.819481 831 leader_election.cc:341] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.820178 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb24f7e7be24b6f97b3c00f6552bbaa with delete_type TABLET_DATA_DELETED (replaced by tablet 27570f4ff9bd4da89fa20113467709dd) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.812563 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:14.812717 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:14.819763 2019 raft_consensus.cc:504] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:14.822009 681 leader_election.cc:341] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:14.822345 681 leader_election.cc:341] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.822463 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_33dfdc9626ae44ec987caf7eb536ac44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.823426 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33dfdc9626ae44ec987caf7eb536ac44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.825093 999 tablet_service.cc:1467] Processing CreateTablet for tablet c2a1e6f386db42e6ba9e4aa29d9f986f (DEFAULT_TABLE table=default.Table_4c854ad3f6644658bc1f28a9655a94a2 [id=fe8b0a3b6e6f464e84dca07ae7bd50a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.825484 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2a1e6f386db42e6ba9e4aa29d9f986f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.826045 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 1776f6361710465ba5036c3bb84740a8 (DEFAULT_TABLE table=default.Table_361fa70850d54eb291b21f9da97fbdb0 [id=7de42b09cc5844288d091524f1355379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.826403 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1776f6361710465ba5036c3bb84740a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.826292 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_275b8e1034684302afacf36ef1aa7c57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.826831 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_275b8e1034684302afacf36ef1aa7c57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.827144 997 tablet_service.cc:1467] Processing CreateTablet for tablet 6dde8878079a4a67bcb91ed58bc66563 (DEFAULT_TABLE table=default.Table_d585435b81584257bc9dedfa4a0cca74 [id=fc1a2e2da32e49fd9eab38bf55f032e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.827448 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dde8878079a4a67bcb91ed58bc66563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.827682 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 67db15f4e6194c0695b253d2dbcb3928 (DEFAULT_TABLE table=default.Table_d9e8ecee8fe44fc28cfb00326864ced1 [id=60328cd9bef44a0188241c7e165d8bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.829450 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 4d15ee88d2814b2e8055f4ca8be415ad (DEFAULT_TABLE table=default.Table_c17256b58e4540fca63f3c14356e0d27 [id=fac903daa14e4a7abf1e0b5933c3c58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.829576 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_29524262208149ff87cf1a63d2d9f6e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:14.830065 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29524262208149ff87cf1a63d2d9f6e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:14.830088 2019 leader_election.cc:288] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:14.830999 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_79f21480be5047f7ac25be9822c09588" } new_table_name: "default.Table_bd22b312cebb4018ab48bb331771a41a" modify_external_catalogs: true
I20260620 07:01:14.831305 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d15ee88d2814b2e8055f4ca8be415ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:14.834360 968 leader_election.cc:341] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: eea1525b54cc42b78180ba6867957f76
I20260620 07:01:14.834595 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67db15f4e6194c0695b253d2dbcb3928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.835364 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_09712bb36f174af99f0b9e0e77871459" } new_table_name: "default.Table_4eba92ab3a61458986cd0d77a674634c" modify_external_catalogs: true
I20260620 07:01:14.836059 1008 tablet_service.cc:1467] Processing CreateTablet for tablet 19b0d00db64b4114876bf4acf300919a (DEFAULT_TABLE table=default.Table_e1384dba2785444ea6cdb6dec7fd171d [id=d88a9b90057949099afaf26a7ef10823]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.836398 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19b0d00db64b4114876bf4acf300919a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.836350 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 2a850b95532446ea9007478fce7c23ea (DEFAULT_TABLE table=default.Table_1fe9925a618f4f8bbfc3f27e7bd9b52e [id=6daa3b6259fa46b2bf7d186a83455944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.836656 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a850b95532446ea9007478fce7c23ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.836958 1004 tablet_service.cc:1467] Processing CreateTablet for tablet fdcfe152ff9a4436b344d662fcdcb671 (DEFAULT_TABLE table=default.Table_16f776af75174366b8650fdeb7578ebf [id=72142d83b3b34f259c99a8899ab776c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.838033 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 3ebca13b8fb646778c1e8b9db404904f (DEFAULT_TABLE table=default.Table_3eb70a87d7cb4c31a43bd0e4f84c769d [id=fab2fe37fee34f40b89a7409e0dd07fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.839355 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 0532a5d9ae484bd186f5c64bebd1b66c with delete_type TABLET_DATA_DELETED (replaced by tablet 4ce786042d8641c08e5e3b2c048a5c03) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.839323 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3f2c7508dd9c4328ae411c21691ee9a6" } new_table_name: "default.Table_944dbe1b638d476eaac9fdb520120272" modify_external_catalogs: true
I20260620 07:01:14.839959 994 tablet_service.cc:1467] Processing CreateTablet for tablet 45788e873c3a4e27b2db531cd02fbbdb (DEFAULT_TABLE table=default.Table_f45dda87379a48449ff996a365bf8802 [id=4c59e2d54ce74e5a888ff6f649daa841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.840364 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdcfe152ff9a4436b344d662fcdcb671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.842207 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 833) took 1119 ms. Trace:
I20260620 07:01:14.842314 1169 rpcz_store.cc:276] 0620 07:01:13.723236 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.723529 (+ 293us) service_pool.cc:227] Handling call
0620 07:01:14.628906 (+905377us) ts_tablet_manager.cc:1145] Deleting tablet 5208f3136bcd45579de49b8b10745122
0620 07:01:14.628919 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.650121 (+ 21202us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.653025 (+ 2904us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.842182 (+189157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":874209}
I20260620 07:01:14.842767 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 5208f3136bcd45579de49b8b10745122 (table default.Table_6559046a0e474633ad24c9215e23b506 [id=47d63992f58d45c3aef24a7a606ce4bf]) successfully deleted
I20260620 07:01:14.842867 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 354937ee58ca4970b9ac211a369f1030 (DEFAULT_TABLE table=default.Table_f2f0727404f240818c87ef3b6e2c28de [id=dff36693882c439eae5d7a2fe79719ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.842430 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 048ff2d75f0347ffae42cfe921417008 (DEFAULT_TABLE table=default.Table_05121e91944b48c78974295fb7f281eb [id=ccd7458b30e444e3bbb17af8714b9feb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.845075 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]). Expected version 3 got 0
I20260620 07:01:14.845551 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet b5c1567e0c9448dca870bd3d8502bf02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.846177 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f9df1d52393e47ce991b5295d03624e8 (table default.Table_982eb8abebd34542b51573e542ad6085 [id=a7902aafbaad4905a6b5b03ad669eeae]) successfully deleted
I20260620 07:01:14.847321 1169 tablet_replica.cc:330] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.847535 1169 raft_consensus.cc:2229] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.848474 1169 raft_consensus.cc:2258] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.848973 1168 tablet_bootstrap.cc:492] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.849112 1169 ts_tablet_manager.cc:1905] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.849188 1168 ts_tablet_manager.cc:1397] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.192s user 0.006s sys 0.008s
I20260620 07:01:14.850020 1168 raft_consensus.cc:348] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.850358 1168 raft_consensus.cc:374] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.850481 1168 raft_consensus.cc:729] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.850836 1168 consensus_queue.cc:260] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.851101 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45788e873c3a4e27b2db531cd02fbbdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.851359 996 tablet_service.cc:1467] Processing CreateTablet for tablet e0c27f9ca93741919eb4cbe8a8e6443d (DEFAULT_TABLE table=default.Table_3f4ce8cf64704cde86845513a33699a4 [id=a5fc4a20926f40d68c5e42092b4260bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.851728 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c27f9ca93741919eb4cbe8a8e6443d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.851769 998 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d23f06461284d6cb950b258e8b39540 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:14.840018 995 tablet_service.cc:1467] Processing CreateTablet for tablet 8fcb1830334a4bb082283d56247a551e (DEFAULT_TABLE table=default.Table_e9c55413664544dc92da5198f9de26be [id=897fb4c783684792a0819406ec8c26c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:14.851949 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ebca13b8fb646778c1e8b9db404904f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.852540 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 354937ee58ca4970b9ac211a369f1030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.853204 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048ff2d75f0347ffae42cfe921417008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.855911 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fcb1830334a4bb082283d56247a551e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.857507 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e2c297072741eb927dff9bcf6a573f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:14.857843 969 leader_election.cc:341] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: eea1525b54cc42b78180ba6867957f76
I20260620 07:01:14.858165 2210 consensus_queue.cc:1035] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:14.858336 969 leader_election.cc:302] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.858078 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dac4a1434751433488eb2913b1ddfd23" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:14.858665 1999 raft_consensus.cc:2726] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:14.859520 830 leader_election.cc:341] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.859627 830 leader_election.cc:302] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:14.860113 830 leader_election.cc:341] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:14.860204 830 leader_election.cc:302] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:14.860276 1168 ts_tablet_manager.cc:1428] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260620 07:01:14.861052 2204 raft_consensus.cc:2726] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.861202 2204 raft_consensus.cc:2726] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:14.862802 1168 tablet_bootstrap.cc:492] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:14.863494 1989 raft_consensus.cc:482] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:14.863615 1989 raft_consensus.cc:504] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.864176 1989 leader_election.cc:288] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:14.864765 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34dc2af503684aaba8388a4611fab48e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:14.865310 1170 tablet_bootstrap.cc:492] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:14.865851 1170 ts_tablet_manager.cc:1397] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.241s user 0.015s sys 0.034s
I20260620 07:01:14.866735 1170 raft_consensus.cc:348] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.867877 1170 raft_consensus.cc:374] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.868060 1170 raft_consensus.cc:729] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.868448 1170 consensus_queue.cc:260] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:14.873977 1169 ts_tablet_manager.cc:1918] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.874166 1169 log.cc:1196] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/9e8cd4ec5619416a8983e1bc1b6b6a09
I20260620 07:01:14.874505 1169 ts_tablet_manager.cc:1939] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.875239 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 838) took 1108 ms. Trace:
I20260620 07:01:14.875385 1169 rpcz_store.cc:276] 0620 07:01:13.767139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.767605 (+ 466us) service_pool.cc:227] Handling call
0620 07:01:14.847204 (+1079599us) ts_tablet_manager.cc:1145] Deleting tablet 9e8cd4ec5619416a8983e1bc1b6b6a09
0620 07:01:14.847274 (+ 70us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.861487 (+ 14213us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.873888 (+ 12401us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.875219 (+ 1331us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1060493}
I20260620 07:01:14.875945 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 837) took 1109 ms. Trace:
I20260620 07:01:14.876080 1169 rpcz_store.cc:276] 0620 07:01:13.767009 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.767635 (+ 626us) service_pool.cc:227] Handling call
0620 07:01:14.875856 (+1108221us) ts_tablet_manager.cc:1145] Deleting tablet f690e150839a4d23860932712f61e7c8
0620 07:01:14.875867 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.875931 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1088901}
I20260620 07:01:14.876515 1168 tablet_bootstrap.cc:654] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.877686 1169 tablet_replica.cc:330] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.877914 1169 raft_consensus.cc:2229] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.883155 1169 raft_consensus.cc:2258] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.883917 1169 ts_tablet_manager.cc:1905] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.878006 1170 ts_tablet_manager.cc:1428] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260620 07:01:14.888094 1170 tablet_bootstrap.cc:492] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:14.889626 1170 tablet_bootstrap.cc:654] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:14.893352 1169 ts_tablet_manager.cc:1918] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.896027 1168 tablet_bootstrap.cc:492] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:14.896317 1168 ts_tablet_manager.cc:1397] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.002s
I20260620 07:01:14.898216 1169 log.cc:1196] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/c38c628514c44c6fa5aff64928e515d9
I20260620 07:01:14.897980 1168 raft_consensus.cc:348] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.898535 1169 ts_tablet_manager.cc:1939] T c38c628514c44c6fa5aff64928e515d9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.901379 1169 tablet_replica.cc:330] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.901566 1169 raft_consensus.cc:2229] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.901726 1169 raft_consensus.cc:2258] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.904023 1169 ts_tablet_manager.cc:1905] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.907406 1030 raft_consensus.cc:3037] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:14.907737 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 47623.9us
I20260620 07:01:14.908335 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34dc2af503684aaba8388a4611fab48e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:14.909798 1170 tablet_bootstrap.cc:492] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:14.909925 1170 ts_tablet_manager.cc:1397] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.004s
I20260620 07:01:14.910529 1170 raft_consensus.cc:348] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.910719 1170 raft_consensus.cc:374] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:14.910777 1170 raft_consensus.cc:729] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:14.910970 1170 consensus_queue.cc:260] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:14.911394 1169 ts_tablet_manager.cc:1918] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.911495 1169 log.cc:1196] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/8cca283f4d2645c0b59f750949b7e263
I20260620 07:01:14.911840 1169 ts_tablet_manager.cc:1939] T 8cca283f4d2645c0b59f750949b7e263 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.915019 1169 tablet_replica.cc:330] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.915307 1169 raft_consensus.cc:2229] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.915485 1169 raft_consensus.cc:2258] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.916213 1169 ts_tablet_manager.cc:1905] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.926151 1166 ts_tablet_manager.cc:1918] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.928699 1169 ts_tablet_manager.cc:1918] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.928927 1169 log.cc:1196] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/04db48e910514d46bb4deb9acf54f7c0
I20260620 07:01:14.929303 1169 ts_tablet_manager.cc:1939] T 04db48e910514d46bb4deb9acf54f7c0 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.929910 1169 tablet_replica.cc:330] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.930160 1169 raft_consensus.cc:2229] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.930377 1169 raft_consensus.cc:2258] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.931198 1169 ts_tablet_manager.cc:1905] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.926925 1166 log.cc:1196] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ca380134173e42f6b562b56375f2ccad
I20260620 07:01:14.929853 969 leader_election.cc:302] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:14.936991 1166 ts_tablet_manager.cc:1939] T ca380134173e42f6b562b56375f2ccad P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:14.937348 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 615) took 6355 ms. Trace:
I20260620 07:01:14.937425 1166 rpcz_store.cc:276] 0620 07:01:08.581579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.581767 (+ 188us) service_pool.cc:227] Handling call
0620 07:01:14.802971 (+6221204us) ts_tablet_manager.cc:1145] Deleting tablet ca380134173e42f6b562b56375f2ccad
0620 07:01:14.802981 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.923131 (+120150us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.926033 (+ 2902us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.937328 (+ 11295us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6220984}
I20260620 07:01:14.937747 1166 tablet_replica.cc:330] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:14.937923 1166 raft_consensus.cc:2229] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.938050 1166 raft_consensus.cc:2258] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.938561 1166 ts_tablet_manager.cc:1905] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.949524 1166 ts_tablet_manager.cc:1918] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.959527 1166 log.cc:1196] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/82020156f3e44a1e84a9435d1f994124
I20260620 07:01:14.959986 1166 ts_tablet_manager.cc:1939] T 82020156f3e44a1e84a9435d1f994124 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:14.960333 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 616) took 6378 ms. Trace:
I20260620 07:01:14.960471 1166 rpcz_store.cc:276] 0620 07:01:08.581725 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.583144 (+ 1419us) service_pool.cc:227] Handling call
0620 07:01:14.937706 (+6354562us) ts_tablet_manager.cc:1145] Deleting tablet 82020156f3e44a1e84a9435d1f994124
0620 07:01:14.937715 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.941554 (+ 3839us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.949454 (+ 7900us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.960319 (+ 10865us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6354297}
I20260620 07:01:14.962025 1169 ts_tablet_manager.cc:1918] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.962302 1166 tablet_replica.cc:330] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:14.962544 1166 raft_consensus.cc:2229] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.962749 1166 raft_consensus.cc:2258] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.963348 1166 ts_tablet_manager.cc:1905] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.964599 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ca380134173e42f6b562b56375f2ccad (table default.Table_6bd66e9c6f5d4e348b7345db1c1175d8 [id=82989da82c6244a7b6f52db6807af15f]) successfully deleted
I20260620 07:01:14.967350 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 82020156f3e44a1e84a9435d1f994124 (table default.Table_136e581f613845f79105f13229d93e06 [id=e3117c7c078044e9872c3c7e880aed79]) successfully deleted
I20260620 07:01:14.969576 1166 ts_tablet_manager.cc:1918] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.969794 1169 log.cc:1196] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/89f5e2f055fb469dbbb935bba724dcb5
I20260620 07:01:14.970188 1169 ts_tablet_manager.cc:1939] T 89f5e2f055fb469dbbb935bba724dcb5 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:14.970867 1169 tablet_replica.cc:330] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:14.971110 1169 raft_consensus.cc:2229] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.971336 1169 raft_consensus.cc:2258] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.971707 1170 ts_tablet_manager.cc:1428] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.062s user 0.000s sys 0.010s
I20260620 07:01:14.971959 1169 ts_tablet_manager.cc:1905] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.972082 1170 tablet_bootstrap.cc:492] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:14.974681 1170 tablet_bootstrap.cc:654] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:14.979789 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 016029eafa1d438da54d963a64767ec5 consensus state has no leader
W20260620 07:01:14.980564 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c0b0969fb784dba96459ea441f88ae9 consensus state has no leader
W20260620 07:01:14.981249 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bed7eba8256c4d85b6fa3a4be0c27635 consensus state has no leader
I20260620 07:01:14.984571 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dde8878079a4a67bcb91ed58bc66563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:14.985252 1166 log.cc:1196] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/95f9a6b2f2cb41e6b74715b2618d8a70
I20260620 07:01:14.985673 1166 ts_tablet_manager.cc:1939] T 95f9a6b2f2cb41e6b74715b2618d8a70 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:14.987995 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 617) took 6404 ms. Trace:
I20260620 07:01:14.988149 1166 rpcz_store.cc:276] 0620 07:01:08.583637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.583689 (+ 52us) service_pool.cc:227] Handling call
0620 07:01:14.962261 (+6378572us) ts_tablet_manager.cc:1145] Deleting tablet 95f9a6b2f2cb41e6b74715b2618d8a70
0620 07:01:14.962270 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:14.966500 (+ 4230us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.969484 (+ 2984us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:14.987977 (+ 18493us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6378365}
I20260620 07:01:14.988547 1166 tablet_replica.cc:330] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:14.988878 1166 raft_consensus.cc:2229] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:14.989269 1169 ts_tablet_manager.cc:1918] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:14.989327 1031 raft_consensus.cc:3037] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:14.991393 1169 log.cc:1196] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/2ee94c1a799a47f997469f96005167dc
W20260620 07:01:14.995373 968 consensus_peers.cc:487] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a46df2909bf43f297b412c33f18a329. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:14.996138 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 95f9a6b2f2cb41e6b74715b2618d8a70 (table default.Table_6641e445a3014a60a287541bee6f57e2 [id=08b49e7b2cb8468e97d459fb1ab36211]) successfully deleted
I20260620 07:01:14.995602 1166 raft_consensus.cc:2258] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:14.998263 1166 ts_tablet_manager.cc:1905] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:14.994076 1920 consensus_queue.cc:1035] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:14.995640 2257 consensus_queue.cc:1035] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:15.006407 968 consensus_peers.cc:487] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a292d66ee14a48959c1f6a63e0a0f492. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:15.010490 1169 ts_tablet_manager.cc:1939] T 2ee94c1a799a47f997469f96005167dc P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:15.012436 2253 raft_consensus.cc:482] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.012580 2253 raft_consensus.cc:504] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.013234 2253 leader_election.cc:288] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:15.014022 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb81ac0ebd4865b9d53259ed5787d1" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:15.015242 831 leader_election.cc:341] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.015846 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:15.019655 1170 tablet_bootstrap.cc:492] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.019848 1170 ts_tablet_manager.cc:1397] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.002s
I20260620 07:01:15.020107 1169 tablet_replica.cc:330] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:15.020797 1170 raft_consensus.cc:348] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.021204 1170 raft_consensus.cc:374] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.021430 1170 raft_consensus.cc:729] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.022023 1170 consensus_queue.cc:260] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.022588 1169 raft_consensus.cc:2229] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.024142 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:15.024345 1169 raft_consensus.cc:2258] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.025033 1170 ts_tablet_manager.cc:1428] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 07:01:15.025097 1169 ts_tablet_manager.cc:1905] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.029080 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb81ac0ebd4865b9d53259ed5787d1" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:15.030349 830 leader_election.cc:341] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.030535 830 leader_election.cc:302] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:15.030857 2253 raft_consensus.cc:2726] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.041625 1166 ts_tablet_manager.cc:1918] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.046226 1169 ts_tablet_manager.cc:1918] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.046510 1166 log.cc:1196] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/bea895c735c847f59794ab8c3282447d
I20260620 07:01:15.046957 1166 ts_tablet_manager.cc:1939] T bea895c735c847f59794ab8c3282447d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:15.047762 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 618) took 6463 ms. Trace:
I20260620 07:01:15.048264 1166 rpcz_store.cc:276] 0620 07:01:08.584037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.584415 (+ 378us) service_pool.cc:227] Handling call
0620 07:01:14.988507 (+6404092us) ts_tablet_manager.cc:1145] Deleting tablet bea895c735c847f59794ab8c3282447d
0620 07:01:14.988517 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.031392 (+ 42875us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:15.041522 (+ 10130us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:15.047743 (+ 6221us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4875,"tablet-delete.queue_time_us":6403837}
I20260620 07:01:15.049300 1166 tablet_replica.cc:330] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:15.049547 1166 raft_consensus.cc:2229] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:15.049921 1166 pending_rounds.cc:62] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:15.050822 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet bea895c735c847f59794ab8c3282447d (table default.Table_53d54ae0843e43bbaa814c4fdd23d530 [id=42744b614d6e4bd7900ea2fc51d30fa4]) successfully deleted
I20260620 07:01:15.051036 1166 pending_rounds.cc:68] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821605790183424 op_type: NO_OP noop_request { }
I20260620 07:01:15.051602 1169 log.cc:1196] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/39504144a623423c873ded7d6839367a
I20260620 07:01:15.051807 1166 raft_consensus.cc:2866] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:15.052237 1169 ts_tablet_manager.cc:1939] T 39504144a623423c873ded7d6839367a P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:15.052388 1166 raft_consensus.cc:2258] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.053006 1166 ts_tablet_manager.cc:1905] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.048938 1170 tablet_bootstrap.cc:492] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.054994 1170 tablet_bootstrap.cc:654] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.056874 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 (table default.Table_2411c7dd68274c07a75cd0b3ae3e2d32 [id=804a023058a643b189246bf7c6a98af6]) successfully deleted
W20260620 07:01:15.057168 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f690e150839a4d23860932712f61e7c8 because the tablet was not found. No further retry: Not found: Tablet not found: f690e150839a4d23860932712f61e7c8
W20260620 07:01:15.057601 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 02584f8ac08f4759a5f9a5aa699d0039 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02584f8ac08f4759a5f9a5aa699d0039 already in progress: creating tablet
W20260620 07:01:15.057878 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ba93e22c4720417c99d471b9c8b49b86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba93e22c4720417c99d471b9c8b49b86 already in progress: creating tablet
W20260620 07:01:15.058159 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet de6ccea1cd074afb9fef17c8e07f444f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de6ccea1cd074afb9fef17c8e07f444f already in progress: creating tablet
W20260620 07:01:15.059245 681 consensus_peers.cc:487] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:15.058679 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8aa5c040d5e84006935e9f06424a34b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aa5c040d5e84006935e9f06424a34b4 already in progress: creating tablet
I20260620 07:01:15.046370 1167 tablet_bootstrap.cc:492] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:15.063654 1167 ts_tablet_manager.cc:1397] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.487s user 0.004s sys 0.008s
I20260620 07:01:15.064558 1167 raft_consensus.cc:348] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.064900 1167 raft_consensus.cc:374] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.064999 1167 raft_consensus.cc:729] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.065240 1167 consensus_queue.cc:260] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.066076 1167 ts_tablet_manager.cc:1428] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:15.066399 1167 tablet_bootstrap.cc:492] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:15.068297 1167 tablet_bootstrap.cc:654] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:15.085776 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet d51c7488711b4db697b48025a5ba6e9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d51c7488711b4db697b48025a5ba6e9d already in progress: creating tablet
W20260620 07:01:15.086215 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 already in progress: creating tablet
W20260620 07:01:15.086511 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ebd9df1a33ed4e7b997a386158460a9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebd9df1a33ed4e7b997a386158460a9a already in progress: creating tablet
I20260620 07:01:15.086803 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet c38c628514c44c6fa5aff64928e515d9 (table default.Table_5a07e98698e24414a5ac54521c1b251c [id=a6be77da33394794ac37a31806294616]) successfully deleted
W20260620 07:01:15.088631 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7f85c8a0ea484b57bb50425867e2774e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f85c8a0ea484b57bb50425867e2774e already in progress: creating tablet
I20260620 07:01:15.069841 1166 ts_tablet_manager.cc:1918] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:15.090188 1166 log.cc:1196] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/d066c73ae0104cb3be792790b1dfb93d
I20260620 07:01:15.095963 861 tablet_service.cc:1467] Processing CreateTablet for tablet 35feb5b4dbc34f5d88620bc1327d86e6 (DEFAULT_TABLE table=default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.096376 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35feb5b4dbc34f5d88620bc1327d86e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.098345 872 tablet_service.cc:1467] Processing CreateTablet for tablet f322a11252cb4a82b87e2737d0faa75e (DEFAULT_TABLE table=default.Table_05fe644ddbaf4a9abfbdd884b9153056 [id=8d20042f750f4e77945c0fa22098c7b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.098647 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f322a11252cb4a82b87e2737d0faa75e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.099049 857 tablet_service.cc:1467] Processing CreateTablet for tablet c24fe8318b4743df886d210fc94318fe (DEFAULT_TABLE table=default.Table_44d2bbefe6b14ed29a35f1c1b6a3a9d9 [id=aacc2d0c0f4841c4ba5b5c7478714337]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.099354 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c24fe8318b4743df886d210fc94318fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.099979 1004 tablet_service.cc:1467] Processing CreateTablet for tablet f6cfeccac77b48be87f3f59810c806ee (DEFAULT_TABLE table=default.Table_ac2df841f29b4ea287cce829a29ba718 [id=71e3a4711bf1418598e11dad60b4f793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.100355 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6cfeccac77b48be87f3f59810c806ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.100417 858 tablet_service.cc:1467] Processing CreateTablet for tablet 5c7d55a43f5c4b2db637a0319b8a3c90 (DEFAULT_TABLE table=default.Table_bad00db5e978459b99678e894e6859fb [id=a5fab8e7369f42728ebddf69b533976e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.100777 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c7d55a43f5c4b2db637a0319b8a3c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.101745 874 tablet_service.cc:1467] Processing CreateTablet for tablet f6cfeccac77b48be87f3f59810c806ee (DEFAULT_TABLE table=default.Table_ac2df841f29b4ea287cce829a29ba718 [id=71e3a4711bf1418598e11dad60b4f793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.102034 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6cfeccac77b48be87f3f59810c806ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.105464 1001 tablet_service.cc:1467] Processing CreateTablet for tablet c24fe8318b4743df886d210fc94318fe (DEFAULT_TABLE table=default.Table_44d2bbefe6b14ed29a35f1c1b6a3a9d9 [id=aacc2d0c0f4841c4ba5b5c7478714337]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.105875 996 tablet_service.cc:1467] Processing CreateTablet for tablet f322a11252cb4a82b87e2737d0faa75e (DEFAULT_TABLE table=default.Table_05fe644ddbaf4a9abfbdd884b9153056 [id=8d20042f750f4e77945c0fa22098c7b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.106151 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f322a11252cb4a82b87e2737d0faa75e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:15.106436 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ddd53657848a4ab291d48956d5778d7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddd53657848a4ab291d48956d5778d7b already in progress: creating tablet
I20260620 07:01:15.106513 867 tablet_service.cc:1467] Processing CreateTablet for tablet 9a8a5da81fac4c17ac60d4c87f844f8f (DEFAULT_TABLE table=default.Table_c1ffe009c5034bb58dbe573808a6cf4a [id=fa021110da20405293f8488c41387d6c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:15.106801 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1d7cec62aea048d3bbe38ab2f83f7656 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d7cec62aea048d3bbe38ab2f83f7656 already in progress: creating tablet
I20260620 07:01:15.106855 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a8a5da81fac4c17ac60d4c87f844f8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:15.107031 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b17bbf2f844b4c01ad5d6dc36e096ee5 already in progress: creating tablet
W20260620 07:01:15.107255 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 294f8a632f9d4191b925d1da605bd80e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 294f8a632f9d4191b925d1da605bd80e already in progress: creating tablet
W20260620 07:01:15.107460 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0e6ef65b5f44f6d9f2100dd404b2e5f already in progress: creating tablet
I20260620 07:01:15.107662 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 8cca283f4d2645c0b59f750949b7e263 (table default.Table_e5288a8179334813988c13c09263d3fb [id=c1fc89d0749e49239f909c0b75349ec3]) successfully deleted
W20260620 07:01:15.107870 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet e6881c5b6560467c8b8e52777976b5da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6881c5b6560467c8b8e52777976b5da already in progress: creating tablet
W20260620 07:01:15.108098 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 9a46df2909bf43f297b412c33f18a329 because the tablet was not found. No further retry: Not found: Tablet not found: 9a46df2909bf43f297b412c33f18a329
W20260620 07:01:15.108395 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a292d66ee14a48959c1f6a63e0a0f492 because the tablet was not found. No further retry: Not found: Tablet not found: a292d66ee14a48959c1f6a63e0a0f492
W20260620 07:01:15.108711 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ceb24f7e7be24b6f97b3c00f6552bbaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ceb24f7e7be24b6f97b3c00f6552bbaa already in progress: creating tablet
W20260620 07:01:15.108932 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 0532a5d9ae484bd186f5c64bebd1b66c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0532a5d9ae484bd186f5c64bebd1b66c already in progress: creating tablet
I20260620 07:01:15.109126 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 04db48e910514d46bb4deb9acf54f7c0 (table default.Table_e398e5c359f8400eac47c32d10c9a432 [id=41c90959790840acbf26b2339272e8ae]) successfully deleted
I20260620 07:01:15.109302 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 89f5e2f055fb469dbbb935bba724dcb5 (table default.Table_361c16a82c8b4f518117b6747d4aa3bc [id=24b0b6eb9f944dbb971530ee8f603c0e]) successfully deleted
I20260620 07:01:15.109501 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 2ee94c1a799a47f997469f96005167dc (table default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]) successfully deleted
I20260620 07:01:15.109807 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 39504144a623423c873ded7d6839367a (table default.Table_7146361681104709b5dfbac7fcecd7cd [id=07dc49586074421fa6e3b6ee862b8216]) successfully deleted
I20260620 07:01:15.110956 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 5c7d55a43f5c4b2db637a0319b8a3c90 (DEFAULT_TABLE table=default.Table_bad00db5e978459b99678e894e6859fb [id=a5fab8e7369f42728ebddf69b533976e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.111236 1166 ts_tablet_manager.cc:1939] T d066c73ae0104cb3be792790b1dfb93d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:15.111333 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 35feb5b4dbc34f5d88620bc1327d86e6 (DEFAULT_TABLE table=default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.110975 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c24fe8318b4743df886d210fc94318fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.115026 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 619) took 6530 ms. Trace:
I20260620 07:01:15.115247 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c7d55a43f5c4b2db637a0319b8a3c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.115268 1166 rpcz_store.cc:276] 0620 07:01:08.584145 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.584717 (+ 572us) service_pool.cc:227] Handling call
0620 07:01:15.049256 (+6464539us) ts_tablet_manager.cc:1145] Deleting tablet d066c73ae0104cb3be792790b1dfb93d
0620 07:01:15.049268 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.066253 (+ 16985us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:15.069724 (+ 3471us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:15.115002 (+ 45278us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6464381}
I20260620 07:01:15.115588 1166 tablet_replica.cc:330] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:15.115806 1166 raft_consensus.cc:2229] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.115960 1166 raft_consensus.cc:2258] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.116637 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35feb5b4dbc34f5d88620bc1327d86e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.120684 1168 raft_consensus.cc:374] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.122762 1168 raft_consensus.cc:729] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.124423 1168 consensus_queue.cc:260] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.116496 1166 ts_tablet_manager.cc:1905] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.127430 1170 tablet_bootstrap.cc:492] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.128875 1170 ts_tablet_manager.cc:1397] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.080s user 0.017s sys 0.001s
I20260620 07:01:15.128891 1168 ts_tablet_manager.cc:1428] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.232s user 0.025s sys 0.005s
I20260620 07:01:15.129992 1170 raft_consensus.cc:348] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.130290 1170 raft_consensus.cc:374] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.130390 1170 raft_consensus.cc:729] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.130623 1170 consensus_queue.cc:260] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.131161 1170 ts_tablet_manager.cc:1428] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:15.131482 1170 tablet_bootstrap.cc:492] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.133356 1170 tablet_bootstrap.cc:654] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.141450 1170 tablet_bootstrap.cc:492] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.141644 1170 ts_tablet_manager.cc:1397] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.001s
I20260620 07:01:15.142724 1170 raft_consensus.cc:348] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.143007 1170 raft_consensus.cc:374] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.143101 1170 raft_consensus.cc:729] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.143335 1170 consensus_queue.cc:260] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.143445 1999 raft_consensus.cc:2726] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.143930 1170 ts_tablet_manager.cc:1428] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:15.146119 1170 tablet_bootstrap.cc:492] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.148092 1168 tablet_bootstrap.cc:492] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:15.154902 1170 tablet_bootstrap.cc:654] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.118080 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet d066c73ae0104cb3be792790b1dfb93d (table default.Table_3dc4c1ec06e74b1ba496fb7896bea7da [id=c8fa0544c10a479ba4496d1482c535f3]) successfully deleted
W20260620 07:01:15.156271 413 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 46443.7us
W20260620 07:01:15.157087 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b5c1567e0c9448dca870bd3d8502bf02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5c1567e0c9448dca870bd3d8502bf02 already in progress: creating tablet
W20260620 07:01:15.157500 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 4d23f06461284d6cb950b258e8b39540 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d23f06461284d6cb950b258e8b39540 already in progress: creating tablet
I20260620 07:01:15.158420 1168 tablet_bootstrap.cc:654] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.160200 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e931da372abe49fe8893c6abb65fe7dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.160341 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dcd39517a9e640af985a7a77e18673e3" } modify_external_catalogs: true
I20260620 07:01:15.160419 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.160543 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dcd39517a9e640af985a7a77e18673e3" } modify_external_catalogs: true
W20260620 07:01:15.160841 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e931da372abe49fe8893c6abb65fe7dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.161128 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f8464cf5d3234e4e9193a822df5bd7c2" } modify_external_catalogs: true
I20260620 07:01:15.161851 1165 tablet_replica.cc:330] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:15.162034 1165 raft_consensus.cc:2229] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.162165 1165 raft_consensus.cc:2258] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.163130 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d93e7060309143e88364bc7045d58c42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.163661 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d93e7060309143e88364bc7045d58c42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.163939 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5ddbd67fa9074a4b817bbe12a7725343" } modify_external_catalogs: true
I20260620 07:01:15.164525 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_713f54def2154a459120edcb5208b0e7" } new_table_name: "default.Table_36ec08d672f748c69d56047ab5bdc4ba" modify_external_catalogs: true
I20260620 07:01:15.163949 725 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b6c578055d4f95b44c85eba8e92ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.164971 1169 tablet_replica.cc:330] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:15.164873 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ff9d8e8291954a39b6ab22986f4c59dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.165139 1169 raft_consensus.cc:2229] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.165297 1169 raft_consensus.cc:2258] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:15.165345 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff9d8e8291954a39b6ab22986f4c59dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.165609 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e8a4d50205544bcf9ad06609ef06f7fb" } new_table_name: "default.Table_8a81ab01f7a6445da5857ad924251bfc" modify_external_catalogs: true
I20260620 07:01:15.165938 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b72b2c9d38dd47108c5784845153d5e3" } modify_external_catalogs: true
I20260620 07:01:15.166005 1169 ts_tablet_manager.cc:1905] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.166287 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_de6c16eb4d8e49f59c88af00c2d27547"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.166739 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de6c16eb4d8e49f59c88af00c2d27547 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.168260 1165 ts_tablet_manager.cc:1905] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.169008 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 9a8a5da81fac4c17ac60d4c87f844f8f (DEFAULT_TABLE table=default.Table_c1ffe009c5034bb58dbe573808a6cf4a [id=fa021110da20405293f8488c41387d6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.169373 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a8a5da81fac4c17ac60d4c87f844f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.172329 1169 ts_tablet_manager.cc:1918] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.172452 1169 log.cc:1196] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/e5b6c578055d4f95b44c85eba8e92ac8
I20260620 07:01:15.172765 1169 ts_tablet_manager.cc:1939] T e5b6c578055d4f95b44c85eba8e92ac8 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:01:15.176018 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet bed7eba8256c4d85b6fa3a4be0c27635 (table default.Table_944dbe1b638d476eaac9fdb520120272 [id=799c1515380046c4ad839ad4d3c62401], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bed7eba8256c4d85b6fa3a4be0c27635 consensus state has no leader
I20260620 07:01:15.179255 2019 raft_consensus.cc:482] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b84cae646b24bc7bd424eb8434ad425)
I20260620 07:01:15.179394 2019 raft_consensus.cc:504] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.179960 2019 leader_election.cc:288] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:15.182386 969 leader_election.cc:341] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 610a25c729cf41b4bd71372bc36365a8
W20260620 07:01:15.183949 968 leader_election.cc:341] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 610a25c729cf41b4bd71372bc36365a8
I20260620 07:01:15.184079 968 leader_election.cc:302] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.185211 2019 raft_consensus.cc:2726] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 07:01:15.208047 968 consensus_peers.cc:487] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2910da33bbdb4410a4a90ff9747a7de1. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:15.216233 720 tablet_service.cc:1467] Processing CreateTablet for tablet f322a11252cb4a82b87e2737d0faa75e (DEFAULT_TABLE table=default.Table_05fe644ddbaf4a9abfbdd884b9153056 [id=8d20042f750f4e77945c0fa22098c7b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.216850 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f322a11252cb4a82b87e2737d0faa75e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.224040 725 tablet_service.cc:1467] Processing CreateTablet for tablet c24fe8318b4743df886d210fc94318fe (DEFAULT_TABLE table=default.Table_44d2bbefe6b14ed29a35f1c1b6a3a9d9 [id=aacc2d0c0f4841c4ba5b5c7478714337]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.224576 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c24fe8318b4743df886d210fc94318fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.230453 731 tablet_service.cc:1467] Processing CreateTablet for tablet 5c7d55a43f5c4b2db637a0319b8a3c90 (DEFAULT_TABLE table=default.Table_bad00db5e978459b99678e894e6859fb [id=a5fab8e7369f42728ebddf69b533976e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.229571 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 83451bba9a3c4c209dddf4250fea8806
I20260620 07:01:15.230926 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c7d55a43f5c4b2db637a0319b8a3c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.231045 720 tablet_service.cc:1467] Processing CreateTablet for tablet f6cfeccac77b48be87f3f59810c806ee (DEFAULT_TABLE table=default.Table_ac2df841f29b4ea287cce829a29ba718 [id=71e3a4711bf1418598e11dad60b4f793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.231441 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6cfeccac77b48be87f3f59810c806ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.232091 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 83451bba9a3c4c209dddf4250fea8806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.232657 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_45dc12e54a7247b1b760816807c74176"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.233374 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45dc12e54a7247b1b760816807c74176 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.234592 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 83451bba9a3c4c209dddf4250fea8806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.234723 733 tablet_service.cc:1467] Processing CreateTablet for tablet 9a8a5da81fac4c17ac60d4c87f844f8f (DEFAULT_TABLE table=default.Table_c1ffe009c5034bb58dbe573808a6cf4a [id=fa021110da20405293f8488c41387d6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.235092 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a8a5da81fac4c17ac60d4c87f844f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.235395 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 83451bba9a3c4c209dddf4250fea8806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.237139 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet e5b6c578055d4f95b44c85eba8e92ac8 (table default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a [id=b64b98af489b40d3a363f9101d971f53]) successfully deleted
I20260620 07:01:15.238224 1169 tablet_replica.cc:330] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:15.238551 1169 raft_consensus.cc:2229] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.238945 1169 raft_consensus.cc:2258] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.239866 1169 ts_tablet_manager.cc:1905] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.243834 1170 tablet_bootstrap.cc:492] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.244158 1170 ts_tablet_manager.cc:1397] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.098s user 0.001s sys 0.004s
I20260620 07:01:15.246209 1170 raft_consensus.cc:348] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.247290 1170 raft_consensus.cc:374] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.247766 1166 ts_tablet_manager.cc:1918] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.247704 1170 raft_consensus.cc:729] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.248274 1166 log.cc:1196] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/076926f7dffe4a7b80c25ea3c18e9958
I20260620 07:01:15.249858 1166 ts_tablet_manager.cc:1939] T 076926f7dffe4a7b80c25ea3c18e9958 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:15.248723 1170 consensus_queue.cc:260] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.251886 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 620) took 6666 ms. Trace:
I20260620 07:01:15.254748 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]). Expected version 3 got 0
I20260620 07:01:15.255121 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:15.254613 1170 ts_tablet_manager.cc:1428] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260620 07:01:15.256541 1920 raft_consensus.cc:482] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.256842 1920 raft_consensus.cc:504] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.257830 1920 leader_election.cc:288] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:15.258361 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27da98f96a2245c5b4210b7cf084886d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:15.258582 890 raft_consensus.cc:2454] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:15.258945 683 leader_election.cc:302] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:15.259178 1920 raft_consensus.cc:2781] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:15.259256 1920 raft_consensus.cc:482] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:15.259310 1920 raft_consensus.cc:3037] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:15.260591 1170 tablet_bootstrap.cc:492] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.262415 1920 raft_consensus.cc:504] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.263407 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f8464cf5d3234e4e9193a822df5bd7c2" } modify_external_catalogs: true
I20260620 07:01:15.265286 1920 leader_election.cc:288] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:15.267324 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27da98f96a2245c5b4210b7cf084886d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:15.267514 894 raft_consensus.cc:3037] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:15.270218 894 raft_consensus.cc:2454] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:15.270709 683 leader_election.cc:302] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:15.270988 1920 raft_consensus.cc:2781] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:15.271261 1920 raft_consensus.cc:686] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:15.271539 1920 consensus_queue.cc:237] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.278910 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5ddbd67fa9074a4b817bbe12a7725343" } modify_external_catalogs: true
I20260620 07:01:15.280206 1170 tablet_bootstrap.cc:654] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.281607 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b72b2c9d38dd47108c5784845153d5e3" } modify_external_catalogs: true
I20260620 07:01:15.283638 720 tablet_service.cc:1514] Processing DeleteTablet for tablet b39e682e71ed4776a786f7d30158e7e0 with delete_type TABLET_DATA_DELETED (replaced by tablet d9a7fab4d1684604be1b81d4d4bbe560) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.283852 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2f0c28057b4534a8a400d1ca7f3991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:15.293467 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3513341e1b664af1813f2b4ffbce1535 consensus state has no leader
I20260620 07:01:15.294749 1166 rpcz_store.cc:276] 0620 07:01:08.585029 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.585156 (+ 127us) service_pool.cc:227] Handling call
0620 07:01:15.115540 (+6530384us) ts_tablet_manager.cc:1145] Deleting tablet 076926f7dffe4a7b80c25ea3c18e9958
0620 07:01:15.115550 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.200655 (+ 85105us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:15.247650 (+ 46995us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:15.251867 (+ 4217us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6530174}
I20260620 07:01:15.294883 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1d27a7ef447b4adaa697d276f936bd20" } modify_external_catalogs: true
I20260620 07:01:15.295090 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1d27a7ef447b4adaa697d276f936bd20" } modify_external_catalogs: true
I20260620 07:01:15.256244 2019 raft_consensus.cc:482] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.266093 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27da98f96a2245c5b4210b7cf084886d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:15.295492 2019 raft_consensus.cc:504] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:15.295966 681 leader_election.cc:341] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.296092 2019 leader_election.cc:288] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:15.266920 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27da98f96a2245c5b4210b7cf084886d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:15.284462 1989 raft_consensus.cc:482] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.296367 1989 raft_consensus.cc:504] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:15.296800 681 leader_election.cc:341] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.296887 1989 leader_election.cc:288] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:15.297798 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 621) took 6712 ms. Trace:
I20260620 07:01:15.298002 1166 rpcz_store.cc:276] 0620 07:01:08.585528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.585608 (+ 80us) service_pool.cc:227] Handling call
0620 07:01:15.297581 (+6711973us) ts_tablet_manager.cc:1145] Deleting tablet 2004ff6f00a441578b8e702e8c7605fc
0620 07:01:15.297595 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.297752 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6711800}
I20260620 07:01:15.298269 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "134f76587b6147afaf4e94fde5574efc" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:15.298640 725 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d6f7f2b5b3473aa010b8982a03aa5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:15.299252 969 leader_election.cc:341] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 581573cafab14ac79ff7ad19da0580b4
I20260620 07:01:15.300464 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "134f76587b6147afaf4e94fde5574efc" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:15.301064 968 consensus_peers.cc:487] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Couldn't send request to peer 2b84cae646b24bc7bd424eb8434ad425. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:15.301234 968 leader_election.cc:341] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 581573cafab14ac79ff7ad19da0580b4
I20260620 07:01:15.301333 968 leader_election.cc:302] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.301664 968 leader_election.cc:302] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.301946 2019 raft_consensus.cc:2726] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:15.302088 2019 raft_consensus.cc:2726] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.302840 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 622) took 6685 ms. Trace:
I20260620 07:01:15.303045 1166 rpcz_store.cc:276] 0620 07:01:08.617799 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.617864 (+ 65us) service_pool.cc:227] Handling call
0620 07:01:15.302620 (+6684756us) ts_tablet_manager.cc:1145] Deleting tablet 40d9875dde7b4455b24b053781993234
0620 07:01:15.302632 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.302822 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6684517}
I20260620 07:01:15.297392 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 076926f7dffe4a7b80c25ea3c18e9958 (table default.Table_2411c7dd68274c07a75cd0b3ae3e2d32 [id=804a023058a643b189246bf7c6a98af6]) successfully deleted
W20260620 07:01:15.304270 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2004ff6f00a441578b8e702e8c7605fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2004ff6f00a441578b8e702e8c7605fc already in progress: creating tablet
W20260620 07:01:15.304636 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 40d9875dde7b4455b24b053781993234 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40d9875dde7b4455b24b053781993234 already in progress: creating tablet
I20260620 07:01:15.305088 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 626) took 6660 ms. Trace:
I20260620 07:01:15.306375 427 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:15.306764 1169 ts_tablet_manager.cc:1918] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 07:01:15.307854 1169 log.cc:1196] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/83451bba9a3c4c209dddf4250fea8806
I20260620 07:01:15.310854 1166 rpcz_store.cc:276] 0620 07:01:08.644833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.644875 (+ 42us) service_pool.cc:227] Handling call
0620 07:01:15.304946 (+6660071us) ts_tablet_manager.cc:1145] Deleting tablet 60ce7d59a97544fda80a54f7124d1dba
0620 07:01:15.304961 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.305071 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":41796,"tablet-delete.queue_time_us":6658669}
I20260620 07:01:15.312093 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 642) took 6479 ms. Trace:
I20260620 07:01:15.312908 1166 rpcz_store.cc:276] 0620 07:01:08.832613 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.833107 (+ 494us) service_pool.cc:227] Handling call
0620 07:01:15.311953 (+6478846us) ts_tablet_manager.cc:1145] Deleting tablet b37f2c150b314b7298f32c3d414ff43d
0620 07:01:15.311965 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.312077 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6478636}
I20260620 07:01:15.312618 1169 ts_tablet_manager.cc:1939] T 83451bba9a3c4c209dddf4250fea8806 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:01:15.311678 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 60ce7d59a97544fda80a54f7124d1dba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60ce7d59a97544fda80a54f7124d1dba already in progress: creating tablet
I20260620 07:01:15.313580 420 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 7cae8b9bbb0e4a7d89b1c970e73d1405
I20260620 07:01:15.314373 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 643) took 6481 ms. Trace:
I20260620 07:01:15.315551 1166 rpcz_store.cc:276] 0620 07:01:08.832768 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.833349 (+ 581us) service_pool.cc:227] Handling call
0620 07:01:15.314251 (+6480902us) ts_tablet_manager.cc:1145] Deleting tablet 95ba8444d70342f781bd84edefbca71f
0620 07:01:15.314262 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.314359 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6480740}
W20260620 07:01:15.313853 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5697e4be46ad49e89c3b1ba8d02cebf6 has no consensus state
I20260620 07:01:15.316740 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 960fca9c94764f3d8d2daae20a0f8388 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:15.316761 427 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]). Expected version 3 got 0
I20260620 07:01:15.319142 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fa2a48cf1abe4b71913bb67889163cb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.319406 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_923c108a61e44c338c767ff9ab8e000f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.319697 1170 tablet_bootstrap.cc:492] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.319823 1170 ts_tablet_manager.cc:1397] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.001s
I20260620 07:01:15.320013 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c73bcb81a0c84cdfb4dea0561647828a
W20260620 07:01:15.320154 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b37f2c150b314b7298f32c3d414ff43d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b37f2c150b314b7298f32c3d414ff43d already in progress: creating tablet
I20260620 07:01:15.320842 874 tablet_service.cc:1514] Processing DeleteTablet for tablet c73bcb81a0c84cdfb4dea0561647828a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.321041 733 tablet_service.cc:1514] Processing DeleteTablet for tablet c73bcb81a0c84cdfb4dea0561647828a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.321305 1170 raft_consensus.cc:348] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:15.322136 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_923c108a61e44c338c767ff9ab8e000f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.321584 1170 raft_consensus.cc:374] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.322850 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_dcd39517a9e640af985a7a77e18673e3 [id=04c170b69f3b43eb88b51e1654ec86df]) successfully deleted
I20260620 07:01:15.322976 1170 raft_consensus.cc:729] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.323292 1170 consensus_queue.cc:260] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:15.322305 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 95ba8444d70342f781bd84edefbca71f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95ba8444d70342f781bd84edefbca71f already in progress: creating tablet
I20260620 07:01:15.322453 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8eb6ccb773d14188b66a1af0fd3252e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.323890 1170 ts_tablet_manager.cc:1428] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260620 07:01:15.324419 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8eb6ccb773d14188b66a1af0fd3252e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.325096 1170 tablet_bootstrap.cc:492] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:15.323817 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa2a48cf1abe4b71913bb67889163cb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.327096 1170 tablet_bootstrap.cc:654] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.327108 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_703c2ae2881649669e2d23335bf7d54c" } new_table_name: "default.Table_3b0bc2da0baf482cb90aaf13892452b1" modify_external_catalogs: true
I20260620 07:01:15.327276 427 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 34dc2af503684aaba8388a4611fab48e (table default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9]). Expected version 1 got 0
I20260620 07:01:15.332912 1170 tablet_bootstrap.cc:492] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.324774 1169 tablet_replica.cc:330] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:15.334224 1170 ts_tablet_manager.cc:1397] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20260620 07:01:15.335016 1169 raft_consensus.cc:2229] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.336735 1169 raft_consensus.cc:2258] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.341539 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f26bb7c751c047a4959b5889562e539b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.340823 1170 raft_consensus.cc:348] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.323997 731 tablet_service.cc:1514] Processing DeleteTablet for tablet ba93e22c4720417c99d471b9c8b49b86 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e6ca6c0a0e40a68e8c6501af7d28c5) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:15.342338 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f26bb7c751c047a4959b5889562e539b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.342087 1170 raft_consensus.cc:374] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.342741 1170 raft_consensus.cc:729] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.343918 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet c73bcb81a0c84cdfb4dea0561647828a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.344233 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 644) took 6511 ms. Trace:
I20260620 07:01:15.344367 1166 rpcz_store.cc:276] 0620 07:01:08.832864 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.833534 (+ 670us) service_pool.cc:227] Handling call
0620 07:01:15.316966 (+6483432us) ts_tablet_manager.cc:1145] Deleting tablet 00a34f01ce5d4d5696248dc88802dafd
0620 07:01:15.316975 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.344204 (+ 27229us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6483253}
I20260620 07:01:15.345088 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 645) took 6512 ms. Trace:
I20260620 07:01:15.345247 1166 rpcz_store.cc:276] 0620 07:01:08.832945 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:08.833015 (+ 70us) service_pool.cc:227] Handling call
0620 07:01:15.344976 (+6511961us) ts_tablet_manager.cc:1145] Deleting tablet 574371fb6915427687df660e733407df
0620 07:01:15.344989 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.345072 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6317284}
W20260620 07:01:15.345811 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 00a34f01ce5d4d5696248dc88802dafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00a34f01ce5d4d5696248dc88802dafd already in progress: creating tablet
I20260620 07:01:15.345870 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 655) took 6143 ms. Trace:
I20260620 07:01:15.344509 1170 consensus_queue.cc:260] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:15.346115 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 574371fb6915427687df660e733407df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 574371fb6915427687df660e733407df already in progress: creating tablet
I20260620 07:01:15.346045 1166 rpcz_store.cc:276] 0620 07:01:09.202951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.202999 (+ 48us) service_pool.cc:227] Handling call
0620 07:01:15.345778 (+6142779us) ts_tablet_manager.cc:1145] Deleting tablet 0e30fb1d050c4439bb72a21a0f2b13eb
0620 07:01:15.345787 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.345857 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6142416}
W20260620 07:01:15.346431 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0e30fb1d050c4439bb72a21a0f2b13eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e30fb1d050c4439bb72a21a0f2b13eb already in progress: creating tablet
I20260620 07:01:15.346572 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 662) took 6141 ms. Trace:
I20260620 07:01:15.346683 1166 rpcz_store.cc:276] 0620 07:01:09.205559 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.205623 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:15.346475 (+6140852us) ts_tablet_manager.cc:1145] Deleting tablet 3e9f0dba4466436f9cfc730d7d6b15fe
0620 07:01:15.346484 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.346559 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6140650}
W20260620 07:01:15.347132 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3e9f0dba4466436f9cfc730d7d6b15fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e9f0dba4466436f9cfc730d7d6b15fe already in progress: creating tablet
I20260620 07:01:15.347481 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 660) took 6142 ms. Trace:
I20260620 07:01:15.351171 1170 ts_tablet_manager.cc:1428] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260620 07:01:15.354743 1170 tablet_bootstrap.cc:492] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.362493 2019 raft_consensus.cc:482] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.362691 2019 raft_consensus.cc:504] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.347594 1166 rpcz_store.cc:276] 0620 07:01:09.205109 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.206063 (+ 954us) service_pool.cc:227] Handling call
0620 07:01:15.347396 (+6141333us) ts_tablet_manager.cc:1145] Deleting tablet 2859db39c7dd486f9ad7e3b5f84927fa
0620 07:01:15.347405 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.347469 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6141088}
W20260620 07:01:15.363430 969 consensus_peers.cc:487] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2910da33bbdb4410a4a90ff9747a7de1. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:15.363629 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 661) took 6158 ms. Trace:
I20260620 07:01:15.363744 1166 rpcz_store.cc:276] 0620 07:01:09.205311 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.206211 (+ 900us) service_pool.cc:227] Handling call
0620 07:01:15.363515 (+6157304us) ts_tablet_manager.cc:1145] Deleting tablet 3a8d48f0f9dd4911876ec8f812688439
0620 07:01:15.363527 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.363616 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6157175}
I20260620 07:01:15.364148 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 663) took 6032 ms. Trace:
I20260620 07:01:15.364259 1166 rpcz_store.cc:276] 0620 07:01:09.332042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.332469 (+ 427us) service_pool.cc:227] Handling call
0620 07:01:15.364064 (+6031595us) ts_tablet_manager.cc:1145] Deleting tablet d05a505f73b24e0ba7159a3d411e5f4f
0620 07:01:15.364073 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.364136 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6018591}
I20260620 07:01:15.364570 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 664) took 6032 ms. Trace:
W20260620 07:01:15.365615 968 leader_election.cc:341] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 261f0d97e1084e828b9562cb30ea422b
I20260620 07:01:15.364665 2019 leader_election.cc:288] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:15.366674 969 leader_election.cc:341] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 261f0d97e1084e828b9562cb30ea422b
I20260620 07:01:15.366766 969 leader_election.cc:302] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.369542 2019 raft_consensus.cc:2726] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 07:01:15.369982 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2859db39c7dd486f9ad7e3b5f84927fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2859db39c7dd486f9ad7e3b5f84927fa already in progress: creating tablet
W20260620 07:01:15.370299 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3a8d48f0f9dd4911876ec8f812688439 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a8d48f0f9dd4911876ec8f812688439 already in progress: creating tablet
W20260620 07:01:15.370548 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d05a505f73b24e0ba7159a3d411e5f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d05a505f73b24e0ba7159a3d411e5f4f already in progress: creating tablet
I20260620 07:01:15.373797 1170 tablet_bootstrap.cc:654] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.374773 1165 ts_tablet_manager.cc:1918] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.374918 1165 log.cc:1196] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/35cb81ac0ebd4865b9d53259ed5787d1
I20260620 07:01:15.375195 1165 ts_tablet_manager.cc:1939] T 35cb81ac0ebd4865b9d53259ed5787d1 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:15.375747 1169 ts_tablet_manager.cc:1905] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.376062 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fc40cf4ca353452590c770c86be0814c
I20260620 07:01:15.376850 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b5e40adb30234141a83c1dbbe20db68b" } new_table_name: "default.Table_000758a78ff9431d9aec460d05262232" modify_external_catalogs: true
I20260620 07:01:15.379302 874 tablet_service.cc:1514] Processing DeleteTablet for tablet fc40cf4ca353452590c770c86be0814c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.379905 731 tablet_service.cc:1514] Processing DeleteTablet for tablet fc40cf4ca353452590c770c86be0814c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.381461 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a3ef4087b9fd4da48145c06945728af0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.382404 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3ef4087b9fd4da48145c06945728af0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.364662 1166 rpcz_store.cc:276] 0620 07:01:09.332381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.333071 (+ 690us) service_pool.cc:227] Handling call
0620 07:01:15.364493 (+6031422us) ts_tablet_manager.cc:1145] Deleting tablet a570e8da585d46839281d606b2f51938
0620 07:01:15.364501 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.364558 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6018914}
I20260620 07:01:15.384727 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 675) took 5619 ms. Trace:
I20260620 07:01:15.384886 1166 rpcz_store.cc:276] 0620 07:01:09.765353 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.765581 (+ 228us) service_pool.cc:227] Handling call
0620 07:01:15.384575 (+5618994us) ts_tablet_manager.cc:1145] Deleting tablet 8cca283f4d2645c0b59f750949b7e263
0620 07:01:15.384589 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.384700 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5612269}
I20260620 07:01:15.385293 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 678) took 5590 ms. Trace:
I20260620 07:01:15.385663 1166 rpcz_store.cc:276] 0620 07:01:09.795015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.795351 (+ 336us) service_pool.cc:227] Handling call
0620 07:01:15.385200 (+5589849us) ts_tablet_manager.cc:1145] Deleting tablet 490eb0893a4f4811b7574c445e483549
0620 07:01:15.385209 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.385279 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5589637}
I20260620 07:01:15.386211 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 676) took 5616 ms. Trace:
W20260620 07:01:15.386713 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8cca283f4d2645c0b59f750949b7e263 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cca283f4d2645c0b59f750949b7e263 already in progress: creating tablet
W20260620 07:01:15.387022 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 490eb0893a4f4811b7574c445e483549 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 490eb0893a4f4811b7574c445e483549 already in progress: creating tablet
I20260620 07:01:15.393970 1165 tablet_replica.cc:330] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:15.394212 1165 raft_consensus.cc:2229] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.394420 1165 raft_consensus.cc:2258] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.395045 1165 ts_tablet_manager.cc:1905] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.399063 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 35cb81ac0ebd4865b9d53259ed5787d1 (table default.Table_1aeab74931f24831bafc5e0ba0dd2a6e [id=1217f9b44b2f484d86191921e496bd0b]) successfully deleted
I20260620 07:01:15.399433 1168 tablet_bootstrap.cc:492] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:15.399564 1168 ts_tablet_manager.cc:1397] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.252s user 0.002s sys 0.034s
I20260620 07:01:15.400280 1168 raft_consensus.cc:348] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.400595 1168 raft_consensus.cc:374] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.400702 1168 raft_consensus.cc:729] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.400995 1168 consensus_queue.cc:260] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.404541 1166 rpcz_store.cc:276] 0620 07:01:09.770147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.770475 (+ 328us) service_pool.cc:227] Handling call
0620 07:01:15.386117 (+5615642us) ts_tablet_manager.cc:1145] Deleting tablet 13c7f0513df34ddb8104b06e5733fb62
0620 07:01:15.386129 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.386198 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5589103}
I20260620 07:01:15.405483 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 684) took 5525 ms. Trace:
I20260620 07:01:15.405897 1166 rpcz_store.cc:276] 0620 07:01:09.880286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.880976 (+ 690us) service_pool.cc:227] Handling call
0620 07:01:15.405361 (+5524385us) ts_tablet_manager.cc:1145] Deleting tablet e972b9bef1bd4c19ac0a8c86331dce60
0620 07:01:15.405374 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.405468 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5524137}
I20260620 07:01:15.406648 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 685) took 5526 ms. Trace:
I20260620 07:01:15.406869 1166 rpcz_store.cc:276] 0620 07:01:09.880396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.881641 (+ 1245us) service_pool.cc:227] Handling call
0620 07:01:15.406551 (+5524910us) ts_tablet_manager.cc:1145] Deleting tablet 2614cc40931e4c308a5a7208f2e8c400
0620 07:01:15.406561 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.406636 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5524688}
I20260620 07:01:15.407279 1166 tablet_replica.cc:330] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:15.407511 1166 raft_consensus.cc:2229] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:15.407963 1168 ts_tablet_manager.cc:1428] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260620 07:01:15.408092 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 13c7f0513df34ddb8104b06e5733fb62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13c7f0513df34ddb8104b06e5733fb62 already in progress: creating tablet
W20260620 07:01:15.408366 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet e972b9bef1bd4c19ac0a8c86331dce60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e972b9bef1bd4c19ac0a8c86331dce60 already in progress: creating tablet
I20260620 07:01:15.408399 1168 tablet_bootstrap.cc:492] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:15.408584 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2614cc40931e4c308a5a7208f2e8c400 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2614cc40931e4c308a5a7208f2e8c400 already in progress: creating tablet
I20260620 07:01:15.410261 1168 tablet_bootstrap.cc:654] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.416395 1170 tablet_bootstrap.cc:492] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.416635 1170 ts_tablet_manager.cc:1397] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.010s
I20260620 07:01:15.417959 1170 raft_consensus.cc:348] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.418351 1170 raft_consensus.cc:374] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.418444 1170 raft_consensus.cc:729] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.418843 1170 consensus_queue.cc:260] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.423302 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_353005aed9854c42bb2013ecbcd04165" } new_table_name: "default.Table_debb21e4366f4317ae8f74130390b8d3" modify_external_catalogs: true
I20260620 07:01:15.423602 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 17c337e52ace48f99316960e655dd264 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:15.425004 1170 ts_tablet_manager.cc:1428] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260620 07:01:15.426065 423 master_service.cc:946] ReplaceTablet: received request to replace tablet cf0bae39e1634710af12de493f7f58d5 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:15.430299 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5db563ce7027457fa0185ef94f3c05b5 consensus state has no leader
I20260620 07:01:15.430190 1170 tablet_bootstrap.cc:492] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.430598 426 master_service.cc:946] ReplaceTablet: received request to replace tablet fbb2fd1a8bb14f3e883a2efb6560d184 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:15.431021 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ce25c8fd7334d1c9d35e33122d58a19 consensus state has no leader
I20260620 07:01:15.432345 2253 raft_consensus.cc:482] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.432499 2253 raft_consensus.cc:504] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.433128 2253 leader_election.cc:288] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:15.434652 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0435678022914e6991c974e116d1a9f7" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:15.435233 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0435678022914e6991c974e116d1a9f7" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:15.435989 830 leader_election.cc:341] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:15.436868 831 leader_election.cc:341] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.436990 831 leader_election.cc:302] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:15.437547 2253 raft_consensus.cc:2726] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.437749 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_759a7e5d01564a1fb58f0994637d7897" } modify_external_catalogs: true
I20260620 07:01:15.437964 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_759a7e5d01564a1fb58f0994637d7897" } modify_external_catalogs: true
W20260620 07:01:15.440275 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9cebdd8c947845528affd32316d9b336 consensus state has no leader
I20260620 07:01:15.452339 1166 pending_rounds.cc:62] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:15.452425 1166 pending_rounds.cc:68] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821611912224768 op_type: NO_OP noop_request { }
W20260620 07:01:15.452472 2173 log.cc:924] Time spent T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: Append to log took a long time: real 0.071s user 0.000s sys 0.001s
I20260620 07:01:15.452291 1170 tablet_bootstrap.cc:654] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.452540 1166 raft_consensus.cc:2866] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:15.452629 1166 raft_consensus.cc:2258] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.453190 1166 ts_tablet_manager.cc:1905] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.454635 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1721a5345ef6498a8c275fcc9f19fc78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.454874 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet fc40cf4ca353452590c770c86be0814c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:15.455271 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1721a5345ef6498a8c275fcc9f19fc78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.470078 1169 ts_tablet_manager.cc:1918] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.470229 1169 log.cc:1196] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/b39e682e71ed4776a786f7d30158e7e0
I20260620 07:01:15.471174 1168 tablet_bootstrap.cc:492] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:15.471400 1168 ts_tablet_manager.cc:1397] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.002s
I20260620 07:01:15.472172 1168 raft_consensus.cc:348] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.472513 1168 raft_consensus.cc:374] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.472615 1168 raft_consensus.cc:729] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.472877 1168 consensus_queue.cc:260] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.477183 1168 ts_tablet_manager.cc:1428] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260620 07:01:15.477546 1168 tablet_bootstrap.cc:492] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:15.483116 1168 tablet_bootstrap.cc:654] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.484476 1170 tablet_bootstrap.cc:492] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.487774 1170 ts_tablet_manager.cc:1397] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.058s user 0.008s sys 0.000s
I20260620 07:01:15.489127 1170 raft_consensus.cc:348] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.489598 1170 raft_consensus.cc:374] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.489768 1170 raft_consensus.cc:729] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.490219 1170 consensus_queue.cc:260] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.487895 1169 ts_tablet_manager.cc:1939] T b39e682e71ed4776a786f7d30158e7e0 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:15.494171 1169 tablet_replica.cc:330] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:15.494176 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet b39e682e71ed4776a786f7d30158e7e0 (table default.Table_982eb8abebd34542b51573e542ad6085 [id=a7902aafbaad4905a6b5b03ad669eeae]) successfully deleted
I20260620 07:01:15.496148 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2fdaf5217bb741faa11eb980163dfe21" } new_table_name: "default.Table_45a3fdc28a0143deb5a12984f8fd8144" modify_external_catalogs: true
I20260620 07:01:15.495169 1170 ts_tablet_manager.cc:1428] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 07:01:15.498661 1169 raft_consensus.cc:2229] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.498886 1169 raft_consensus.cc:2258] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.499210 1165 ts_tablet_manager.cc:1918] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 07:01:15.499104 1170 tablet_bootstrap.cc:492] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.499491 1165 log.cc:1196] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/83451bba9a3c4c209dddf4250fea8806
I20260620 07:01:15.500437 1165 ts_tablet_manager.cc:1939] T 83451bba9a3c4c209dddf4250fea8806 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:15.501483 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_dcd39517a9e640af985a7a77e18673e3 [id=04c170b69f3b43eb88b51e1654ec86df]) successfully deleted
W20260620 07:01:15.502003 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c73bcb81a0c84cdfb4dea0561647828a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c73bcb81a0c84cdfb4dea0561647828a already in progress: creating tablet
W20260620 07:01:15.502210 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fc40cf4ca353452590c770c86be0814c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc40cf4ca353452590c770c86be0814c already in progress: creating tablet
I20260620 07:01:15.502912 1168 tablet_bootstrap.cc:492] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:15.503043 1168 ts_tablet_manager.cc:1397] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260620 07:01:15.503759 1168 raft_consensus.cc:348] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.503999 1168 raft_consensus.cc:374] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.504065 1168 raft_consensus.cc:729] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.504276 1168 consensus_queue.cc:260] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.507627 1168 ts_tablet_manager.cc:1428] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:15.507891 1168 tablet_bootstrap.cc:492] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:15.513696 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_43ca3403b54a4673add23baba8a8edd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.513756 1170 tablet_bootstrap.cc:654] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:15.514355 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43ca3403b54a4673add23baba8a8edd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.521462 2253 raft_consensus.cc:482] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.521628 2253 raft_consensus.cc:504] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.522233 2253 leader_election.cc:288] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:15.522959 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "967cc8f19ad64278910c86ffc4cb3ed2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:15.523558 831 leader_election.cc:341] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.524314 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "967cc8f19ad64278910c86ffc4cb3ed2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:15.525586 830 leader_election.cc:341] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.525728 830 leader_election.cc:302] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:15.526262 2253 raft_consensus.cc:2726] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.527698 2284 tablet.cc:1722] T 96453f82ff3048beabeb188fb27dee42 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:15.530349 1168 tablet_bootstrap.cc:654] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.532532 2285 tablet.cc:1722] T 96453f82ff3048beabeb188fb27dee42 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:15.540494 1168 tablet_bootstrap.cc:492] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:15.547818 1166 ts_tablet_manager.cc:1918] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:15.548035 1166 log.cc:1196] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/a5757e05e9a2403a86ca98f455e11754
I20260620 07:01:15.548612 1166 ts_tablet_manager.cc:1939] T a5757e05e9a2403a86ca98f455e11754 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:15.548995 1170 tablet_bootstrap.cc:492] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.549232 1170 ts_tablet_manager.cc:1397] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.001s
I20260620 07:01:15.549659 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 687) took 5580 ms. Trace:
I20260620 07:01:15.549834 1166 rpcz_store.cc:276] 0620 07:01:09.968845 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:09.975931 (+ 7086us) service_pool.cc:227] Handling call
0620 07:01:15.407242 (+5431311us) ts_tablet_manager.cc:1145] Deleting tablet a5757e05e9a2403a86ca98f455e11754
0620 07:01:15.407251 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.493030 (+ 85779us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:15.547652 (+ 54622us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:15.549635 (+ 1983us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5430965}
I20260620 07:01:15.550064 1170 raft_consensus.cc:348] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.550392 1170 raft_consensus.cc:374] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.550475 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet a5757e05e9a2403a86ca98f455e11754 (table default.Table_0f52b588d09748288097316c7b3de423 [id=7abc3167416745d0871a33a335f880c6]) successfully deleted
I20260620 07:01:15.550554 1170 raft_consensus.cc:729] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.550900 1168 ts_tablet_manager.cc:1397] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.043s user 0.005s sys 0.000s
I20260620 07:01:15.550983 1166 tablet_replica.cc:330] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:15.550997 1170 consensus_queue.cc:260] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.551455 1166 raft_consensus.cc:2229] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.551664 1166 raft_consensus.cc:2258] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.551692 1168 raft_consensus.cc:348] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.552000 1168 raft_consensus.cc:374] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.552102 1168 raft_consensus.cc:729] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.552187 1170 ts_tablet_manager.cc:1428] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:15.552402 1168 consensus_queue.cc:260] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.553900 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:15.554443 1170 tablet_bootstrap.cc:492] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.555076 1168 ts_tablet_manager.cc:1428] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260620 07:01:15.558097 1168 tablet_bootstrap.cc:492] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:15.565981 419 catalog_manager.cc:5495] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:15.566500 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 27da98f96a2245c5b4210b7cf084886d (table default.Table_96e0a2412a5040ba8c91876d7263de57 [id=6d5b03179de540539513cab6cd39da39]). Expected version 2 got 0
I20260620 07:01:15.566830 1168 tablet_bootstrap.cc:654] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.575603 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]). Expected version 3 got 0
I20260620 07:01:15.575922 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 97e01aa120cc4c189017236ad57de811 (table default.Table_b19a46e2d20e4f75a3d170cbb543ca71 [id=19dd20742533400980193075baec1956]). Expected version 1 got 0
I20260620 07:01:15.576139 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:15.577594 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:15.578291 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 35cb81ac0ebd4865b9d53259ed5787d1 because the tablet was not found. No further retry: Not found: Tablet not found: 35cb81ac0ebd4865b9d53259ed5787d1
I20260620 07:01:15.579481 1170 tablet_bootstrap.cc:654] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.592303 1168 tablet_bootstrap.cc:492] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:15.592552 1168 ts_tablet_manager.cc:1397] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.004s
I20260620 07:01:15.593336 1168 raft_consensus.cc:348] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.593604 1168 raft_consensus.cc:374] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.593693 1168 raft_consensus.cc:729] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.593971 1168 consensus_queue.cc:260] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.596124 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 0435678022914e6991c974e116d1a9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.596367 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b781d0578834708ae64b24419959cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.596441 1165 tablet_replica.cc:330] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:15.596531 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 3456cf91d65a4413a35efe94513c723d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.596625 1165 raft_consensus.cc:2229] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.596652 874 tablet_service.cc:1514] Processing DeleteTablet for tablet f793a91ab247408bbe4a9f7cb370fffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.596765 1165 raft_consensus.cc:2258] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.597689 1165 ts_tablet_manager.cc:1905] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.599668 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:15.604095 1165 ts_tablet_manager.cc:1918] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.605197 1165 log.cc:1196] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/0435678022914e6991c974e116d1a9f7
I20260620 07:01:15.605624 1165 ts_tablet_manager.cc:1939] T 0435678022914e6991c974e116d1a9f7 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:15.606537 2257 raft_consensus.cc:482] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.606624 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 0435678022914e6991c974e116d1a9f7 (table default.Table_9f21f8c0c60642fd97b87ce5e1befcaf [id=3497d9fc568f4979baf33dfdd30ce222]) successfully deleted
I20260620 07:01:15.606678 2257 raft_consensus.cc:504] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.606032 1168 ts_tablet_manager.cc:1428] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260620 07:01:15.607431 1168 tablet_bootstrap.cc:492] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:15.607416 2257 leader_election.cc:288] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:15.608968 683 leader_election.cc:341] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a2d6f7f2b5b3473aa010b8982a03aa5e
I20260620 07:01:15.609162 1168 tablet_bootstrap.cc:654] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.610368 1165 tablet_replica.cc:330] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:15.612859 1165 raft_consensus.cc:2229] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.613072 1165 raft_consensus.cc:2258] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.614149 1165 ts_tablet_manager.cc:1905] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.615272 1170 tablet_bootstrap.cc:492] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.615445 1170 ts_tablet_manager.cc:1397] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.001s
I20260620 07:01:15.616202 1170 raft_consensus.cc:348] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.616501 1170 raft_consensus.cc:374] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.616609 1170 raft_consensus.cc:729] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.616976 1170 consensus_queue.cc:260] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.618968 731 tablet_service.cc:1467] Processing CreateTablet for tablet 633f3666050846dc9fc59a365110406d (DEFAULT_TABLE table=default.Table_29524262208149ff87cf1a63d2d9f6e4 [id=3daa5ca510994cf98e77f80f2bd54064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.619377 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 633f3666050846dc9fc59a365110406d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.619357 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0e8e9256a3c0466abfacc2b4266a5db2
I20260620 07:01:15.621716 1170 ts_tablet_manager.cc:1428] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:15.621802 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0467f4c59a6647f0b8dc78ce62517b66" } modify_external_catalogs: true
I20260620 07:01:15.622011 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0467f4c59a6647f0b8dc78ce62517b66" } modify_external_catalogs: true
I20260620 07:01:15.623034 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0f8ddfba5500406eba8f184bd5039170
I20260620 07:01:15.623600 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fa2a48cf1abe4b71913bb67889163cb0" } new_table_name: "default.Table_2478c0ed7b254bec883d76e134a5a88a" modify_external_catalogs: true
I20260620 07:01:15.625546 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e8e9256a3c0466abfacc2b4266a5db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.625800 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c51ecf0f006400597f0e7f776698854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.625994 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8ddfba5500406eba8f184bd5039170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.629668 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e8e9256a3c0466abfacc2b4266a5db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.629794 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8ddfba5500406eba8f184bd5039170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.629424 1170 tablet_bootstrap.cc:492] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.630357 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 17c337e52ace48f99316960e655dd264
I20260620 07:01:15.630803 420 catalog_manager.cc:6565] ReplaceTablet: tablet 17c337e52ace48f99316960e655dd264 deleted and replaced by tablet 90ed8a1968f94ff7a0e1493cc97a3191
I20260620 07:01:15.631044 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c337e52ace48f99316960e655dd264 with delete_type TABLET_DATA_DELETED (replaced by tablet 90ed8a1968f94ff7a0e1493cc97a3191) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.631194 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b6ae67323cd248cd93143c8bdcf3187e" } modify_external_catalogs: true
I20260620 07:01:15.631438 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b6ae67323cd248cd93143c8bdcf3187e" } modify_external_catalogs: true
I20260620 07:01:15.631501 1170 tablet_bootstrap.cc:654] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.633013 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7f4e45654c564d97a4acee1989b9b9dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.633554 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f4e45654c564d97a4acee1989b9b9dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:15.634743 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef4e6fda73ba45c6892273b33b37a688 consensus state has no leader
I20260620 07:01:15.635150 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9a8785defc83404485359d8702fa2ddb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.635721 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a8785defc83404485359d8702fa2ddb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.638516 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bddd763d82d14db2bc1ceb50eaa2ae69" } modify_external_catalogs: true
I20260620 07:01:15.638711 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bddd763d82d14db2bc1ceb50eaa2ae69" } modify_external_catalogs: true
I20260620 07:01:15.640674 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_72beaf5462364dd7930966b62a3d6717"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.641172 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72beaf5462364dd7930966b62a3d6717 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.642516 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c337e52ace48f99316960e655dd264 with delete_type TABLET_DATA_DELETED (replaced by tablet 90ed8a1968f94ff7a0e1493cc97a3191) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.646567 1165 ts_tablet_manager.cc:1918] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.646694 1165 log.cc:1196] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/7b781d0578834708ae64b24419959cca
I20260620 07:01:15.647083 1165 ts_tablet_manager.cc:1939] T 7b781d0578834708ae64b24419959cca P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:15.649307 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 7b781d0578834708ae64b24419959cca (table default.Table_6d1419cac1c54567a909e7a7b5bc2ff0 [id=84ff58148b4f4e10b31009115fe83352]) successfully deleted
I20260620 07:01:15.650274 1165 tablet_replica.cc:330] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:15.650476 1165 raft_consensus.cc:2229] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.650638 1165 raft_consensus.cc:2258] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.650628 424 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_7e1bd0d27961486986559381614efd38 [id=7c6337d452d64674bd95e1738caa4345] alter complete (version 2)
I20260620 07:01:15.651161 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 7fb2d5c0f6d24969a0fea05a34fea00f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:15.651358 2257 raft_consensus.cc:482] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.651511 2257 raft_consensus.cc:504] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.652163 2257 leader_election.cc:288] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:15.653067 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b09f83cd81ce404d9738bbad2ad671cc has no consensus state
I20260620 07:01:15.653528 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ae11a807ad8e4678a0b70fd92379ddd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.654271 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae11a807ad8e4678a0b70fd92379ddd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.654307 1165 ts_tablet_manager.cc:1905] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.656208 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6dca84adc5940e5a5505378e7276731" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:15.656481 890 raft_consensus.cc:2454] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:15.657094 683 leader_election.cc:302] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:15.657176 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet cf0bae39e1634710af12de493f7f58d5
I20260620 07:01:15.657392 2257 raft_consensus.cc:2781] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:15.657459 2257 raft_consensus.cc:482] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:15.657516 2257 raft_consensus.cc:3037] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:15.657723 423 catalog_manager.cc:6565] ReplaceTablet: tablet cf0bae39e1634710af12de493f7f58d5 deleted and replaced by tablet 394a20b5d4814305b347c5718731d551
I20260620 07:01:15.658190 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8e5aac889fc34a76a4d0bb8e8840a31e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.658954 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e5aac889fc34a76a4d0bb8e8840a31e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.660128 2257 raft_consensus.cc:504] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.661276 867 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0bae39e1634710af12de493f7f58d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 394a20b5d4814305b347c5718731d551) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.662313 2257 leader_election.cc:288] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:15.662603 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6dca84adc5940e5a5505378e7276731" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:15.662848 890 raft_consensus.cc:3037] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:15.665490 890 raft_consensus.cc:2454] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:15.666018 683 leader_election.cc:302] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:15.666358 2257 raft_consensus.cc:2781] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:15.666918 2257 raft_consensus.cc:686] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:15.667275 2257 consensus_queue.cc:237] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.669195 725 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0bae39e1634710af12de493f7f58d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 394a20b5d4814305b347c5718731d551) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.670082 731 tablet_service.cc:1514] Processing DeleteTablet for tablet d51c7488711b4db697b48025a5ba6e9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.670610 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fbb2fd1a8bb14f3e883a2efb6560d184
I20260620 07:01:15.670856 1166 ts_tablet_manager.cc:1905] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.671080 426 catalog_manager.cc:6565] ReplaceTablet: tablet fbb2fd1a8bb14f3e883a2efb6560d184 deleted and replaced by tablet b627c1c966b7416ca842dfdb2ab2efdb
I20260620 07:01:15.561558 1167 tablet_bootstrap.cc:492] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:15.608577 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d6f7f2b5b3473aa010b8982a03aa5e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:15.672844 681 leader_election.cc:341] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.672957 681 leader_election.cc:302] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.673062 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 70f09b7dfdc1467eb47b8d7acb214919
I20260620 07:01:15.673337 1920 raft_consensus.cc:2726] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.673437 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 5a4390225af348f89c934f0f179ddab5 (table default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b]). Expected version 1 got 0
I20260620 07:01:15.673656 1167 ts_tablet_manager.cc:1397] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.607s user 0.021s sys 0.062s
I20260620 07:01:15.673749 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]). Expected version 3 got 0
I20260620 07:01:15.673796 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_27d83c05f310476ca4266dc0b9b58ab5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.674407 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27d83c05f310476ca4266dc0b9b58ab5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.674501 1167 raft_consensus.cc:348] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.674732 1167 raft_consensus.cc:374] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.674806 1167 raft_consensus.cc:729] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.625687 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8ddfba5500406eba8f184bd5039170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.635442 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e8e9256a3c0466abfacc2b4266a5db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.675475 867 tablet_service.cc:1514] Processing DeleteTablet for tablet fbb2fd1a8bb14f3e883a2efb6560d184 with delete_type TABLET_DATA_DELETED (replaced by tablet b627c1c966b7416ca842dfdb2ab2efdb) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.644027 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c337e52ace48f99316960e655dd264 with delete_type TABLET_DATA_DELETED (replaced by tablet 90ed8a1968f94ff7a0e1493cc97a3191) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.675707 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f09b7dfdc1467eb47b8d7acb214919 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.655812 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6dca84adc5940e5a5505378e7276731" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:15.675871 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 702e78bcd01f41c1846294deadca1b54
I20260620 07:01:15.661068 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0bae39e1634710af12de493f7f58d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 394a20b5d4814305b347c5718731d551) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.661757 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6dca84adc5940e5a5505378e7276731" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:15.676397 681 leader_election.cc:341] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.676438 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 702e78bcd01f41c1846294deadca1b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.676503 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ad5730ccf942456cac948b6a2a12fb4b" } new_table_name: "default.Table_a237ed25c24d4a888a3fdd693bb8e73e" modify_external_catalogs: true
W20260620 07:01:15.677183 681 leader_election.cc:341] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.677637 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6497405bcc42404db11302f413834ec1" } new_table_name: "default.Table_6bd7256e447b419db6c6f79b49b94fc9" modify_external_catalogs: true
I20260620 07:01:15.678282 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_01c7359d6f2b482b93aed480983cd31b" } new_table_name: "default.Table_a76e5fada5c24c4f94cf995134ab8a96" modify_external_catalogs: true
I20260620 07:01:15.679634 1170 tablet_bootstrap.cc:492] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.679723 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_975d0608ca3b4bef8479a03d4028e427"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.680295 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_975d0608ca3b4bef8479a03d4028e427 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.680931 1170 ts_tablet_manager.cc:1397] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.003s
I20260620 07:01:15.681465 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7a554c1eebd542619bb1989987a3d9a6
I20260620 07:01:15.682132 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ac08547b5a874d02b9bc1ca762ce6eba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.682675 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac08547b5a874d02b9bc1ca762ce6eba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.684682 2253 raft_consensus.cc:482] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.684818 2253 raft_consensus.cc:504] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.685000 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a554c1eebd542619bb1989987a3d9a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.685389 2253 leader_election.cc:288] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:15.686215 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f793a91ab247408bbe4a9f7cb370fffe" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:15.688380 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 702e78bcd01f41c1846294deadca1b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.688530 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 54bb495eea4c49b7ad7bf2300ad0e60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.688696 720 tablet_service.cc:1514] Processing DeleteTablet for tablet c8f81fa4e88945f1a392fbacfd031392 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.688659 732 tablet_service.cc:1514] Processing DeleteTablet for tablet eeb082e189304f13909d115f7197c5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.688433 733 tablet_service.cc:1514] Processing DeleteTablet for tablet a9daee42d5c748ceaed7dc94f551c0d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.688941 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a554c1eebd542619bb1989987a3d9a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:15.689123 831 leader_election.cc:341] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.691162 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f09b7dfdc1467eb47b8d7acb214919 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.693385 1165 ts_tablet_manager.cc:1918] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.693928 1165 log.cc:1196] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/3456cf91d65a4413a35efe94513c723d
I20260620 07:01:15.694279 1165 ts_tablet_manager.cc:1939] T 3456cf91d65a4413a35efe94513c723d P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:15.695720 1165 tablet_replica.cc:330] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:15.695839 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 3456cf91d65a4413a35efe94513c723d (table default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9 [id=24e00ed0d7994f1cbebd87b708274b55]) successfully deleted
I20260620 07:01:15.695902 1165 raft_consensus.cc:2229] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.696043 1165 raft_consensus.cc:2258] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.699170 1165 ts_tablet_manager.cc:1905] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.700976 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7fb2d5c0f6d24969a0fea05a34fea00f
I20260620 07:01:15.701429 424 catalog_manager.cc:6565] ReplaceTablet: tablet 7fb2d5c0f6d24969a0fea05a34fea00f deleted and replaced by tablet 5e98a39613e04c919a7c3e6579796240
I20260620 07:01:15.699806 1170 raft_consensus.cc:348] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.702114 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fb2d5c0f6d24969a0fea05a34fea00f with delete_type TABLET_DATA_DELETED (replaced by tablet 5e98a39613e04c919a7c3e6579796240) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.701838 1170 raft_consensus.cc:374] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.702898 1170 raft_consensus.cc:729] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.708873 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fb2d5c0f6d24969a0fea05a34fea00f with delete_type TABLET_DATA_DELETED (replaced by tablet 5e98a39613e04c919a7c3e6579796240) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.704603 1170 consensus_queue.cc:260] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.711076 423 catalog_manager.cc:5495] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:15.713539 1170 ts_tablet_manager.cc:1428] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.032s user 0.003s sys 0.000s
I20260620 07:01:15.714972 1170 tablet_bootstrap.cc:492] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.716807 1165 ts_tablet_manager.cc:1918] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.716945 1165 log.cc:1196] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f793a91ab247408bbe4a9f7cb370fffe
I20260620 07:01:15.717303 1165 ts_tablet_manager.cc:1939] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:15.717857 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f793a91ab247408bbe4a9f7cb370fffe (table default.Table_6f694d1dc105473b93ba18dc487d0d55 [id=4a2d8361d2404c1eb6710cc8f5190708]) successfully deleted
I20260620 07:01:15.717971 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]). Expected version 3 got 0
I20260620 07:01:15.721755 2210 raft_consensus.cc:482] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:15.721820 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7401e8cbac62479b9cca9c8af78d5b6a consensus state has no leader
I20260620 07:01:15.721921 2210 raft_consensus.cc:504] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.722550 2210 leader_election.cc:288] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:15.723596 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4f4ca1a88154011a917e953fd6a759b consensus state has no leader
W20260620 07:01:15.724072 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 052c0fc25dc5419d9e6a5c28a3b8a662 consensus state has no leader
W20260620 07:01:15.725453 683 leader_election.cc:341] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a9daee42d5c748ceaed7dc94f551c0d1
I20260620 07:01:15.725471 731 tablet_service.cc:1514] Processing DeleteTablet for tablet fbb2fd1a8bb14f3e883a2efb6560d184 with delete_type TABLET_DATA_DELETED (replaced by tablet b627c1c966b7416ca842dfdb2ab2efdb) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:15.727563 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0e8e9256a3c0466abfacc2b4266a5db2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e8e9256a3c0466abfacc2b4266a5db2 already in progress: creating tablet
I20260620 07:01:15.727850 1165 tablet_replica.cc:330] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:15.685710 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet fbb2fd1a8bb14f3e883a2efb6560d184 with delete_type TABLET_DATA_DELETED (replaced by tablet b627c1c966b7416ca842dfdb2ab2efdb) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.728047 1165 raft_consensus.cc:2229] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.685822 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a554c1eebd542619bb1989987a3d9a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.728199 1165 raft_consensus.cc:2258] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.685920 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f09b7dfdc1467eb47b8d7acb214919 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.685990 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 702e78bcd01f41c1846294deadca1b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.687407 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f793a91ab247408bbe4a9f7cb370fffe" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:15.704097 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fb2d5c0f6d24969a0fea05a34fea00f with delete_type TABLET_DATA_DELETED (replaced by tablet 5e98a39613e04c919a7c3e6579796240) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.723421 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9daee42d5c748ceaed7dc94f551c0d1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:15.729171 830 leader_election.cc:341] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.729286 830 leader_election.cc:302] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:15.729441 830 raft_consensus.cc:2670] T f793a91ab247408bbe4a9f7cb370fffe P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:15.729513 681 leader_election.cc:341] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.729602 1165 ts_tablet_manager.cc:1905] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.729604 681 leader_election.cc:302] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.730858 2210 raft_consensus.cc:2726] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.730404 1170 tablet_bootstrap.cc:654] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.731084 2210 consensus_queue.cc:1035] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:15.675252 1167 consensus_queue.cc:260] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.740100 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ee94c1a799a47f997469f96005167dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.746611 1165 ts_tablet_manager.cc:1918] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.750360 1167 ts_tablet_manager.cc:1428] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.077s user 0.002s sys 0.000s
I20260620 07:01:15.752486 1169 ts_tablet_manager.cc:1905] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.746778 1165 log.cc:1196] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/0c51ecf0f006400597f0e7f776698854
I20260620 07:01:15.754532 861 tablet_service.cc:1467] Processing CreateTablet for tablet 633f3666050846dc9fc59a365110406d (DEFAULT_TABLE table=default.Table_29524262208149ff87cf1a63d2d9f6e4 [id=3daa5ca510994cf98e77f80f2bd54064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.757805 1165 ts_tablet_manager.cc:1939] T 0c51ecf0f006400597f0e7f776698854 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:15.757853 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 633f3666050846dc9fc59a365110406d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.759904 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 0c51ecf0f006400597f0e7f776698854 (table default.Table_48b14443dddd46969ee0299cee27e93e [id=3a5017c5c8104328b9446a42bf0354a6]) successfully deleted
W20260620 07:01:15.760597 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0f8ddfba5500406eba8f184bd5039170 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f8ddfba5500406eba8f184bd5039170 already in progress: creating tablet
W20260620 07:01:15.761004 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 17c337e52ace48f99316960e655dd264 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17c337e52ace48f99316960e655dd264 already in progress: creating tablet
I20260620 07:01:15.761140 1165 tablet_replica.cc:330] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:15.761337 1165 raft_consensus.cc:2229] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:15.761478 1165 raft_consensus.cc:2258] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:15.761966 1165 ts_tablet_manager.cc:1905] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:15.764552 1167 tablet_bootstrap.cc:492] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:15.766712 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 633f3666050846dc9fc59a365110406d (DEFAULT_TABLE table=default.Table_29524262208149ff87cf1a63d2d9f6e4 [id=3daa5ca510994cf98e77f80f2bd54064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.767247 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 633f3666050846dc9fc59a365110406d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.766294 1170 tablet_bootstrap.cc:492] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.779217 1170 ts_tablet_manager.cc:1397] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.006s
I20260620 07:01:15.780072 1170 raft_consensus.cc:348] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.780293 1170 raft_consensus.cc:374] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.780350 1170 raft_consensus.cc:729] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.780565 1170 consensus_queue.cc:260] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.781327 1170 ts_tablet_manager.cc:1428] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:15.782855 1170 tablet_bootstrap.cc:492] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.784475 1165 ts_tablet_manager.cc:1918] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:15.784595 1165 log.cc:1196] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/cf0bae39e1634710af12de493f7f58d5
I20260620 07:01:15.784924 1165 ts_tablet_manager.cc:1939] T cf0bae39e1634710af12de493f7f58d5 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:15.784997 1170 tablet_bootstrap.cc:654] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.778380 2257 raft_consensus.cc:482] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.786600 2257 raft_consensus.cc:504] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.792368 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d51c7488711b4db697b48025a5ba6e9d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:15.793780 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet cf0bae39e1634710af12de493f7f58d5 (table default.Table_dd975c3c465e439db363c170ba3e4147 [id=c5d6638ed0bf48e1b8339e21c50f9a0a]) successfully deleted
W20260620 07:01:15.793743 683 leader_election.cc:341] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d51c7488711b4db697b48025a5ba6e9d
W20260620 07:01:15.794129 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fbb2fd1a8bb14f3e883a2efb6560d184 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbb2fd1a8bb14f3e883a2efb6560d184 already in progress: creating tablet
I20260620 07:01:15.794438 1920 raft_consensus.cc:482] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:15.794548 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 70f09b7dfdc1467eb47b8d7acb214919 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70f09b7dfdc1467eb47b8d7acb214919 already in progress: creating tablet
I20260620 07:01:15.794605 1920 raft_consensus.cc:504] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:15.795360 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 702e78bcd01f41c1846294deadca1b54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 702e78bcd01f41c1846294deadca1b54 already in progress: creating tablet
I20260620 07:01:15.795382 1920 leader_election.cc:288] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:15.795636 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7a554c1eebd542619bb1989987a3d9a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a554c1eebd542619bb1989987a3d9a6 already in progress: creating tablet
W20260620 07:01:15.795924 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7fb2d5c0f6d24969a0fea05a34fea00f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fb2d5c0f6d24969a0fea05a34fea00f already in progress: creating tablet
W20260620 07:01:15.796480 681 leader_election.cc:341] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.797014 681 leader_election.cc:302] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.797760 1920 raft_consensus.cc:2726] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:15.800462 683 leader_election.cc:341] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c8f81fa4e88945f1a392fbacfd031392
I20260620 07:01:15.800415 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8f81fa4e88945f1a392fbacfd031392" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:15.801182 681 leader_election.cc:341] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.801414 681 leader_election.cc:302] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.801908 1920 raft_consensus.cc:2726] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.806435 2257 leader_election.cc:288] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:15.814137 2257 raft_consensus.cc:482] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.814376 2257 raft_consensus.cc:504] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.817759 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba93e22c4720417c99d471b9c8b49b86" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:15.818555 681 leader_election.cc:341] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:15.822466 683 leader_election.cc:341] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ba93e22c4720417c99d471b9c8b49b86
I20260620 07:01:15.822655 683 leader_election.cc:302] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.823009 1920 raft_consensus.cc:2726] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.823232 2257 leader_election.cc:288] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:15.824513 1170 tablet_bootstrap.cc:492] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.824803 1170 ts_tablet_manager.cc:1397] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.003s
I20260620 07:01:15.825369 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 34dc2af503684aaba8388a4611fab48e (table default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9]). Expected version 1 got 0
I20260620 07:01:15.826483 1170 raft_consensus.cc:348] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.827199 1170 raft_consensus.cc:374] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.827499 1170 raft_consensus.cc:729] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:15.829528 731 tablet_service.cc:1467] Processing CreateTablet for tablet 099d9ce724c745cf8ca9a4428535668b (DEFAULT_TABLE table=default.Table_2e9e8136a5e44b90a465ce0fee7fcb65 [id=2b4dca9c342e42c19a8056a3e214b193]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.829979 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099d9ce724c745cf8ca9a4428535668b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.830521 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet f8be5f41f1d64d918b727e3eef18738e (table default.Table_3122a50618184dc7bf7cb696dca2a55b [id=d55d6c70a1b34227b4820944e280fde8]). Expected version 1 got 0
I20260620 07:01:15.830694 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cddcca7b8f8e497ab1dceca5e0526472" } modify_external_catalogs: true
I20260620 07:01:15.830861 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0d78714a2610473a9e0c46db9d2d89fc" } modify_external_catalogs: true
I20260620 07:01:15.830958 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cddcca7b8f8e497ab1dceca5e0526472" } modify_external_catalogs: true
I20260620 07:01:15.831076 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0d78714a2610473a9e0c46db9d2d89fc" } modify_external_catalogs: true
I20260620 07:01:15.834412 1167 tablet_bootstrap.cc:654] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.835196 725 tablet_service.cc:1514] Processing DeleteTablet for tablet ab60101b34144f85b0afd2e8c4846e48 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fc99f79e7b4df2b74a79468656b6ab) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.836187 861 tablet_service.cc:1467] Processing CreateTablet for tablet 099d9ce724c745cf8ca9a4428535668b (DEFAULT_TABLE table=default.Table_2e9e8136a5e44b90a465ce0fee7fcb65 [id=2b4dca9c342e42c19a8056a3e214b193]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.836606 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099d9ce724c745cf8ca9a4428535668b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.838902 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_54d230c45497496f8117ad3266e2305b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.839541 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54d230c45497496f8117ad3266e2305b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.841518 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 361dff84507843b5aeb2404b7245bf60
I20260620 07:01:15.841851 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8822fe581d474be2a24d69357f8c3331" } new_table_name: "default.Table_0697bd00827d407cbde2bc7d5e842757" modify_external_catalogs: true
I20260620 07:01:15.844862 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b160f0f270d742b6bfe7def51d8a8ed1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.845196 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 361dff84507843b5aeb2404b7245bf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.845573 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 361dff84507843b5aeb2404b7245bf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:15.845840 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 361dff84507843b5aeb2404b7245bf60 because the tablet was not found. No further retry: Not found: Tablet not found: 361dff84507843b5aeb2404b7245bf60
W20260620 07:01:15.845853 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b160f0f270d742b6bfe7def51d8a8ed1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.828462 1170 consensus_queue.cc:260] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:15.851928 681 consensus_peers.cc:487] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:15.852748 896 raft_consensus.cc:1261] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Refusing update from remote peer 2b84cae646b24bc7bd424eb8434ad425: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:01:15.853538 1920 consensus_queue.cc:1035] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:15.853950 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8b2a9d1b793f4cb0a1ff7298e10c3162
W20260620 07:01:15.854877 681 consensus_peers.cc:487] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:15.855229 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:15.855880 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 already in progress: creating tablet
I20260620 07:01:15.858269 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.858213 1170 ts_tablet_manager.cc:1428] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.033s user 0.002s sys 0.001s
I20260620 07:01:15.860164 1170 tablet_bootstrap.cc:492] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:15.869964 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_05121e91944b48c78974295fb7f281eb" } new_table_name: "default.Table_d0e84d426dce4774849299d2d74ccc29" modify_external_catalogs: true
I20260620 07:01:15.878089 2253 raft_consensus.cc:482] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.878259 2253 raft_consensus.cc:504] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.879168 2253 leader_election.cc:288] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:15.880270 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97e01aa120cc4c189017236ad57de811" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:15.881114 831 leader_election.cc:341] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.882073 1170 tablet_bootstrap.cc:654] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.886093 2285 tablet.cc:1722] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:15.895540 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1721a5345ef6498a8c275fcc9f19fc78" } modify_external_catalogs: true
I20260620 07:01:15.895859 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1721a5345ef6498a8c275fcc9f19fc78" } modify_external_catalogs: true
I20260620 07:01:15.896173 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_59b0b7d236ea417689758568dbc1e467" } modify_external_catalogs: true
I20260620 07:01:15.896354 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_59b0b7d236ea417689758568dbc1e467" } modify_external_catalogs: true
I20260620 07:01:15.896435 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d158029631994114988cdbd6ea1888d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.897054 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d158029631994114988cdbd6ea1888d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.898259 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_400af15ad4774512a1aa3b021c8da9b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.898613 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_79d0b92537fb4325a156ed14dda845bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.898876 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_400af15ad4774512a1aa3b021c8da9b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:15.899179 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79d0b92537fb4325a156ed14dda845bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.900379 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d7959a3e4df54745953dd46f404ae841" } modify_external_catalogs: true
I20260620 07:01:15.900933 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d7959a3e4df54745953dd46f404ae841" } modify_external_catalogs: true
W20260620 07:01:15.905838 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c8aa75356fb54672a0ada533fc634613 consensus state has no leader
I20260620 07:01:15.913570 1170 tablet_bootstrap.cc:492] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:15.913944 1170 ts_tablet_manager.cc:1397] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.002s
I20260620 07:01:15.914991 1170 raft_consensus.cc:348] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.915226 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ac84d5816b2c4ac5aa5ab2dd2ece9b0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.915504 1170 raft_consensus.cc:374] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:15.915650 1170 raft_consensus.cc:729] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
W20260620 07:01:15.915884 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac84d5816b2c4ac5aa5ab2dd2ece9b0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.916109 1170 consensus_queue.cc:260] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:15.917062 1170 ts_tablet_manager.cc:1428] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:15.920953 425 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 1864deefd216490ba0474c2abb157725
I20260620 07:01:15.921409 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e143cb15733d4fc1af6495a98134e9fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.922930 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_761dbedd508c4c35b1528aa0be191f6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.924152 2297 tablet.cc:1722] T 96453f82ff3048beabeb188fb27dee42 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:15.924146 1170 tablet_bootstrap.cc:492] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:15.924747 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e143cb15733d4fc1af6495a98134e9fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:15.924598 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_761dbedd508c4c35b1528aa0be191f6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.928885 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5e3c8ac39ee542c6acdd0d2b790e2502" } new_table_name: "default.Table_8f940313465e4afa9bc6d1a6a27c8467" modify_external_catalogs: true
I20260620 07:01:15.929951 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0fd4539155d74bd082a0ce934e3126c5
W20260620 07:01:15.931494 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 048ff2d75f0347ffae42cfe921417008 consensus state has no leader
I20260620 07:01:15.932569 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ffe453ce52ce406fad5206bdedad9ef0
I20260620 07:01:15.932710 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd4539155d74bd082a0ce934e3126c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:15.933399 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0fd4539155d74bd082a0ce934e3126c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd4539155d74bd082a0ce934e3126c5 already in progress: creating tablet
I20260620 07:01:15.934551 861 tablet_service.cc:1514] Processing DeleteTablet for tablet ffe453ce52ce406fad5206bdedad9ef0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:15.935307 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e63870c87d324724bc7865165bd9aa36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:15.935684 725 tablet_service.cc:1514] Processing DeleteTablet for tablet ffe453ce52ce406fad5206bdedad9ef0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:15.935775 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ffe453ce52ce406fad5206bdedad9ef0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffe453ce52ce406fad5206bdedad9ef0 already in progress: creating tablet
W20260620 07:01:15.935909 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63870c87d324724bc7865165bd9aa36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.936103 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_43ca3403b54a4673add23baba8a8edd1" } new_table_name: "default.Table_6f07addf070c41ca99d660f88ffd8c7c" modify_external_catalogs: true
I20260620 07:01:15.937479 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6107f40b9dc844919004d6f61a1e07ab" } new_table_name: "default.Table_0a9175d400ae4bba8026478343ec1848" modify_external_catalogs: true
I20260620 07:01:15.941645 1170 tablet_bootstrap.cc:654] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:15.942231 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d7082a5a3e4242c19ddf98d6100a150d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:15.943133 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7082a5a3e4242c19ddf98d6100a150d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:15.951397 725 tablet_service.cc:1467] Processing CreateTablet for tablet 361dff84507843b5aeb2404b7245bf60 (DEFAULT_TABLE table=default.Table_0d78714a2610473a9e0c46db9d2d89fc [id=c2db06efd72c45caa3ab0db792c7006f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.951903 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 361dff84507843b5aeb2404b7245bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.952239 2285 tablet.cc:1717] T 27da98f96a2245c5b4210b7cf084886d P 2b84cae646b24bc7bd424eb8434ad425: Skipping requested alter to schema version 2, tablet already version 2
I20260620 07:01:15.854861 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.882594 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97e01aa120cc4c189017236ad57de811" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:15.904850 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 361dff84507843b5aeb2404b7245bf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.932317 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd4539155d74bd082a0ce934e3126c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.942274 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet ffe453ce52ce406fad5206bdedad9ef0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:15.949896 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 099d9ce724c745cf8ca9a4428535668b (DEFAULT_TABLE table=default.Table_2e9e8136a5e44b90a465ce0fee7fcb65 [id=2b4dca9c342e42c19a8056a3e214b193]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.972764 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099d9ce724c745cf8ca9a4428535668b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:15.972879 830 leader_election.cc:341] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:15.973027 830 leader_election.cc:302] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:15.973443 2253 raft_consensus.cc:2726] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.973662 2019 raft_consensus.cc:482] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:15.973767 2019 raft_consensus.cc:504] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:15.974303 2019 leader_election.cc:288] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:15.975404 968 leader_election.cc:341] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 2ee94c1a799a47f997469f96005167dc
W20260620 07:01:15.975597 969 leader_election.cc:341] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 2ee94c1a799a47f997469f96005167dc
I20260620 07:01:15.975687 969 leader_election.cc:302] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:15.976015 2019 raft_consensus.cc:2726] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:15.941238 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:15.981127 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd4539155d74bd082a0ce934e3126c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:15.985823 2287 tablet.cc:1722] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:15.992422 861 tablet_service.cc:1467] Processing CreateTablet for tablet 361dff84507843b5aeb2404b7245bf60 (DEFAULT_TABLE table=default.Table_0d78714a2610473a9e0c46db9d2d89fc [id=c2db06efd72c45caa3ab0db792c7006f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.992602 867 tablet_service.cc:1467] Processing CreateTablet for tablet 65329e2dca0c4743ac7feedefed8ef4c (DEFAULT_TABLE table=default.Table_46b1d7a0877845ddbdf9a709bf123b5e [id=4ee543fd4d6a4a118bb6f105616edcaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.992877 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 361dff84507843b5aeb2404b7245bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.993093 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65329e2dca0c4743ac7feedefed8ef4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:15.995105 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 361dff84507843b5aeb2404b7245bf60 (DEFAULT_TABLE table=default.Table_0d78714a2610473a9e0c46db9d2d89fc [id=c2db06efd72c45caa3ab0db792c7006f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:15.997771 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 361dff84507843b5aeb2404b7245bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.000005 725 tablet_service.cc:1467] Processing CreateTablet for tablet 65329e2dca0c4743ac7feedefed8ef4c (DEFAULT_TABLE table=default.Table_46b1d7a0877845ddbdf9a709bf123b5e [id=4ee543fd4d6a4a118bb6f105616edcaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.000659 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65329e2dca0c4743ac7feedefed8ef4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:16.007169 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b627c1c966b7416ca842dfdb2ab2efdb has no consensus state
W20260620 07:01:16.010129 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ded117a6342e473e992c6a9d192462f1 has no consensus state
W20260620 07:01:16.011417 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2de9d54736ec49c49adda482d1f603ca consensus state has no leader
I20260620 07:01:16.018357 422 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_96e0a2412a5040ba8c91876d7263de57 [id=6d5b03179de540539513cab6cd39da39] alter complete (version 2)
I20260620 07:01:16.021785 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:16.025754 2257 raft_consensus.cc:482] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.026007 2257 raft_consensus.cc:504] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:16.026747 969 consensus_peers.cc:487] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83451bba9a3c4c209dddf4250fea8806. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:16.027092 2257 leader_election.cc:288] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:16.027316 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab60101b34144f85b0afd2e8c4846e48" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:16.027870 681 leader_election.cc:341] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:16.028481 683 leader_election.cc:341] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ab60101b34144f85b0afd2e8c4846e48
I20260620 07:01:16.028596 683 leader_election.cc:302] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.029387 1170 tablet_bootstrap.cc:492] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:16.029585 1170 ts_tablet_manager.cc:1397] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.107s user 0.003s sys 0.005s
I20260620 07:01:16.030429 1170 raft_consensus.cc:348] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.030716 2210 raft_consensus.cc:2726] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:16.030882 1170 raft_consensus.cc:374] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.031558 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:16.038683 1167 tablet_bootstrap.cc:492] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:16.038866 1167 ts_tablet_manager.cc:1397] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.274s user 0.003s sys 0.001s
I20260620 07:01:16.039713 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.040285 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.043587 1167 raft_consensus.cc:348] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.043862 1167 raft_consensus.cc:374] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.043968 1167 raft_consensus.cc:729] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.044651 1167 consensus_queue.cc:260] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.046442 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:16.046633 1166 ts_tablet_manager.cc:1918] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:16.047857 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cf1dac024eb44810b66df64acb8efa84" } modify_external_catalogs: true
I20260620 07:01:16.048112 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cf1dac024eb44810b66df64acb8efa84" } modify_external_catalogs: true
I20260620 07:01:16.050263 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 65329e2dca0c4743ac7feedefed8ef4c (DEFAULT_TABLE table=default.Table_46b1d7a0877845ddbdf9a709bf123b5e [id=4ee543fd4d6a4a118bb6f105616edcaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.050671 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65329e2dca0c4743ac7feedefed8ef4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.051635 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 052c0fc25dc5419d9e6a5c28a3b8a662 (DEFAULT_TABLE table=default.Table_a76e5fada5c24c4f94cf995134ab8a96 [id=032b84a799e24082a202bf6200852b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.051710 731 tablet_service.cc:1467] Processing CreateTablet for tablet 052c0fc25dc5419d9e6a5c28a3b8a662 (DEFAULT_TABLE table=default.Table_a76e5fada5c24c4f94cf995134ab8a96 [id=032b84a799e24082a202bf6200852b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.052017 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 052c0fc25dc5419d9e6a5c28a3b8a662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.052191 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 052c0fc25dc5419d9e6a5c28a3b8a662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.054955 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f (DEFAULT_TABLE table=default.Table_98730c8b3adc487e872a10c6df721a4f [id=d75b008dce3f4f10aeac01a7f0a4b3c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.055335 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.058418 996 tablet_service.cc:1467] Processing CreateTablet for tablet a84c6aea4b4b4c9390475fe46b73efa9 (DEFAULT_TABLE table=default.Table_08264d5097d844c88353d8eb8d79c256 [id=29e3a153ecad41af95ef180c534bbe85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.058817 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84c6aea4b4b4c9390475fe46b73efa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.062515 1169 ts_tablet_manager.cc:1918] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:16.062850 2287 tablet.cc:1717] T 27da98f96a2245c5b4210b7cf084886d P 978f112862c64141b1009856bef3d624: Skipping requested alter to schema version 2, tablet already version 2
I20260620 07:01:16.063862 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cca283f4d2645c0b59f750949b7e263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.064787 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa
I20260620 07:01:16.066869 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b4b60d2a45944a09a60a2826a9a45738
I20260620 07:01:16.067912 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet b4b60d2a45944a09a60a2826a9a45738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.069114 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa with delete_type TABLET_DATA_DELETED (replaced by tablet 0833926b10164039b5a374969d53bc9e) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.070020 1168 tablet_bootstrap.cc:492] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:16.070820 1168 ts_tablet_manager.cc:1397] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.463s user 0.019s sys 0.057s
W20260620 07:01:16.070884 393 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 67321.7us
I20260620 07:01:16.071451 1166 log.cc:1196] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/581573cafab14ac79ff7ad19da0580b4
I20260620 07:01:16.072917 422 catalog_manager.cc:6565] ReplaceTablet: tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa deleted and replaced by tablet 0833926b10164039b5a374969d53bc9e
I20260620 07:01:16.075433 1166 ts_tablet_manager.cc:1939] T 581573cafab14ac79ff7ad19da0580b4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:16.077298 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 7379c7378e3e4f8888770d11ced4ad52 (DEFAULT_TABLE table=default.Table_918635bc15074fb5a3389b58a96575cf [id=4fd0f0ce6b434c54924bbc26bb236a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.077567 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 688) took 6048 ms. Trace:
I20260620 07:01:16.062826 733 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f (DEFAULT_TABLE table=default.Table_98730c8b3adc487e872a10c6df721a4f [id=d75b008dce3f4f10aeac01a7f0a4b3c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.077992 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.063730 715 tablet_service.cc:1467] Processing CreateTablet for tablet a84c6aea4b4b4c9390475fe46b73efa9 (DEFAULT_TABLE table=default.Table_08264d5097d844c88353d8eb8d79c256 [id=29e3a153ecad41af95ef180c534bbe85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.064109 732 tablet_service.cc:1467] Processing CreateTablet for tablet 7379c7378e3e4f8888770d11ced4ad52 (DEFAULT_TABLE table=default.Table_918635bc15074fb5a3389b58a96575cf [id=4fd0f0ce6b434c54924bbc26bb236a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.081588 1920 raft_consensus.cc:482] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.065754 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa with delete_type TABLET_DATA_DELETED (replaced by tablet 0833926b10164039b5a374969d53bc9e) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.068445 719 tablet_service.cc:1514] Processing DeleteTablet for tablet b4b60d2a45944a09a60a2826a9a45738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.081732 1920 raft_consensus.cc:504] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.082387 1920 leader_election.cc:288] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:16.081590 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84c6aea4b4b4c9390475fe46b73efa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.083518 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7379c7378e3e4f8888770d11ced4ad52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.085597 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_98730c8b3adc487e872a10c6df721a4f" } modify_external_catalogs: true
I20260620 07:01:16.085850 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_98730c8b3adc487e872a10c6df721a4f" } modify_external_catalogs: true
I20260620 07:01:16.086270 719 tablet_service.cc:1467] Processing CreateTablet for tablet 037b05aa85ca4cc4be394d7e22e94b30 (DEFAULT_TABLE table=default.Table_33849761b0d646b38ef15cb33a98f362 [id=1b371e6bec0045deae512c72e408eef5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.086687 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 037b05aa85ca4cc4be394d7e22e94b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.086169 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6c57eb996eb043cbbaa95debde14f72f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.087567 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c57eb996eb043cbbaa95debde14f72f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.088896 1168 raft_consensus.cc:348] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.089102 1168 raft_consensus.cc:374] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.089148 1168 raft_consensus.cc:729] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.089335 1168 consensus_queue.cc:260] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.089812 1168 ts_tablet_manager.cc:1428] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.019s user 0.001s sys 0.000s
I20260620 07:01:16.090405 861 tablet_service.cc:1467] Processing CreateTablet for tablet 052c0fc25dc5419d9e6a5c28a3b8a662 (DEFAULT_TABLE table=default.Table_a76e5fada5c24c4f94cf995134ab8a96 [id=032b84a799e24082a202bf6200852b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.091205 874 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f (DEFAULT_TABLE table=default.Table_98730c8b3adc487e872a10c6df721a4f [id=d75b008dce3f4f10aeac01a7f0a4b3c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.091555 857 tablet_service.cc:1467] Processing CreateTablet for tablet 7379c7378e3e4f8888770d11ced4ad52 (DEFAULT_TABLE table=default.Table_918635bc15074fb5a3389b58a96575cf [id=4fd0f0ce6b434c54924bbc26bb236a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.093119 1168 tablet_bootstrap.cc:492] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:16.094297 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7379c7378e3e4f8888770d11ced4ad52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.095340 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 052c0fc25dc5419d9e6a5c28a3b8a662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.095927 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.103018 862 tablet_service.cc:1514] Processing DeleteTablet for tablet b4b60d2a45944a09a60a2826a9a45738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.103468 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f
I20260620 07:01:16.103859 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa with delete_type TABLET_DATA_DELETED (replaced by tablet 0833926b10164039b5a374969d53bc9e) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.104215 1169 log.cc:1196] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/9b2f0c28057b4534a8a400d1ca7f3991
W20260620 07:01:16.104586 683 leader_election.cc:341] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: eeb082e189304f13909d115f7197c5a1
I20260620 07:01:16.105170 1169 ts_tablet_manager.cc:1939] T 9b2f0c28057b4534a8a400d1ca7f3991 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:16.105451 867 tablet_service.cc:1467] Processing CreateTablet for tablet a84c6aea4b4b4c9390475fe46b73efa9 (DEFAULT_TABLE table=default.Table_08264d5097d844c88353d8eb8d79c256 [id=29e3a153ecad41af95ef180c534bbe85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.077721 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7379c7378e3e4f8888770d11ced4ad52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.109400 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84c6aea4b4b4c9390475fe46b73efa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.083029 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb082e189304f13909d115f7197c5a1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:16.110320 858 tablet_service.cc:1467] Processing CreateTablet for tablet 037b05aa85ca4cc4be394d7e22e94b30 (DEFAULT_TABLE table=default.Table_33849761b0d646b38ef15cb33a98f362 [id=1b371e6bec0045deae512c72e408eef5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:16.110617 681 leader_election.cc:341] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.110714 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 037b05aa85ca4cc4be394d7e22e94b30. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:16.110698 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b4b60d2a45944a09a60a2826a9a45738 because the tablet was not found. No further retry: Not found: Tablet not found: b4b60d2a45944a09a60a2826a9a45738
W20260620 07:01:16.110980 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa already in progress: creating tablet
I20260620 07:01:16.110761 681 leader_election.cc:302] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.112129 1920 raft_consensus.cc:2726] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:16.115336 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:16.117995 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f because the tablet was not found. No further retry: Not found: Tablet not found: 6b6a0adb24e64d4fa05f26d2ccce3c4f
I20260620 07:01:16.119501 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.106233 719 tablet_service.cc:1467] Processing CreateTablet for tablet 5b4e6a2a407f4e759740641385c07ed8 (DEFAULT_TABLE table=default.Table_ce6aa6be59cb406db47a6b3202ccc571 [id=44fc2716eab4438a8565ed1c992a2489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.122774 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b4e6a2a407f4e759740641385c07ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.123010 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b160f0f270d742b6bfe7def51d8a8ed1" } new_table_name: "default.Table_61d1f36ce2e84d41b78605dfb0f804b3" modify_external_catalogs: true
I20260620 07:01:16.125563 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ecf861541ad040c68363a1ed9fe3fb70" } modify_external_catalogs: true
I20260620 07:01:16.125797 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ecf861541ad040c68363a1ed9fe3fb70" } modify_external_catalogs: true
I20260620 07:01:16.122468 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.106578 1166 rpcz_store.cc:276] 0620 07:01:10.029582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.031974 (+ 2392us) service_pool.cc:227] Handling call
0620 07:01:15.550924 (+5518950us) ts_tablet_manager.cc:1145] Deleting tablet 581573cafab14ac79ff7ad19da0580b4
0620 07:01:15.550939 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:15.995596 (+444657us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.046016 (+ 50420us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.077548 (+ 31532us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5518691}
I20260620 07:01:16.087064 1167 ts_tablet_manager.cc:1428] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260620 07:01:16.106302 996 tablet_service.cc:1467] Processing CreateTablet for tablet 037b05aa85ca4cc4be394d7e22e94b30 (DEFAULT_TABLE table=default.Table_33849761b0d646b38ef15cb33a98f362 [id=1b371e6bec0045deae512c72e408eef5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.127784 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 037b05aa85ca4cc4be394d7e22e94b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.128237 1169 tablet_replica.cc:330] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:16.128433 1169 raft_consensus.cc:2229] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:16.128597 1169 raft_consensus.cc:2258] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:16.130483 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 689) took 6049 ms. Trace:
I20260620 07:01:16.130663 1166 rpcz_store.cc:276] 0620 07:01:10.081250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.081309 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:16.127198 (+6045889us) ts_tablet_manager.cc:1145] Deleting tablet 41a03013bba54676abeaed30195e8a1e
0620 07:01:16.130362 (+ 3164us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.130464 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6040410}
I20260620 07:01:16.131743 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 692) took 6035 ms. Trace:
I20260620 07:01:16.132268 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 581573cafab14ac79ff7ad19da0580b4 (table default.Table_52bddb4b77954070ad4efafc2734ea40 [id=8f88c270fabb4c93a3b154ed158ab22b]) successfully deleted
W20260620 07:01:16.132731 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 41a03013bba54676abeaed30195e8a1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41a03013bba54676abeaed30195e8a1e already in progress: creating tablet
I20260620 07:01:16.134262 1170 raft_consensus.cc:729] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.134685 1170 consensus_queue.cc:260] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.137856 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 9b2f0c28057b4534a8a400d1ca7f3991 (table default.Table_8e6e4c363d6f44828436c4fca5227174 [id=e2675f19e2dd4de2b88dca72b4b16a97]) successfully deleted
I20260620 07:01:16.137940 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:16.139161 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9d9e9ea2ddae464a96fb6335aba96e75" } modify_external_catalogs: true
I20260620 07:01:16.139398 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9d9e9ea2ddae464a96fb6335aba96e75" } modify_external_catalogs: true
I20260620 07:01:16.141250 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8e5aac889fc34a76a4d0bb8e8840a31e" } new_table_name: "default.Table_b5d2eb86f6bc4e668432323c020f4560" modify_external_catalogs: true
I20260620 07:01:16.141363 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5987e1344b92480ebe6572fceadaf39e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.141976 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5987e1344b92480ebe6572fceadaf39e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.144243 732 tablet_service.cc:1514] Processing DeleteTablet for tablet c2e38178b9244152915d4c0a9dcf59dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.145584 1166 rpcz_store.cc:276] 0620 07:01:10.096423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.096473 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:16.131639 (+6035166us) ts_tablet_manager.cc:1145] Deleting tablet b58ce7876b614d63932d458036c7e041
0620 07:01:16.131650 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.131728 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6034957}
I20260620 07:01:16.137653 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 5b4e6a2a407f4e759740641385c07ed8 (DEFAULT_TABLE table=default.Table_ce6aa6be59cb406db47a6b3202ccc571 [id=44fc2716eab4438a8565ed1c992a2489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.144096 1000 tablet_service.cc:1467] Processing CreateTablet for tablet e6814cf61e8b43beab262728b4f0e9bd (DEFAULT_TABLE table=default.Table_94d4f67fb7384726ab2dbdf2db2138d7 [id=aa4c78b0d9e14530a96f7667493ab851]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.146638 1167 tablet_bootstrap.cc:492] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:16.146644 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b58ce7876b614d63932d458036c7e041 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b58ce7876b614d63932d458036c7e041 already in progress: creating tablet
I20260620 07:01:16.150624 1170 ts_tablet_manager.cc:1428] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.121s user 0.017s sys 0.006s
I20260620 07:01:16.152680 862 tablet_service.cc:1467] Processing CreateTablet for tablet 5b4e6a2a407f4e759740641385c07ed8 (DEFAULT_TABLE table=default.Table_ce6aa6be59cb406db47a6b3202ccc571 [id=44fc2716eab4438a8565ed1c992a2489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.152967 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a9d4ef3ba51e432f889fb927a6af8b49
I20260620 07:01:16.153085 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b4e6a2a407f4e759740641385c07ed8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:16.153855 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c2915c0e3604565a48dffef8c670219 has no consensus state
I20260620 07:01:16.155481 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet a9d4ef3ba51e432f889fb927a6af8b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.156951 1167 tablet_bootstrap.cc:654] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.158488 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d93d57c99d6f419f9d0a86faafba8f3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.159118 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d93d57c99d6f419f9d0a86faafba8f3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.160195 732 tablet_service.cc:1514] Processing DeleteTablet for tablet a9d4ef3ba51e432f889fb927a6af8b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.161820 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2bd50406a4304cd7927462a2bf47aaae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:16.162050 2019 raft_consensus.cc:482] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 978f112862c64141b1009856bef3d624)
I20260620 07:01:16.162181 2019 raft_consensus.cc:504] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:16.162420 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bd50406a4304cd7927462a2bf47aaae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.162778 2019 leader_election.cc:288] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:16.160215 857 tablet_service.cc:1467] Processing CreateTablet for tablet e6814cf61e8b43beab262728b4f0e9bd (DEFAULT_TABLE table=default.Table_94d4f67fb7384726ab2dbdf2db2138d7 [id=aa4c78b0d9e14530a96f7667493ab851]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.163569 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6814cf61e8b43beab262728b4f0e9bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:16.164283 968 leader_election.cc:341] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 62ef9a12e3684d27b6696f631c68a5af
I20260620 07:01:16.164815 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e14a8ee0f38e44c3977154c6d6a3279c" } modify_external_catalogs: true
I20260620 07:01:16.165041 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e14a8ee0f38e44c3977154c6d6a3279c" } modify_external_catalogs: true
I20260620 07:01:16.167634 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8ed3b3839c1c4c85ae6723e50d955079"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:16.167920 1169 ts_tablet_manager.cc:1905] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:16.168005 1170 tablet_bootstrap.cc:492] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:16.168192 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ed3b3839c1c4c85ae6723e50d955079 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.168323 1166 tablet_replica.cc:330] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:16.168503 1166 raft_consensus.cc:2229] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:16.168658 1166 raft_consensus.cc:2258] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:16.169175 1166 ts_tablet_manager.cc:1905] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:16.169968 872 tablet_service.cc:1514] Processing DeleteTablet for tablet a9d4ef3ba51e432f889fb927a6af8b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:16.171970 969 leader_election.cc:341] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 62ef9a12e3684d27b6696f631c68a5af
I20260620 07:01:16.172111 969 leader_election.cc:302] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.172557 2019 raft_consensus.cc:2726] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:16.177582 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b4e6a2a407f4e759740641385c07ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.178412 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6814cf61e8b43beab262728b4f0e9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.170193 1165 tablet_replica.cc:330] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:16.174417 2253 raft_consensus.cc:482] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.179462 1165 raft_consensus.cc:2229] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:16.179430 2253 raft_consensus.cc:504] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.179629 1165 raft_consensus.cc:2258] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:16.179982 2253 leader_election.cc:288] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:16.180140 1165 ts_tablet_manager.cc:1905] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:16.180598 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8be5f41f1d64d918b727e3eef18738e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:16.180672 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8be5f41f1d64d918b727e3eef18738e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:16.180866 749 raft_consensus.cc:2454] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
W20260620 07:01:16.181093 830 leader_election.cc:341] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.181813 831 leader_election.cc:302] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:16.182147 2253 raft_consensus.cc:2781] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:16.182250 2253 raft_consensus.cc:482] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:16.182319 2253 raft_consensus.cc:3037] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:16.183646 733 tablet_service.cc:1467] Processing CreateTablet for tablet e6814cf61e8b43beab262728b4f0e9bd (DEFAULT_TABLE table=default.Table_94d4f67fb7384726ab2dbdf2db2138d7 [id=aa4c78b0d9e14530a96f7667493ab851]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.184204 1080 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:16.185226 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_466db1e9c696430ca1b2fb643bdb5611"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.186051 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_466db1e9c696430ca1b2fb643bdb5611 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:16.186878 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet dac4a1434751433488eb2913b1ddfd23 consensus state has no leader
I20260620 07:01:16.194533 1170 tablet_bootstrap.cc:654] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.200686 1167 tablet_bootstrap.cc:492] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:16.201079 1167 ts_tablet_manager.cc:1397] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
I20260620 07:01:16.201588 2253 raft_consensus.cc:504] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.201958 1167 raft_consensus.cc:348] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.202224 1167 raft_consensus.cc:374] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.202337 1167 raft_consensus.cc:729] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.202359 2253 leader_election.cc:288] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:16.203101 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8be5f41f1d64d918b727e3eef18738e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:16.203300 749 raft_consensus.cc:3037] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:16.205936 749 raft_consensus.cc:2454] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:16.206497 831 leader_election.cc:302] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:16.207255 1167 consensus_queue.cc:260] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.207818 1167 ts_tablet_manager.cc:1428] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260620 07:01:16.208091 1167 tablet_bootstrap.cc:492] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:16.208595 2253 raft_consensus.cc:2781] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:16.210840 1167 tablet_bootstrap.cc:654] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.212549 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6814cf61e8b43beab262728b4f0e9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.217790 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.223477 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8be5f41f1d64d918b727e3eef18738e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:16.224956 830 leader_election.cc:341] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:16.227559 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 394d3124d03a438aa31d94967487b4be has no consensus state
I20260620 07:01:16.228145 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5046d808d01f4af3803cb3edf425f777
I20260620 07:01:16.229135 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 5046d808d01f4af3803cb3edf425f777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.229477 1170 tablet_bootstrap.cc:492] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:16.230160 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 5046d808d01f4af3803cb3edf425f777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.230348 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3963c0af021142c49a0afa8aa254302e" } new_table_name: "default.Table_50157bc19fd44763b232e6927583f516" modify_external_catalogs: true
I20260620 07:01:16.231272 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1d3cbad85c554427ac7cb39c8275f6dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.232028 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d3cbad85c554427ac7cb39c8275f6dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.235554 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c72f91cb64424554a72fe0051d18c425"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:16.235863 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_28037a8bfe2d4a36bca9c899f6dd515c" } new_table_name: "default.Table_688ff13d46674626a6c920564c99f459" modify_external_catalogs: true
W20260620 07:01:16.236625 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c72f91cb64424554a72fe0051d18c425 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.237466 1170 ts_tablet_manager.cc:1397] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.002s
I20260620 07:01:16.240192 1168 tablet_bootstrap.cc:654] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.244870 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 5046d808d01f4af3803cb3edf425f777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.247148 2299 raft_consensus.cc:482] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.245157 1170 raft_consensus.cc:348] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.247287 2299 raft_consensus.cc:504] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.247987 2299 leader_election.cc:288] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:16.247895 1170 raft_consensus.cc:374] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.248610 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9d7421b549468e8a7782f467473bdb" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:16.248250 1170 raft_consensus.cc:729] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
W20260620 07:01:16.249171 681 leader_election.cc:341] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.250890 1170 consensus_queue.cc:260] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.254300 1165 ts_tablet_manager.cc:1918] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:16.254426 1165 log.cc:1196] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/a9d4ef3ba51e432f889fb927a6af8b49
I20260620 07:01:16.255115 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9d7421b549468e8a7782f467473bdb" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:16.255347 890 raft_consensus.cc:2454] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:16.256027 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1dc8297521db42c98ffe92b370890ba8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:16.256176 683 leader_election.cc:302] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:16.256563 2299 raft_consensus.cc:2781] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:16.256636 2299 raft_consensus.cc:482] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 07:01:16.256650 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dc8297521db42c98ffe92b370890ba8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.256703 2299 raft_consensus.cc:3037] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:16.258064 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_75b3f0f8752e4c80ab14ac6376da9cb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.258584 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75b3f0f8752e4c80ab14ac6376da9cb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.258291 1170 ts_tablet_manager.cc:1428] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260620 07:01:16.259835 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6c0d1d8a5e244f1985ca6279bd1dda77
I20260620 07:01:16.260006 1170 tablet_bootstrap.cc:492] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:16.261531 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c0d1d8a5e244f1985ca6279bd1dda77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.268854 2299 raft_consensus.cc:504] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.269524 2299 leader_election.cc:288] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:16.270085 1170 tablet_bootstrap.cc:654] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:16.271445 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 302adda3630e44289d371de591061692 consensus state has no leader
W20260620 07:01:16.271880 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8ce639e510c24db4b8c6e627a33a5ca9 consensus state has no leader
I20260620 07:01:16.272131 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9d7421b549468e8a7782f467473bdb" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:16.272727 681 leader_election.cc:341] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.275348 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c0d1d8a5e244f1985ca6279bd1dda77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.275660 890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9d7421b549468e8a7782f467473bdb" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:16.275897 890 raft_consensus.cc:3037] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:16.276394 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fc572851b8c44ec5b5403b38a65d7049" } modify_external_catalogs: true
I20260620 07:01:16.276576 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fc572851b8c44ec5b5403b38a65d7049" } modify_external_catalogs: true
I20260620 07:01:16.283696 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c95b908674e4f8425d765444c281b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.289409 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 25adb514cb22461bbcbecad7d74e643c
I20260620 07:01:16.291647 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_33dfdc9626ae44ec987caf7eb536ac44" } new_table_name: "default.Table_9f09a5bdbd854420abb7b4357cbf11a7" modify_external_catalogs: true
I20260620 07:01:16.292980 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 25adb514cb22461bbcbecad7d74e643c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.293440 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 25adb514cb22461bbcbecad7d74e643c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.296481 1170 tablet_bootstrap.cc:492] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:16.296754 1170 ts_tablet_manager.cc:1397] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.004s
I20260620 07:01:16.296842 1029 raft_consensus.cc:3037] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:16.297992 1170 raft_consensus.cc:348] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.298421 1170 raft_consensus.cc:374] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.298554 1170 raft_consensus.cc:729] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.299002 1170 consensus_queue.cc:260] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.300558 1169 ts_tablet_manager.cc:1918] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:16.300715 1169 log.cc:1196] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/a2d6f7f2b5b3473aa010b8982a03aa5e
I20260620 07:01:16.301178 1169 ts_tablet_manager.cc:1939] T a2d6f7f2b5b3473aa010b8982a03aa5e P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:16.302120 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 892) took 1019 ms. Trace:
I20260620 07:01:16.309998 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2468c12d9c934cfcaee276fea69ac254"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:16.312247 890 raft_consensus.cc:2454] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:16.313501 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2468c12d9c934cfcaee276fea69ac254 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.315898 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c0d1d8a5e244f1985ca6279bd1dda77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:16.321550 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29eb0db9b60f413ebce9ce16fe50aea4 consensus state has no leader
I20260620 07:01:16.330281 1166 ts_tablet_manager.cc:1918] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:16.331807 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_55a40d12ea5d42b8b6b51b6b11ae4f7b" } modify_external_catalogs: true
I20260620 07:01:16.332183 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_55a40d12ea5d42b8b6b51b6b11ae4f7b" } modify_external_catalogs: true
I20260620 07:01:16.333880 1165 ts_tablet_manager.cc:1939] T a9d4ef3ba51e432f889fb927a6af8b49 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:16.340548 1166 log.cc:1196] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f4e3145a872348b6a85a19d1678636bc
I20260620 07:01:16.341295 1166 ts_tablet_manager.cc:1939] T f4e3145a872348b6a85a19d1678636bc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:16.342389 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]) successfully deleted
W20260620 07:01:16.342751 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5046d808d01f4af3803cb3edf425f777 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5046d808d01f4af3803cb3edf425f777 already in progress: creating tablet
W20260620 07:01:16.343264 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 25adb514cb22461bbcbecad7d74e643c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25adb514cb22461bbcbecad7d74e643c already in progress: creating tablet
W20260620 07:01:16.343647 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 6c0d1d8a5e244f1985ca6279bd1dda77 because the tablet was not found. No further retry: Not found: Tablet not found: 6c0d1d8a5e244f1985ca6279bd1dda77
I20260620 07:01:16.346673 857 tablet_service.cc:1467] Processing CreateTablet for tablet f7458014780644fc87e152ac018a33c1 (DEFAULT_TABLE table=default.Table_ea0b0e0b727347258f2ffdbfbc42459e [id=e7e87c288c444f60b0847d37cd17e006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.348721 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 694) took 6216 ms. Trace:
I20260620 07:01:16.352162 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 06fd96feb4a74b9f8d3243b7d774f388
I20260620 07:01:16.354209 858 tablet_service.cc:1514] Processing DeleteTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.355688 1166 rpcz_store.cc:276] 0620 07:01:10.132016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.132479 (+ 463us) service_pool.cc:227] Handling call
0620 07:01:16.146154 (+6013675us) ts_tablet_manager.cc:1145] Deleting tablet f4e3145a872348b6a85a19d1678636bc
0620 07:01:16.168242 (+ 22088us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.194530 (+ 26288us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.214763 (+ 20233us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.348696 (+133933us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6013428}
I20260620 07:01:16.356722 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f4e3145a872348b6a85a19d1678636bc (table default.Table_1f805755212a4ca8861811107079a79b [id=543dd082f0474b39ae0f0e66dc257ebb]) successfully deleted
I20260620 07:01:16.357322 1166 tablet_replica.cc:330] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:16.357899 1166 raft_consensus.cc:2229] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:16.358670 1166 pending_rounds.cc:62] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:16.354737 1167 tablet_bootstrap.cc:492] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:16.359936 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7458014780644fc87e152ac018a33c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.353331 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.360090 1167 ts_tablet_manager.cc:1397] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.152s user 0.002s sys 0.002s
I20260620 07:01:16.361716 1167 raft_consensus.cc:348] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.362010 1167 raft_consensus.cc:374] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.362082 1167 raft_consensus.cc:729] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.362319 1167 consensus_queue.cc:260] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.363009 1167 ts_tablet_manager.cc:1428] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:16.363370 1167 tablet_bootstrap.cc:492] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:16.366192 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 06fd96feb4a74b9f8d3243b7d774f388 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06fd96feb4a74b9f8d3243b7d774f388 already in progress: creating tablet
I20260620 07:01:16.368633 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 5697e4be46ad49e89c3b1ba8d02cebf6 (DEFAULT_TABLE table=default.Table_36ec08d672f748c69d56047ab5bdc4ba [id=04f309f179364f0388e733cf94b7a1b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.369113 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5697e4be46ad49e89c3b1ba8d02cebf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.366753 1011 tablet_service.cc:1467] Processing CreateTablet for tablet f7458014780644fc87e152ac018a33c1 (DEFAULT_TABLE table=default.Table_ea0b0e0b727347258f2ffdbfbc42459e [id=e7e87c288c444f60b0847d37cd17e006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.369908 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7458014780644fc87e152ac018a33c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.302156 1170 ts_tablet_manager.cc:1428] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:16.382838 1169 rpcz_store.cc:276] 0620 07:01:15.283178 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.283555 (+ 377us) service_pool.cc:227] Handling call
0620 07:01:16.128177 (+844622us) ts_tablet_manager.cc:1145] Deleting tablet a2d6f7f2b5b3473aa010b8982a03aa5e
0620 07:01:16.128189 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.189498 (+ 61309us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.300437 (+110939us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.302097 (+ 1660us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":829401}
I20260620 07:01:16.383093 1170 tablet_bootstrap.cc:492] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:16.383455 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 896) took 1062 ms. Trace:
I20260620 07:01:16.384164 1167 tablet_bootstrap.cc:654] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.383543 1169 rpcz_store.cc:276] 0620 07:01:15.320922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.320975 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:16.383312 (+1062337us) ts_tablet_manager.cc:1145] Deleting tablet c73bcb81a0c84cdfb4dea0561647828a
0620 07:01:16.383327 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.383437 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1062134}
I20260620 07:01:16.311111 719 tablet_service.cc:1514] Processing DeleteTablet for tablet 25adb514cb22461bbcbecad7d74e643c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.384636 1170 tablet_bootstrap.cc:654] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.311345 2299 raft_consensus.cc:482] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.385432 2299 raft_consensus.cc:504] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.386039 2299 leader_election.cc:288] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:16.313122 683 leader_election.cc:302] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:16.386582 2299 raft_consensus.cc:2781] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 07:01:16.386533 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 73439.2us
I20260620 07:01:16.386689 2299 raft_consensus.cc:686] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:16.335953 732 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.386914 2299 consensus_queue.cc:237] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.347180 715 tablet_service.cc:1467] Processing CreateTablet for tablet f7458014780644fc87e152ac018a33c1 (DEFAULT_TABLE table=default.Table_ea0b0e0b727347258f2ffdbfbc42459e [id=e7e87c288c444f60b0847d37cd17e006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.354714 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.387509 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54bb495eea4c49b7ad7bf2300ad0e60a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:16.388245 681 leader_election.cc:341] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.392194 1170 tablet_bootstrap.cc:492] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:16.392335 1170 ts_tablet_manager.cc:1397] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260620 07:01:16.393271 1170 raft_consensus.cc:348] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.393544 1170 raft_consensus.cc:374] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.393615 1170 raft_consensus.cc:729] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.393885 1170 consensus_queue.cc:260] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.394615 1170 ts_tablet_manager.cc:1428] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:16.400578 996 tablet_service.cc:1467] Processing CreateTablet for tablet 0d02b00437d04192bfd7fb7e7a6b55f3 (DEFAULT_TABLE table=default.Table_8d053cfb76e143659a645e3f8eaba768 [id=6f8cad1f8c064ec880389a6c890171dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.400694 1001 tablet_service.cc:1467] Processing CreateTablet for tablet b8e6ca6c0a0e40a68e8c6501af7d28c5 (DEFAULT_TABLE table=default.Table_222fe401283741dfbd8316b30e97e70d [id=f974e84fd3e44839bf7da901087aa984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.401028 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d02b00437d04192bfd7fb7e7a6b55f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.401605 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e6ca6c0a0e40a68e8c6501af7d28c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.409781 1004 tablet_service.cc:1467] Processing CreateTablet for tablet b4b60d2a45944a09a60a2826a9a45738 (DEFAULT_TABLE table=default.Table_cf1dac024eb44810b66df64acb8efa84 [id=6049241b527d4ef69f4b1663b37b1c77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.410239 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4b60d2a45944a09a60a2826a9a45738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.413200 861 tablet_service.cc:1467] Processing CreateTablet for tablet 27570f4ff9bd4da89fa20113467709dd (DEFAULT_TABLE table=default.Table_2fa21eaf565847aa9ede7f122ac6fefe [id=2717322e13f2432197953dc62ff802ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.413961 867 tablet_service.cc:1467] Processing CreateTablet for tablet 0d02b00437d04192bfd7fb7e7a6b55f3 (DEFAULT_TABLE table=default.Table_8d053cfb76e143659a645e3f8eaba768 [id=6f8cad1f8c064ec880389a6c890171dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.414897 872 tablet_service.cc:1467] Processing CreateTablet for tablet b8e6ca6c0a0e40a68e8c6501af7d28c5 (DEFAULT_TABLE table=default.Table_222fe401283741dfbd8316b30e97e70d [id=f974e84fd3e44839bf7da901087aa984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.415500 874 tablet_service.cc:1467] Processing CreateTablet for tablet b4b60d2a45944a09a60a2826a9a45738 (DEFAULT_TABLE table=default.Table_cf1dac024eb44810b66df64acb8efa84 [id=6049241b527d4ef69f4b1663b37b1c77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.415940 858 tablet_service.cc:1467] Processing CreateTablet for tablet 5697e4be46ad49e89c3b1ba8d02cebf6 (DEFAULT_TABLE table=default.Table_36ec08d672f748c69d56047ab5bdc4ba [id=04f309f179364f0388e733cf94b7a1b7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:16.416385 683 leader_election.cc:341] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 54bb495eea4c49b7ad7bf2300ad0e60a
I20260620 07:01:16.416545 683 leader_election.cc:302] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.416998 1920 raft_consensus.cc:2726] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:16.418902 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e6ca6c0a0e40a68e8c6501af7d28c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.419063 862 tablet_service.cc:1467] Processing CreateTablet for tablet 29eb0db9b60f413ebce9ce16fe50aea4 (DEFAULT_TABLE table=default.Table_9f09a5bdbd854420abb7b4357cbf11a7 [id=942db1c9d67d41518a3e27315ef63051]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.419622 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29eb0db9b60f413ebce9ce16fe50aea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.426438 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27570f4ff9bd4da89fa20113467709dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.426980 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d02b00437d04192bfd7fb7e7a6b55f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.427196 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4b60d2a45944a09a60a2826a9a45738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.427959 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5697e4be46ad49e89c3b1ba8d02cebf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.384629 1169 tablet_replica.cc:330] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:16.428757 1169 raft_consensus.cc:2229] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:16.429183 1169 raft_consensus.cc:2258] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:16.429944 1169 ts_tablet_manager.cc:1905] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:16.430927 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7458014780644fc87e152ac018a33c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.432657 1170 tablet_bootstrap.cc:492] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:16.434294 1170 tablet_bootstrap.cc:654] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.439857 1170 tablet_bootstrap.cc:492] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:16.440104 1170 ts_tablet_manager.cc:1397] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20260620 07:01:16.441015 1170 raft_consensus.cc:348] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.441280 1170 raft_consensus.cc:374] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.441375 1170 raft_consensus.cc:729] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.441592 1170 consensus_queue.cc:260] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.441689 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 29eb0db9b60f413ebce9ce16fe50aea4 (DEFAULT_TABLE table=default.Table_9f09a5bdbd854420abb7b4357cbf11a7 [id=942db1c9d67d41518a3e27315ef63051]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.442445 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29eb0db9b60f413ebce9ce16fe50aea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.442773 719 tablet_service.cc:1467] Processing CreateTablet for tablet b8e6ca6c0a0e40a68e8c6501af7d28c5 (DEFAULT_TABLE table=default.Table_222fe401283741dfbd8316b30e97e70d [id=f974e84fd3e44839bf7da901087aa984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.443145 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e6ca6c0a0e40a68e8c6501af7d28c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.445607 733 tablet_service.cc:1467] Processing CreateTablet for tablet 29eb0db9b60f413ebce9ce16fe50aea4 (DEFAULT_TABLE table=default.Table_9f09a5bdbd854420abb7b4357cbf11a7 [id=942db1c9d67d41518a3e27315ef63051]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.445631 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 27570f4ff9bd4da89fa20113467709dd (DEFAULT_TABLE table=default.Table_2fa21eaf565847aa9ede7f122ac6fefe [id=2717322e13f2432197953dc62ff802ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.446250 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27570f4ff9bd4da89fa20113467709dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.446537 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29eb0db9b60f413ebce9ce16fe50aea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.447055 731 tablet_service.cc:1467] Processing CreateTablet for tablet b4b60d2a45944a09a60a2826a9a45738 (DEFAULT_TABLE table=default.Table_cf1dac024eb44810b66df64acb8efa84 [id=6049241b527d4ef69f4b1663b37b1c77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.447407 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4b60d2a45944a09a60a2826a9a45738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.442354 1170 ts_tablet_manager.cc:1428] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:16.447984 1170 tablet_bootstrap.cc:492] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:16.450270 1170 tablet_bootstrap.cc:654] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.442380 720 tablet_service.cc:1467] Processing CreateTablet for tablet 27570f4ff9bd4da89fa20113467709dd (DEFAULT_TABLE table=default.Table_2fa21eaf565847aa9ede7f122ac6fefe [id=2717322e13f2432197953dc62ff802ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.451857 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27570f4ff9bd4da89fa20113467709dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.442595 732 tablet_service.cc:1467] Processing CreateTablet for tablet 0d02b00437d04192bfd7fb7e7a6b55f3 (DEFAULT_TABLE table=default.Table_8d053cfb76e143659a645e3f8eaba768 [id=6f8cad1f8c064ec880389a6c890171dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.455247 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d02b00437d04192bfd7fb7e7a6b55f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.459713 1170 tablet_bootstrap.cc:492] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:16.459954 1170 ts_tablet_manager.cc:1397] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260620 07:01:16.459993 426 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:16.460943 1170 raft_consensus.cc:348] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.461283 1170 raft_consensus.cc:374] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.461377 1170 raft_consensus.cc:729] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.461719 1170 consensus_queue.cc:260] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.462158 1166 pending_rounds.cc:68] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821614270210048 op_type: NO_OP noop_request { }
I20260620 07:01:16.462337 1166 raft_consensus.cc:2866] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:16.462458 1166 raft_consensus.cc:2258] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:16.462646 1170 ts_tablet_manager.cc:1428] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:16.463004 1170 tablet_bootstrap.cc:492] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:16.463193 1166 ts_tablet_manager.cc:1905] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:16.464890 1170 tablet_bootstrap.cc:654] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.470006 2210 raft_consensus.cc:482] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.470207 2210 raft_consensus.cc:504] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.471094 2210 leader_election.cc:288] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:16.477932 715 tablet_service.cc:1467] Processing CreateTablet for tablet 5697e4be46ad49e89c3b1ba8d02cebf6 (DEFAULT_TABLE table=default.Table_36ec08d672f748c69d56047ab5bdc4ba [id=04f309f179364f0388e733cf94b7a1b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.478492 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5697e4be46ad49e89c3b1ba8d02cebf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.482113 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ebdb3ef844adf82b99a6d3b6c61c2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:16.483008 681 leader_election.cc:341] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.484072 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet a2d6f7f2b5b3473aa010b8982a03aa5e (table default.Table_0f52b588d09748288097316c7b3de423 [id=7abc3167416745d0871a33a335f880c6]) successfully deleted
W20260620 07:01:16.484836 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c73bcb81a0c84cdfb4dea0561647828a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c73bcb81a0c84cdfb4dea0561647828a already in progress: creating tablet
I20260620 07:01:16.487046 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_05fe644ddbaf4a9abfbdd884b9153056" } new_table_name: "default.Table_c7b23abc0801498582f75de9cca26256" modify_external_catalogs: true
W20260620 07:01:16.492812 683 leader_election.cc:341] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7d3ebdb3ef844adf82b99a6d3b6c61c2
I20260620 07:01:16.492959 683 leader_election.cc:302] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.493352 2210 raft_consensus.cc:2726] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:16.497830 996 tablet_service.cc:1467] Processing CreateTablet for tablet bb037d6896144379ae6c7ade4f79bf56 (DEFAULT_TABLE table=default.Table_2320c8254c394144bae71f5e762a1764 [id=bad5d0e6e9c94e04851e298198041444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.497824 1004 tablet_service.cc:1467] Processing CreateTablet for tablet fbc8c484e491431bbd1c2713662fd22b (DEFAULT_TABLE table=default.Table_275b8e1034684302afacf36ef1aa7c57 [id=f98cd03de8184cf5ae78d8c60f640d34]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:16.498525 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f322a11252cb4a82b87e2737d0faa75e consensus state has no leader
I20260620 07:01:16.510885 2210 raft_consensus.cc:482] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.511104 2210 raft_consensus.cc:504] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.511970 2210 leader_election.cc:288] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:16.519174 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3b70b1674e43768b29dea84b09a1a0" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:16.521238 872 tablet_service.cc:1467] Processing CreateTablet for tablet bb037d6896144379ae6c7ade4f79bf56 (DEFAULT_TABLE table=default.Table_2320c8254c394144bae71f5e762a1764 [id=bad5d0e6e9c94e04851e298198041444]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:16.525081 681 leader_election.cc:341] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.523912 1167 tablet_bootstrap.cc:492] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:16.525537 1167 ts_tablet_manager.cc:1397] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.162s user 0.018s sys 0.031s
I20260620 07:01:16.527197 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb037d6896144379ae6c7ade4f79bf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.528191 1167 raft_consensus.cc:348] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.530946 1167 raft_consensus.cc:374] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.531248 1167 raft_consensus.cc:729] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.531752 1167 consensus_queue.cc:260] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.537741 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3b70b1674e43768b29dea84b09a1a0" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:16.538355 683 leader_election.cc:341] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.538496 683 leader_election.cc:302] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.542393 2299 raft_consensus.cc:2726] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:16.544528 2309 raft_consensus.cc:482] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.546165 1167 ts_tablet_manager.cc:1428] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260620 07:01:16.546725 862 tablet_service.cc:1467] Processing CreateTablet for tablet fbc8c484e491431bbd1c2713662fd22b (DEFAULT_TABLE table=default.Table_275b8e1034684302afacf36ef1aa7c57 [id=f98cd03de8184cf5ae78d8c60f640d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.548482 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc8c484e491431bbd1c2713662fd22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.547317 2253 raft_consensus.cc:686] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:16.552767 2309 raft_consensus.cc:504] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.558235 861 tablet_service.cc:1467] Processing CreateTablet for tablet 444715fb1f1c4023a2787ea5c49d2a39 (DEFAULT_TABLE table=default.Table_a1c5db7b75ec4aedb7bba0695c4c8bf9 [id=c5cbaa5866314cd3abdc7bed8d9a8ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.559182 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 444715fb1f1c4023a2787ea5c49d2a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.559984 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88c6aeea7c504f36964e8bf41b0fc4f9" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:16.559690 2309 leader_election.cc:288] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:16.560719 830 leader_election.cc:341] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.564420 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d7082a5a3e4242c19ddf98d6100a150d" } modify_external_catalogs: true
I20260620 07:01:16.564632 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d7082a5a3e4242c19ddf98d6100a150d" } modify_external_catalogs: true
I20260620 07:01:16.567601 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 444715fb1f1c4023a2787ea5c49d2a39 (DEFAULT_TABLE table=default.Table_a1c5db7b75ec4aedb7bba0695c4c8bf9 [id=c5cbaa5866314cd3abdc7bed8d9a8ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.568028 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_47d0fc88515d40168f24f17a58c66098" } modify_external_catalogs: true
I20260620 07:01:16.568244 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_47d0fc88515d40168f24f17a58c66098" } modify_external_catalogs: true
I20260620 07:01:16.574560 426 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 751912710f4a4ad78c0c777404d4c1fa
I20260620 07:01:16.579389 427 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 90ed8a1968f94ff7a0e1493cc97a3191
I20260620 07:01:16.582628 1999 raft_consensus.cc:482] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b84cae646b24bc7bd424eb8434ad425)
I20260620 07:01:16.582834 1999 raft_consensus.cc:504] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.583498 1999 leader_election.cc:288] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:16.584391 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d96a379d122b43e6bc9ac07444ddce19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.584983 968 leader_election.cc:341] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: f690e150839a4d23860932712f61e7c8
W20260620 07:01:16.585243 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d96a379d122b43e6bc9ac07444ddce19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:16.585566 969 leader_election.cc:341] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f690e150839a4d23860932712f61e7c8
I20260620 07:01:16.585664 969 leader_election.cc:302] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.586046 1999 raft_consensus.cc:2726] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:16.593686 1001 tablet_service.cc:1467] Processing CreateTablet for tablet fcedfd476f654cf4b45605a3a2db4a16 (DEFAULT_TABLE table=default.Table_094460eef3254b5a83363b9b4700dabf [id=163c42f5e26e4156957e5e632489e661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.594254 995 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce786042d8641c08e5e3b2c048a5c03 (DEFAULT_TABLE table=default.Table_d3219442b0f145f7b2e94b234889b7de [id=f9fe6caf41ce4c9a87f7e33e9f06a789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.594631 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 8ce639e510c24db4b8c6e627a33a5ca9 (DEFAULT_TABLE table=default.Table_688ff13d46674626a6c920564c99f459 [id=6118f1dfd7014482b139fb5bb934e7bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.595054 994 tablet_service.cc:1467] Processing CreateTablet for tablet 6c0d1d8a5e244f1985ca6279bd1dda77 (DEFAULT_TABLE table=default.Table_e14a8ee0f38e44c3977154c6d6a3279c [id=6e00599bd8f042fdad8d1674ec0093c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.595376 999 tablet_service.cc:1467] Processing CreateTablet for tablet 848a456e584e466387057f98eeec44ba (DEFAULT_TABLE table=default.Table_2482ab78f5ea4572853295626b0aea5e [id=29d27798dd06433bae77c4f4b0c77482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.595515 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2d068c58b71c4076a78a31fcade380a2" } new_table_name: "default.Table_871343df667b44b59cca42f0cef66c7a" modify_external_catalogs: true
I20260620 07:01:16.596194 1168 tablet_bootstrap.cc:492] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:16.596493 1168 ts_tablet_manager.cc:1397] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.503s user 0.002s sys 0.013s
I20260620 07:01:16.597922 1168 raft_consensus.cc:348] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.598424 1168 raft_consensus.cc:374] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.598663 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a91fa09ee722442bb26d79231bd672ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:16.599090 1168 raft_consensus.cc:729] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:16.599300 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a91fa09ee722442bb26d79231bd672ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.600718 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_be4d9d9276824bb4885ee335ba4e86da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.601230 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be4d9d9276824bb4885ee335ba4e86da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.602321 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9a16fc4ee1f24bb095f9aaeee07780ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:16.599539 1168 consensus_queue.cc:260] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:16.603185 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a16fc4ee1f24bb095f9aaeee07780ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.604267 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_83336d879c48467589d9607e5d0096f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.604700 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83336d879c48467589d9607e5d0096f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.605440 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_db252cfad66a4f05ae3924ff1bd71ff7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.605881 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db252cfad66a4f05ae3924ff1bd71ff7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.606998 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bbadfae915284228b94e490802bdfe40" } new_table_name: "default.Table_8658418f64d1429a914ad81355f9cdc0" modify_external_catalogs: true
I20260620 07:01:16.607398 865 tablet_service.cc:1467] Processing CreateTablet for tablet 6c0d1d8a5e244f1985ca6279bd1dda77 (DEFAULT_TABLE table=default.Table_e14a8ee0f38e44c3977154c6d6a3279c [id=6e00599bd8f042fdad8d1674ec0093c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.607801 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c0d1d8a5e244f1985ca6279bd1dda77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.608033 857 tablet_service.cc:1467] Processing CreateTablet for tablet 8ce639e510c24db4b8c6e627a33a5ca9 (DEFAULT_TABLE table=default.Table_688ff13d46674626a6c920564c99f459 [id=6118f1dfd7014482b139fb5bb934e7bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.608178 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb037d6896144379ae6c7ade4f79bf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.608165 864 tablet_service.cc:1467] Processing CreateTablet for tablet 848a456e584e466387057f98eeec44ba (DEFAULT_TABLE table=default.Table_2482ab78f5ea4572853295626b0aea5e [id=29d27798dd06433bae77c4f4b0c77482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.608333 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ce639e510c24db4b8c6e627a33a5ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.608487 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848a456e584e466387057f98eeec44ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.608701 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88c6aeea7c504f36964e8bf41b0fc4f9" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:16.607111 874 tablet_service.cc:1467] Processing CreateTablet for tablet fcedfd476f654cf4b45605a3a2db4a16 (DEFAULT_TABLE table=default.Table_094460eef3254b5a83363b9b4700dabf [id=163c42f5e26e4156957e5e632489e661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.611025 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc8c484e491431bbd1c2713662fd22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.611219 860 tablet_service.cc:1467] Processing CreateTablet for tablet d1b347b220184e238760e03197d81014 (DEFAULT_TABLE table=default.Table_bb633c146e9743d092c50bf2e1aeb423 [id=5a6f00263fcb44be91e7cfadb7702509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.611207 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcedfd476f654cf4b45605a3a2db4a16. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:16.611670 831 leader_election.cc:341] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.611765 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1b347b220184e238760e03197d81014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.611789 831 leader_election.cc:302] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:16.615100 2299 raft_consensus.cc:482] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.615232 2299 raft_consensus.cc:504] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.615705 732 tablet_service.cc:1467] Processing CreateTablet for tablet 444715fb1f1c4023a2787ea5c49d2a39 (DEFAULT_TABLE table=default.Table_a1c5db7b75ec4aedb7bba0695c4c8bf9 [id=c5cbaa5866314cd3abdc7bed8d9a8ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.616073 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 444715fb1f1c4023a2787ea5c49d2a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.616158 2299 leader_election.cc:288] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:16.616264 2299 raft_consensus.cc:482] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.616358 2299 raft_consensus.cc:504] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.616418 734 tablet_service.cc:1467] Processing CreateTablet for tablet d1b347b220184e238760e03197d81014 (DEFAULT_TABLE table=default.Table_bb633c146e9743d092c50bf2e1aeb423 [id=5a6f00263fcb44be91e7cfadb7702509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.616726 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1b347b220184e238760e03197d81014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.616703 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d89e389b5c644055882085d52e4d1195" } modify_external_catalogs: true
I20260620 07:01:16.616977 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d89e389b5c644055882085d52e4d1195" } modify_external_catalogs: true
I20260620 07:01:16.618304 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_aeeb14e2b08a485cb1c6a913b384d45b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.618860 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aeeb14e2b08a485cb1c6a913b384d45b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.616101 722 tablet_service.cc:1467] Processing CreateTablet for tablet 848a456e584e466387057f98eeec44ba (DEFAULT_TABLE table=default.Table_2482ab78f5ea4572853295626b0aea5e [id=29d27798dd06433bae77c4f4b0c77482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.619014 719 tablet_service.cc:1467] Processing CreateTablet for tablet fcedfd476f654cf4b45605a3a2db4a16 (DEFAULT_TABLE table=default.Table_094460eef3254b5a83363b9b4700dabf [id=163c42f5e26e4156957e5e632489e661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.619164 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848a456e584e466387057f98eeec44ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.619316 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcedfd476f654cf4b45605a3a2db4a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.622331 731 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce786042d8641c08e5e3b2c048a5c03 (DEFAULT_TABLE table=default.Table_d3219442b0f145f7b2e94b234889b7de [id=f9fe6caf41ce4c9a87f7e33e9f06a789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.622632 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce786042d8641c08e5e3b2c048a5c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.624033 2299 leader_election.cc:288] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:16.624084 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dac4a1434751433488eb2913b1ddfd23" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:16.624759 681 leader_election.cc:341] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.627092 720 tablet_service.cc:1467] Processing CreateTablet for tablet 8ce639e510c24db4b8c6e627a33a5ca9 (DEFAULT_TABLE table=default.Table_688ff13d46674626a6c920564c99f459 [id=6118f1dfd7014482b139fb5bb934e7bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.627432 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ce639e510c24db4b8c6e627a33a5ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.627774 725 tablet_service.cc:1467] Processing CreateTablet for tablet 6c0d1d8a5e244f1985ca6279bd1dda77 (DEFAULT_TABLE table=default.Table_e14a8ee0f38e44c3977154c6d6a3279c [id=6e00599bd8f042fdad8d1674ec0093c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.632390 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6229a52adf8d4b17bdf89347e01621ed" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:16.632895 681 leader_election.cc:341] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.633142 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c0d1d8a5e244f1985ca6279bd1dda77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.633554 867 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce786042d8641c08e5e3b2c048a5c03 (DEFAULT_TABLE table=default.Table_d3219442b0f145f7b2e94b234889b7de [id=f9fe6caf41ce4c9a87f7e33e9f06a789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.633975 2253 consensus_queue.cc:237] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:16.634238 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60dc050958574863bae5e7c59acaa774 consensus state has no leader
I20260620 07:01:16.636030 426 catalog_manager.cc:5495] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:16.636574 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 2 got 0
I20260620 07:01:16.640712 733 tablet_service.cc:1467] Processing CreateTablet for tablet bb037d6896144379ae6c7ade4f79bf56 (DEFAULT_TABLE table=default.Table_2320c8254c394144bae71f5e762a1764 [id=bad5d0e6e9c94e04851e298198041444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.641089 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb037d6896144379ae6c7ade4f79bf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.644912 427 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:16.645697 2322 raft_consensus.cc:2726] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:16.646557 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 5208f3136bcd45579de49b8b10745122 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d9875dde7b4455b24b053781993234) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.647397 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dac4a1434751433488eb2913b1ddfd23" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:16.647884 892 raft_consensus.cc:2454] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
W20260620 07:01:16.648257 683 leader_election.cc:341] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 6229a52adf8d4b17bdf89347e01621ed
I20260620 07:01:16.648370 683 leader_election.cc:302] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.648743 2210 raft_consensus.cc:2726] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:16.649191 683 leader_election.cc:302] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:16.615705 715 tablet_service.cc:1467] Processing CreateTablet for tablet fbc8c484e491431bbd1c2713662fd22b (DEFAULT_TABLE table=default.Table_275b8e1034684302afacf36ef1aa7c57 [id=f98cd03de8184cf5ae78d8c60f640d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.649531 2210 raft_consensus.cc:2781] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:16.649600 2210 raft_consensus.cc:482] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:16.649657 2210 raft_consensus.cc:3037] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:16.649691 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc8c484e491431bbd1c2713662fd22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.652251 2210 raft_consensus.cc:504] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.653121 2210 leader_election.cc:288] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:16.654127 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dac4a1434751433488eb2913b1ddfd23" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:16.654407 892 raft_consensus.cc:3037] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:16.657166 892 raft_consensus.cc:2454] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:16.657300 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 228af95ef5b24823a4a98b876a50d9af consensus state has no leader
I20260620 07:01:16.657761 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3b0bc2da0baf482cb90aaf13892452b1" } new_table_name: "default.Table_4248c917b1ab466086f9ae5cf25bbe7b" modify_external_catalogs: true
I20260620 07:01:16.659356 683 leader_election.cc:302] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:16.659777 2210 raft_consensus.cc:2781] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:16.659922 2210 raft_consensus.cc:686] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:16.659821 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8f52009921d54b0cb21a5f60133b32ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:16.660135 2210 consensus_queue.cc:237] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:16.660403 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f52009921d54b0cb21a5f60133b32ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.661597 2273 raft_consensus.cc:482] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.661734 2273 raft_consensus.cc:504] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.661883 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7fa5ed394e58488599dee907c0b79367"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:16.662294 2273 leader_election.cc:288] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:16.662348 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fa5ed394e58488599dee907c0b79367 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.662458 1168 ts_tablet_manager.cc:1428] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.066s user 0.001s sys 0.001s
I20260620 07:01:16.663223 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3a8207eeb3544a2cb063745765f5f8e1" } modify_external_catalogs: true
I20260620 07:01:16.663420 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3a8207eeb3544a2cb063745765f5f8e1" } modify_external_catalogs: true
W20260620 07:01:16.663910 969 leader_election.cc:341] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 9e8cd4ec5619416a8983e1bc1b6b6a09
I20260620 07:01:16.664634 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3de447b04fc944688d6034db69fe2907
W20260620 07:01:16.665100 968 leader_election.cc:341] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 9e8cd4ec5619416a8983e1bc1b6b6a09
I20260620 07:01:16.665205 968 leader_election.cc:302] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.665294 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3b7824f8ca9245a4808576761591080d" } new_table_name: "default.Table_e673aadd5ad94cfd870f850dc0d14201" modify_external_catalogs: true
I20260620 07:01:16.665555 2019 raft_consensus.cc:2726] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:16.671787 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d5ce229059f94b59b8e4c882aba39374"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.672402 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5ce229059f94b59b8e4c882aba39374 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.673986 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_12d9e4d1ff354d6e957774c34d5af410" } modify_external_catalogs: true
I20260620 07:01:16.674213 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_12d9e4d1ff354d6e957774c34d5af410" } modify_external_catalogs: true
I20260620 07:01:16.675911 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 5db9a7df42e04949934b6962c9253196 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:16.682029 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 3de447b04fc944688d6034db69fe2907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.682425 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 3de447b04fc944688d6034db69fe2907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:16.685652 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3de447b04fc944688d6034db69fe2907 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3de447b04fc944688d6034db69fe2907 already in progress: creating tablet
I20260620 07:01:16.685225 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 444715fb1f1c4023a2787ea5c49d2a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.690958 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c0d1d8a5e244f1985ca6279bd1dda77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.695274 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ce639e510c24db4b8c6e627a33a5ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.697840 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dac4a1434751433488eb2913b1ddfd23" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:16.698937 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848a456e584e466387057f98eeec44ba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:16.699466 681 leader_election.cc:341] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.702412 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce786042d8641c08e5e3b2c048a5c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.703249 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcedfd476f654cf4b45605a3a2db4a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.705390 2299 raft_consensus.cc:482] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.705519 2299 raft_consensus.cc:504] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.706096 2299 leader_election.cc:288] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:16.707185 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf81c5c0d9744f5a8c3f0866a435ae3" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:16.707630 681 leader_election.cc:341] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.708061 1168 tablet_bootstrap.cc:492] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:16.712781 683 leader_election.cc:341] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7cf81c5c0d9744f5a8c3f0866a435ae3
I20260620 07:01:16.712914 683 leader_election.cc:302] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.715720 2299 raft_consensus.cc:2726] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:16.716085 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce786042d8641c08e5e3b2c048a5c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.717880 1168 tablet_bootstrap.cc:654] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.728497 1167 tablet_bootstrap.cc:492] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:16.728864 1166 ts_tablet_manager.cc:1918] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:16.729061 1166 log.cc:1196] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/da1e30385ed44c7f8b7db868f2e2bc29
I20260620 07:01:16.729804 1166 ts_tablet_manager.cc:1939] T da1e30385ed44c7f8b7db868f2e2bc29 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:16.730252 1167 tablet_bootstrap.cc:654] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:16.737630 683 consensus_peers.cc:487] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9d4ef3ba51e432f889fb927a6af8b49. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:16.738963 1169 ts_tablet_manager.cc:1918] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:16.739132 1169 log.cc:1196] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ba93e22c4720417c99d471b9c8b49b86
I20260620 07:01:16.740150 1169 ts_tablet_manager.cc:1939] T ba93e22c4720417c99d471b9c8b49b86 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:16.742272 1168 tablet_bootstrap.cc:492] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:16.742472 1168 ts_tablet_manager.cc:1397] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.004s
W20260620 07:01:16.743227 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5db563ce7027457fa0185ef94f3c05b5 consensus state has no leader
I20260620 07:01:16.743470 1168 raft_consensus.cc:348] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.743696 1168 raft_consensus.cc:374] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.743753 1168 raft_consensus.cc:729] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.744108 1168 consensus_queue.cc:260] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.745379 1168 ts_tablet_manager.cc:1428] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:16.746065 1168 tablet_bootstrap.cc:492] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:16.749646 996 tablet_service.cc:1467] Processing CreateTablet for tablet d1b347b220184e238760e03197d81014 (DEFAULT_TABLE table=default.Table_bb633c146e9743d092c50bf2e1aeb423 [id=5a6f00263fcb44be91e7cfadb7702509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.750170 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1b347b220184e238760e03197d81014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.758620 1170 tablet_bootstrap.cc:492] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:16.758891 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 3de447b04fc944688d6034db69fe2907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.760051 1170 ts_tablet_manager.cc:1397] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.297s user 0.051s sys 0.036s
I20260620 07:01:16.765270 1170 raft_consensus.cc:348] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.768349 1168 tablet_bootstrap.cc:654] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.770936 422 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0833926b10164039b5a374969d53bc9e
W20260620 07:01:16.771517 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9e70b585def4a4a9081a0938af8ce5b consensus state has no leader
I20260620 07:01:16.772109 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1936a2b27a1f4fda9ceb295c9c00acf8
I20260620 07:01:16.773177 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:16.773849 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1936a2b27a1f4fda9ceb295c9c00acf8 already in progress: creating tablet
I20260620 07:01:16.774524 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:16.778894 1170 raft_consensus.cc:374] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.779076 1170 raft_consensus.cc:729] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.779134 867 tablet_service.cc:1467] Processing CreateTablet for tablet 0755e21ca4f14f498ece0016ab0c864e (DEFAULT_TABLE table=default.Table_fa6b987ef48b4d669fbb2ff3ca718174 [id=dc4170b841004a9eb39373991cd29d29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.779420 1170 consensus_queue.cc:260] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.779615 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0755e21ca4f14f498ece0016ab0c864e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.783340 1170 ts_tablet_manager.cc:1428] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260620 07:01:16.784720 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5db9a7df42e04949934b6962c9253196
I20260620 07:01:16.786144 423 catalog_manager.cc:6565] ReplaceTablet: tablet 5db9a7df42e04949934b6962c9253196 deleted and replaced by tablet f7419a8974c843748a9022c5fe1a8b34
I20260620 07:01:16.786895 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 5db9a7df42e04949934b6962c9253196 with delete_type TABLET_DATA_DELETED (replaced by tablet f7419a8974c843748a9022c5fe1a8b34) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.788403 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 5db9a7df42e04949934b6962c9253196 with delete_type TABLET_DATA_DELETED (replaced by tablet f7419a8974c843748a9022c5fe1a8b34) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:16.788842 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5db9a7df42e04949934b6962c9253196 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5db9a7df42e04949934b6962c9253196 already in progress: creating tablet
I20260620 07:01:16.785741 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:16.793995 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 894) took 1457 ms. Trace:
I20260620 07:01:16.794124 1169 rpcz_store.cc:276] 0620 07:01:15.283396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.323942 (+ 40546us) service_pool.cc:227] Handling call
0620 07:01:16.384585 (+1060643us) ts_tablet_manager.cc:1145] Deleting tablet ba93e22c4720417c99d471b9c8b49b86
0620 07:01:16.384596 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.555107 (+170511us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.738853 (+183746us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.740930 (+ 2077us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1042179}
I20260620 07:01:16.794564 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 897) took 1414 ms. Trace:
I20260620 07:01:16.794649 1169 rpcz_store.cc:276] 0620 07:01:15.379778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.379843 (+ 65us) service_pool.cc:227] Handling call
0620 07:01:16.794439 (+1414596us) ts_tablet_manager.cc:1145] Deleting tablet fc40cf4ca353452590c770c86be0814c
0620 07:01:16.794451 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.794547 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1414378}
I20260620 07:01:16.794989 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 899) took 1165 ms. Trace:
I20260620 07:01:16.795060 1169 rpcz_store.cc:276] 0620 07:01:15.629547 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.629607 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:16.794899 (+1165292us) ts_tablet_manager.cc:1145] Deleting tablet 0e8e9256a3c0466abfacc2b4266a5db2
0620 07:01:16.794909 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.794976 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165086}
I20260620 07:01:16.795436 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 900) took 1165 ms. Trace:
I20260620 07:01:16.795508 1169 rpcz_store.cc:276] 0620 07:01:15.629677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.629740 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:16.795279 (+1165539us) ts_tablet_manager.cc:1145] Deleting tablet 0f8ddfba5500406eba8f184bd5039170
0620 07:01:16.795290 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.795367 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165355}
I20260620 07:01:16.795769 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 901) took 1164 ms. Trace:
I20260620 07:01:16.795826 1169 rpcz_store.cc:276] 0620 07:01:15.630952 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.631004 (+ 52us) service_pool.cc:227] Handling call
0620 07:01:16.795686 (+1164682us) ts_tablet_manager.cc:1145] Deleting tablet 17c337e52ace48f99316960e655dd264
0620 07:01:16.795694 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.795756 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1164539}
I20260620 07:01:16.796079 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 903) took 1127 ms. Trace:
I20260620 07:01:16.796157 1169 rpcz_store.cc:276] 0620 07:01:15.669080 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.669132 (+ 52us) service_pool.cc:227] Handling call
0620 07:01:16.795990 (+1126858us) ts_tablet_manager.cc:1145] Deleting tablet cf0bae39e1634710af12de493f7f58d5
0620 07:01:16.796001 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.796065 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1126661}
I20260620 07:01:16.796619 995 tablet_service.cc:1467] Processing CreateTablet for tablet 0755e21ca4f14f498ece0016ab0c864e (DEFAULT_TABLE table=default.Table_fa6b987ef48b4d669fbb2ff3ca718174 [id=dc4170b841004a9eb39373991cd29d29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.796895 1169 tablet_replica.cc:330] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:16.797082 1169 raft_consensus.cc:2229] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:16.797400 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0755e21ca4f14f498ece0016ab0c864e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.797500 1169 raft_consensus.cc:2258] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:16.798017 1169 ts_tablet_manager.cc:1905] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:16.801504 874 tablet_service.cc:1467] Processing CreateTablet for tablet c15e31e8ae5d433e942064323b21055b (DEFAULT_TABLE table=default.Table_18967e0d91a4466bb91f79226d99cca5 [id=2cc916f7dc304ec8abb9f7f5027b97e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.801940 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c15e31e8ae5d433e942064323b21055b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.801893 1011 tablet_service.cc:1467] Processing CreateTablet for tablet c15e31e8ae5d433e942064323b21055b (DEFAULT_TABLE table=default.Table_18967e0d91a4466bb91f79226d99cca5 [id=2cc916f7dc304ec8abb9f7f5027b97e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.802214 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c15e31e8ae5d433e942064323b21055b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.805037 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 4302edba0ec04d7abc2789bc7be1beca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.805037 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 6229a52adf8d4b17bdf89347e01621ed with delete_type TABLET_DATA_DELETED (replaced by tablet 883d1959ed484c58935db467aa2dc50a) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.808307 731 tablet_service.cc:1467] Processing CreateTablet for tablet 0755e21ca4f14f498ece0016ab0c864e (DEFAULT_TABLE table=default.Table_fa6b987ef48b4d669fbb2ff3ca718174 [id=dc4170b841004a9eb39373991cd29d29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.808738 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0755e21ca4f14f498ece0016ab0c864e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.809569 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ba93e22c4720417c99d471b9c8b49b86 (table default.Table_222fe401283741dfbd8316b30e97e70d [id=f974e84fd3e44839bf7da901087aa984]) successfully deleted
W20260620 07:01:16.809849 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet fc40cf4ca353452590c770c86be0814c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc40cf4ca353452590c770c86be0814c already in progress: creating tablet
W20260620 07:01:16.810071 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 0e8e9256a3c0466abfacc2b4266a5db2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e8e9256a3c0466abfacc2b4266a5db2 already in progress: creating tablet
W20260620 07:01:16.810299 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 0f8ddfba5500406eba8f184bd5039170 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f8ddfba5500406eba8f184bd5039170 already in progress: creating tablet
I20260620 07:01:16.810128 421 catalog_manager.cc:5495] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:16.810598 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet f8be5f41f1d64d918b727e3eef18738e (table default.Table_3122a50618184dc7bf7cb696dca2a55b [id=d55d6c70a1b34227b4820944e280fde8]). Expected version 1 got 0
W20260620 07:01:16.810572 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet cf0bae39e1634710af12de493f7f58d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf0bae39e1634710af12de493f7f58d5 already in progress: creating tablet
I20260620 07:01:16.814395 874 tablet_service.cc:1467] Processing CreateTablet for tablet 7b95e310e729480b9d1abccdde414004 (DEFAULT_TABLE table=default.Table_7c9fc0dca645486199a3d5593b381587 [id=29e2d958e6204c7da107cdea7bf97eb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.814855 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b95e310e729480b9d1abccdde414004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.815037 999 tablet_service.cc:1467] Processing CreateTablet for tablet 7b95e310e729480b9d1abccdde414004 (DEFAULT_TABLE table=default.Table_7c9fc0dca645486199a3d5593b381587 [id=29e2d958e6204c7da107cdea7bf97eb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.815297 858 tablet_service.cc:1467] Processing CreateTablet for tablet 941d471c9f41437cb79dfc030ef9cf17 (DEFAULT_TABLE table=default.Table_930aed9ced5a425ab5fd1f3e6a7ee4e2 [id=83cb5a90301644a8ba118d3eda993e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.815400 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b95e310e729480b9d1abccdde414004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.815601 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 941d471c9f41437cb79dfc030ef9cf17. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:16.817564 681 consensus_peers.cc:487] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:16.818938 994 tablet_service.cc:1467] Processing CreateTablet for tablet 941d471c9f41437cb79dfc030ef9cf17 (DEFAULT_TABLE table=default.Table_930aed9ced5a425ab5fd1f3e6a7ee4e2 [id=83cb5a90301644a8ba118d3eda993e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.819311 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 941d471c9f41437cb79dfc030ef9cf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.830498 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 699) took 6686 ms. Trace:
I20260620 07:01:16.832355 1080 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:16.830711 1166 rpcz_store.cc:276] 0620 07:01:10.143669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.143718 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:16.357249 (+6213531us) ts_tablet_manager.cc:1145] Deleting tablet da1e30385ed44c7f8b7db868f2e2bc29
0620 07:01:16.357268 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.466506 (+109238us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.728772 (+262266us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:16.830471 (+101699us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6213221}
I20260620 07:01:16.836710 1166 tablet_replica.cc:330] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:16.837258 1166 raft_consensus.cc:2229] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:16.837692 1166 raft_consensus.cc:2258] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:16.838606 1166 ts_tablet_manager.cc:1905] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:16.847338 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 5db9a7df42e04949934b6962c9253196 with delete_type TABLET_DATA_DELETED (replaced by tablet f7419a8974c843748a9022c5fe1a8b34) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.848207 731 tablet_service.cc:1467] Processing CreateTablet for tablet c15e31e8ae5d433e942064323b21055b (DEFAULT_TABLE table=default.Table_18967e0d91a4466bb91f79226d99cca5 [id=2cc916f7dc304ec8abb9f7f5027b97e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.848685 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c15e31e8ae5d433e942064323b21055b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.850601 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet da1e30385ed44c7f8b7db868f2e2bc29 (table default.Table_0d2790345adb48f6b1c2e10d634207e3 [id=640b0fb8da40454d94a90d23f41b06ff]) successfully deleted
I20260620 07:01:16.858247 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.859046 1170 tablet_bootstrap.cc:492] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:16.861013 1167 tablet_bootstrap.cc:492] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:16.861084 1168 tablet_bootstrap.cc:492] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:16.861240 1167 ts_tablet_manager.cc:1397] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.133s user 0.002s sys 0.002s
I20260620 07:01:16.861405 1168 ts_tablet_manager.cc:1397] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.116s user 0.005s sys 0.012s
I20260620 07:01:16.862136 1167 raft_consensus.cc:348] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.862609 1168 raft_consensus.cc:348] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.863044 1168 raft_consensus.cc:374] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.863234 1168 raft_consensus.cc:729] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.863673 1168 consensus_queue.cc:260] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.864245 1167 raft_consensus.cc:374] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.864368 1167 raft_consensus.cc:729] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.864665 1167 consensus_queue.cc:260] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.869203 1168 ts_tablet_manager.cc:1428] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260620 07:01:16.872634 1168 tablet_bootstrap.cc:492] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:16.879381 1167 ts_tablet_manager.cc:1428] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260620 07:01:16.881547 1167 tablet_bootstrap.cc:492] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:16.881892 1168 tablet_bootstrap.cc:654] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.863376 731 tablet_service.cc:1467] Processing CreateTablet for tablet 941d471c9f41437cb79dfc030ef9cf17 (DEFAULT_TABLE table=default.Table_930aed9ced5a425ab5fd1f3e6a7ee4e2 [id=83cb5a90301644a8ba118d3eda993e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.882437 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 941d471c9f41437cb79dfc030ef9cf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.863744 733 tablet_service.cc:1467] Processing CreateTablet for tablet 7b95e310e729480b9d1abccdde414004 (DEFAULT_TABLE table=default.Table_7c9fc0dca645486199a3d5593b381587 [id=29e2d958e6204c7da107cdea7bf97eb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:16.884164 2273 raft_consensus.cc:482] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.884296 2273 raft_consensus.cc:504] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.884922 2273 leader_election.cc:288] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:16.886317 969 leader_election.cc:341] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8cca283f4d2645c0b59f750949b7e263
I20260620 07:01:16.886893 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:16.887662 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 2057b7689b1c4c65901ed8ec04279568 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:16.890601 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_19c484fd2214414ca2f3f07207342be4" } new_table_name: "default.Table_6817cdda2b4448508cc2226285e89f46" modify_external_catalogs: true
I20260620 07:01:16.891079 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b95e310e729480b9d1abccdde414004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:16.892118 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b0ba90ad7d404eefaffdd72e2bbd6645" } modify_external_catalogs: true
I20260620 07:01:16.892340 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b0ba90ad7d404eefaffdd72e2bbd6645" } modify_external_catalogs: true
I20260620 07:01:16.894193 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f2f0727404f240818c87ef3b6e2c28de" } modify_external_catalogs: true
I20260620 07:01:16.894384 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f2f0727404f240818c87ef3b6e2c28de" } modify_external_catalogs: true
W20260620 07:01:16.895117 968 leader_election.cc:341] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 8cca283f4d2645c0b59f750949b7e263
I20260620 07:01:16.895285 968 leader_election.cc:302] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:16.896452 2299 consensus_queue.cc:1035] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:16.897231 423 catalog_manager.cc:5495] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:16.897697 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 2 got 0
I20260620 07:01:16.898483 2253 raft_consensus.cc:482] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.898627 2253 raft_consensus.cc:504] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.899295 2253 leader_election.cc:288] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:16.899679 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3eda988492234d6aaeaee87f84f99d06" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:16.900200 831 leader_election.cc:341] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:16.903061 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 27da98f96a2245c5b4210b7cf084886d (table default.Table_96e0a2412a5040ba8c91876d7263de57 [id=6d5b03179de540539513cab6cd39da39]). Expected version 2 got 0
I20260620 07:01:16.903720 2210 raft_consensus.cc:482] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:16.903857 2210 raft_consensus.cc:504] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.904438 2210 leader_election.cc:288] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:16.907891 683 leader_election.cc:341] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c2e38178b9244152915d4c0a9dcf59dc
I20260620 07:01:16.911664 1168 tablet_bootstrap.cc:492] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:16.911981 1168 ts_tablet_manager.cc:1397] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.004s
I20260620 07:01:16.913213 1168 raft_consensus.cc:348] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.913684 1168 raft_consensus.cc:374] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.913884 1168 raft_consensus.cc:729] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.914330 1168 consensus_queue.cc:260] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:16.916101 1168 ts_tablet_manager.cc:1428] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260620 07:01:16.917804 1168 tablet_bootstrap.cc:492] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:16.927387 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]). Expected version 3 got 0
I20260620 07:01:16.928720 1168 tablet_bootstrap.cc:654] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:16.929081 862 tablet_service.cc:1514] Processing DeleteTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e with delete_type TABLET_DATA_DELETED (replaced by tablet 74eaa712962245b4bb14d17e4cdd8485) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.929370 1165 tablet_replica.cc:330] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:16.929507 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d2c706414684bb1bacc6f9b870fc9c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.929636 1165 raft_consensus.cc:2229] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:16.929777 1165 raft_consensus.cc:2258] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:16.930716 1165 ts_tablet_manager.cc:1905] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:16.936908 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 033c8b817757441ea7ebc2dbf77aa2dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.937177 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eda988492234d6aaeaee87f84f99d06 with delete_type TABLET_DATA_DELETED (replaced by tablet a590f553b9e041c4830234897dbbf09f) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:16.938438 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2de8ddbab4c6462999b074d9b375b3f6 consensus state has no leader
I20260620 07:01:16.939049 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 88c6aeea7c504f36964e8bf41b0fc4f9
I20260620 07:01:16.940147 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c6aeea7c504f36964e8bf41b0fc4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.950907 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c6aeea7c504f36964e8bf41b0fc4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.953119 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]). Expected version 3 got 0
I20260620 07:01:16.956955 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 354937ee58ca4970b9ac211a369f1030
I20260620 07:01:16.961887 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 354937ee58ca4970b9ac211a369f1030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:16.967139 1168 tablet_bootstrap.cc:492] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:16.967494 1168 ts_tablet_manager.cc:1397] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.000s
I20260620 07:01:16.968726 1168 raft_consensus.cc:348] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.969256 1168 raft_consensus.cc:374] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:16.969466 1168 raft_consensus.cc:729] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:16.969915 1168 consensus_queue.cc:260] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:16.972231 1168 ts_tablet_manager.cc:1428] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:16.973476 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 354937ee58ca4970b9ac211a369f1030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.973889 720 tablet_service.cc:1514] Processing DeleteTablet for tablet b5c1567e0c9448dca870bd3d8502bf02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:16.974305 1168 tablet_bootstrap.cc:492] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:16.978170 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0697bd00827d407cbde2bc7d5e842757" } new_table_name: "default.Table_830d1bf5012e446b871ec75b647e73b5" modify_external_catalogs: true
I20260620 07:01:16.982414 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_69de24cd01774857909747c287120f79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:16.983280 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69de24cd01774857909747c287120f79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:16.987825 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ade72c04813c4285bb87ba905a586546" } new_table_name: "default.Table_9affe0d0a37c410fa0a2ab917761189b" modify_external_catalogs: true
I20260620 07:01:16.988672 1168 tablet_bootstrap.cc:654] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:16.997830 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c8aa75356fb54672a0ada533fc634613 consensus state has no leader
W20260620 07:01:17.006837 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ffe4cee1210f4baf9fd02639444c0ec2 consensus state has no leader
I20260620 07:01:17.010694 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3478a0c2fd4b42f597345cfc8ef000aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:17.011555 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3478a0c2fd4b42f597345cfc8ef000aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.012351 1169 ts_tablet_manager.cc:1918] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.012490 1169 log.cc:1196] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/d51c7488711b4db697b48025a5ba6e9d
I20260620 07:01:17.012734 1168 tablet_bootstrap.cc:492] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:17.012777 1169 ts_tablet_manager.cc:1939] T d51c7488711b4db697b48025a5ba6e9d P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:17.012959 1168 ts_tablet_manager.cc:1397] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.000s
I20260620 07:01:17.013100 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 902) took 1367 ms. Trace:
I20260620 07:01:17.013182 1169 rpcz_store.cc:276] 0620 07:01:15.645624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.670029 (+ 24405us) service_pool.cc:227] Handling call
0620 07:01:16.796851 (+1126822us) ts_tablet_manager.cc:1145] Deleting tablet d51c7488711b4db697b48025a5ba6e9d
0620 07:01:16.796861 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.877826 (+ 80965us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.012233 (+134407us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.013082 (+ 849us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1126605}
I20260620 07:01:17.014019 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 910) took 1325 ms. Trace:
I20260620 07:01:17.014151 1169 rpcz_store.cc:276] 0620 07:01:15.688273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.688319 (+ 46us) service_pool.cc:227] Handling call
0620 07:01:17.013891 (+1325572us) ts_tablet_manager.cc:1145] Deleting tablet 702e78bcd01f41c1846294deadca1b54
0620 07:01:17.013902 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.014001 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325357}
I20260620 07:01:17.014252 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c549664d74264eefb4f82ade7cbde2ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.014835 1169 tablet_replica.cc:330] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:17.014726 1168 raft_consensus.cc:348] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:17.015036 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c549664d74264eefb4f82ade7cbde2ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.015091 1169 raft_consensus.cc:2229] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.015254 1169 raft_consensus.cc:2258] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.015251 1168 raft_consensus.cc:374] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.015499 1168 raft_consensus.cc:729] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.015816 1169 ts_tablet_manager.cc:1905] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.015964 1168 consensus_queue.cc:260] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.017590 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2975167a62b94aa0aaf9d2301469a1a3" } modify_external_catalogs: true
I20260620 07:01:17.017836 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2975167a62b94aa0aaf9d2301469a1a3" } modify_external_catalogs: true
I20260620 07:01:17.018736 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0a1890bc1daa402480e753409ee074df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.020318 1168 ts_tablet_manager.cc:1428] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260620 07:01:17.022153 1168 tablet_bootstrap.cc:492] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:17.022563 1170 tablet_bootstrap.cc:654] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.019526 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d62c7ea251d64d68b6cfb78275ee57b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.024648 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c3dc76e516e64345bd515e7d786b93a8" } new_table_name: "default.Table_95bf37d6a97f41a5ba9d681d07d75283" modify_external_catalogs: true
W20260620 07:01:17.024909 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d62c7ea251d64d68b6cfb78275ee57b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.025027 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9781a7cd64e242389d7bab889fe0781d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:17.026278 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9781a7cd64e242389d7bab889fe0781d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.026685 1165 ts_tablet_manager.cc:1918] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.026823 1165 log.cc:1196] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/d0c41bf6a8a448ad809292d66ebf9c0e
I20260620 07:01:17.029088 1165 ts_tablet_manager.cc:1939] T d0c41bf6a8a448ad809292d66ebf9c0e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:17.030438 1165 tablet_replica.cc:330] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:17.030704 1165 raft_consensus.cc:2229] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.030937 1165 raft_consensus.cc:2258] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:17.031214 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a1890bc1daa402480e753409ee074df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.031576 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet d0c41bf6a8a448ad809292d66ebf9c0e (table default.Table_d980ceff63f447adbc0aaf600b24f40e [id=ea3947fe0a794502a317ef69c47c0444]) successfully deleted
I20260620 07:01:17.031797 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a4f3e4033b514356b31b22033f8bd248"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.032459 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d2938b69b1084b4ca3c8877f6c5cf511"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.033427 2019 raft_consensus.cc:2726] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.035581 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c6aeea7c504f36964e8bf41b0fc4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:17.036412 1168 tablet_bootstrap.cc:654] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:17.031527 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 136414us
I20260620 07:01:17.037164 1999 raft_consensus.cc:482] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.038630 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 354937ee58ca4970b9ac211a369f1030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:17.043727 1167 tablet_bootstrap.cc:654] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.037321 1999 raft_consensus.cc:504] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.046201 1169 ts_tablet_manager.cc:1918] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.046337 1169 log.cc:1196] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/54bb495eea4c49b7ad7bf2300ad0e60a
I20260620 07:01:17.049767 1170 tablet_bootstrap.cc:492] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:17.049973 1170 ts_tablet_manager.cc:1397] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.191s user 0.004s sys 0.006s
I20260620 07:01:17.049882 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2e38178b9244152915d4c0a9dcf59dc" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:17.039008 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3eda988492234d6aaeaee87f84f99d06" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:17.050980 1999 leader_election.cc:288] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:17.050954 1170 raft_consensus.cc:348] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.051242 1170 raft_consensus.cc:374] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.051342 1170 raft_consensus.cc:729] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.051601 1170 consensus_queue.cc:260] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:17.051803 681 leader_election.cc:341] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.051923 681 leader_election.cc:302] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:17.053215 968 leader_election.cc:341] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: b4ee5c79e2a6419ea3847cbebdeced79
I20260620 07:01:17.053951 2299 raft_consensus.cc:2726] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:17.056355 830 leader_election.cc:341] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.056492 830 leader_election.cc:302] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:17.056974 1170 ts_tablet_manager.cc:1428] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260620 07:01:17.057261 2253 raft_consensus.cc:2726] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:17.060566 969 leader_election.cc:341] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b4ee5c79e2a6419ea3847cbebdeced79
I20260620 07:01:17.060734 969 leader_election.cc:302] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.061302 1999 raft_consensus.cc:2726] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.064359 1166 ts_tablet_manager.cc:1918] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:17.064620 1166 log.cc:1196] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/46689d13712842bf9145ad2bc3fc2acf
I20260620 07:01:17.065402 1166 ts_tablet_manager.cc:1939] T 46689d13712842bf9145ad2bc3fc2acf P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:17.067632 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2482ab78f5ea4572853295626b0aea5e" } modify_external_catalogs: true
I20260620 07:01:17.069051 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 686) took 7100 ms. Trace:
I20260620 07:01:17.069224 1166 rpcz_store.cc:276] 0620 07:01:09.968688 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.166853 (+198165us) service_pool.cc:227] Handling call
0620 07:01:16.836659 (+6669806us) ts_tablet_manager.cc:1145] Deleting tablet 46689d13712842bf9145ad2bc3fc2acf
0620 07:01:16.836671 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:16.918019 (+ 81348us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.064218 (+146199us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.069025 (+ 4807us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6663952}
I20260620 07:01:17.069674 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 701) took 6879 ms. Trace:
I20260620 07:01:17.069878 1166 rpcz_store.cc:276] 0620 07:01:10.190023 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.192400 (+ 2377us) service_pool.cc:227] Handling call
0620 07:01:17.069552 (+6877152us) ts_tablet_manager.cc:1145] Deleting tablet a594df0df6ad48cab77cc1deed22bff0
0620 07:01:17.069562 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.069656 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6853103}
I20260620 07:01:17.070526 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 707) took 6842 ms. Trace:
I20260620 07:01:17.070637 1166 rpcz_store.cc:276] 0620 07:01:10.227815 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.227882 (+ 67us) service_pool.cc:227] Handling call
0620 07:01:17.070424 (+6842542us) ts_tablet_manager.cc:1145] Deleting tablet 5883a8466d0c4e45aba3b4095ced91a4
0620 07:01:17.070434 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.070511 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6841242}
I20260620 07:01:17.071153 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 708) took 6837 ms. Trace:
I20260620 07:01:17.071273 1166 rpcz_store.cc:276] 0620 07:01:10.233801 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.233860 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:17.071054 (+6837194us) ts_tablet_manager.cc:1145] Deleting tablet 4260b0c953c14a198dbf9b64a30e7e05
0620 07:01:17.071065 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.071138 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6825774}
I20260620 07:01:17.071678 1166 tablet_replica.cc:330] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:17.071949 1166 raft_consensus.cc:2229] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:17.072329 1166 raft_consensus.cc:2258] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.072974 1166 ts_tablet_manager.cc:1905] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.074239 1170 tablet_bootstrap.cc:492] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:17.074775 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2938b69b1084b4ca3c8877f6c5cf511 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:17.075974 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4f3e4033b514356b31b22033f8bd248 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.076150 1169 ts_tablet_manager.cc:1939] T 54bb495eea4c49b7ad7bf2300ad0e60a P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:17.076483 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 907) took 1388 ms. Trace:
I20260620 07:01:17.076566 1169 rpcz_store.cc:276] 0620 07:01:15.687928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.688508 (+ 580us) service_pool.cc:227] Handling call
0620 07:01:17.014591 (+1326083us) ts_tablet_manager.cc:1145] Deleting tablet 54bb495eea4c49b7ad7bf2300ad0e60a
0620 07:01:17.014605 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.018882 (+ 4277us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.046076 (+ 27194us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.076465 (+ 30389us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325961}
I20260620 07:01:17.077026 1169 tablet_replica.cc:330] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:17.077222 1169 raft_consensus.cc:2229] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.077369 1169 raft_consensus.cc:2258] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.077716 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2482ab78f5ea4572853295626b0aea5e" } modify_external_catalogs: true
I20260620 07:01:17.077898 1169 ts_tablet_manager.cc:1905] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.078974 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 46689d13712842bf9145ad2bc3fc2acf (table default.Table_eedf4e35718843d2bb59ddbb3c085feb [id=00c840fc683c4a4491fe102554b4bc2a]) successfully deleted
W20260620 07:01:17.079344 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a594df0df6ad48cab77cc1deed22bff0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a594df0df6ad48cab77cc1deed22bff0 already in progress: creating tablet
W20260620 07:01:17.079545 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5883a8466d0c4e45aba3b4095ced91a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5883a8466d0c4e45aba3b4095ced91a4 already in progress: creating tablet
W20260620 07:01:17.079768 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4260b0c953c14a198dbf9b64a30e7e05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4260b0c953c14a198dbf9b64a30e7e05 already in progress: creating tablet
I20260620 07:01:17.084924 1170 tablet_bootstrap.cc:654] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.087091 1167 tablet_bootstrap.cc:492] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:17.087330 1167 ts_tablet_manager.cc:1397] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.206s user 0.007s sys 0.002s
I20260620 07:01:17.088332 1167 raft_consensus.cc:348] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.088714 1167 raft_consensus.cc:374] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.088827 1167 raft_consensus.cc:729] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.089154 1167 consensus_queue.cc:260] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.090024 1167 ts_tablet_manager.cc:1428] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:17.090653 1170 tablet_bootstrap.cc:492] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:17.091300 1170 ts_tablet_manager.cc:1397] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260620 07:01:17.091912 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet d51c7488711b4db697b48025a5ba6e9d (table default.Table_8bb5c7631c6145c49b7b09fcda4e4554 [id=ca832808e4a449deab0a9c100d5ead0b]) successfully deleted
I20260620 07:01:17.093623 1170 raft_consensus.cc:348] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:17.093544 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 702e78bcd01f41c1846294deadca1b54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 702e78bcd01f41c1846294deadca1b54 already in progress: creating tablet
I20260620 07:01:17.099959 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 54bb495eea4c49b7ad7bf2300ad0e60a (table default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]) successfully deleted
W20260620 07:01:17.111591 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e864cac7431439b9eb18d0cd98a7755 consensus state has no leader
I20260620 07:01:17.113523 426 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]). Expected version 3 got 0
I20260620 07:01:17.115365 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c72f91cb64424554a72fe0051d18c425" } new_table_name: "default.Table_31729b86132444c4b29a5b85590a8c7a" modify_external_catalogs: true
I20260620 07:01:17.115770 1170 raft_consensus.cc:374] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.115867 1170 raft_consensus.cc:729] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.116447 1170 consensus_queue.cc:260] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.117216 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1dc8297521db42c98ffe92b370890ba8" } modify_external_catalogs: true
I20260620 07:01:17.117487 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1dc8297521db42c98ffe92b370890ba8" } modify_external_catalogs: true
I20260620 07:01:17.118355 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_04102f1fee5f4618a55d7381082bf5de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.119290 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e7168442aafd4cfe8abca1a1b570fa44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:17.119932 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7168442aafd4cfe8abca1a1b570fa44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.121311 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 848a456e584e466387057f98eeec44ba
I20260620 07:01:17.122565 1170 ts_tablet_manager.cc:1428] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260620 07:01:17.124063 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 848a456e584e466387057f98eeec44ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:17.124437 1029 raft_consensus.cc:3037] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:17.126042 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04102f1fee5f4618a55d7381082bf5de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.126909 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 848a456e584e466387057f98eeec44ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:17.133900 996 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e08a38c42d4e3da20292343bf085b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:17.139631 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f7aa6b156e84e708a3c6b3b32bce7c3 has no consensus state
I20260620 07:01:17.145874 867 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:17.139119 2299 raft_consensus.cc:482] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.151021 2299 raft_consensus.cc:504] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.151928 1165 ts_tablet_manager.cc:1905] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.151907 2299 leader_election.cc:288] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:17.153174 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5c1567e0c9448dca870bd3d8502bf02" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:17.153713 683 leader_election.cc:341] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b5c1567e0c9448dca870bd3d8502bf02
W20260620 07:01:17.153932 681 leader_election.cc:341] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.154018 681 leader_election.cc:302] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.154408 2299 raft_consensus.cc:2726] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.156848 2299 raft_consensus.cc:482] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.156989 2299 raft_consensus.cc:504] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.157582 2299 leader_election.cc:288] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:17.157883 1166 ts_tablet_manager.cc:1918] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260620 07:01:17.158685 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4302edba0ec04d7abc2789bc7be1beca" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:17.159209 681 leader_election.cc:341] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:17.160034 683 leader_election.cc:341] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4302edba0ec04d7abc2789bc7be1beca
I20260620 07:01:17.160137 683 leader_election.cc:302] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.160830 2210 raft_consensus.cc:2726] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.161018 1166 log.cc:1196] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f0e54f1185cd4c5c8e5d2ed289b61650
I20260620 07:01:17.161633 1166 ts_tablet_manager.cc:1939] T f0e54f1185cd4c5c8e5d2ed289b61650 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:17.160857 1170 tablet_bootstrap.cc:492] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:17.162083 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 709) took 6734 ms. Trace:
I20260620 07:01:17.162191 1166 rpcz_store.cc:276] 0620 07:01:10.428068 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.428141 (+ 73us) service_pool.cc:227] Handling call
0620 07:01:17.071638 (+6643497us) ts_tablet_manager.cc:1145] Deleting tablet f0e54f1185cd4c5c8e5d2ed289b61650
0620 07:01:17.071648 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.080411 (+ 8763us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.157770 (+ 77359us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.162060 (+ 4290us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6642918}
I20260620 07:01:17.162673 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f0e54f1185cd4c5c8e5d2ed289b61650 (table default.Table_811e4d61e71e47ab80ad8c0488b3183c [id=2abd0f99a3034a0e8824bcb0002c91bd]) successfully deleted
I20260620 07:01:17.169631 1169 ts_tablet_manager.cc:1918] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.171425 2343 tablet.cc:1722] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:17.171535 1999 raft_consensus.cc:482] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.171780 1999 raft_consensus.cc:504] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.172536 1999 leader_election.cc:288] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:17.173404 969 leader_election.cc:341] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 5208f3136bcd45579de49b8b10745122
W20260620 07:01:17.173635 968 leader_election.cc:341] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 5208f3136bcd45579de49b8b10745122
I20260620 07:01:17.173749 968 leader_election.cc:302] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.174181 1999 raft_consensus.cc:2726] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.181720 2253 raft_consensus.cc:482] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.181885 2253 raft_consensus.cc:504] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.182462 2253 leader_election.cc:288] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.184048 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033c8b817757441ea7ebc2dbf77aa2dd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:17.184787 830 leader_election.cc:341] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:17.189430 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0435678022914e6991c974e116d1a9f7 (table default.Table_9f21f8c0c60642fd97b87ce5e1befcaf [id=3497d9fc568f4979baf33dfdd30ce222], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0435678022914e6991c974e116d1a9f7 consensus state has no leader
I20260620 07:01:17.191998 1168 tablet_bootstrap.cc:492] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:17.192415 1168 ts_tablet_manager.cc:1397] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.171s user 0.016s sys 0.015s
I20260620 07:01:17.194326 1168 raft_consensus.cc:348] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.195139 1168 raft_consensus.cc:374] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.195379 1168 raft_consensus.cc:729] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.195902 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d1317e297da54e3794bdefbfeedea221" } new_table_name: "default.Table_228ceee38078438899c31dd170861a70" modify_external_catalogs: true
I20260620 07:01:17.196852 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_06bc01b8cb5d447ea25fd376cc255a6d" } modify_external_catalogs: true
I20260620 07:01:17.197063 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_06bc01b8cb5d447ea25fd376cc255a6d" } modify_external_catalogs: true
I20260620 07:01:17.197610 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9f09a5bdbd854420abb7b4357cbf11a7" } modify_external_catalogs: true
I20260620 07:01:17.197853 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9f09a5bdbd854420abb7b4357cbf11a7" } modify_external_catalogs: true
I20260620 07:01:17.197084 1168 consensus_queue.cc:260] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.207047 2343 tablet.cc:1717] T 27da98f96a2245c5b4210b7cf084886d P 06a32ef63b2b495a9ade1de48c024ae9: Skipping requested alter to schema version 2, tablet already version 2
I20260620 07:01:17.212375 1168 ts_tablet_manager.cc:1428] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20260620 07:01:17.224052 1165 ts_tablet_manager.cc:1918] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.224527 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 710) took 6787 ms. Trace:
I20260620 07:01:17.224647 1166 rpcz_store.cc:276] 0620 07:01:10.436699 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.436761 (+ 62us) service_pool.cc:227] Handling call
0620 07:01:17.224362 (+6787601us) ts_tablet_manager.cc:1145] Deleting tablet a13a60f7f3e74f7dbf5204c974e0e346
0620 07:01:17.224376 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.224506 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6787326}
W20260620 07:01:17.225162 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a13a60f7f3e74f7dbf5204c974e0e346 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a13a60f7f3e74f7dbf5204c974e0e346 already in progress: creating tablet
I20260620 07:01:17.225592 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 724) took 6541 ms. Trace:
I20260620 07:01:17.225723 1166 rpcz_store.cc:276] 0620 07:01:10.683681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.683740 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:17.225459 (+6541719us) ts_tablet_manager.cc:1145] Deleting tablet 09eddf4734144bdaba24759647553020
0620 07:01:17.225472 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.225547 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6541459}
W20260620 07:01:17.226203 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 09eddf4734144bdaba24759647553020 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09eddf4734144bdaba24759647553020 already in progress: creating tablet
I20260620 07:01:17.226639 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 723) took 6543 ms. Trace:
I20260620 07:01:17.226761 1166 rpcz_store.cc:276] 0620 07:01:10.683551 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.684249 (+ 698us) service_pool.cc:227] Handling call
0620 07:01:17.226503 (+6542254us) ts_tablet_manager.cc:1145] Deleting tablet 36f1fc6123cd40cb839d47de316502b3
0620 07:01:17.226515 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.226617 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6541916}
W20260620 07:01:17.227190 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 36f1fc6123cd40cb839d47de316502b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36f1fc6123cd40cb839d47de316502b3 already in progress: creating tablet
I20260620 07:01:17.227555 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 726) took 6531 ms. Trace:
I20260620 07:01:17.227692 1166 rpcz_store.cc:276] 0620 07:01:10.696503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.696564 (+ 61us) service_pool.cc:227] Handling call
0620 07:01:17.227453 (+6530889us) ts_tablet_manager.cc:1145] Deleting tablet 63525282e222490687713a92e5371a5c
0620 07:01:17.227468 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.227540 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6530631}
W20260620 07:01:17.228205 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 63525282e222490687713a92e5371a5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63525282e222490687713a92e5371a5c already in progress: creating tablet
I20260620 07:01:17.228688 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 722) took 6560 ms. Trace:
I20260620 07:01:17.228884 1166 rpcz_store.cc:276] 0620 07:01:10.668518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.698922 (+ 30404us) service_pool.cc:227] Handling call
0620 07:01:17.228554 (+6529632us) ts_tablet_manager.cc:1145] Deleting tablet 7294e5678ad44622a3249c1113b5e297
0620 07:01:17.228569 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.228667 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6529384}
W20260620 07:01:17.229377 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7294e5678ad44622a3249c1113b5e297 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7294e5678ad44622a3249c1113b5e297 already in progress: creating tablet
I20260620 07:01:17.229775 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 725) took 6533 ms. Trace:
I20260620 07:01:17.229913 1166 rpcz_store.cc:276] 0620 07:01:10.696339 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.699210 (+ 2871us) service_pool.cc:227] Handling call
0620 07:01:17.229661 (+6530451us) ts_tablet_manager.cc:1145] Deleting tablet 960fca9c94764f3d8d2daae20a0f8388
0620 07:01:17.229671 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.229759 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6530244}
W20260620 07:01:17.230378 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 960fca9c94764f3d8d2daae20a0f8388 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 960fca9c94764f3d8d2daae20a0f8388 already in progress: creating tablet
I20260620 07:01:17.240216 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
W20260620 07:01:17.248863 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a201a40f85af4542b0e20dd7d38901bb consensus state has no leader
I20260620 07:01:17.254959 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a590f553b9e041c4830234897dbbf09f
I20260620 07:01:17.256115 996 tablet_service.cc:1514] Processing DeleteTablet for tablet a590f553b9e041c4830234897dbbf09f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:17.258915 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 727) took 6496 ms. Trace:
I20260620 07:01:17.259902 1166 rpcz_store.cc:276] 0620 07:01:10.762644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.762739 (+ 95us) service_pool.cc:227] Handling call
0620 07:01:17.230672 (+6467933us) ts_tablet_manager.cc:1145] Deleting tablet 8aa92aae55ef4527a1e8f98945e1e833
0620 07:01:17.255030 (+ 24358us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.258894 (+ 3864us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6461631}
I20260620 07:01:17.261324 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 729) took 6496 ms. Trace:
W20260620 07:01:17.261404 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8aa92aae55ef4527a1e8f98945e1e833 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aa92aae55ef4527a1e8f98945e1e833 already in progress: creating tablet
I20260620 07:01:17.262979 1166 rpcz_store.cc:276] 0620 07:01:10.764462 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.765833 (+ 1371us) service_pool.cc:227] Handling call
0620 07:01:17.261183 (+6495350us) ts_tablet_manager.cc:1145] Deleting tablet 9dbfd0959737438e8508b96777afb8e1
0620 07:01:17.261195 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.261306 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6491226}
W20260620 07:01:17.264263 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9dbfd0959737438e8508b96777afb8e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9dbfd0959737438e8508b96777afb8e1 already in progress: creating tablet
I20260620 07:01:17.264415 1166 tablet_replica.cc:330] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:17.264604 1166 raft_consensus.cc:2229] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:17.266368 1166 raft_consensus.cc:2258] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.271449 1166 ts_tablet_manager.cc:1905] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.183375 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033c8b817757441ea7ebc2dbf77aa2dd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:17.185880 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 848a456e584e466387057f98eeec44ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:17.220409 2210 raft_consensus.cc:482] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.285045 2210 raft_consensus.cc:504] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.285713 2210 leader_election.cc:288] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:17.286226 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864c95b908674e4f8425d765444c281b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:17.287724 681 leader_election.cc:341] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.291254 1169 log.cc:1196] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/c8f81fa4e88945f1a392fbacfd031392
I20260620 07:01:17.291953 1169 ts_tablet_manager.cc:1939] T c8f81fa4e88945f1a392fbacfd031392 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:17.292878 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 908) took 1604 ms. Trace:
I20260620 07:01:17.224200 1165 log.cc:1196] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/8d2c706414684bb1bacc6f9b870fc9c1
I20260620 07:01:17.224916 1168 tablet_bootstrap.cc:492] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:17.256018 862 tablet_service.cc:1514] Processing DeleteTablet for tablet a590f553b9e041c4830234897dbbf09f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:17.285140 831 leader_election.cc:341] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.295430 831 leader_election.cc:302] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:17.242180 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 3651ef9790d342ec96f554134ae714dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:17.296226 2253 raft_consensus.cc:2726] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.296944 1168 tablet_bootstrap.cc:654] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.303843 2173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: Bootstrap replayed 1/1 log segments. Stats: ops{read=695 overwritten=0 applied=695 ignored=0} inserts{seen=643 ignored=0} mutations{seen=803 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 07:01:17.304713 2173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: Bootstrap complete.
W20260620 07:01:17.296957 683 leader_election.cc:341] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 864c95b908674e4f8425d765444c281b
I20260620 07:01:17.306550 683 leader_election.cc:302] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.306516 1169 rpcz_store.cc:276] 0620 07:01:15.688034 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.688661 (+ 627us) service_pool.cc:227] Handling call
0620 07:01:17.076984 (+1388323us) ts_tablet_manager.cc:1145] Deleting tablet c8f81fa4e88945f1a392fbacfd031392
0620 07:01:17.076994 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.091693 (+ 14699us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.169515 (+ 77822us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.292855 (+123340us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1388185}
I20260620 07:01:17.306915 1169 tablet_replica.cc:330] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:17.307119 1169 raft_consensus.cc:2229] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.306353 1165 ts_tablet_manager.cc:1939] T 8d2c706414684bb1bacc6f9b870fc9c1 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:17.309563 1165 tablet_replica.cc:330] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:17.309973 1169 raft_consensus.cc:2258] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.311079 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 8d2c706414684bb1bacc6f9b870fc9c1 (table default.Table_27b3605ce0ed4b8a8c04f4f83227b678 [id=7cff577663c14bf997e9091e37d1c832]) successfully deleted
I20260620 07:01:17.284418 1170 tablet_bootstrap.cc:654] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.307416 2348 tablet.cc:1722] T 34dc2af503684aaba8388a4611fab48e P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:17.315073 1169 ts_tablet_manager.cc:1905] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.315636 1165 raft_consensus.cc:2229] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.318251 2173 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:01:17.319602 1165 raft_consensus.cc:2258] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.319813 2173 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2395d394cd84440ebae89d1ecfa13fb5, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.321746 2173 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 695, Last appended: 3.695, Last appended by leader: 695, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:01:17.328738 2354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:01:17.331113 2354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:01:17.330982 2173 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 07:01:17.333961 2299 consensus_queue.cc:1035] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:17.336165 1166 ts_tablet_manager.cc:1918] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:17.336303 1166 log.cc:1196] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/69113a64960d4aee9a2a4fcb28570bf2
I20260620 07:01:17.314087 2350 tablet.cc:1722] T 34dc2af503684aaba8388a4611fab48e P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:17.307938 2346 raft_consensus.cc:2726] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:17.344805 830 consensus_peers.cc:487] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:17.345944 749 raft_consensus.cc:1261] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Refusing update from remote peer 978f112862c64141b1009856bef3d624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 07:01:17.349879 2350 tablet.cc:1722] T 5a4390225af348f89c934f0f179ddab5 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:17.350427 2343 tablet.cc:1722] T 34dc2af503684aaba8388a4611fab48e P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:17.352998 2358 consensus_queue.cc:1035] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:17.343398 1165 ts_tablet_manager.cc:1905] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.365510 1168 tablet_bootstrap.cc:492] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:17.365674 1168 ts_tablet_manager.cc:1397] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.141s user 0.004s sys 0.008s
I20260620 07:01:17.367699 2348 tablet.cc:1722] T 5a4390225af348f89c934f0f179ddab5 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:17.369131 1170 tablet_bootstrap.cc:492] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:17.371975 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:17.374209 1166 ts_tablet_manager.cc:1939] T 69113a64960d4aee9a2a4fcb28570bf2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:17.371273 681 consensus_peers.cc:487] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:17.378882 1170 ts_tablet_manager.cc:1397] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.218s user 0.001s sys 0.006s
I20260620 07:01:17.379657 1170 raft_consensus.cc:348] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.379899 1170 raft_consensus.cc:374] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.379958 1170 raft_consensus.cc:729] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.380136 1170 consensus_queue.cc:260] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.380548 1170 ts_tablet_manager.cc:1428] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:17.377372 2343 tablet.cc:1722] T 5a4390225af348f89c934f0f179ddab5 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:17.383232 2358 raft_consensus.cc:482] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.383412 2358 raft_consensus.cc:504] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.384847 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3651ef9790d342ec96f554134ae714dc" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:17.385512 831 leader_election.cc:341] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.386729 2358 leader_election.cc:288] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.404927 1080 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:17.411404 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3651ef9790d342ec96f554134ae714dc" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:17.413576 830 leader_election.cc:341] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.413717 830 leader_election.cc:302] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:17.414165 2358 raft_consensus.cc:2726] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.419853 1170 tablet_bootstrap.cc:492] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:17.425166 1165 ts_tablet_manager.cc:1918] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.426952 1165 log.cc:1196] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/033c8b817757441ea7ebc2dbf77aa2dd
I20260620 07:01:17.412983 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 728) took 6648 ms. Trace:
I20260620 07:01:17.435464 1166 rpcz_store.cc:276] 0620 07:01:10.764316 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:10.768025 (+ 3709us) service_pool.cc:227] Handling call
0620 07:01:17.264365 (+6496340us) ts_tablet_manager.cc:1145] Deleting tablet 69113a64960d4aee9a2a4fcb28570bf2
0620 07:01:17.264378 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.289549 (+ 25171us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.336050 (+ 46501us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.412963 (+ 76913us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6492354}
I20260620 07:01:17.438412 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 69113a64960d4aee9a2a4fcb28570bf2 (table default.Table_815bd5183e254243bbd89ce69522aafb [id=fc671ac815da4c76b050f11dfcaee2a3]) successfully deleted
I20260620 07:01:17.439860 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 754) took 5667 ms. Trace:
I20260620 07:01:17.440053 1166 rpcz_store.cc:276] 0620 07:01:11.772178 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.772881 (+ 703us) service_pool.cc:227] Handling call
0620 07:01:17.437320 (+5664439us) ts_tablet_manager.cc:1145] Deleting tablet 80138f3919f34d5d8163fdfc89d5c52b
0620 07:01:17.439723 (+ 2403us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.439839 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5649805}
W20260620 07:01:17.440814 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 80138f3919f34d5d8163fdfc89d5c52b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80138f3919f34d5d8163fdfc89d5c52b already in progress: creating tablet
I20260620 07:01:17.441474 1166 tablet_replica.cc:330] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:17.441733 1166 raft_consensus.cc:2229] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.444201 2346 consensus_queue.cc:1035] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:17.449098 2348 tablet.cc:1722] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:17.454993 1166 raft_consensus.cc:2258] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.457947 1169 ts_tablet_manager.cc:1918] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.458150 1169 log.cc:1196] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/eeb082e189304f13909d115f7197c5a1
I20260620 07:01:17.458541 1169 ts_tablet_manager.cc:1939] T eeb082e189304f13909d115f7197c5a1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:17.458916 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 909) took 1770 ms. Trace:
I20260620 07:01:17.460391 1166 ts_tablet_manager.cc:1905] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.459061 1169 rpcz_store.cc:276] 0620 07:01:15.688163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.688603 (+ 440us) service_pool.cc:227] Handling call
0620 07:01:17.306862 (+1618259us) ts_tablet_manager.cc:1145] Deleting tablet eeb082e189304f13909d115f7197c5a1
0620 07:01:17.306877 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.403677 (+ 96800us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.457841 (+ 54164us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.458897 (+ 1056us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618029}
I20260620 07:01:17.471977 1169 tablet_replica.cc:330] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:17.472282 1169 raft_consensus.cc:2229] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.475787 1170 tablet_bootstrap.cc:654] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.481519 1165 ts_tablet_manager.cc:1939] T 033c8b817757441ea7ebc2dbf77aa2dd P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:17.437409 1168 raft_consensus.cc:348] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.443356 2350 tablet.cc:1722] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:17.482331 1168 raft_consensus.cc:374] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.482530 1168 raft_consensus.cc:729] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.487375 1168 consensus_queue.cc:260] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.488132 1168 ts_tablet_manager.cc:1428] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.122s user 0.001s sys 0.001s
I20260620 07:01:17.488512 1168 tablet_bootstrap.cc:492] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:17.490206 1168 tablet_bootstrap.cc:654] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.495673 1169 raft_consensus.cc:2258] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.496415 1169 ts_tablet_manager.cc:1905] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.501415 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 033c8b817757441ea7ebc2dbf77aa2dd (table default.Table_dbcf6925600345658e340ad71565e073 [id=a7528a9274144f0ebbcd1efa102a2a1b]) successfully deleted
I20260620 07:01:17.501845 1165 tablet_replica.cc:330] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:17.502189 1165 raft_consensus.cc:2229] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.502441 1165 raft_consensus.cc:2258] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.505820 1165 ts_tablet_manager.cc:1905] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:17.511554 681 consensus_peers.cc:487] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:17.514889 1170 tablet_bootstrap.cc:492] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:17.515167 1170 ts_tablet_manager.cc:1397] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.095s user 0.003s sys 0.002s
I20260620 07:01:17.516062 1170 raft_consensus.cc:348] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.516399 1170 raft_consensus.cc:374] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.516549 1170 raft_consensus.cc:729] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.516831 1170 consensus_queue.cc:260] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.517473 1170 ts_tablet_manager.cc:1428] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:17.517796 1170 tablet_bootstrap.cc:492] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:17.519526 1170 tablet_bootstrap.cc:654] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.507927 1168 tablet_bootstrap.cc:492] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:17.527035 1168 ts_tablet_manager.cc:1397] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.001s
I20260620 07:01:17.527932 1168 raft_consensus.cc:348] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.528219 1168 raft_consensus.cc:374] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.528743 1168 raft_consensus.cc:729] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.529016 1168 consensus_queue.cc:260] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.529659 1168 ts_tablet_manager.cc:1428] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:17.539929 1167 tablet_bootstrap.cc:492] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:17.542625 1167 tablet_bootstrap.cc:654] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.560073 1168 tablet_bootstrap.cc:492] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:17.566304 1167 tablet_bootstrap.cc:492] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:17.566763 1167 ts_tablet_manager.cc:1397] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.001s
I20260620 07:01:17.567546 1167 raft_consensus.cc:348] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.570250 1167 raft_consensus.cc:374] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.570400 1167 raft_consensus.cc:729] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.566612 1166 ts_tablet_manager.cc:1918] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260620 07:01:17.571100 1166 log.cc:1196] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/610a25c729cf41b4bd71372bc36365a8
I20260620 07:01:17.571569 1166 ts_tablet_manager.cc:1939] T 610a25c729cf41b4bd71372bc36365a8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:17.572382 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 753) took 5800 ms. Trace:
I20260620 07:01:17.572572 1166 rpcz_store.cc:276] 0620 07:01:11.772094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.772770 (+ 676us) service_pool.cc:227] Handling call
0620 07:01:17.441168 (+5668398us) ts_tablet_manager.cc:1145] Deleting tablet 610a25c729cf41b4bd71372bc36365a8
0620 07:01:17.441433 (+ 265us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.539822 (+ 98389us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.566503 (+ 26681us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.572365 (+ 5862us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5653542}
I20260620 07:01:17.563544 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 4655d289c94c4bce9707be375fc4b850 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:17.550768 1169 ts_tablet_manager.cc:1918] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.573258 1169 log.cc:1196] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/a9daee42d5c748ceaed7dc94f551c0d1
I20260620 07:01:17.573706 1169 ts_tablet_manager.cc:1939] T a9daee42d5c748ceaed7dc94f551c0d1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:17.573709 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 610a25c729cf41b4bd71372bc36365a8 (table default.Table_b700a15c3ddb49248d638c0c8ea908bd [id=2b29e3533ace483db8c5f38a662f63f3]) successfully deleted
I20260620 07:01:17.573313 1167 consensus_queue.cc:260] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.574486 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 906) took 1886 ms. Trace:
I20260620 07:01:17.574633 1169 rpcz_store.cc:276] 0620 07:01:15.687818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.688398 (+ 580us) service_pool.cc:227] Handling call
0620 07:01:17.471910 (+1783512us) ts_tablet_manager.cc:1145] Deleting tablet a9daee42d5c748ceaed7dc94f551c0d1
0620 07:01:17.471926 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.547724 (+ 75798us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.550638 (+ 2914us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.574442 (+ 23804us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23043,"tablet-delete.queue_time_us":1782955}
I20260620 07:01:17.577877 1167 ts_tablet_manager.cc:1428] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260620 07:01:17.580574 1167 tablet_bootstrap.cc:492] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:17.581717 1165 ts_tablet_manager.cc:1918] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.581881 1165 log.cc:1196] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/3eda988492234d6aaeaee87f84f99d06
I20260620 07:01:17.582459 1170 tablet_bootstrap.cc:492] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:17.582451 1165 ts_tablet_manager.cc:1939] T 3eda988492234d6aaeaee87f84f99d06 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:17.582777 1170 ts_tablet_manager.cc:1397] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.065s user 0.000s sys 0.003s
I20260620 07:01:17.584071 1170 raft_consensus.cc:348] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.584309 1165 tablet_replica.cc:330] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:17.584646 1165 raft_consensus.cc:2229] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.584854 1165 raft_consensus.cc:2258] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.585342 1170 raft_consensus.cc:374] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.585484 1170 raft_consensus.cc:729] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.578048 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 762) took 5674 ms. Trace:
I20260620 07:01:17.585850 1166 rpcz_store.cc:276] 0620 07:01:11.903107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.903652 (+ 545us) service_pool.cc:227] Handling call
0620 07:01:17.574736 (+5671084us) ts_tablet_manager.cc:1145] Deleting tablet 4302edba0ec04d7abc2789bc7be1beca
0620 07:01:17.574746 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.578030 (+ 3284us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5640997}
W20260620 07:01:17.586400 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4302edba0ec04d7abc2789bc7be1beca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4302edba0ec04d7abc2789bc7be1beca already in progress: creating tablet
I20260620 07:01:17.586825 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 763) took 5683 ms. Trace:
I20260620 07:01:17.587709 1168 tablet_bootstrap.cc:654] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.586938 1166 rpcz_store.cc:276] 0620 07:01:11.903171 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.904786 (+ 1615us) service_pool.cc:227] Handling call
0620 07:01:17.586670 (+5681884us) ts_tablet_manager.cc:1145] Deleting tablet 45358f467b864c3284040893d7351b03
0620 07:01:17.586682 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.586806 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5631784}
W20260620 07:01:17.589128 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 45358f467b864c3284040893d7351b03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45358f467b864c3284040893d7351b03 already in progress: creating tablet
I20260620 07:01:17.589291 2346 raft_consensus.cc:482] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.589432 2346 raft_consensus.cc:504] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.590086 2346 leader_election.cc:288] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.590556 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 769) took 5685 ms. Trace:
I20260620 07:01:17.590637 1166 rpcz_store.cc:276] 0620 07:01:11.905332 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.905656 (+ 324us) service_pool.cc:227] Handling call
0620 07:01:17.590418 (+5684762us) ts_tablet_manager.cc:1145] Deleting tablet 29b8ce279cfe4684bd296a48e8783e1b
0620 07:01:17.590430 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.590538 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5631551}
I20260620 07:01:17.590911 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1c683a2169e4938b6941f83308cd392" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:17.591095 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 29b8ce279cfe4684bd296a48e8783e1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29b8ce279cfe4684bd296a48e8783e1b already in progress: creating tablet
I20260620 07:01:17.591053 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1c683a2169e4938b6941f83308cd392" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:17.591193 893 raft_consensus.cc:2454] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:17.587301 1170 consensus_queue.cc:260] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:17.591589 681 leader_election.cc:341] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.591814 1170 ts_tablet_manager.cc:1428] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260620 07:01:17.591949 683 leader_election.cc:302] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:17.592532 2346 raft_consensus.cc:2781] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:17.592651 2346 raft_consensus.cc:482] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:17.592736 2346 raft_consensus.cc:3037] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:17.595649 2346 raft_consensus.cc:504] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.596186 1166 tablet_replica.cc:330] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:17.596963 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1c683a2169e4938b6941f83308cd392" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:17.597198 893 raft_consensus.cc:3037] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:17.597373 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1c683a2169e4938b6941f83308cd392" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:17.597886 681 leader_election.cc:341] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.598049 2346 leader_election.cc:288] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.600906 893 raft_consensus.cc:2454] T a1c683a2169e4938b6941f83308cd392 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:17.601483 683 leader_election.cc:302] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:17.601598 1168 tablet_bootstrap.cc:492] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:17.601759 1168 ts_tablet_manager.cc:1397] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.005s
I20260620 07:01:17.602880 2346 raft_consensus.cc:2781] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:17.602779 1168 raft_consensus.cc:348] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.603150 1168 raft_consensus.cc:374] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.603228 1168 raft_consensus.cc:729] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.603518 2346 raft_consensus.cc:686] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:17.603554 1168 consensus_queue.cc:260] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.604032 2346 consensus_queue.cc:237] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.611313 1167 tablet_bootstrap.cc:654] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.610747 1168 ts_tablet_manager.cc:1428] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260620 07:01:17.613080 1170 tablet_bootstrap.cc:492] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:17.618955 715 tablet_service.cc:1514] Processing DeleteTablet for tablet a590f553b9e041c4830234897dbbf09f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:17.620249 1168 tablet_bootstrap.cc:492] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:17.613324 1166 raft_consensus.cc:2229] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.621068 1166 raft_consensus.cc:2258] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.621798 1166 ts_tablet_manager.cc:1905] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.622516 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 911) took 1934 ms. Trace:
I20260620 07:01:17.622651 1168 tablet_bootstrap.cc:654] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.626538 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet c8f81fa4e88945f1a392fbacfd031392 (table default.Table_a3dece319ace4b3c8341417bad1846e4 [id=0828a7e1651a4a46926570ca443cf647]) successfully deleted
I20260620 07:01:17.627509 1169 rpcz_store.cc:276] 0620 07:01:15.688386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.688878 (+ 492us) service_pool.cc:227] Handling call
0620 07:01:17.622310 (+1933432us) ts_tablet_manager.cc:1145] Deleting tablet 7a554c1eebd542619bb1989987a3d9a6
0620 07:01:17.622324 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.622466 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1933237}
I20260620 07:01:17.628170 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet eeb082e189304f13909d115f7197c5a1 (table default.Table_a40bbf24d40c42a693a3c8694f7dac84 [id=6bf90216e3494e01b7d8c51f68a83db0]) successfully deleted
I20260620 07:01:17.631022 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 905) took 1943 ms. Trace:
I20260620 07:01:17.631330 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet a9daee42d5c748ceaed7dc94f551c0d1 (table default.Table_659d4f17a45b47f5a065e40e30ab00b7 [id=88c48077ab69456c9d5241e3cd750089]) successfully deleted
I20260620 07:01:17.631711 1168 tablet_bootstrap.cc:492] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:17.631902 1168 ts_tablet_manager.cc:1397] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.010s
I20260620 07:01:17.633112 1168 raft_consensus.cc:348] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.633421 1168 raft_consensus.cc:374] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.633512 1168 raft_consensus.cc:729] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.633967 1170 tablet_bootstrap.cc:654] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.633805 1168 consensus_queue.cc:260] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:17.632184 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7a554c1eebd542619bb1989987a3d9a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a554c1eebd542619bb1989987a3d9a6 already in progress: creating tablet
I20260620 07:01:17.639642 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6b062b6459e8486c88d38312f5078599" } new_table_name: "default.Table_8bbfec3c96db4b6192dc005a4c789282" modify_external_catalogs: true
I20260620 07:01:17.646982 1168 ts_tablet_manager.cc:1428] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.015s user 0.002s sys 0.001s
I20260620 07:01:17.648204 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
W20260620 07:01:17.650368 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e41b3c6afb94142ba62f38948b6a355 consensus state has no leader
I20260620 07:01:17.633167 1169 rpcz_store.cc:276] 0620 07:01:15.687695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.691095 (+ 3400us) service_pool.cc:227] Handling call
0620 07:01:17.630849 (+1939754us) ts_tablet_manager.cc:1145] Deleting tablet 70f09b7dfdc1467eb47b8d7acb214919
0620 07:01:17.630863 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.630978 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1939523}
I20260620 07:01:17.657441 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 912) took 1948 ms. Trace:
I20260620 07:01:17.657565 1169 rpcz_store.cc:276] 0620 07:01:15.708753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.708812 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:17.657286 (+1948474us) ts_tablet_manager.cc:1145] Deleting tablet 7fb2d5c0f6d24969a0fea05a34fea00f
0620 07:01:17.657297 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.657404 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1948251}
I20260620 07:01:17.658048 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 904) took 1970 ms. Trace:
I20260620 07:01:17.658154 1169 rpcz_store.cc:276] 0620 07:01:15.687580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.725416 (+ 37836us) service_pool.cc:227] Handling call
0620 07:01:17.657950 (+1932534us) ts_tablet_manager.cc:1145] Deleting tablet fbb2fd1a8bb14f3e883a2efb6560d184
0620 07:01:17.657960 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.658035 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1932033}
I20260620 07:01:17.658474 1168 tablet_bootstrap.cc:492] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:17.658537 1169 tablet_replica.cc:330] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:17.661041 1167 tablet_bootstrap.cc:492] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:17.661206 1168 tablet_bootstrap.cc:654] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.661212 1167 ts_tablet_manager.cc:1397] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.081s user 0.006s sys 0.000s
I20260620 07:01:17.664584 1167 raft_consensus.cc:348] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.664844 1167 raft_consensus.cc:374] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.664920 1167 raft_consensus.cc:729] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.665139 1168 tablet_bootstrap.cc:492] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:17.665285 1168 ts_tablet_manager.cc:1397] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260620 07:01:17.665140 1167 consensus_queue.cc:260] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.665725 1167 ts_tablet_manager.cc:1428] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260620 07:01:17.666003 1167 tablet_bootstrap.cc:492] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:17.665956 1168 raft_consensus.cc:348] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.667534 1168 raft_consensus.cc:374] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.667606 1168 raft_consensus.cc:729] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.667789 1168 consensus_queue.cc:260] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.668637 1168 ts_tablet_manager.cc:1428] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:17.669129 1168 tablet_bootstrap.cc:492] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:17.670812 1168 tablet_bootstrap.cc:654] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.671249 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7e14acf1c0a24b5fb959872664181f23" } new_table_name: "default.Table_0ab928899b3146b7b2a5ca13688518bd" modify_external_catalogs: true
W20260620 07:01:17.677917 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5855497e5b22493bb60024d30cc23e03 consensus state has no leader
I20260620 07:01:17.679795 1166 ts_tablet_manager.cc:1918] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.680780 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_82448b58ee6d41c3b20be9d9a5a49592"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.681879 420 master_service.cc:946] ReplaceTablet: received request to replace tablet fe3b70b1674e43768b29dea84b09a1a0 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:17.682744 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_022c97d0b49b4f8a8fb16b578c3a9bd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.683238 1168 tablet_bootstrap.cc:492] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:17.683475 1168 ts_tablet_manager.cc:1397] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.002s
I20260620 07:01:17.684451 1168 raft_consensus.cc:348] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.684710 1168 raft_consensus.cc:374] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.684811 1168 raft_consensus.cc:729] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.685158 1168 consensus_queue.cc:260] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.686434 1168 ts_tablet_manager.cc:1428] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 07:01:17.687417 1168 tablet_bootstrap.cc:492] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:17.690338 2367 raft_consensus.cc:482] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.690485 2367 raft_consensus.cc:504] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.691140 2367 leader_election.cc:288] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.692692 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3b70b1674e43768b29dea84b09a1a0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:17.693034 749 raft_consensus.cc:2454] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:17.693414 1168 tablet_bootstrap.cc:654] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.586027 1165 ts_tablet_manager.cc:1905] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.699002 831 leader_election.cc:302] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:17.699344 2367 raft_consensus.cc:2781] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:17.699434 2367 raft_consensus.cc:482] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:17.699493 2367 raft_consensus.cc:3037] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:17.702044 2367 raft_consensus.cc:504] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.703285 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3b70b1674e43768b29dea84b09a1a0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:17.703500 752 raft_consensus.cc:3037] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:17.706085 752 raft_consensus.cc:2454] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:17.706664 831 leader_election.cc:302] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:17.707073 2366 raft_consensus.cc:2781] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:17.707227 2366 raft_consensus.cc:686] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:17.707114 2367 leader_election.cc:288] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.707571 2366 consensus_queue.cc:237] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.716396 2253 raft_consensus.cc:482] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.716552 2253 raft_consensus.cc:504] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.717067 2253 leader_election.cc:288] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.717625 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "302adda3630e44289d371de591061692" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:17.718317 831 leader_election.cc:341] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.718850 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_02d02883b6c246c780aa0e2d912752f2" } new_table_name: "default.Table_df0efea78a1c45a39d7163fa6a2c088c" modify_external_catalogs: true
I20260620 07:01:17.680054 2019 raft_consensus.cc:482] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.691751 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3b70b1674e43768b29dea84b09a1a0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:17.724414 1166 log.cc:1196] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f8ec1e179a704e5480f3deaf856156e7
I20260620 07:01:17.706501 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3b70b1674e43768b29dea84b09a1a0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:17.724922 1166 ts_tablet_manager.cc:1939] T f8ec1e179a704e5480f3deaf856156e7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:17.717696 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "302adda3630e44289d371de591061692" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:17.724949 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_900d2a2ae8934a659e9cb9a906c1480e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:17.725345 830 leader_election.cc:341] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:17.725643 830 leader_election.cc:341] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.724442 2019 raft_consensus.cc:504] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.725997 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1a65dfcfbc4448d284b3d53d977f42fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.726567 2019 leader_election.cc:288] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:17.728006 830 leader_election.cc:341] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.728117 830 leader_election.cc:302] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:17.728726 2253 raft_consensus.cc:2726] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.728813 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 770) took 5822 ms. Trace:
I20260620 07:01:17.728937 1166 rpcz_store.cc:276] 0620 07:01:11.905847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.905922 (+ 75us) service_pool.cc:227] Handling call
0620 07:01:17.596134 (+5690212us) ts_tablet_manager.cc:1145] Deleting tablet f8ec1e179a704e5480f3deaf856156e7
0620 07:01:17.596146 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.643981 (+ 47835us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.679664 (+ 35683us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.728789 (+ 49125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5636439}
W20260620 07:01:17.729297 969 leader_election.cc:341] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 39504144a623423c873ded7d6839367a
I20260620 07:01:17.729434 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 760) took 5826 ms. Trace:
I20260620 07:01:17.729552 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f8ec1e179a704e5480f3deaf856156e7 (table default.Table_09cc34c1ecf8432980b9247bf2be1e8d [id=0597dd0aeaa9466b8804375281de13b6]) successfully deleted
I20260620 07:01:17.729511 1166 rpcz_store.cc:276] 0620 07:01:11.902959 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.905987 (+ 3028us) service_pool.cc:227] Handling call
0620 07:01:17.729293 (+5823306us) ts_tablet_manager.cc:1145] Deleting tablet d612e9caa8b540b4b96860491d653f11
0620 07:01:17.729306 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.729416 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5749672}
I20260620 07:01:17.729822 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 773) took 5823 ms. Trace:
W20260620 07:01:17.729836 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d612e9caa8b540b4b96860491d653f11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d612e9caa8b540b4b96860491d653f11 already in progress: creating tablet
I20260620 07:01:17.729907 1166 rpcz_store.cc:276] 0620 07:01:11.906624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.906669 (+ 45us) service_pool.cc:227] Handling call
0620 07:01:17.729732 (+5823063us) ts_tablet_manager.cc:1145] Deleting tablet 0435678022914e6991c974e116d1a9f7
0620 07:01:17.729741 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.729808 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5750070}
I20260620 07:01:17.730294 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 764) took 5827 ms. Trace:
W20260620 07:01:17.730402 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0435678022914e6991c974e116d1a9f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0435678022914e6991c974e116d1a9f7 already in progress: creating tablet
I20260620 07:01:17.730376 1166 rpcz_store.cc:276] 0620 07:01:11.903252 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:11.903296 (+ 44us) service_pool.cc:227] Handling call
0620 07:01:17.730186 (+5826890us) ts_tablet_manager.cc:1145] Deleting tablet 80a83948f0424b47889f4be7fee15706
0620 07:01:17.730198 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.730279 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5749832}
W20260620 07:01:17.730566 968 leader_election.cc:341] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 39504144a623423c873ded7d6839367a
I20260620 07:01:17.730664 1166 tablet_replica.cc:330] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:17.730671 968 leader_election.cc:302] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:17.731032 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2584a6d508594c86a152889ab55197d8 consensus state has no leader
I20260620 07:01:17.731127 2019 raft_consensus.cc:2726] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.731446 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bbd40332020c4274afc8e651e5fa33d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:17.732551 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 80a83948f0424b47889f4be7fee15706 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80a83948f0424b47889f4be7fee15706 already in progress: creating tablet
I20260620 07:01:17.738267 1169 raft_consensus.cc:2229] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.746932 1169 raft_consensus.cc:2258] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.747772 1169 ts_tablet_manager.cc:1905] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.751803 1999 raft_consensus.cc:482] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.751959 1999 raft_consensus.cc:504] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.752583 1999 leader_election.cc:288] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:17.756948 1166 raft_consensus.cc:2229] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.757215 1166 raft_consensus.cc:2258] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.757985 1166 ts_tablet_manager.cc:1905] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:17.760805 969 leader_election.cc:341] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b5e08a38c42d4e3da20292343bf085b9
W20260620 07:01:17.764657 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 70f09b7dfdc1467eb47b8d7acb214919 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70f09b7dfdc1467eb47b8d7acb214919 already in progress: creating tablet
W20260620 07:01:17.765118 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a65dfcfbc4448d284b3d53d977f42fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:17.771306 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7fb2d5c0f6d24969a0fea05a34fea00f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fb2d5c0f6d24969a0fea05a34fea00f already in progress: creating tablet
W20260620 07:01:17.773855 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet fbb2fd1a8bb14f3e883a2efb6560d184 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbb2fd1a8bb14f3e883a2efb6560d184 already in progress: creating tablet
I20260620 07:01:17.774318 1167 tablet_bootstrap.cc:654] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.775611 1168 tablet_bootstrap.cc:492] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:17.775822 1168 ts_tablet_manager.cc:1397] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.089s user 0.004s sys 0.004s
I20260620 07:01:17.776618 1168 raft_consensus.cc:348] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:17.765307 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82448b58ee6d41c3b20be9d9a5a49592 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.779193 1168 raft_consensus.cc:374] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.781136 1168 raft_consensus.cc:729] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.781729 1168 consensus_queue.cc:260] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.787571 1166 ts_tablet_manager.cc:1918] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.787706 1166 log.cc:1196] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/261f0d97e1084e828b9562cb30ea422b
I20260620 07:01:17.787995 1166 ts_tablet_manager.cc:1939] T 261f0d97e1084e828b9562cb30ea422b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:17.788704 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 776) took 5702 ms. Trace:
I20260620 07:01:17.788801 1166 rpcz_store.cc:276] 0620 07:01:12.086468 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.090461 (+ 3993us) service_pool.cc:227] Handling call
0620 07:01:17.730619 (+5640158us) ts_tablet_manager.cc:1145] Deleting tablet 261f0d97e1084e828b9562cb30ea422b
0620 07:01:17.730629 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.784539 (+ 53910us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.787473 (+ 2934us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.788687 (+ 1214us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5639926}
I20260620 07:01:17.789168 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 777) took 5692 ms. Trace:
I20260620 07:01:17.789248 1166 rpcz_store.cc:276] 0620 07:01:12.096589 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.097605 (+ 1016us) service_pool.cc:227] Handling call
0620 07:01:17.789059 (+5691454us) ts_tablet_manager.cc:1145] Deleting tablet 70e7fada94584d68b287c2318e21d345
0620 07:01:17.789070 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.789155 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5691246}
I20260620 07:01:17.789537 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 774) took 5703 ms. Trace:
I20260620 07:01:17.789616 1166 rpcz_store.cc:276] 0620 07:01:12.086255 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.140005 (+ 53750us) service_pool.cc:227] Handling call
0620 07:01:17.789459 (+5649454us) ts_tablet_manager.cc:1145] Deleting tablet 89f5e2f055fb469dbbb935bba724dcb5
0620 07:01:17.789467 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.789526 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5649202}
I20260620 07:01:17.789916 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 775) took 5703 ms. Trace:
I20260620 07:01:17.789991 1166 rpcz_store.cc:276] 0620 07:01:12.086375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.141924 (+ 55549us) service_pool.cc:227] Handling call
0620 07:01:17.789834 (+5647910us) ts_tablet_manager.cc:1145] Deleting tablet 3d81d05b4b1646b4b1fa6577c149a7ad
0620 07:01:17.789842 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.789902 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5647386}
I20260620 07:01:17.790239 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 778) took 5613 ms. Trace:
I20260620 07:01:17.790309 1166 rpcz_store.cc:276] 0620 07:01:12.176836 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.176891 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:17.790162 (+5613271us) ts_tablet_manager.cc:1145] Deleting tablet 71977c69b29143eebfcc8ece39daf78e
0620 07:01:17.790169 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.790228 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5613048}
I20260620 07:01:17.790572 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 782) took 5467 ms. Trace:
I20260620 07:01:17.790645 1166 rpcz_store.cc:276] 0620 07:01:12.323110 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.323191 (+ 81us) service_pool.cc:227] Handling call
0620 07:01:17.790493 (+5467302us) ts_tablet_manager.cc:1145] Deleting tablet b1aed58dc714451b94fc9a6c14b7d734
0620 07:01:17.790503 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.790562 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5465234}
I20260620 07:01:17.791379 1165 ts_tablet_manager.cc:1918] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.791265 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_30d1afddb5ab451e977a6d13dacc3f1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.791628 1165 log.cc:1196] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/88c6aeea7c504f36964e8bf41b0fc4f9
W20260620 07:01:17.791990 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30d1afddb5ab451e977a6d13dacc3f1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:17.765198 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_022c97d0b49b4f8a8fb16b578c3a9bd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.794094 1167 tablet_bootstrap.cc:492] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:17.794219 1167 ts_tablet_manager.cc:1397] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.128s user 0.003s sys 0.000s
W20260620 07:01:17.765255 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_900d2a2ae8934a659e9cb9a906c1480e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.792312 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 261f0d97e1084e828b9562cb30ea422b (table default.Table_49629c65f95a46ff815a7d39c7143227 [id=466c737c0047420081fddb786a8093f3]) successfully deleted
W20260620 07:01:17.795946 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 70e7fada94584d68b287c2318e21d345 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70e7fada94584d68b287c2318e21d345 already in progress: creating tablet
W20260620 07:01:17.796161 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 89f5e2f055fb469dbbb935bba724dcb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89f5e2f055fb469dbbb935bba724dcb5 already in progress: creating tablet
W20260620 07:01:17.796314 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3d81d05b4b1646b4b1fa6577c149a7ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d81d05b4b1646b4b1fa6577c149a7ad already in progress: creating tablet
W20260620 07:01:17.796429 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 71977c69b29143eebfcc8ece39daf78e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71977c69b29143eebfcc8ece39daf78e already in progress: creating tablet
W20260620 07:01:17.796587 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b1aed58dc714451b94fc9a6c14b7d734 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1aed58dc714451b94fc9a6c14b7d734 already in progress: creating tablet
W20260620 07:01:17.765357 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbd40332020c4274afc8e651e5fa33d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.803026 1170 tablet_bootstrap.cc:492] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:17.803251 1170 ts_tablet_manager.cc:1397] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.190s user 0.024s sys 0.001s
I20260620 07:01:17.803874 1170 raft_consensus.cc:348] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.804117 1170 raft_consensus.cc:374] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.804193 1170 raft_consensus.cc:729] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.804399 1170 consensus_queue.cc:260] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.804915 1170 ts_tablet_manager.cc:1428] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:17.805209 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 783) took 5473 ms. Trace:
I20260620 07:01:17.805454 2359 raft_consensus.cc:482] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.805570 1170 tablet_bootstrap.cc:492] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:17.805570 2359 raft_consensus.cc:504] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.806203 2359 leader_election.cc:288] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.806839 1170 tablet_bootstrap.cc:654] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.806941 1166 rpcz_store.cc:276] 0620 07:01:12.331563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.331659 (+ 96us) service_pool.cc:227] Handling call
0620 07:01:17.805075 (+5473416us) ts_tablet_manager.cc:1145] Deleting tablet 20fc99f79e7b4df2b74a79468656b6ab
0620 07:01:17.805087 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.805189 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5473204}
I20260620 07:01:17.807274 1166 tablet_replica.cc:330] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:17.807322 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4655d289c94c4bce9707be375fc4b850" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:17.807476 1166 raft_consensus.cc:2229] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.807619 1166 raft_consensus.cc:2258] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.808102 1166 ts_tablet_manager.cc:1905] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.810331 1167 raft_consensus.cc:348] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.810671 1167 raft_consensus.cc:374] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:17.810811 1167 raft_consensus.cc:729] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:17.811084 1167 consensus_queue.cc:260] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.811692 1167 ts_tablet_manager.cc:1428] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260620 07:01:17.813220 1167 tablet_bootstrap.cc:492] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:17.808785 681 leader_election.cc:341] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.809458 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
W20260620 07:01:17.815075 683 leader_election.cc:341] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4655d289c94c4bce9707be375fc4b850
I20260620 07:01:17.815167 1167 tablet_bootstrap.cc:654] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:17.815325 683 leader_election.cc:302] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.815711 2359 raft_consensus.cc:2726] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:17.816708 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 20fc99f79e7b4df2b74a79468656b6ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20fc99f79e7b4df2b74a79468656b6ab already in progress: creating tablet
I20260620 07:01:17.792065 1165 ts_tablet_manager.cc:1939] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:17.820343 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 88c6aeea7c504f36964e8bf41b0fc4f9 (table default.Table_b0ba90ad7d404eefaffdd72e2bbd6645 [id=b6dc41e1ec4b4b8c9aa8583c725fa886]) successfully deleted
W20260620 07:01:17.820613 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 354937ee58ca4970b9ac211a369f1030 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 354937ee58ca4970b9ac211a369f1030 already in progress: creating tablet
W20260620 07:01:17.820809 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 848a456e584e466387057f98eeec44ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 848a456e584e466387057f98eeec44ba already in progress: creating tablet
I20260620 07:01:17.793171 1168 ts_tablet_manager.cc:1428] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260620 07:01:17.821274 1169 ts_tablet_manager.cc:1918] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:17.821441 1169 log.cc:1196] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ab60101b34144f85b0afd2e8c4846e48
I20260620 07:01:17.821856 1169 ts_tablet_manager.cc:1939] T ab60101b34144f85b0afd2e8c4846e48 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:17.822186 1168 tablet_bootstrap.cc:492] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:17.822322 1165 tablet_replica.cc:330] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:17.822546 1165 raft_consensus.cc:2229] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:17.823551 1165 pending_rounds.cc:62] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:17.823871 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dd64d961ce8f4ce7a9ad5110749d872c" } new_table_name: "default.Table_b9fb248283f045a98de6bafa82727011" modify_external_catalogs: true
I20260620 07:01:17.824012 1165 pending_rounds.cc:68] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821643093942272 op_type: NO_OP noop_request { }
I20260620 07:01:17.825012 1165 raft_consensus.cc:2866] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:17.825306 1165 raft_consensus.cc:2258] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.826632 1165 ts_tablet_manager.cc:1905] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.827436 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 914) took 1992 ms. Trace:
I20260620 07:01:17.827615 1169 rpcz_store.cc:276] 0620 07:01:15.835044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.835104 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:17.658497 (+1823393us) ts_tablet_manager.cc:1145] Deleting tablet ab60101b34144f85b0afd2e8c4846e48
0620 07:01:17.658506 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.784542 (+126036us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.788216 (+ 3674us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.827409 (+ 39193us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1823161}
I20260620 07:01:17.828713 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 915) took 1985 ms. Trace:
I20260620 07:01:17.828976 1169 rpcz_store.cc:276] 0620 07:01:15.843630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.845494 (+ 1864us) service_pool.cc:227] Handling call
0620 07:01:17.828448 (+1982954us) ts_tablet_manager.cc:1145] Deleting tablet 361dff84507843b5aeb2404b7245bf60
0620 07:01:17.828463 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.828668 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1982715}
I20260620 07:01:17.829885 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 917) took 1971 ms. Trace:
I20260620 07:01:17.830752 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ab60101b34144f85b0afd2e8c4846e48 (table default.Table_22154b88a133429f981e2e3a4d1fd4aa [id=76b0e45d4d264794a80b3293898b6064]) successfully deleted
I20260620 07:01:17.833302 1166 ts_tablet_manager.cc:1918] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:17.834739 1166 log.cc:1196] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f690e150839a4d23860932712f61e7c8
I20260620 07:01:17.836097 1166 ts_tablet_manager.cc:1939] T f690e150839a4d23860932712f61e7c8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:17.837391 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 785) took 5477 ms. Trace:
I20260620 07:01:17.843245 1166 rpcz_store.cc:276] 0620 07:01:12.359679 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.359741 (+ 62us) service_pool.cc:227] Handling call
0620 07:01:17.807234 (+5447493us) ts_tablet_manager.cc:1145] Deleting tablet f690e150839a4d23860932712f61e7c8
0620 07:01:17.807244 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.811190 (+ 3946us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.833163 (+ 21973us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.837373 (+ 4210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5447301}
I20260620 07:01:17.844197 1166 tablet_replica.cc:330] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:17.844792 1166 raft_consensus.cc:2229] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:17.845135 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 361dff84507843b5aeb2404b7245bf60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 361dff84507843b5aeb2404b7245bf60 already in progress: creating tablet
I20260620 07:01:17.844388 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f690e150839a4d23860932712f61e7c8 (table default.Table_52bd8cf613ad458b8436906e69e4cbd8 [id=72036a5a731244a4a1f797ec8663aef8]) successfully deleted
I20260620 07:01:17.846798 1166 raft_consensus.cc:2258] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.855537 2366 raft_consensus.cc:482] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.855765 2366 raft_consensus.cc:504] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.856588 2366 leader_election.cc:288] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.837687 2359 raft_consensus.cc:482] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.857293 2359 raft_consensus.cc:504] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.857442 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:17.857903 2359 leader_election.cc:288] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.839308 2346 raft_consensus.cc:482] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.847246 2210 raft_consensus.cc:482] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:17.858454 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:17.858585 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:17.858599 2210 raft_consensus.cc:504] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.858811 892 raft_consensus.cc:2454] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:17.859097 2210 leader_election.cc:288] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:17.859130 681 leader_election.cc:341] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.857024 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:17.859336 752 raft_consensus.cc:2454] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:17.859625 2346 raft_consensus.cc:504] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:17.859316 683 leader_election.cc:302] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:17.859781 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704e8aaabe6d40138b6611bdc30abf16" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:17.860174 683 leader_election.cc:341] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 704e8aaabe6d40138b6611bdc30abf16
I20260620 07:01:17.860180 2346 leader_election.cc:288] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:17.860378 2346 raft_consensus.cc:2781] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:17.860442 2346 raft_consensus.cc:482] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:17.860505 2346 raft_consensus.cc:3037] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:17.860457 681 leader_election.cc:341] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.860577 681 leader_election.cc:302] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.860692 831 leader_election.cc:302] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
W20260620 07:01:17.861213 683 leader_election.cc:341] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cf0bae39e1634710af12de493f7f58d5
I20260620 07:01:17.861316 2210 raft_consensus.cc:2726] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.861591 2366 raft_consensus.cc:2781] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:17.861687 2366 raft_consensus.cc:482] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:17.861768 2366 raft_consensus.cc:3037] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:17.863545 2346 raft_consensus.cc:504] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.864598 2346 leader_election.cc:288] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.864931 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:17.864802 1169 rpcz_store.cc:276] 0620 07:01:15.858086 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.858160 (+ 74us) service_pool.cc:227] Handling call
0620 07:01:17.829663 (+1971503us) ts_tablet_manager.cc:1145] Deleting tablet 8b2a9d1b793f4cb0a1ff7298e10c3162
0620 07:01:17.829677 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.829866 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1971064}
W20260620 07:01:17.865770 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 already in progress: creating tablet
W20260620 07:01:17.866056 681 leader_election.cc:341] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.866987 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0bae39e1634710af12de493f7f58d5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:17.867625 681 leader_election.cc:341] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.867755 681 leader_election.cc:302] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.868608 2210 raft_consensus.cc:2726] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:17.869007 830 leader_election.cc:341] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.867731 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 920) took 1932 ms. Trace:
I20260620 07:01:17.869133 1169 rpcz_store.cc:276] 0620 07:01:15.935241 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.935611 (+ 370us) service_pool.cc:227] Handling call
0620 07:01:17.867330 (+1931719us) ts_tablet_manager.cc:1145] Deleting tablet ffe453ce52ce406fad5206bdedad9ef0
0620 07:01:17.867342 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.867709 (+ 367us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1931520}
W20260620 07:01:17.869653 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ffe453ce52ce406fad5206bdedad9ef0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffe453ce52ce406fad5206bdedad9ef0 already in progress: creating tablet
I20260620 07:01:17.870481 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:17.870443 2366 raft_consensus.cc:504] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:17.871585 892 raft_consensus.cc:2379] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:01:17.871564 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 919) took 1939 ms. Trace:
I20260620 07:01:17.872117 683 leader_election.cc:302] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.872577 2210 raft_consensus.cc:2726] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.874260 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:17.874284 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:17.874611 752 raft_consensus.cc:2379] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 978f112862c64141b1009856bef3d624 in current term 1: Already voted for candidate 2b84cae646b24bc7bd424eb8434ad425 in this term.
W20260620 07:01:17.875056 830 leader_election.cc:341] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:17.875569 831 leader_election.cc:302] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:17.875864 2253 raft_consensus.cc:2726] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.875893 2366 leader_election.cc:288] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:17.876328 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_67eedfddcbdc4b76b0c7c0b2ee310376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:17.876878 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67eedfddcbdc4b76b0c7c0b2ee310376 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.878105 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4c854ad3f6644658bc1f28a9655a94a2" } modify_external_catalogs: true
I20260620 07:01:17.878407 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4c854ad3f6644658bc1f28a9655a94a2" } modify_external_catalogs: true
I20260620 07:01:17.879068 427 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 302adda3630e44289d371de591061692 (table default.Table_50157bc19fd44763b232e6927583f516 [id=92e4f74224ab4135982722f846eb9e73]). Expected version 2 got 0
I20260620 07:01:17.879962 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f8f12d1a288545379b3034aa4b6e6e68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:17.880420 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_21200189c9d144febf4465b5dd0ba8e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:17.880722 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8f12d1a288545379b3034aa4b6e6e68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:17.880903 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21200189c9d144febf4465b5dd0ba8e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:17.884944 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 2 got 0
I20260620 07:01:17.885299 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:17.887022 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:17.892241 867 tablet_service.cc:1467] Processing CreateTablet for tablet f83dc03de5ad407b85daff91e19ff012 (DEFAULT_TABLE table=default.Table_d5ce229059f94b59b8e4c882aba39374 [id=7826314a983940a89b9d33a3e5ad8b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.893100 996 tablet_service.cc:1467] Processing CreateTablet for tablet f83dc03de5ad407b85daff91e19ff012 (DEFAULT_TABLE table=default.Table_d5ce229059f94b59b8e4c882aba39374 [id=7826314a983940a89b9d33a3e5ad8b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.893631 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83dc03de5ad407b85daff91e19ff012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.895920 995 tablet_service.cc:1467] Processing CreateTablet for tablet 44eef5e59eaa4ad5a3c2758d30d298c1 (DEFAULT_TABLE table=default.Table_a91fa09ee722442bb26d79231bd672ad [id=f8e87684780448e38c0c0842314bc05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.896350 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44eef5e59eaa4ad5a3c2758d30d298c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.897038 874 tablet_service.cc:1467] Processing CreateTablet for tablet dc48ff87e84c473f9ba73d9232b1c6d7 (DEFAULT_TABLE table=default.Table_9a16fc4ee1f24bb095f9aaeee07780ed [id=ec3aa07c3bc542aa8c7a648b0d527da2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.897138 715 tablet_service.cc:1467] Processing CreateTablet for tablet f83dc03de5ad407b85daff91e19ff012 (DEFAULT_TABLE table=default.Table_d5ce229059f94b59b8e4c882aba39374 [id=7826314a983940a89b9d33a3e5ad8b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.897097 862 tablet_service.cc:1467] Processing CreateTablet for tablet 44eef5e59eaa4ad5a3c2758d30d298c1 (DEFAULT_TABLE table=default.Table_a91fa09ee722442bb26d79231bd672ad [id=f8e87684780448e38c0c0842314bc05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.897500 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83dc03de5ad407b85daff91e19ff012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.903772 733 tablet_service.cc:1467] Processing CreateTablet for tablet 44eef5e59eaa4ad5a3c2758d30d298c1 (DEFAULT_TABLE table=default.Table_a91fa09ee722442bb26d79231bd672ad [id=f8e87684780448e38c0c0842314bc05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.904178 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44eef5e59eaa4ad5a3c2758d30d298c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.906502 996 tablet_service.cc:1467] Processing CreateTablet for tablet dc48ff87e84c473f9ba73d9232b1c6d7 (DEFAULT_TABLE table=default.Table_9a16fc4ee1f24bb095f9aaeee07780ed [id=ec3aa07c3bc542aa8c7a648b0d527da2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.907006 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc48ff87e84c473f9ba73d9232b1c6d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:17.911162 968 leader_election.cc:341] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: b5e08a38c42d4e3da20292343bf085b9
I20260620 07:01:17.911324 968 leader_election.cc:302] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:17.911526 2019 raft_consensus.cc:2726] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:17.912395 1166 ts_tablet_manager.cc:1905] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.912626 715 tablet_service.cc:1467] Processing CreateTablet for tablet dc48ff87e84c473f9ba73d9232b1c6d7 (DEFAULT_TABLE table=default.Table_9a16fc4ee1f24bb095f9aaeee07780ed [id=ec3aa07c3bc542aa8c7a648b0d527da2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.913201 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc48ff87e84c473f9ba73d9232b1c6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.871647 1169 rpcz_store.cc:276] 0620 07:01:15.932222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.981001 (+ 48779us) service_pool.cc:227] Handling call
0620 07:01:17.871445 (+1890444us) ts_tablet_manager.cc:1145] Deleting tablet 0fd4539155d74bd082a0ce934e3126c5
0620 07:01:17.871459 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.871546 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1890142}
I20260620 07:01:17.933655 1166 ts_tablet_manager.cc:1918] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:17.934101 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 0fd4539155d74bd082a0ce934e3126c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd4539155d74bd082a0ce934e3126c5 already in progress: creating tablet
I20260620 07:01:17.934996 1166 log.cc:1196] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/39504144a623423c873ded7d6839367a
I20260620 07:01:17.935402 1166 ts_tablet_manager.cc:1939] T 39504144a623423c873ded7d6839367a P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:17.935763 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 784) took 5576 ms. Trace:
I20260620 07:01:17.935880 1166 rpcz_store.cc:276] 0620 07:01:12.359585 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.359751 (+ 166us) service_pool.cc:227] Handling call
0620 07:01:17.844129 (+5484378us) ts_tablet_manager.cc:1145] Deleting tablet 39504144a623423c873ded7d6839367a
0620 07:01:17.844146 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.916337 (+ 72191us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.933529 (+ 17192us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.935745 (+ 2216us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5484067}
I20260620 07:01:17.936332 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 39504144a623423c873ded7d6839367a (table default.Table_7146361681104709b5dfbac7fcecd7cd [id=07dc49586074421fa6e3b6ee862b8216]) successfully deleted
I20260620 07:01:17.936658 1166 tablet_replica.cc:330] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:17.936880 1166 raft_consensus.cc:2229] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:17.937252 1166 raft_consensus.cc:2258] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.937846 1166 ts_tablet_manager.cc:1905] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:17.946288 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b54ee547016d41d9abeb94ea26d0960f consensus state has no leader
I20260620 07:01:17.949362 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 2 got 0
I20260620 07:01:17.951084 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet e6bae5090f81417cbcf4b4d598b438da (table default.Table_2887bc68d41444e7a3da02fea7842d8d [id=e872cbca26c7448ea0b1e65fd692f96e]). Expected version 1 got 0
I20260620 07:01:17.956519 1169 tablet_replica.cc:330] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:17.957093 1169 raft_consensus.cc:2229] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:17.957553 1169 raft_consensus.cc:2258] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:17.959491 1169 ts_tablet_manager.cc:1905] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:17.960577 2360 tablet.cc:1722] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:17.966553 2400 tablet.cc:1722] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:17.969025 858 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd167f9f4e74611b3a5c5f89c65c702 (DEFAULT_TABLE table=default.Table_83336d879c48467589d9607e5d0096f3 [id=c5e8dc14defd4cc89be547aa56acff80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.969295 996 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd167f9f4e74611b3a5c5f89c65c702 (DEFAULT_TABLE table=default.Table_83336d879c48467589d9607e5d0096f3 [id=c5e8dc14defd4cc89be547aa56acff80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.970129 995 tablet_service.cc:1467] Processing CreateTablet for tablet 5843215411324504bc0d57139f650cc3 (DEFAULT_TABLE table=default.Table_be4d9d9276824bb4885ee335ba4e86da [id=29bf5a3485bd49daafcad45d6bf35d2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.970991 1166 ts_tablet_manager.cc:1918] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:17.970966 994 tablet_service.cc:1467] Processing CreateTablet for tablet cbd30082c16d48979d893d8777f9c2cf (DEFAULT_TABLE table=default.Table_2468c12d9c934cfcaee276fea69ac254 [id=a9ace2102c484084a06bb1db26005a74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.970989 857 tablet_service.cc:1467] Processing CreateTablet for tablet cbd30082c16d48979d893d8777f9c2cf (DEFAULT_TABLE table=default.Table_2468c12d9c934cfcaee276fea69ac254 [id=a9ace2102c484084a06bb1db26005a74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.971088 1166 log.cc:1196] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ba907170f2df4bd0b5e42d4c2d29b21e
I20260620 07:01:17.971305 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbd30082c16d48979d893d8777f9c2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.971472 1166 ts_tablet_manager.cc:1939] T ba907170f2df4bd0b5e42d4c2d29b21e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:17.974004 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 7d067448ff3c4faea9579eaaf29cd29f (DEFAULT_TABLE table=default.Table_1d3cbad85c554427ac7cb39c8275f6dc [id=786b16f0e27c41bd8a85d9b604518924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.974361 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d067448ff3c4faea9579eaaf29cd29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.974714 733 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd167f9f4e74611b3a5c5f89c65c702 (DEFAULT_TABLE table=default.Table_83336d879c48467589d9607e5d0096f3 [id=c5e8dc14defd4cc89be547aa56acff80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.975319 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd167f9f4e74611b3a5c5f89c65c702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.975482 861 tablet_service.cc:1467] Processing CreateTablet for tablet 5843215411324504bc0d57139f650cc3 (DEFAULT_TABLE table=default.Table_be4d9d9276824bb4885ee335ba4e86da [id=29bf5a3485bd49daafcad45d6bf35d2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.975986 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd167f9f4e74611b3a5c5f89c65c702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.977226 999 tablet_service.cc:1467] Processing CreateTablet for tablet 70e7267f9a63476aa7186e3c6a7c81e7 (DEFAULT_TABLE table=default.Table_75b3f0f8752e4c80ab14ac6376da9cb6 [id=0604d279005e4619961d9ce7281926b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.978417 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5843215411324504bc0d57139f650cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.979959 872 tablet_service.cc:1467] Processing CreateTablet for tablet 70e7267f9a63476aa7186e3c6a7c81e7 (DEFAULT_TABLE table=default.Table_75b3f0f8752e4c80ab14ac6376da9cb6 [id=0604d279005e4619961d9ce7281926b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.980002 860 tablet_service.cc:1467] Processing CreateTablet for tablet 7d067448ff3c4faea9579eaaf29cd29f (DEFAULT_TABLE table=default.Table_1d3cbad85c554427ac7cb39c8275f6dc [id=786b16f0e27c41bd8a85d9b604518924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.980477 865 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7aa6b156e84e708a3c6b3b32bce7c3 (DEFAULT_TABLE table=default.Table_31729b86132444c4b29a5b85590a8c7a [id=41125e53b12844de8f7ee12fef9e1d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.982479 1080 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:17.985690 731 tablet_service.cc:1467] Processing CreateTablet for tablet 5843215411324504bc0d57139f650cc3 (DEFAULT_TABLE table=default.Table_be4d9d9276824bb4885ee335ba4e86da [id=29bf5a3485bd49daafcad45d6bf35d2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.986107 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5843215411324504bc0d57139f650cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.986268 720 tablet_service.cc:1467] Processing CreateTablet for tablet cbd30082c16d48979d893d8777f9c2cf (DEFAULT_TABLE table=default.Table_2468c12d9c934cfcaee276fea69ac254 [id=a9ace2102c484084a06bb1db26005a74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.986621 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbd30082c16d48979d893d8777f9c2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:17.987196 719 tablet_service.cc:1467] Processing CreateTablet for tablet 70e7267f9a63476aa7186e3c6a7c81e7 (DEFAULT_TABLE table=default.Table_75b3f0f8752e4c80ab14ac6376da9cb6 [id=0604d279005e4619961d9ce7281926b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:17.987540 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e7267f9a63476aa7186e3c6a7c81e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.004858 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 786) took 5640 ms. Trace:
I20260620 07:01:18.005142 1166 rpcz_store.cc:276] 0620 07:01:12.364165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.364232 (+ 67us) service_pool.cc:227] Handling call
0620 07:01:17.936614 (+5572382us) ts_tablet_manager.cc:1145] Deleting tablet ba907170f2df4bd0b5e42d4c2d29b21e
0620 07:01:17.936625 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:17.940941 (+ 4316us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:17.970907 (+ 29966us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.004738 (+ 33831us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5544291}
I20260620 07:01:18.006436 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ba907170f2df4bd0b5e42d4c2d29b21e (table default.Table_155f286726eb4befbc18214b304e1db8 [id=156f143b869542dbac1e92fd120f0f36]) successfully deleted
I20260620 07:01:18.007269 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 792) took 5439 ms. Trace:
I20260620 07:01:18.008129 1166 rpcz_store.cc:276] 0620 07:01:12.567809 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.567871 (+ 62us) service_pool.cc:227] Handling call
0620 07:01:18.006974 (+5439103us) ts_tablet_manager.cc:1145] Deleting tablet 9e07325dc3f649aca9c5fc21c47d360f
0620 07:01:18.006991 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.007250 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5410644}
W20260620 07:01:18.009044 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9e07325dc3f649aca9c5fc21c47d360f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e07325dc3f649aca9c5fc21c47d360f already in progress: creating tablet
I20260620 07:01:18.010058 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 793) took 5442 ms. Trace:
I20260620 07:01:18.017097 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e7267f9a63476aa7186e3c6a7c81e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.017105 732 tablet_service.cc:1467] Processing CreateTablet for tablet 7d067448ff3c4faea9579eaaf29cd29f (DEFAULT_TABLE table=default.Table_1d3cbad85c554427ac7cb39c8275f6dc [id=786b16f0e27c41bd8a85d9b604518924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.017496 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d067448ff3c4faea9579eaaf29cd29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.025738 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e7267f9a63476aa7186e3c6a7c81e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.025962 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc48ff87e84c473f9ba73d9232b1c6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.026144 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbd30082c16d48979d893d8777f9c2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.026356 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d067448ff3c4faea9579eaaf29cd29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.026531 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83dc03de5ad407b85daff91e19ff012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.030413 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7aa6b156e84e708a3c6b3b32bce7c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.030535 1030 raft_consensus.cc:3037] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:18.030974 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5843215411324504bc0d57139f650cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.031149 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44eef5e59eaa4ad5a3c2758d30d298c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.034801 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd167f9f4e74611b3a5c5f89c65c702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.057596 1167 tablet_bootstrap.cc:492] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:18.057847 1167 ts_tablet_manager.cc:1397] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.245s user 0.006s sys 0.000s
I20260620 07:01:18.058166 1168 tablet_bootstrap.cc:654] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.058823 1167 raft_consensus.cc:348] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:18.059262 1167 raft_consensus.cc:374] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.059378 1167 raft_consensus.cc:729] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.059763 1167 consensus_queue.cc:260] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:18.061803 1170 tablet_bootstrap.cc:492] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.061980 1170 ts_tablet_manager.cc:1397] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.256s user 0.009s sys 0.029s
I20260620 07:01:18.010428 1166 rpcz_store.cc:276] 0620 07:01:12.567956 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.568097 (+ 141us) service_pool.cc:227] Handling call
0620 07:01:18.009579 (+5441482us) ts_tablet_manager.cc:1145] Deleting tablet 2823c6f6ab334550bbcff7eee49810c1
0620 07:01:18.009626 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.010038 (+ 412us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5413193}
W20260620 07:01:18.062870 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2823c6f6ab334550bbcff7eee49810c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2823c6f6ab334550bbcff7eee49810c1 already in progress: creating tablet
I20260620 07:01:18.062898 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 794) took 5432 ms. Trace:
I20260620 07:01:18.062892 1170 raft_consensus.cc:348] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.063074 1166 rpcz_store.cc:276] 0620 07:01:12.630499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.630545 (+ 46us) service_pool.cc:227] Handling call
0620 07:01:18.062741 (+5432196us) ts_tablet_manager.cc:1145] Deleting tablet 4b565f418cc54d77ba9d405a7d024646
0620 07:01:18.062751 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.062881 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5432017}
I20260620 07:01:18.063288 1170 raft_consensus.cc:374] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.063445 1170 raft_consensus.cc:729] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
W20260620 07:01:18.063640 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4b565f418cc54d77ba9d405a7d024646 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b565f418cc54d77ba9d405a7d024646 already in progress: creating tablet
I20260620 07:01:18.063807 1170 consensus_queue.cc:260] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.065585 1170 ts_tablet_manager.cc:1428] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 07:01:18.068804 1170 tablet_bootstrap.cc:492] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:18.070699 1170 tablet_bootstrap.cc:654] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.081519 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 29eb0db9b60f413ebce9ce16fe50aea4
I20260620 07:01:18.082747 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263
I20260620 07:01:18.083364 419 master_service.cc:946] ReplaceTablet: received request to replace tablet 2d1bad6b34f14270a060ce7245ff0c0f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:18.083809 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2e05786efb6341ea85fb3d3c42bd85d7
I20260620 07:01:18.084210 423 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42866 (request call id 1235) took 1066 ms. Trace:
I20260620 07:01:18.084360 423 rpcz_store.cc:276] 0620 07:01:17.017384 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.017431 (+ 47us) service_pool.cc:227] Handling call
0620 07:01:17.018008 (+ 577us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 07:01:17.018150 (+ 142us) catalog_manager.cc:2752] Modifying in-memory table state
0620 07:01:17.018236 (+ 86us) catalog_manager.cc:2761] Locking tablets
0620 07:01:17.877286 (+859050us) catalog_manager.cc:2775] Removing table and tablets from system table
0620 07:01:18.083646 (+206360us) catalog_manager.cc:2793] Removing table from by-name map
0620 07:01:18.083716 (+ 70us) catalog_manager.cc:2809] Committing in-memory state
0620 07:01:18.083752 (+ 36us) catalog_manager.cc:2813] Aborting table tasks
0620 07:01:18.084159 (+ 407us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:17.879440 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:17.879541 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:17.879546 (+ 5us) write_op.cc:435] Acquired schema lock
0620 07:01:17.879548 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:17.879662 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:17.879671 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:17.879676 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:17.879794 (+ 118us) tablet.cc:699] Row locks acquired
0620 07:01:17.879797 (+ 3us) write_op.cc:260] PREPARE: finished
0620 07:01:17.879826 (+ 29us) write_op.cc:270] Start()
0620 07:01:17.879857 (+ 31us) write_op.cc:276] Timestamp: P: 1781938877879747 usec, L: 0
0620 07:01:17.879861 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:17.880048 (+ 187us) log.cc:842] Serialized 722 byte log entry
0620 07:01:18.079211 (+199163us) op_driver.cc:444] REPLICATION: finished
0620 07:01:18.080390 (+ 1179us) write_op.cc:301] APPLY: starting
0620 07:01:18.080409 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:18.080436 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:18.080455 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:18.080501 (+ 46us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:18.080525 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0620 07:01:18.080531 (+ 6us) write_op.cc:312] APPLY: finished
0620 07:01:18.080580 (+ 49us) log.cc:842] Serialized 29 byte log entry
0620 07:01:18.080617 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:18.080629 (+ 12us) write_op.cc:454] Released schema lock
0620 07:01:18.080634 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:18.080680 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:18.080684 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1150,"apply.run_cpu_time_us":331,"apply.run_wall_time_us":330,"num_ops":2,"prepare.queue_time_us":1587,"prepare.run_cpu_time_us":690,"prepare.run_wall_time_us":690,"replication_time_us":199336,"spinlock_wait_cycles":56704,"threads_started":1}]]}
I20260620 07:01:18.085897 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 1d7cec62aea048d3bbe38ab2f83f7656 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:18.086863 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 29eb0db9b60f413ebce9ce16fe50aea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.087080 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.087929 1999 raft_consensus.cc:482] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b84cae646b24bc7bd424eb8434ad425)
I20260620 07:01:18.088121 1999 raft_consensus.cc:504] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:18.089013 1999 leader_election.cc:288] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:18.091672 1165 ts_tablet_manager.cc:1918] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:18.091825 1165 log.cc:1196] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/fe3b70b1674e43768b29dea84b09a1a0
I20260620 07:01:18.092284 1165 ts_tablet_manager.cc:1939] T fe3b70b1674e43768b29dea84b09a1a0 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:18.093811 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet fe3b70b1674e43768b29dea84b09a1a0 (table default.Table_ec98cedea527437ebc2237e75dcc45ec [id=55c4c9a5f69b4cf7bb05ce4157f8a5e8]) successfully deleted
I20260620 07:01:18.096841 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e05786efb6341ea85fb3d3c42bd85d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:18.097622 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e05786efb6341ea85fb3d3c42bd85d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:18.105615 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet a590f553b9e041c4830234897dbbf09f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a590f553b9e041c4830234897dbbf09f already in progress: creating tablet
I20260620 07:01:18.107939 1165 tablet_replica.cc:330] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:18.108479 1165 raft_consensus.cc:2229] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:18.111595 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:18.111900 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 29eb0db9b60f413ebce9ce16fe50aea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:18.098397 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:18.098377 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 29eb0db9b60f413ebce9ce16fe50aea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:18.113948 1165 raft_consensus.cc:2258] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.099256 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:18.109231 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e05786efb6341ea85fb3d3c42bd85d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:18.114708 1165 ts_tablet_manager.cc:1905] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.115947 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0891d6911d4bf8887f7e88a605aed5" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:18.116652 969 leader_election.cc:302] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.117062 1999 raft_consensus.cc:2726] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:18.121356 857 tablet_service.cc:1467] Processing CreateTablet for tablet 84c6ad4f5e5b43d9a25fbaaa3e789a69 (DEFAULT_TABLE table=default.Table_466db1e9c696430ca1b2fb643bdb5611 [id=845a703aeeb543dfb0f5fb0cf0837de6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.121974 995 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7aa6b156e84e708a3c6b3b32bce7c3 (DEFAULT_TABLE table=default.Table_31729b86132444c4b29a5b85590a8c7a [id=41125e53b12844de8f7ee12fef9e1d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.123037 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7aa6b156e84e708a3c6b3b32bce7c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.123353 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c6ad4f5e5b43d9a25fbaaa3e789a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.127451 1167 ts_tablet_manager.cc:1428] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.069s user 0.002s sys 0.000s
I20260620 07:01:18.127871 1167 tablet_bootstrap.cc:492] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:18.130720 733 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7aa6b156e84e708a3c6b3b32bce7c3 (DEFAULT_TABLE table=default.Table_31729b86132444c4b29a5b85590a8c7a [id=41125e53b12844de8f7ee12fef9e1d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.131413 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7aa6b156e84e708a3c6b3b32bce7c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.133646 1170 tablet_bootstrap.cc:492] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.133836 1170 ts_tablet_manager.cc:1397] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.002s
I20260620 07:01:18.134743 1170 raft_consensus.cc:348] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.135176 1170 raft_consensus.cc:374] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.135499 1170 raft_consensus.cc:729] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.135840 1170 consensus_queue.cc:260] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.136761 1170 ts_tablet_manager.cc:1428] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:18.137478 1170 tablet_bootstrap.cc:492] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:18.137594 996 tablet_service.cc:1467] Processing CreateTablet for tablet 84c6ad4f5e5b43d9a25fbaaa3e789a69 (DEFAULT_TABLE table=default.Table_466db1e9c696430ca1b2fb643bdb5611 [id=845a703aeeb543dfb0f5fb0cf0837de6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.138121 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c6ad4f5e5b43d9a25fbaaa3e789a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.139479 2019 raft_consensus.cc:482] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.139598 2019 raft_consensus.cc:504] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.140116 1170 tablet_bootstrap.cc:654] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.140209 2019 leader_election.cc:288] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:18.141357 968 leader_election.cc:341] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 89f5e2f055fb469dbbb935bba724dcb5
W20260620 07:01:18.142448 969 leader_election.cc:341] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 89f5e2f055fb469dbbb935bba724dcb5
I20260620 07:01:18.142675 969 leader_election.cc:302] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.143023 2019 raft_consensus.cc:2726] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.147979 720 tablet_service.cc:1467] Processing CreateTablet for tablet 84c6ad4f5e5b43d9a25fbaaa3e789a69 (DEFAULT_TABLE table=default.Table_466db1e9c696430ca1b2fb643bdb5611 [id=845a703aeeb543dfb0f5fb0cf0837de6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.148524 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c6ad4f5e5b43d9a25fbaaa3e789a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.149473 2360 tablet.cc:1722] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:18.182235 1170 tablet_bootstrap.cc:492] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.182636 1170 ts_tablet_manager.cc:1397] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.004s
I20260620 07:01:18.183535 1170 raft_consensus.cc:348] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.184608 1170 raft_consensus.cc:374] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.184835 1170 raft_consensus.cc:729] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.185323 1170 consensus_queue.cc:260] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.186468 1170 ts_tablet_manager.cc:1428] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:18.186566 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 795) took 5496 ms. Trace:
I20260620 07:01:18.186738 1166 rpcz_store.cc:276] 0620 07:01:12.690295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.690378 (+ 83us) service_pool.cc:227] Handling call
0620 07:01:18.186413 (+5496035us) ts_tablet_manager.cc:1145] Deleting tablet 39f1e3760868420d82ccf925e739e121
0620 07:01:18.186428 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.186542 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5495825}
I20260620 07:01:18.187131 1170 tablet_bootstrap.cc:492] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:18.187464 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 39f1e3760868420d82ccf925e739e121 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39f1e3760868420d82ccf925e739e121 already in progress: creating tablet
I20260620 07:01:18.188547 1170 tablet_bootstrap.cc:654] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.189313 2366 raft_consensus.cc:482] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.189510 2366 raft_consensus.cc:504] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.190263 2366 leader_election.cc:288] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.190541 999 tablet_service.cc:1467] Processing CreateTablet for tablet 9f0c037506384ea1afd233a53091c6b0 (DEFAULT_TABLE table=default.Table_d93d57c99d6f419f9d0a86faafba8f3a [id=61c67492c60b4c919541cdad5e29560d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.191073 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f0c037506384ea1afd233a53091c6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.191752 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a36a5319a044e9da7dc7b666484e257" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:18.192101 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 39504144a623423c873ded7d6839367a (table default.Table_7146361681104709b5dfbac7fcecd7cd [id=07dc49586074421fa6e3b6ee862b8216], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 39504144a623423c873ded7d6839367a consensus state has no leader
W20260620 07:01:18.192435 830 leader_election.cc:341] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.192751 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a36a5319a044e9da7dc7b666484e257" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:18.193318 831 leader_election.cc:341] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.193434 831 leader_election.cc:302] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:18.193985 2366 raft_consensus.cc:2726] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.194535 857 tablet_service.cc:1467] Processing CreateTablet for tablet 9f0c037506384ea1afd233a53091c6b0 (DEFAULT_TABLE table=default.Table_d93d57c99d6f419f9d0a86faafba8f3a [id=61c67492c60b4c919541cdad5e29560d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.195066 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f0c037506384ea1afd233a53091c6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.198324 2210 raft_consensus.cc:482] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.198465 2210 raft_consensus.cc:504] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.199155 2210 leader_election.cc:288] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.199641 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd75e318982a4fb9bf28cb35b030642f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:18.200213 681 leader_election.cc:341] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:18.200345 683 leader_election.cc:341] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cd75e318982a4fb9bf28cb35b030642f
I20260620 07:01:18.200495 683 leader_election.cc:302] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.200945 1166 tablet_replica.cc:330] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:18.200997 2210 raft_consensus.cc:2726] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.201263 1166 raft_consensus.cc:2229] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:18.201396 1170 tablet_bootstrap.cc:492] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.201565 1170 ts_tablet_manager.cc:1397] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260620 07:01:18.201560 1165 ts_tablet_manager.cc:1918] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:18.201666 1165 log.cc:1196] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/3651ef9790d342ec96f554134ae714dc
I20260620 07:01:18.201679 1166 raft_consensus.cc:2258] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.201673 733 tablet_service.cc:1467] Processing CreateTablet for tablet 9f0c037506384ea1afd233a53091c6b0 (DEFAULT_TABLE table=default.Table_d93d57c99d6f419f9d0a86faafba8f3a [id=61c67492c60b4c919541cdad5e29560d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.202128 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f0c037506384ea1afd233a53091c6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.202312 1166 ts_tablet_manager.cc:1905] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.202337 1170 raft_consensus.cc:348] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.202574 1170 raft_consensus.cc:374] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.202667 1170 raft_consensus.cc:729] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.201982 1165 ts_tablet_manager.cc:1939] T 3651ef9790d342ec96f554134ae714dc P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:18.203042 1170 consensus_queue.cc:260] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.203752 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 3651ef9790d342ec96f554134ae714dc (table default.Table_5f1815876abd4a8282d506949e5adcda [id=e6ffdd91974a44eabefbcf60974613cb]) successfully deleted
W20260620 07:01:18.204094 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 29eb0db9b60f413ebce9ce16fe50aea4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29eb0db9b60f413ebce9ce16fe50aea4 already in progress: creating tablet
W20260620 07:01:18.204377 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 because the tablet was not found. No further retry: Not found: Tablet not found: 2d01ac3dd3844ac6b3b9c9c9f86ad263
W20260620 07:01:18.204610 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2e05786efb6341ea85fb3d3c42bd85d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e05786efb6341ea85fb3d3c42bd85d7 already in progress: creating tablet
I20260620 07:01:18.207402 1170 ts_tablet_manager.cc:1428] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260620 07:01:18.207629 1167 tablet_bootstrap.cc:654] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.208287 1170 tablet_bootstrap.cc:492] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:18.211447 1170 tablet_bootstrap.cc:654] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.215811 999 tablet_service.cc:1467] Processing CreateTablet for tablet 557381d3c2d8498690c70128f67cfd1e (DEFAULT_TABLE table=default.Table_5987e1344b92480ebe6572fceadaf39e [id=297c24c8cf6645e7ba0f51ac6cd426b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.216327 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 557381d3c2d8498690c70128f67cfd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.216238 867 tablet_service.cc:1467] Processing CreateTablet for tablet 557381d3c2d8498690c70128f67cfd1e (DEFAULT_TABLE table=default.Table_5987e1344b92480ebe6572fceadaf39e [id=297c24c8cf6645e7ba0f51ac6cd426b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.216583 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 557381d3c2d8498690c70128f67cfd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.224465 2411 tablet.cc:1722] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:18.226241 1168 tablet_bootstrap.cc:492] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:18.226450 1168 ts_tablet_manager.cc:1397] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.404s user 0.009s sys 0.026s
I20260620 07:01:18.227274 1168 raft_consensus.cc:348] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.227425 1170 tablet_bootstrap.cc:492] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.227553 1170 ts_tablet_manager.cc:1397] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.002s
I20260620 07:01:18.227562 1168 raft_consensus.cc:374] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.227624 1168 raft_consensus.cc:729] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.227921 1168 consensus_queue.cc:260] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.228308 1170 raft_consensus.cc:348] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.228497 1168 ts_tablet_manager.cc:1428] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:18.228554 1170 raft_consensus.cc:374] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.228721 1170 raft_consensus.cc:729] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.229269 1170 consensus_queue.cc:260] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.235569 1170 ts_tablet_manager.cc:1428] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260620 07:01:18.235584 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c2a1e6f386db42e6ba9e4aa29d9f986f
I20260620 07:01:18.236451 418 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_d65dd044d2b645638bc5ed4451380807 [id=10e4dd185dca4e42ad74dfc50e7db3e9] alter complete (version 1)
I20260620 07:01:18.236490 1170 tablet_bootstrap.cc:492] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:18.238116 1168 tablet_bootstrap.cc:492] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:18.239898 867 tablet_service.cc:1514] Processing DeleteTablet for tablet c2a1e6f386db42e6ba9e4aa29d9f986f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.240145 1168 tablet_bootstrap.cc:654] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.238116 1170 tablet_bootstrap.cc:654] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:18.241284 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c2a1e6f386db42e6ba9e4aa29d9f986f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2a1e6f386db42e6ba9e4aa29d9f986f already in progress: creating tablet
W20260620 07:01:18.241475 393 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 75452.3us
I20260620 07:01:18.241729 422 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_edddb8415e3043bd8364bbb691528ebf [id=4e394c13e3214375a63a155d3a95d20b] alter complete (version 1)
I20260620 07:01:18.243268 1170 tablet_bootstrap.cc:492] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.243398 1170 ts_tablet_manager.cc:1397] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260620 07:01:18.244102 1170 raft_consensus.cc:348] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.244297 1170 raft_consensus.cc:374] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.244339 1170 raft_consensus.cc:729] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.244508 994 tablet_service.cc:1514] Processing DeleteTablet for tablet c2a1e6f386db42e6ba9e4aa29d9f986f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:18.244709 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet ba907170f2df4bd0b5e42d4c2d29b21e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:18.245400 731 tablet_service.cc:1514] Processing DeleteTablet for tablet c2a1e6f386db42e6ba9e4aa29d9f986f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:17 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:18.245574 720 tablet_service.cc:1467] Processing CreateTablet for tablet 557381d3c2d8498690c70128f67cfd1e (DEFAULT_TABLE table=default.Table_5987e1344b92480ebe6572fceadaf39e [id=297c24c8cf6645e7ba0f51ac6cd426b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.246167 1170 consensus_queue.cc:260] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.247560 1170 ts_tablet_manager.cc:1428] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 07:01:18.261153 1011 tablet_service.cc:1467] Processing CreateTablet for tablet c4b3bb7a8c1f404b9744fd63bbe62c83 (DEFAULT_TABLE table=default.Table_d158029631994114988cdbd6ea1888d1 [id=d71c1c4cec764e9d8e7c094cf81fdd79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.261605 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4b3bb7a8c1f404b9744fd63bbe62c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.265331 1167 tablet_bootstrap.cc:492] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:18.265478 1167 ts_tablet_manager.cc:1397] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.138s user 0.003s sys 0.000s
I20260620 07:01:18.266291 1167 raft_consensus.cc:348] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:18.266477 1167 raft_consensus.cc:374] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.266530 1167 raft_consensus.cc:729] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.266721 1167 consensus_queue.cc:260] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:18.267254 1167 ts_tablet_manager.cc:1428] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:18.267486 1167 tablet_bootstrap.cc:492] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:18.269163 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 394d3124d03a438aa31d94967487b4be (DEFAULT_TABLE table=default.Table_b5d2eb86f6bc4e668432323c020f4560 [id=62985f7656e64d3a8c9451c3de768df9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.269536 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394d3124d03a438aa31d94967487b4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.269464 994 tablet_service.cc:1467] Processing CreateTablet for tablet e2031edb67194127bcfe98fd4e47bf2d (DEFAULT_TABLE table=default.Table_27d83c05f310476ca4266dc0b9b58ab5 [id=5544b240418744bc91b8b8b9bd2c759c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.269752 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2031edb67194127bcfe98fd4e47bf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.270026 1001 tablet_service.cc:1467] Processing CreateTablet for tablet d354a36489014c16abf22e244349c95e (DEFAULT_TABLE table=default.Table_72beaf5462364dd7930966b62a3d6717 [id=1a7e0f79e6c14c23820d52ca234e1301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.270339 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d354a36489014c16abf22e244349c95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.273067 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 6dfa946f7c9e4cd28b6c0fdd9963738d (DEFAULT_TABLE table=default.Table_f26bb7c751c047a4959b5889562e539b [id=f74bb39944104ddeb21e0d2b670cd3bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.273420 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dfa946f7c9e4cd28b6c0fdd9963738d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.277231 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac711276e1e4febb408a374648db60b (DEFAULT_TABLE table=default.Table_a3ef4087b9fd4da48145c06945728af0 [id=47769abcb8bb403e8cea94ade05ebc98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.281260 867 tablet_service.cc:1467] Processing CreateTablet for tablet e2031edb67194127bcfe98fd4e47bf2d (DEFAULT_TABLE table=default.Table_27d83c05f310476ca4266dc0b9b58ab5 [id=5544b240418744bc91b8b8b9bd2c759c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.281675 858 tablet_service.cc:1467] Processing CreateTablet for tablet 1aea2a38bd5044aca80fee266c65caa0 (DEFAULT_TABLE table=default.Table_6c57eb996eb043cbbaa95debde14f72f [id=bb8eccc3d5a84561b365363eea3accd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.281915 874 tablet_service.cc:1467] Processing CreateTablet for tablet 394d3124d03a438aa31d94967487b4be (DEFAULT_TABLE table=default.Table_b5d2eb86f6bc4e668432323c020f4560 [id=62985f7656e64d3a8c9451c3de768df9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.282231 872 tablet_service.cc:1467] Processing CreateTablet for tablet 6dfa946f7c9e4cd28b6c0fdd9963738d (DEFAULT_TABLE table=default.Table_f26bb7c751c047a4959b5889562e539b [id=f74bb39944104ddeb21e0d2b670cd3bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.282650 860 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac711276e1e4febb408a374648db60b (DEFAULT_TABLE table=default.Table_a3ef4087b9fd4da48145c06945728af0 [id=47769abcb8bb403e8cea94ade05ebc98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.281946 862 tablet_service.cc:1467] Processing CreateTablet for tablet d354a36489014c16abf22e244349c95e (DEFAULT_TABLE table=default.Table_72beaf5462364dd7930966b62a3d6717 [id=1a7e0f79e6c14c23820d52ca234e1301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.281701 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2031edb67194127bcfe98fd4e47bf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.284691 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394d3124d03a438aa31d94967487b4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.284966 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aea2a38bd5044aca80fee266c65caa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.285866 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d354a36489014c16abf22e244349c95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.287602 1168 tablet_bootstrap.cc:492] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:18.287725 1168 ts_tablet_manager.cc:1397] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.000s
I20260620 07:01:18.288396 1168 raft_consensus.cc:348] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.288599 1168 raft_consensus.cc:374] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.288650 1168 raft_consensus.cc:729] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.288837 1168 consensus_queue.cc:260] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.289831 1168 ts_tablet_manager.cc:1428] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:18.290094 1168 tablet_bootstrap.cc:492] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:18.291018 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac711276e1e4febb408a374648db60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.291510 1168 tablet_bootstrap.cc:654] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.293349 1169 ts_tablet_manager.cc:1918] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:18.293521 1169 log.cc:1196] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/7cf81c5c0d9744f5a8c3f0866a435ae3
I20260620 07:01:18.293933 1169 ts_tablet_manager.cc:1939] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:18.295043 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dfa946f7c9e4cd28b6c0fdd9963738d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.303886 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_41998d0ef447409ca36946bbe2f01936"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:18.304629 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41998d0ef447409ca36946bbe2f01936 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:18.307564 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d82480660a9a4d358324cb6f84fdb341" } new_table_name: "default.Table_ace112cdfa4542c688a64271d6530be8" modify_external_catalogs: true
I20260620 07:01:18.308887 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8f940313465e4afa9bc6d1a6a27c8467" } new_table_name: "default.Table_633441e84b94415b92ea2531d625a89a" modify_external_catalogs: true
I20260620 07:01:18.310395 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_50157bc19fd44763b232e6927583f516" } new_table_name: "default.Table_443cffc65b664caf91066d86837262e1" modify_external_catalogs: true
I20260620 07:01:18.312923 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2f5cab7043db44b18d164d5864ce8b51" } new_table_name: "default.Table_dded8d9a854f4910a34639f2693e73a1" modify_external_catalogs: true
I20260620 07:01:18.315177 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_83d56d1245704fd3935391f2558b3e89" } modify_external_catalogs: true
I20260620 07:01:18.315349 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_83d56d1245704fd3935391f2558b3e89" } modify_external_catalogs: true
I20260620 07:01:18.320782 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:18.321077 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]). Expected version 3 got 0
I20260620 07:01:18.323704 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f5e2f055fb469dbbb935bba724dcb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:18.325529 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 04db48e910514d46bb4deb9acf54f7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:18.325893 867 tablet_service.cc:1467] Processing CreateTablet for tablet 5b7a2b791f154fb38a26033fcfce2398 (DEFAULT_TABLE table=default.Table_923c108a61e44c338c767ff9ab8e000f [id=716d58e3d27342bb9a33dc786c86c8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.326551 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b7a2b791f154fb38a26033fcfce2398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.326993 858 tablet_service.cc:1467] Processing CreateTablet for tablet b09f83cd81ce404d9738bbad2ad671cc (DEFAULT_TABLE table=default.Table_2478c0ed7b254bec883d76e134a5a88a [id=8b361a6ea11544d18e63105583b2930c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.327584 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 5b7a2b791f154fb38a26033fcfce2398 (DEFAULT_TABLE table=default.Table_923c108a61e44c338c767ff9ab8e000f [id=716d58e3d27342bb9a33dc786c86c8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.328038 731 tablet_service.cc:1467] Processing CreateTablet for tablet c4b3bb7a8c1f404b9744fd63bbe62c83 (DEFAULT_TABLE table=default.Table_d158029631994114988cdbd6ea1888d1 [id=d71c1c4cec764e9d8e7c094cf81fdd79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.328421 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4b3bb7a8c1f404b9744fd63bbe62c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.329411 996 tablet_service.cc:1467] Processing CreateTablet for tablet 1aea2a38bd5044aca80fee266c65caa0 (DEFAULT_TABLE table=default.Table_6c57eb996eb043cbbaa95debde14f72f [id=bb8eccc3d5a84561b365363eea3accd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.329973 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b09f83cd81ce404d9738bbad2ad671cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.331521 719 tablet_service.cc:1467] Processing CreateTablet for tablet e2031edb67194127bcfe98fd4e47bf2d (DEFAULT_TABLE table=default.Table_27d83c05f310476ca4266dc0b9b58ab5 [id=5544b240418744bc91b8b8b9bd2c759c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.332054 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2031edb67194127bcfe98fd4e47bf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.332134 995 tablet_service.cc:1467] Processing CreateTablet for tablet b09f83cd81ce404d9738bbad2ad671cc (DEFAULT_TABLE table=default.Table_2478c0ed7b254bec883d76e134a5a88a [id=8b361a6ea11544d18e63105583b2930c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.332132 715 tablet_service.cc:1467] Processing CreateTablet for tablet d354a36489014c16abf22e244349c95e (DEFAULT_TABLE table=default.Table_72beaf5462364dd7930966b62a3d6717 [id=1a7e0f79e6c14c23820d52ca234e1301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.332490 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d354a36489014c16abf22e244349c95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.334822 732 tablet_service.cc:1467] Processing CreateTablet for tablet 394d3124d03a438aa31d94967487b4be (DEFAULT_TABLE table=default.Table_b5d2eb86f6bc4e668432323c020f4560 [id=62985f7656e64d3a8c9451c3de768df9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.335080 722 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac711276e1e4febb408a374648db60b (DEFAULT_TABLE table=default.Table_a3ef4087b9fd4da48145c06945728af0 [id=47769abcb8bb403e8cea94ade05ebc98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.335282 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394d3124d03a438aa31d94967487b4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.335481 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac711276e1e4febb408a374648db60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.336232 2019 raft_consensus.cc:482] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.336369 2019 raft_consensus.cc:504] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:18.337000 2019 leader_election.cc:288] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:18.338011 968 leader_election.cc:341] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: eea1525b54cc42b78180ba6867957f76
W20260620 07:01:18.338935 969 leader_election.cc:341] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: eea1525b54cc42b78180ba6867957f76
I20260620 07:01:18.339042 969 leader_election.cc:302] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.339272 725 tablet_service.cc:1467] Processing CreateTablet for tablet 6dfa946f7c9e4cd28b6c0fdd9963738d (DEFAULT_TABLE table=default.Table_f26bb7c751c047a4959b5889562e539b [id=f74bb39944104ddeb21e0d2b670cd3bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.339478 2019 raft_consensus.cc:2726] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.339834 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dfa946f7c9e4cd28b6c0fdd9963738d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.340690 729 tablet_service.cc:1467] Processing CreateTablet for tablet 5b7a2b791f154fb38a26033fcfce2398 (DEFAULT_TABLE table=default.Table_923c108a61e44c338c767ff9ab8e000f [id=716d58e3d27342bb9a33dc786c86c8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.340759 726 tablet_service.cc:1467] Processing CreateTablet for tablet b09f83cd81ce404d9738bbad2ad671cc (DEFAULT_TABLE table=default.Table_2478c0ed7b254bec883d76e134a5a88a [id=8b361a6ea11544d18e63105583b2930c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.341075 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b7a2b791f154fb38a26033fcfce2398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.341274 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b09f83cd81ce404d9738bbad2ad671cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.340762 734 tablet_service.cc:1467] Processing CreateTablet for tablet 1aea2a38bd5044aca80fee266c65caa0 (DEFAULT_TABLE table=default.Table_6c57eb996eb043cbbaa95debde14f72f [id=bb8eccc3d5a84561b365363eea3accd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.342525 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aea2a38bd5044aca80fee266c65caa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.347517 1170 tablet_bootstrap.cc:492] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:18.349335 1170 tablet_bootstrap.cc:654] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.353189 858 tablet_service.cc:1467] Processing CreateTablet for tablet eb4d9534187f44af9dfe0134cf0f1620 (DEFAULT_TABLE table=default.Table_8eb6ccb773d14188b66a1af0fd3252e1 [id=1f644686880748ada8508a66824b2aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.353703 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb4d9534187f44af9dfe0134cf0f1620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.358176 2366 raft_consensus.cc:482] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.358469 2366 raft_consensus.cc:504] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.359135 2253 raft_consensus.cc:482] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.359254 2253 raft_consensus.cc:504] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.359520 999 tablet_service.cc:1467] Processing CreateTablet for tablet eb4d9534187f44af9dfe0134cf0f1620 (DEFAULT_TABLE table=default.Table_8eb6ccb773d14188b66a1af0fd3252e1 [id=1f644686880748ada8508a66824b2aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.359797 2253 leader_election.cc:288] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.360350 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e70b585def4a4a9081a0938af8ce5b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:18.360811 2366 leader_election.cc:288] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.360780 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e70b585def4a4a9081a0938af8ce5b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:18.361681 831 leader_election.cc:341] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:18.361900 830 leader_election.cc:341] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.361992 830 leader_election.cc:302] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:18.361951 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06fd96feb4a74b9f8d3243b7d774f388" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:18.362356 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06fd96feb4a74b9f8d3243b7d774f388" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:18.362641 831 leader_election.cc:341] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.362869 2366 raft_consensus.cc:2726] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:18.362985 830 leader_election.cc:341] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.363075 830 leader_election.cc:302] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:18.363596 2366 raft_consensus.cc:2726] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.367951 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aea2a38bd5044aca80fee266c65caa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.368602 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb4d9534187f44af9dfe0134cf0f1620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.369069 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b09f83cd81ce404d9738bbad2ad671cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.370920 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b7a2b791f154fb38a26033fcfce2398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.371378 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac711276e1e4febb408a374648db60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.375005 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 1be799b684ec46c9878a3555f7133e09 (DEFAULT_TABLE table=default.Table_d93e7060309143e88364bc7045d58c42 [id=c0c8c8fe0b71420d9562fbc9b4733640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.375486 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1be799b684ec46c9878a3555f7133e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.376127 1168 tablet_bootstrap.cc:492] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:18.376263 1168 ts_tablet_manager.cc:1397] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.007s
I20260620 07:01:18.376986 1168 raft_consensus.cc:348] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.377182 1168 raft_consensus.cc:374] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.377223 1168 raft_consensus.cc:729] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.377413 1168 consensus_queue.cc:260] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.377926 1168 ts_tablet_manager.cc:1428] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:18.378171 1168 tablet_bootstrap.cc:492] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:18.379113 874 tablet_service.cc:1467] Processing CreateTablet for tablet 1be799b684ec46c9878a3555f7133e09 (DEFAULT_TABLE table=default.Table_d93e7060309143e88364bc7045d58c42 [id=c0c8c8fe0b71420d9562fbc9b4733640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.379383 715 tablet_service.cc:1467] Processing CreateTablet for tablet 1be799b684ec46c9878a3555f7133e09 (DEFAULT_TABLE table=default.Table_d93e7060309143e88364bc7045d58c42 [id=c0c8c8fe0b71420d9562fbc9b4733640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.379707 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1be799b684ec46c9878a3555f7133e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.379755 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1be799b684ec46c9878a3555f7133e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.326596 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2f3beeb172c74e62bdfa32b0f78ee03e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:18.382418 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f3beeb172c74e62bdfa32b0f78ee03e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:18.384066 1168 tablet_bootstrap.cc:654] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.385466 2366 raft_consensus.cc:482] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.385614 2366 raft_consensus.cc:504] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.386379 2366 leader_election.cc:288] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.390354 719 tablet_service.cc:1467] Processing CreateTablet for tablet eb4d9534187f44af9dfe0134cf0f1620 (DEFAULT_TABLE table=default.Table_8eb6ccb773d14188b66a1af0fd3252e1 [id=1f644686880748ada8508a66824b2aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.390774 418 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_3122a50618184dc7bf7cb696dca2a55b [id=d55d6c70a1b34227b4820944e280fde8] alter complete (version 1)
W20260620 07:01:18.392027 418 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.1:52621 (request call id 118) took 770 ms (client timeout 1000 ms). Trace:
W20260620 07:01:18.392150 418 rpcz_store.cc:269] 0620 07:01:17.621536 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.622864 (+ 1328us) service_pool.cc:227] Handling call
0620 07:01:18.391956 (+769092us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:17.887118 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:17.887193 (+ 75us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:17.887197 (+ 4us) write_op.cc:435] Acquired schema lock
0620 07:01:17.887199 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:17.887280 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:17.887290 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:17.887296 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:17.887347 (+ 51us) tablet.cc:699] Row locks acquired
0620 07:01:17.887351 (+ 4us) write_op.cc:260] PREPARE: finished
0620 07:01:17.887768 (+ 417us) write_op.cc:270] Start()
0620 07:01:17.887798 (+ 30us) write_op.cc:276] Timestamp: P: 1781938877887301 usec, L: 0
0620 07:01:17.887801 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:17.887916 (+ 115us) log.cc:842] Serialized 356 byte log entry
0620 07:01:18.231191 (+343275us) op_driver.cc:444] REPLICATION: finished
0620 07:01:18.231966 (+ 775us) write_op.cc:301] APPLY: starting
0620 07:01:18.231977 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:18.232000 (+ 23us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:18.232022 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:18.232073 (+ 51us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:18.232095 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:18.232101 (+ 6us) write_op.cc:312] APPLY: finished
0620 07:01:18.232283 (+ 182us) log.cc:842] Serialized 23 byte log entry
0620 07:01:18.232349 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:18.232359 (+ 10us) write_op.cc:454] Released schema lock
0620 07:01:18.232363 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:18.232412 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:18.232415 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0620 07:01:18.239157 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:18.239293 (+ 136us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:18.239301 (+ 8us) write_op.cc:435] Acquired schema lock
0620 07:01:18.239305 (+ 4us) tablet.cc:660] Decoding operations
0620 07:01:18.239444 (+ 139us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:18.239460 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:18.239467 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:18.239544 (+ 77us) tablet.cc:699] Row locks acquired
0620 07:01:18.239548 (+ 4us) write_op.cc:260] PREPARE: finished
0620 07:01:18.239592 (+ 44us) write_op.cc:270] Start()
0620 07:01:18.239630 (+ 38us) write_op.cc:276] Timestamp: P: 1781938878239549 usec, L: 0
0620 07:01:18.239636 (+ 6us) op_driver.cc:331] REPLICATION: starting
0620 07:01:18.311022 (+ 71386us) log.cc:842] Serialized 356 byte log entry
0620 07:01:18.311232 (+ 210us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x615000033024. stack: 00007f2486e7566e 00007f2486e75430 00007f2485efc5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f2492383d02 00007f24936b67f1 00007f24936b5359 00007f24936bd1bb 00007f24936bd038 00000000009edb7c 00007f2486ebb344 00007f2486ebe91b 00007f2486ebe798 00000000009edb7c
0620 07:01:18.389898 (+ 78666us) op_driver.cc:444] REPLICATION: finished
0620 07:01:18.390169 (+ 271us) write_op.cc:301] APPLY: starting
0620 07:01:18.390187 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:18.390230 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:18.390232 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:18.390304 (+ 72us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:18.390349 (+ 45us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:18.390355 (+ 6us) write_op.cc:312] APPLY: finished
0620 07:01:18.390462 (+ 107us) log.cc:842] Serialized 23 byte log entry
0620 07:01:18.390538 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:18.390562 (+ 24us) write_op.cc:454] Released schema lock
0620 07:01:18.390572 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:18.390641 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:18.390646 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":725,"apply.run_cpu_time_us":441,"apply.run_wall_time_us":494,"num_ops":1,"prepare.queue_time_us":860,"prepare.run_cpu_time_us":486,"prepare.run_wall_time_us":838,"replication_time_us":343372,"spinlock_wait_cycles":9600}],["op",{"apply.queue_time_us":218,"apply.run_cpu_time_us":542,"apply.run_wall_time_us":542,"num_ops":1,"prepare.queue_time_us":1850,"prepare.run_cpu_time_us":1652,"prepare.run_wall_time_us":72148,"raft.queue_time_us":1066,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":258,"replication_time_us":150234,"spinlock_wait_cycles":163652864}]]}
I20260620 07:01:18.398034 874 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.398264 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b878def9344cbdae65b209cac4067f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.398042 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a36a5319a044e9da7dc7b666484e257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.398443 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 125e8a5e20bf484cade408f0358489a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 48726d9a3aa745fca3bcd9b6e8807c49) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.398613 1165 tablet_replica.cc:330] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:18.398746 1168 tablet_bootstrap.cc:492] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:18.398878 1165 raft_consensus.cc:2229] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:18.399050 1165 raft_consensus.cc:2258] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:18.399401 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fe3b70b1674e43768b29dea84b09a1a0 because the tablet was not found. No further retry: Not found: Tablet not found: fe3b70b1674e43768b29dea84b09a1a0
I20260620 07:01:18.399506 1165 ts_tablet_manager.cc:1905] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.399677 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25b878def9344cbdae65b209cac4067f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:18.393316 2210 raft_consensus.cc:482] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.399909 2210 raft_consensus.cc:504] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.400213 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:18.400261 830 leader_election.cc:341] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.400542 2210 leader_election.cc:288] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.395956 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25b878def9344cbdae65b209cac4067f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:18.401242 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3456cf91d65a4413a35efe94513c723d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:18.401726 681 leader_election.cc:341] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:18.402350 831 leader_election.cc:341] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.402462 831 leader_election.cc:302] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:18.402599 831 raft_consensus.cc:2670] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:18.402884 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 7294e5678ad44622a3249c1113b5e297 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.403043 872 tablet_service.cc:1514] Processing DeleteTablet for tablet d53c90eff33044479838ff67dea93057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:18.403754 683 leader_election.cc:341] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3456cf91d65a4413a35efe94513c723d
I20260620 07:01:18.403861 683 leader_election.cc:302] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.404213 2210 raft_consensus.cc:2726] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.404659 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb4d9534187f44af9dfe0134cf0f1620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.405815 1165 ts_tablet_manager.cc:1918] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:18.405925 1165 log.cc:1196] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/25b878def9344cbdae65b209cac4067f
I20260620 07:01:18.406188 1165 ts_tablet_manager.cc:1939] T 25b878def9344cbdae65b209cac4067f P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:18.398873 1168 ts_tablet_manager.cc:1397] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
I20260620 07:01:18.407513 1168 raft_consensus.cc:348] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.407776 1168 raft_consensus.cc:374] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.407866 1168 raft_consensus.cc:729] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.408097 1168 consensus_queue.cc:260] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.408641 1168 ts_tablet_manager.cc:1428] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:18.409384 1168 tablet_bootstrap.cc:492] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:18.409358 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 25b878def9344cbdae65b209cac4067f (table default.Table_9e2f2ecd97ee48f89579302e371615a7 [id=07e9b630b86b44ad8440941033df1efc]) successfully deleted
I20260620 07:01:18.410485 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 704e8aaabe6d40138b6611bdc30abf16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:18.411108 1168 tablet_bootstrap.cc:654] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.412588 1170 tablet_bootstrap.cc:492] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.412712 1170 ts_tablet_manager.cc:1397] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.065s user 0.009s sys 0.010s
I20260620 07:01:18.414944 1170 raft_consensus.cc:348] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.415185 1170 raft_consensus.cc:374] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.415243 1170 raft_consensus.cc:729] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.415431 1170 consensus_queue.cc:260] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.408711 857 tablet_service.cc:1467] Processing CreateTablet for tablet c4b3bb7a8c1f404b9744fd63bbe62c83 (DEFAULT_TABLE table=default.Table_d158029631994114988cdbd6ea1888d1 [id=d71c1c4cec764e9d8e7c094cf81fdd79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.431704 1170 ts_tablet_manager.cc:1428] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260620 07:01:18.432193 1170 tablet_bootstrap.cc:492] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:18.433596 1166 ts_tablet_manager.cc:1918] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:18.433797 1166 log.cc:1196] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/9a46df2909bf43f297b412c33f18a329
I20260620 07:01:18.441272 1170 tablet_bootstrap.cc:654] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.444877 1165 tablet_replica.cc:330] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:18.445222 1165 raft_consensus.cc:2229] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:18.446272 2366 raft_consensus.cc:482] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.446426 2366 raft_consensus.cc:504] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.447175 2366 leader_election.cc:288] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.447585 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7294e5678ad44622a3249c1113b5e297" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:18.448150 831 leader_election.cc:341] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.448570 1165 raft_consensus.cc:2258] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.448558 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7294e5678ad44622a3249c1113b5e297" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:18.449191 1165 ts_tablet_manager.cc:1905] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:18.449167 830 leader_election.cc:341] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.449285 830 leader_election.cc:302] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:18.449862 2366 raft_consensus.cc:2726] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.457427 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4b3bb7a8c1f404b9744fd63bbe62c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.458561 1000 tablet_service.cc:1467] Processing CreateTablet for tablet be38fd9a1be94c7f9879f9f94cf83348 (DEFAULT_TABLE table=default.Table_45dc12e54a7247b1b760816807c74176 [id=9dcae316385a4f438d1261bd8ed92b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.459499 872 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb89be110b744408d6730a251a832ef (DEFAULT_TABLE table=default.Table_ff9d8e8291954a39b6ab22986f4c59dd [id=c4951c2a533a4244aefd96a25bc21579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.459884 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb89be110b744408d6730a251a832ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.463718 862 tablet_service.cc:1467] Processing CreateTablet for tablet be38fd9a1be94c7f9879f9f94cf83348 (DEFAULT_TABLE table=default.Table_45dc12e54a7247b1b760816807c74176 [id=9dcae316385a4f438d1261bd8ed92b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.463860 715 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb89be110b744408d6730a251a832ef (DEFAULT_TABLE table=default.Table_ff9d8e8291954a39b6ab22986f4c59dd [id=c4951c2a533a4244aefd96a25bc21579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.464160 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be38fd9a1be94c7f9879f9f94cf83348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.464215 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb89be110b744408d6730a251a832ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.464726 731 tablet_service.cc:1467] Processing CreateTablet for tablet be38fd9a1be94c7f9879f9f94cf83348 (DEFAULT_TABLE table=default.Table_45dc12e54a7247b1b760816807c74176 [id=9dcae316385a4f438d1261bd8ed92b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.465070 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be38fd9a1be94c7f9879f9f94cf83348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.471592 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 557381d3c2d8498690c70128f67cfd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.475677 862 tablet_service.cc:1467] Processing CreateTablet for tablet 14bbd042527e4f55aec6fbd996b132aa (DEFAULT_TABLE table=default.Table_ac08547b5a874d02b9bc1ca762ce6eba [id=ce663774082b444f8cf94b2aa009228d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.476454 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14bbd042527e4f55aec6fbd996b132aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.477584 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 14bbd042527e4f55aec6fbd996b132aa (DEFAULT_TABLE table=default.Table_ac08547b5a874d02b9bc1ca762ce6eba [id=ce663774082b444f8cf94b2aa009228d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.479722 996 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb89be110b744408d6730a251a832ef (DEFAULT_TABLE table=default.Table_ff9d8e8291954a39b6ab22986f4c59dd [id=c4951c2a533a4244aefd96a25bc21579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.481020 867 tablet_service.cc:1467] Processing CreateTablet for tablet b627c1c966b7416ca842dfdb2ab2efdb (DEFAULT_TABLE table=default.Table_8f940313465e4afa9bc6d1a6a27c8467 [id=895abc42be5c4fbf9378b0ffe8afd783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.481379 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b627c1c966b7416ca842dfdb2ab2efdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.294740 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 923) took 2255 ms. Trace:
I20260620 07:01:18.482038 1169 rpcz_store.cc:276] 0620 07:01:16.039563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.039623 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:17.956400 (+1916777us) ts_tablet_manager.cc:1145] Deleting tablet 7cf81c5c0d9744f5a8c3f0866a435ae3
0620 07:01:17.956445 (+ 45us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.072244 (+115799us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.293243 (+220999us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.294720 (+ 1477us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1916485}
I20260620 07:01:18.482580 1169 tablet_replica.cc:330] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:18.482908 1169 raft_consensus.cc:2229] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:18.483054 1169 raft_consensus.cc:2258] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.483697 1169 ts_tablet_manager.cc:1905] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.484602 2210 raft_consensus.cc:482] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.484721 2210 raft_consensus.cc:504] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.484994 1001 tablet_service.cc:1467] Processing CreateTablet for tablet b627c1c966b7416ca842dfdb2ab2efdb (DEFAULT_TABLE table=default.Table_8f940313465e4afa9bc6d1a6a27c8467 [id=895abc42be5c4fbf9378b0ffe8afd783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.485291 2210 leader_election.cc:288] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.485800 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e2c297072741eb927dff9bcf6a573f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:18.486608 681 leader_election.cc:341] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.486603 872 tablet_service.cc:1467] Processing CreateTablet for tablet 8c50b36ee754463ca4588216f104f1f9 (DEFAULT_TABLE table=default.Table_ae11a807ad8e4678a0b70fd92379ddd5 [id=e0eebc38aa484069b670bfc5fcd9d659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.487226 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c50b36ee754463ca4588216f104f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.487202 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e2c297072741eb927dff9bcf6a573f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:18.487394 892 raft_consensus.cc:2454] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:18.487718 683 leader_election.cc:302] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:18.487913 715 tablet_service.cc:1467] Processing CreateTablet for tablet 14bbd042527e4f55aec6fbd996b132aa (DEFAULT_TABLE table=default.Table_ac08547b5a874d02b9bc1ca762ce6eba [id=ce663774082b444f8cf94b2aa009228d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.488096 2210 raft_consensus.cc:2781] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:18.488160 2210 raft_consensus.cc:482] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:18.488233 2210 raft_consensus.cc:3037] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:18.488265 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14bbd042527e4f55aec6fbd996b132aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.488389 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 (table default.Table_9dd2793fba0e423ab605fac4be9fc8c9 [id=441ab9871f3141a28fb5f7c8c26e41bb]) successfully deleted
I20260620 07:01:18.488832 722 tablet_service.cc:1467] Processing CreateTablet for tablet b627c1c966b7416ca842dfdb2ab2efdb (DEFAULT_TABLE table=default.Table_8f940313465e4afa9bc6d1a6a27c8467 [id=895abc42be5c4fbf9378b0ffe8afd783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.489140 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b627c1c966b7416ca842dfdb2ab2efdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.491451 2366 raft_consensus.cc:482] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.491499 2210 raft_consensus.cc:504] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.491652 2366 raft_consensus.cc:504] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.492128 994 tablet_service.cc:1467] Processing CreateTablet for tablet 8c50b36ee754463ca4588216f104f1f9 (DEFAULT_TABLE table=default.Table_ae11a807ad8e4678a0b70fd92379ddd5 [id=e0eebc38aa484069b670bfc5fcd9d659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.492436 2210 leader_election.cc:288] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.492520 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e2c297072741eb927dff9bcf6a573f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:18.492959 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125e8a5e20bf484cade408f0358489a1" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:18.493079 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125e8a5e20bf484cade408f0358489a1" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:18.493433 681 leader_election.cc:341] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.492374 2366 leader_election.cc:288] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.493870 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e2c297072741eb927dff9bcf6a573f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:18.494031 892 raft_consensus.cc:3037] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:18.497177 892 raft_consensus.cc:2454] T b6e2c297072741eb927dff9bcf6a573f P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:18.493554 831 leader_election.cc:341] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.499303 683 leader_election.cc:302] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:18.499918 1167 tablet_bootstrap.cc:654] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.499969 2210 raft_consensus.cc:2781] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:18.500087 2210 raft_consensus.cc:686] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:18.500270 867 tablet_service.cc:1467] Processing CreateTablet for tablet 07cb45503b894ffc9f85cd65e36fa6ff (DEFAULT_TABLE table=default.Table_54d230c45497496f8117ad3266e2305b [id=d2ecd552159248a8af29e1fa072f1317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.500303 2210 consensus_queue.cc:237] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.500711 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07cb45503b894ffc9f85cd65e36fa6ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:18.503293 830 leader_election.cc:341] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.503739 830 leader_election.cc:302] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:18.505146 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8bdf0be41ce54dcaba30e6e3a59b743c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:18.505775 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bdf0be41ce54dcaba30e6e3a59b743c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:18.505856 1165 ts_tablet_manager.cc:1918] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:18.506011 1165 log.cc:1196] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/6a36a5319a044e9da7dc7b666484e257
I20260620 07:01:18.506314 1165 ts_tablet_manager.cc:1939] T 6a36a5319a044e9da7dc7b666484e257 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:18.507230 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_637bc4c2642d48fe9086bac631bc9b8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:18.507752 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_637bc4c2642d48fe9086bac631bc9b8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:18.509171 2210 raft_consensus.cc:482] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.509308 2210 raft_consensus.cc:504] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.510565 2210 leader_election.cc:288] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.511509 2253 raft_consensus.cc:2726] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.511687 2253 raft_consensus.cc:482] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.511826 2253 raft_consensus.cc:504] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.512367 2253 leader_election.cc:288] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.513931 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d53c90eff33044479838ff67dea93057" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:18.514880 831 leader_election.cc:341] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.516180 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:18.516533 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 134f76587b6147afaf4e94fde5574efc (table default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc]). Expected version 3 got 0
I20260620 07:01:18.516987 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:18.517448 421 catalog_manager.cc:5495] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:18.518043 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 2 got 0
I20260620 07:01:18.520445 1167 tablet_bootstrap.cc:492] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:18.520484 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d53c90eff33044479838ff67dea93057" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:18.520665 1167 ts_tablet_manager.cc:1397] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.253s user 0.003s sys 0.000s
I20260620 07:01:18.520463 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a109e7871241ec9467858dca467bbe" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:18.521474 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be38fd9a1be94c7f9879f9f94cf83348. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:18.521347 681 leader_election.cc:341] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.522002 1167 raft_consensus.cc:348] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.522174 1167 raft_consensus.cc:374] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.522228 1167 raft_consensus.cc:729] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.522421 1167 consensus_queue.cc:260] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.522941 1167 ts_tablet_manager.cc:1428] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260620 07:01:18.525640 830 leader_election.cc:341] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.525774 830 leader_election.cc:302] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:18.526253 2253 raft_consensus.cc:2726] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.526736 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet c38c628514c44c6fa5aff64928e515d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:18.530475 1166 ts_tablet_manager.cc:1939] T 9a46df2909bf43f297b412c33f18a329 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:18.535789 683 leader_election.cc:341] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 95a109e7871241ec9467858dca467bbe
I20260620 07:01:18.535933 683 leader_election.cc:302] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.536288 2359 raft_consensus.cc:2726] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:18.536924 681 consensus_peers.cc:487] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:18.537557 1170 tablet_bootstrap.cc:492] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.537788 1170 ts_tablet_manager.cc:1397] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.106s user 0.011s sys 0.007s
I20260620 07:01:18.538595 1170 raft_consensus.cc:348] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.538889 1170 raft_consensus.cc:374] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.538988 1170 raft_consensus.cc:729] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.539132 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 07cb45503b894ffc9f85cd65e36fa6ff (DEFAULT_TABLE table=default.Table_54d230c45497496f8117ad3266e2305b [id=d2ecd552159248a8af29e1fa072f1317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.539479 858 tablet_service.cc:1467] Processing CreateTablet for tablet c55ae1fd8ab44a84811657b6cfbe721a (DEFAULT_TABLE table=default.Table_79d0b92537fb4325a156ed14dda845bb [id=9d97f11183aa4cc5a5c2d68a79f829b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.539430 1170 consensus_queue.cc:260] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.539960 1170 ts_tablet_manager.cc:1428] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:18.540213 801 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:18.541703 1170 tablet_bootstrap.cc:492] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:18.541690 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c55ae1fd8ab44a84811657b6cfbe721a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.543958 1170 tablet_bootstrap.cc:654] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.546007 1168 tablet_bootstrap.cc:492] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:18.546164 1168 ts_tablet_manager.cc:1397] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.137s user 0.004s sys 0.000s
W20260620 07:01:18.546288 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47365e10ce274af891055b34e2f0a2bd consensus state has no leader
I20260620 07:01:18.546872 1168 raft_consensus.cc:348] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.547065 1168 raft_consensus.cc:374] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.547106 1168 raft_consensus.cc:729] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.547272 1168 consensus_queue.cc:260] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.547744 1168 ts_tablet_manager.cc:1428] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:18.549952 1168 tablet_bootstrap.cc:492] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:18.551195 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07cb45503b894ffc9f85cd65e36fa6ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.551347 943 heartbeater.cc:347] Connected to a master server at 127.0.97.61:33455
I20260620 07:01:18.551474 1168 tablet_bootstrap.cc:654] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.557216 1029 raft_consensus.cc:3037] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:18.558478 2399 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fe29008ed9b430ea13d40e54e3ddfcc)
W20260620 07:01:18.558744 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b627c1c966b7416ca842dfdb2ab2efdb consensus state has no leader
I20260620 07:01:18.558847 2354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe29008ed9b430ea13d40e54e3ddfcc. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:01:18.558905 2399 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:01:18.559156 2354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 07:01:18.559198 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2889b3fc6d5a48d0a1eab791cc561be7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:18.559823 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2889b3fc6d5a48d0a1eab791cc561be7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:18.561168 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 302adda3630e44289d371de591061692 consensus state has no leader
I20260620 07:01:18.561584 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8dab0fdb88604443b6f8e8deb4ae4537"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:18.562129 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dab0fdb88604443b6f8e8deb4ae4537 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:18.564121 2359 raft_consensus.cc:482] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.564277 2359 raft_consensus.cc:504] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.564792 2359 leader_election.cc:288] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.567636 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f793a91ab247408bbe4a9f7cb370fffe" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:18.568213 681 leader_election.cc:341] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.570494 2399 leader_election.cc:288] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fe29008ed9b430ea13d40e54e3ddfcc (127.0.97.62:36007), f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775)
W20260620 07:01:18.575672 683 leader_election.cc:341] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f793a91ab247408bbe4a9f7cb370fffe
I20260620 07:01:18.575831 683 leader_election.cc:302] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.576253 2359 raft_consensus.cc:2726] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.579295 1167 tablet_bootstrap.cc:492] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:18.580781 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14bbd042527e4f55aec6fbd996b132aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.588586 1167 tablet_bootstrap.cc:654] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.590169 722 tablet_service.cc:1467] Processing CreateTablet for tablet 8c50b36ee754463ca4588216f104f1f9 (DEFAULT_TABLE table=default.Table_ae11a807ad8e4678a0b70fd92379ddd5 [id=e0eebc38aa484069b670bfc5fcd9d659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.589433 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b627c1c966b7416ca842dfdb2ab2efdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.596902 2087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 0) took 5276 ms. Trace:
I20260620 07:01:18.597815 1999 raft_consensus.cc:482] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.597944 1999 raft_consensus.cc:504] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:18.598394 1169 ts_tablet_manager.cc:1918] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:18.598520 1169 log.cc:1196] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/7d3ebdb3ef844adf82b99a6d3b6c61c2
I20260620 07:01:18.598533 1999 leader_election.cc:288] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:18.598876 1169 ts_tablet_manager.cc:1939] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:18.600721 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c50b36ee754463ca4588216f104f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.601051 2359 consensus_queue.cc:1035] T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:18.601178 731 tablet_service.cc:1467] Processing CreateTablet for tablet 07cb45503b894ffc9f85cd65e36fa6ff (DEFAULT_TABLE table=default.Table_54d230c45497496f8117ad3266e2305b [id=d2ecd552159248a8af29e1fa072f1317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.603153 2441 tablet.cc:1722] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:18.591217 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 796) took 5788 ms. Trace:
I20260620 07:01:18.611035 1166 rpcz_store.cc:276] 0620 07:01:12.803247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:12.803305 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:18.200883 (+5397578us) ts_tablet_manager.cc:1145] Deleting tablet 9a46df2909bf43f297b412c33f18a329
0620 07:01:18.200895 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.406056 (+205161us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.433496 (+ 27440us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.591201 (+157705us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5380197}
I20260620 07:01:18.611943 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 797) took 5437 ms. Trace:
I20260620 07:01:18.612344 1166 rpcz_store.cc:276] 0620 07:01:13.174671 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.174720 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:18.611791 (+5437071us) ts_tablet_manager.cc:1145] Deleting tablet f2f5004b6e28431db1a2b9d1e8c0cfcf
0620 07:01:18.611801 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.611899 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5412994}
I20260620 07:01:18.612907 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 798) took 5373 ms. Trace:
I20260620 07:01:18.613054 1166 rpcz_store.cc:276] 0620 07:01:13.239793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.239846 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:18.612788 (+5372942us) ts_tablet_manager.cc:1145] Deleting tablet fa0b581de06149cf93b469a4a095573b
0620 07:01:18.612798 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.612878 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5372764}
I20260620 07:01:18.613525 1166 tablet_replica.cc:330] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:18.613787 1166 raft_consensus.cc:2229] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:18.614092 1166 raft_consensus.cc:2258] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.615106 1166 ts_tablet_manager.cc:1905] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.618676 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 6a36a5319a044e9da7dc7b666484e257 (table default.Table_690ab28d5a40472ebf9dfa50126f6c42 [id=0b2270efe0844d8aa33eac8150145bad]) successfully deleted
I20260620 07:01:18.620234 2359 raft_consensus.cc:482] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.620378 2359 raft_consensus.cc:504] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.620805 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb89be110b744408d6730a251a832ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.620993 2359 leader_election.cc:288] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.621706 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "333eef8b98da4a279acceaead9405149" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:18.622231 681 leader_election.cc:341] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:18.627442 683 leader_election.cc:341] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 333eef8b98da4a279acceaead9405149
I20260620 07:01:18.627586 683 leader_election.cc:302] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:18.627799 969 leader_election.cc:341] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c38c628514c44c6fa5aff64928e515d9
I20260620 07:01:18.627996 2359 raft_consensus.cc:2726] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.634860 720 tablet_service.cc:1467] Processing CreateTablet for tablet c55ae1fd8ab44a84811657b6cfbe721a (DEFAULT_TABLE table=default.Table_79d0b92537fb4325a156ed14dda845bb [id=9d97f11183aa4cc5a5c2d68a79f829b9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:18.637099 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8f66e10cb4f4037a5997a5c33e3f117 consensus state has no leader
I20260620 07:01:18.638571 858 tablet_service.cc:1467] Processing CreateTablet for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 (DEFAULT_TABLE table=default.Table_1dc8297521db42c98ffe92b370890ba8 [id=8c2e26b7eebe41a3826bfce9ce969131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.638963 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2d1bad6b34f14270a060ce7245ff0c0f
I20260620 07:01:18.639022 1165 tablet_replica.cc:330] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:18.639212 1165 raft_consensus.cc:2229] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:18.639374 1165 raft_consensus.cc:2258] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.639401 419 catalog_manager.cc:6565] ReplaceTablet: tablet 2d1bad6b34f14270a060ce7245ff0c0f deleted and replaced by tablet 5889c0b321604b82ac12918ae3030405
I20260620 07:01:18.639446 719 tablet_service.cc:1467] Processing CreateTablet for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 (DEFAULT_TABLE table=default.Table_1dc8297521db42c98ffe92b370890ba8 [id=8c2e26b7eebe41a3826bfce9ce969131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.639741 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3291c3f046e145a4bd25965836d3e9eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:18.639916 1165 ts_tablet_manager.cc:1905] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:18.640334 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3291c3f046e145a4bd25965836d3e9eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:18.641673 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8dad7e6437ab4328b9b88d5e6febe8a0
I20260620 07:01:18.642279 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e143cb15733d4fc1af6495a98134e9fe" } new_table_name: "default.Table_d32b0d19ea7845ffb2aaf7b73f1083fd" modify_external_catalogs: true
I20260620 07:01:18.643625 1168 tablet_bootstrap.cc:492] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:18.643751 1168 ts_tablet_manager.cc:1397] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.094s user 0.005s sys 0.002s
I20260620 07:01:18.644248 715 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d1bad6b34f14270a060ce7245ff0c0f with delete_type TABLET_DATA_DELETED (replaced by tablet 5889c0b321604b82ac12918ae3030405) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:18.644562 1168 raft_consensus.cc:348] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.644773 1168 raft_consensus.cc:374] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.644829 1168 raft_consensus.cc:729] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.645017 1168 consensus_queue.cc:260] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.645510 1168 ts_tablet_manager.cc:1428] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:18.646989 1168 tablet_bootstrap.cc:492] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:18.647130 423 master_service.cc:946] ReplaceTablet: received request to replace tablet 7fb2d5c0f6d24969a0fea05a34fea00f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:18.647760 715 tablet_service.cc:1467] Processing CreateTablet for tablet 2816955770f74f52b3d1077078728736 (DEFAULT_TABLE table=default.Table_e143cb15733d4fc1af6495a98134e9fe [id=88ec6b1137cb4b9ba766f712ff353961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.647795 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3122a50618184dc7bf7cb696dca2a55b" } modify_external_catalogs: true
I20260620 07:01:18.648041 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3122a50618184dc7bf7cb696dca2a55b" } modify_external_catalogs: true
I20260620 07:01:18.648447 725 tablet_service.cc:1467] Processing CreateTablet for tablet ded117a6342e473e992c6a9d192462f1 (DEFAULT_TABLE table=default.Table_6f07addf070c41ca99d660f88ffd8c7c [id=dee51f63425c413393e59dfd3b38f50e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.649077 732 tablet_service.cc:1467] Processing CreateTablet for tablet 394a20b5d4814305b347c5718731d551 (DEFAULT_TABLE table=default.Table_dd975c3c465e439db363c170ba3e4147 [id=c5d6638ed0bf48e1b8339e21c50f9a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.649641 729 tablet_service.cc:1467] Processing CreateTablet for tablet 3ce4142ad2cb4e0daa65ab051adc005d (DEFAULT_TABLE table=default.Table_e63870c87d324724bc7865165bd9aa36 [id=bf6f7fc36d26424e827fb46eb09694ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.649816 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1d3cbad85c554427ac7cb39c8275f6dc" } modify_external_catalogs: true
I20260620 07:01:18.650002 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1d3cbad85c554427ac7cb39c8275f6dc" } modify_external_catalogs: true
I20260620 07:01:18.650380 733 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2915c0e3604565a48dffef8c670219 (DEFAULT_TABLE table=default.Table_61d1f36ce2e84d41b78605dfb0f804b3 [id=10fe6ec447bb439587bac583f63e66da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.650867 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dad7e6437ab4328b9b88d5e6febe8a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:18.651425 734 tablet_service.cc:1467] Processing CreateTablet for tablet f7419a8974c843748a9022c5fe1a8b34 (DEFAULT_TABLE table=default.Table_608fa7fe9add4c14b2705f68900223d3 [id=015a91e5966740859f4cd6a00214671f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.652302 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d1bad6b34f14270a060ce7245ff0c0f with delete_type TABLET_DATA_DELETED (replaced by tablet 5889c0b321604b82ac12918ae3030405) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.652385 726 tablet_service.cc:1467] Processing CreateTablet for tablet 5e98a39613e04c919a7c3e6579796240 (DEFAULT_TABLE table=default.Table_0d0e1d25b4b4481c836dfb048e9c1604 [id=4e50d6a0c50240ee9b86edb3d845f61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.652904 857 tablet_service.cc:1467] Processing CreateTablet for tablet 394a20b5d4814305b347c5718731d551 (DEFAULT_TABLE table=default.Table_dd975c3c465e439db363c170ba3e4147 [id=c5d6638ed0bf48e1b8339e21c50f9a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.653537 862 tablet_service.cc:1467] Processing CreateTablet for tablet ded117a6342e473e992c6a9d192462f1 (DEFAULT_TABLE table=default.Table_6f07addf070c41ca99d660f88ffd8c7c [id=dee51f63425c413393e59dfd3b38f50e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.653600 872 tablet_service.cc:1467] Processing CreateTablet for tablet 3ce4142ad2cb4e0daa65ab051adc005d (DEFAULT_TABLE table=default.Table_e63870c87d324724bc7865165bd9aa36 [id=bf6f7fc36d26424e827fb46eb09694ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.654047 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dad7e6437ab4328b9b88d5e6febe8a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:18.654237 874 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2915c0e3604565a48dffef8c670219 (DEFAULT_TABLE table=default.Table_61d1f36ce2e84d41b78605dfb0f804b3 [id=10fe6ec447bb439587bac583f63e66da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.654419 865 tablet_service.cc:1467] Processing CreateTablet for tablet f7419a8974c843748a9022c5fe1a8b34 (DEFAULT_TABLE table=default.Table_608fa7fe9add4c14b2705f68900223d3 [id=015a91e5966740859f4cd6a00214671f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.654910 861 tablet_service.cc:1467] Processing CreateTablet for tablet 5e98a39613e04c919a7c3e6579796240 (DEFAULT_TABLE table=default.Table_0d0e1d25b4b4481c836dfb048e9c1604 [id=4e50d6a0c50240ee9b86edb3d845f61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.654968 867 tablet_service.cc:1467] Processing CreateTablet for tablet 2816955770f74f52b3d1077078728736 (DEFAULT_TABLE table=default.Table_e143cb15733d4fc1af6495a98134e9fe [id=88ec6b1137cb4b9ba766f712ff353961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.655938 1168 tablet_bootstrap.cc:654] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.665488 2072 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" instance_seqno: 1781938854080208) as {username='slave'} at 127.0.97.3:47645; Asking this server to re-register.
I20260620 07:01:18.667215 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 9a46df2909bf43f297b412c33f18a329 (table default.Table_f7d77da45d5248419e216d47e3676655 [id=403d8690063647f8a96225625f58531d]) successfully deleted
W20260620 07:01:18.667665 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f5004b6e28431db1a2b9d1e8c0cfcf already in progress: creating tablet
W20260620 07:01:18.668022 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fa0b581de06149cf93b469a4a095573b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa0b581de06149cf93b469a4a095573b already in progress: creating tablet
I20260620 07:01:18.669209 994 tablet_service.cc:1467] Processing CreateTablet for tablet c55ae1fd8ab44a84811657b6cfbe721a (DEFAULT_TABLE table=default.Table_79d0b92537fb4325a156ed14dda845bb [id=9d97f11183aa4cc5a5c2d68a79f829b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.669772 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d1bad6b34f14270a060ce7245ff0c0f with delete_type TABLET_DATA_DELETED (replaced by tablet 5889c0b321604b82ac12918ae3030405) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:18.672313 968 leader_election.cc:341] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: c38c628514c44c6fa5aff64928e515d9
I20260620 07:01:18.672487 968 leader_election.cc:302] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.672761 2019 raft_consensus.cc:2726] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.676486 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ded117a6342e473e992c6a9d192462f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.676712 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ce4142ad2cb4e0daa65ab051adc005d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.677819 1080 heartbeater.cc:464] Registering TS with master...
I20260620 07:01:18.678993 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7419a8974c843748a9022c5fe1a8b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.682963 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e98a39613e04c919a7c3e6579796240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.682868 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 (DEFAULT_TABLE table=default.Table_1dc8297521db42c98ffe92b370890ba8 [id=8c2e26b7eebe41a3826bfce9ce969131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.683537 2359 raft_consensus.cc:482] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.683671 2359 raft_consensus.cc:504] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.684249 999 tablet_service.cc:1467] Processing CreateTablet for tablet 2816955770f74f52b3d1077078728736 (DEFAULT_TABLE table=default.Table_e143cb15733d4fc1af6495a98134e9fe [id=88ec6b1137cb4b9ba766f712ff353961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.684418 2359 leader_election.cc:288] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.685215 1000 tablet_service.cc:1467] Processing CreateTablet for tablet ded117a6342e473e992c6a9d192462f1 (DEFAULT_TABLE table=default.Table_6f07addf070c41ca99d660f88ffd8c7c [id=dee51f63425c413393e59dfd3b38f50e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.686004 995 tablet_service.cc:1467] Processing CreateTablet for tablet 394a20b5d4814305b347c5718731d551 (DEFAULT_TABLE table=default.Table_dd975c3c465e439db363c170ba3e4147 [id=c5d6638ed0bf48e1b8339e21c50f9a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.687139 1166 ts_tablet_manager.cc:1918] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:18.687263 1166 log.cc:1196] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/62ef9a12e3684d27b6696f631c68a5af
W20260620 07:01:18.687330 683 leader_election.cc:341] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 88c6aeea7c504f36964e8bf41b0fc4f9
I20260620 07:01:18.687711 1166 ts_tablet_manager.cc:1939] T 62ef9a12e3684d27b6696f631c68a5af P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:18.688442 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 3ce4142ad2cb4e0daa65ab051adc005d (DEFAULT_TABLE table=default.Table_e63870c87d324724bc7865165bd9aa36 [id=bf6f7fc36d26424e827fb46eb09694ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.689489 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2915c0e3604565a48dffef8c670219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.690209 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dad7e6437ab4328b9b88d5e6febe8a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:18.690686 1004 tablet_service.cc:1467] Processing CreateTablet for tablet f7419a8974c843748a9022c5fe1a8b34 (DEFAULT_TABLE table=default.Table_608fa7fe9add4c14b2705f68900223d3 [id=015a91e5966740859f4cd6a00214671f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.691200 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 5e98a39613e04c919a7c3e6579796240 (DEFAULT_TABLE table=default.Table_0d0e1d25b4b4481c836dfb048e9c1604 [id=4e50d6a0c50240ee9b86edb3d845f61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.693316 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2816955770f74f52b3d1077078728736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.694319 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2915c0e3604565a48dffef8c670219 (DEFAULT_TABLE table=default.Table_61d1f36ce2e84d41b78605dfb0f804b3 [id=10fe6ec447bb439587bac583f63e66da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.695346 1170 tablet_bootstrap.cc:492] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.695489 1170 ts_tablet_manager.cc:1397] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.154s user 0.004s sys 0.002s
I20260620 07:01:18.696448 1170 raft_consensus.cc:348] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.696709 1170 raft_consensus.cc:374] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.696729 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.696832 1170 raft_consensus.cc:729] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.697085 1170 consensus_queue.cc:260] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.699818 1170 ts_tablet_manager.cc:1428] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:01:18.702472 2359 raft_consensus.cc:482] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.702608 2359 raft_consensus.cc:504] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.703332 2359 leader_election.cc:288] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.705022 860 tablet_service.cc:1467] Processing CreateTablet for tablet 7fa7a6b405c44d27850b68c20bd46a80 (DEFAULT_TABLE table=default.Table_975d0608ca3b4bef8479a03d4028e427 [id=fd211f51587e4f62bf9fe5f944d8f074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.705431 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fa7a6b405c44d27850b68c20bd46a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.705893 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9a8785defc83404485359d8702fa2ddb" } modify_external_catalogs: true
I20260620 07:01:18.706106 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9a8785defc83404485359d8702fa2ddb" } modify_external_catalogs: true
I20260620 07:01:18.706110 716 tablet_service.cc:1467] Processing CreateTablet for tablet 0621724505b34d10bced5c920b46442f (DEFAULT_TABLE table=default.Table_ac84d5816b2c4ac5aa5ab2dd2ece9b0c [id=4626c031b9b545c5a892de35d93bc88c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.706837 721 tablet_service.cc:1467] Processing CreateTablet for tablet 7fa7a6b405c44d27850b68c20bd46a80 (DEFAULT_TABLE table=default.Table_975d0608ca3b4bef8479a03d4028e427 [id=fd211f51587e4f62bf9fe5f944d8f074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.707118 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394a20b5d4814305b347c5718731d551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.707578 730 tablet_service.cc:1467] Processing CreateTablet for tablet b2f5c0f1c20f46b7b62fccea47f857d9 (DEFAULT_TABLE table=default.Table_8f52009921d54b0cb21a5f60133b32ef [id=249288a3cce64ee08682fb42cae01305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.707933 727 tablet_service.cc:1467] Processing CreateTablet for tablet 74990dfb3d774dd0b7bb4666afde5797 (DEFAULT_TABLE table=default.Table_d96a379d122b43e6bc9ac07444ddce19 [id=c3c42ed056834f90802c65a298268f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.709578 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 0621724505b34d10bced5c920b46442f (DEFAULT_TABLE table=default.Table_ac84d5816b2c4ac5aa5ab2dd2ece9b0c [id=4626c031b9b545c5a892de35d93bc88c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.710748 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 7fa7a6b405c44d27850b68c20bd46a80 (DEFAULT_TABLE table=default.Table_975d0608ca3b4bef8479a03d4028e427 [id=fd211f51587e4f62bf9fe5f944d8f074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.711076 864 tablet_service.cc:1467] Processing CreateTablet for tablet b2f5c0f1c20f46b7b62fccea47f857d9 (DEFAULT_TABLE table=default.Table_8f52009921d54b0cb21a5f60133b32ef [id=249288a3cce64ee08682fb42cae01305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.711186 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fa7a6b405c44d27850b68c20bd46a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.711441 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2f5c0f1c20f46b7b62fccea47f857d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.712334 1165 ts_tablet_manager.cc:1918] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:18.712426 1165 log.cc:1196] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/125e8a5e20bf484cade408f0358489a1
I20260620 07:01:18.712690 1165 ts_tablet_manager.cc:1939] T 125e8a5e20bf484cade408f0358489a1 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:18.713096 1165 tablet_replica.cc:330] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:18.713285 1165 raft_consensus.cc:2229] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:18.713438 1165 raft_consensus.cc:2258] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.713914 1165 ts_tablet_manager.cc:1905] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.705022 871 tablet_service.cc:1467] Processing CreateTablet for tablet 74990dfb3d774dd0b7bb4666afde5797 (DEFAULT_TABLE table=default.Table_d96a379d122b43e6bc9ac07444ddce19 [id=c3c42ed056834f90802c65a298268f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.715130 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394a20b5d4814305b347c5718731d551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.715368 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74990dfb3d774dd0b7bb4666afde5797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.716261 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7419a8974c843748a9022c5fe1a8b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.716390 858 tablet_service.cc:1467] Processing CreateTablet for tablet 0621724505b34d10bced5c920b46442f (DEFAULT_TABLE table=default.Table_ac84d5816b2c4ac5aa5ab2dd2ece9b0c [id=4626c031b9b545c5a892de35d93bc88c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.719311 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e70b585def4a4a9081a0938af8ce5b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:18.719770 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0621724505b34d10bced5c920b46442f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:18.720007 681 leader_election.cc:341] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.720470 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 125e8a5e20bf484cade408f0358489a1 (table default.Table_072aff5d28cf4c61bbecd2cadb3e58c3 [id=bb41cdc85465446193c33f0722351f6a]) successfully deleted
I20260620 07:01:18.721306 872 tablet_service.cc:1467] Processing CreateTablet for tablet ba2228150b9543e78c81b12e2592484a (DEFAULT_TABLE table=default.Table_400af15ad4774512a1aa3b021c8da9b1 [id=ec05a796336943fa88639c9377b969b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.723368 1167 tablet_bootstrap.cc:492] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:18.723568 1167 ts_tablet_manager.cc:1397] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.144s user 0.004s sys 0.000s
I20260620 07:01:18.724464 1167 raft_consensus.cc:348] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.724725 1167 raft_consensus.cc:374] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.724843 1167 raft_consensus.cc:729] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.725116 1167 consensus_queue.cc:260] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.725771 1167 ts_tablet_manager.cc:1428] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:18.727541 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e70b585def4a4a9081a0938af8ce5b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:18.727943 893 raft_consensus.cc:2454] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:18.728452 1445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2395d394cd84440ebae89d1ecfa13fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 1068 } } ignore_live_leader: false dest_uuid: "f32c3995c70946c38ce1a3094aaaffb1" is_pre_election: true
I20260620 07:01:18.728596 683 leader_election.cc:302] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:18.729293 2359 raft_consensus.cc:2781] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:18.729426 2359 raft_consensus.cc:482] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:18.729523 2359 raft_consensus.cc:3037] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:18.731787 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba2228150b9543e78c81b12e2592484a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.732430 2019 raft_consensus.cc:482] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.732570 2019 raft_consensus.cc:504] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.733193 2019 leader_election.cc:288] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:18.734264 968 leader_election.cc:341] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: a2d6f7f2b5b3473aa010b8982a03aa5e
I20260620 07:01:18.734578 2359 raft_consensus.cc:504] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.736649 2359 leader_election.cc:288] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.737300 2072 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "978f112862c64141b1009856bef3d624" instance_seqno: 1781938853580019) as {username='slave'} at 127.0.97.2:35485; Asking this server to re-register.
I20260620 07:01:18.738231 723 tablet_service.cc:1467] Processing CreateTablet for tablet ba2228150b9543e78c81b12e2592484a (DEFAULT_TABLE table=default.Table_400af15ad4774512a1aa3b021c8da9b1 [id=ec05a796336943fa88639c9377b969b0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:18.738749 969 leader_election.cc:341] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a2d6f7f2b5b3473aa010b8982a03aa5e
I20260620 07:01:18.738936 969 leader_election.cc:302] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.739488 2019 raft_consensus.cc:2726] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.739655 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 74990dfb3d774dd0b7bb4666afde5797 (DEFAULT_TABLE table=default.Table_d96a379d122b43e6bc9ac07444ddce19 [id=c3c42ed056834f90802c65a298268f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.742246 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e70b585def4a4a9081a0938af8ce5b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:18.747184 893 raft_consensus.cc:3037] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:18.747223 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 390a327225344afda3076c341202cc1d (table default.Table_4563e27d87354007895f9d9819e8d8a0 [id=d7198485f2104c2092955ef5305900cf]). Expected version 1 got 0
I20260620 07:01:18.747495 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]). Expected version 1 got 0
I20260620 07:01:18.748293 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]). Expected version 3 got 0
I20260620 07:01:18.748924 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d3eea3be2a8c4190a262d1af2221fd3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:18.749549 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3eea3be2a8c4190a262d1af2221fd3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:18.749682 1168 tablet_bootstrap.cc:492] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:18.749974 1168 ts_tablet_manager.cc:1397] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.103s user 0.006s sys 0.002s
I20260620 07:01:18.752539 996 tablet_service.cc:1467] Processing CreateTablet for tablet b2f5c0f1c20f46b7b62fccea47f857d9 (DEFAULT_TABLE table=default.Table_8f52009921d54b0cb21a5f60133b32ef [id=249288a3cce64ee08682fb42cae01305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.756361 943 heartbeater.cc:464] Registering TS with master...
I20260620 07:01:18.757846 1168 raft_consensus.cc:348] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.758265 1168 raft_consensus.cc:374] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.758594 1168 raft_consensus.cc:729] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.761107 893 raft_consensus.cc:2454] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:18.761528 683 leader_election.cc:302] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:18.761914 2359 raft_consensus.cc:2781] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:18.761977 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2816955770f74f52b3d1077078728736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.762418 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 924) took 2722 ms. Trace:
I20260620 07:01:18.762526 1169 rpcz_store.cc:276] 0620 07:01:16.040199 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.040249 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:18.482490 (+2442241us) ts_tablet_manager.cc:1145] Deleting tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2
0620 07:01:18.482504 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.525483 (+ 42979us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.598299 (+ 72816us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.762360 (+164061us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2442062}
I20260620 07:01:18.763025 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 929) took 2697 ms. Trace:
I20260620 07:01:18.763114 1169 rpcz_store.cc:276] 0620 07:01:16.065663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.065712 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:18.762854 (+2697142us) ts_tablet_manager.cc:1145] Deleting tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa
0620 07:01:18.762864 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.762971 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2681007}
I20260620 07:01:18.763438 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 930) took 2695 ms. Trace:
I20260620 07:01:18.763525 1169 rpcz_store.cc:276] 0620 07:01:16.068356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.068405 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:18.763309 (+2694904us) ts_tablet_manager.cc:1145] Deleting tablet b4b60d2a45944a09a60a2826a9a45738
0620 07:01:18.763318 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.763386 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2681403}
I20260620 07:01:18.763840 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 933) took 2656 ms. Trace:
I20260620 07:01:18.763950 1169 rpcz_store.cc:276] 0620 07:01:16.107822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.119413 (+ 11591us) service_pool.cc:227] Handling call
0620 07:01:18.763699 (+2644286us) ts_tablet_manager.cc:1145] Deleting tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f
0620 07:01:18.763708 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.763765 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2644021}
I20260620 07:01:18.764436 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2915c0e3604565a48dffef8c670219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.765024 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e70b585def4a4a9081a0938af8ce5b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:18.766848 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88c6aeea7c504f36964e8bf41b0fc4f9" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:18.767300 2366 raft_consensus.cc:482] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.767557 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ded117a6342e473e992c6a9d192462f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.768260 1167 tablet_bootstrap.cc:492] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:18.771447 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07cb45503b894ffc9f85cd65e36fa6ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.771401 864 tablet_service.cc:1467] Processing CreateTablet for tablet 4f8767b1f8cb41e3ad3aebfd269fd2ef (DEFAULT_TABLE table=default.Table_8ed3b3839c1c4c85ae6723e50d955079 [id=101551dac4b645c5a244321d95120f93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.771600 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c50b36ee754463ca4588216f104f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:18.774966 681 leader_election.cc:341] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.775198 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ce4142ad2cb4e0daa65ab051adc005d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:18.775328 681 leader_election.cc:341] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.775426 681 leader_election.cc:302] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.764204 1169 tablet_replica.cc:330] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:18.778954 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394a20b5d4814305b347c5718731d551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.779379 1169 raft_consensus.cc:2229] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:18.780133 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 799) took 5481 ms. Trace:
I20260620 07:01:18.781255 1169 raft_consensus.cc:2258] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.783468 2019 raft_consensus.cc:482] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.783694 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c55ae1fd8ab44a84811657b6cfbe721a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.783603 2019 raft_consensus.cc:504] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:18.784272 2019 leader_election.cc:288] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:18.785311 968 leader_election.cc:341] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 04db48e910514d46bb4deb9acf54f7c0
I20260620 07:01:18.786760 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7419a8974c843748a9022c5fe1a8b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.789363 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e98a39613e04c919a7c3e6579796240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.790114 1013 tablet_service.cc:1467] Processing CreateTablet for tablet ba2228150b9543e78c81b12e2592484a (DEFAULT_TABLE table=default.Table_400af15ad4774512a1aa3b021c8da9b1 [id=ec05a796336943fa88639c9377b969b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.796650 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.780715 1166 rpcz_store.cc:276] 0620 07:01:13.298717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.298801 (+ 84us) service_pool.cc:227] Handling call
0620 07:01:18.613466 (+5314665us) ts_tablet_manager.cc:1145] Deleting tablet 62ef9a12e3684d27b6696f631c68a5af
0620 07:01:18.613476 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.630819 (+ 17343us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.687022 (+ 56203us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.724521 (+ 37499us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x618000005118. stack: 00007f5f3ef5866e 00007f5f3ef58430 00007f5f3dfdf5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f5f3ef4e0fd 00007f5f3ef4f16e 00007f5f51ea3cfd 00007f5f51e21883 00007f5f4e0c3752 00007f5f4e0f5404 00007f5f4e0d6870 00007f5f4e0d65fd 00000000009edb7c 00007f5f3ef9e344
0620 07:01:18.779993 (+ 55472us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":83374464,"tablet-delete.queue_time_us":5281886}
I20260620 07:01:18.803161 1169 ts_tablet_manager.cc:1905] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.820418 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0621724505b34d10bced5c920b46442f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.821924 2072 ts_manager.cc:194] Registered new tserver with Master: 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.823042 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fa7a6b405c44d27850b68c20bd46a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.823311 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba2228150b9543e78c81b12e2592484a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.826903 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74990dfb3d774dd0b7bb4666afde5797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.597066 2087 rpcz_store.cc:276] 0620 07:01:13.320865 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.324585 (+ 3720us) service_pool.cc:227] Handling call
0620 07:01:17.335122 (+4010537us) raft_consensus.cc:1457] Updating replica for 373 ops
0620 07:01:17.364607 (+ 29485us) raft_consensus.cc:1520] Early marking committed up to index 0
0620 07:01:17.364616 (+ 9us) raft_consensus.cc:1525] Triggering prepare for 373 ops
0620 07:01:17.365298 (+ 682us) write_op.cc:270] Start()
0620 07:01:17.365372 (+ 74us) write_op.cc:276] Timestamp: P: 1781938865456421 usec, L: 0
0620 07:01:17.399415 (+ 34043us) write_op.cc:270] Start()
0620 07:01:17.399458 (+ 43us) write_op.cc:276] Timestamp: P: 1781938865457290 usec, L: 0
0620 07:01:17.399801 (+ 343us) write_op.cc:270] Start()
0620 07:01:17.399874 (+ 73us) write_op.cc:276] Timestamp: P: 1781938865457811 usec, L: 0
0620 07:01:17.400085 (+ 211us) write_op.cc:270] Start()
0620 07:01:17.400111 (+ 26us) write_op.cc:276] Timestamp: P: 1781938865469096 usec, L: 0
0620 07:01:17.400303 (+ 192us) write_op.cc:270] Start()
0620 07:01:17.400328 (+ 25us) write_op.cc:276] Timestamp: P: 1781938865469723 usec, L: 0
0620 07:01:17.400479 (+ 151us) write_op.cc:270] Start()
0620 07:01:17.400503 (+ 24us) write_op.cc:276] Timestamp: P: 1781938865470190 usec, L: 0
0620 07:01:17.400674 (+ 171us) write_op.cc:270] Start()
0620 07:01:17.400738 (+ 64us) write_op.cc:276] Timestamp: P: 1781938865485214 usec, L: 0
0620 07:01:17.400917 (+ 179us) write_op.cc:270] Start()
0620 07:01:17.400942 (+ 25us) write_op.cc:276] Timestamp: P: 1781938865486210 usec, L: 0
0620 07:01:17.401108 (+ 166us) write_op.cc:270] Start()
0620 07:01:17.401133 (+ 25us) write_op.cc:276] Timestamp: P: 1781938865529633 usec, L: 0
0620 07:01:17.401290 (+ 157us) write_op.cc:270] Start()
0620 07:01:17.401313 (+ 23us) write_op.cc:276] Timestamp: P: 1781938865542911 usec, L: 0
0620 07:01:17.401488 (+ 175us) write_op.cc:270] Start()
0620 07:01:17.401512 (+ 24us) write_op.cc:276] Timestamp: P: 1781938865561144 usec, L: 0
0620 07:01:17.401651 (+ 139us) write_op.cc:270] Start()
0620 07:01:17.401675 (+ 24us) write_op.cc:276] Timestamp: P: 1781938865597250 usec, L: 0
0620 07:01:17.401842 (+ 167us) write_op.cc:270] Start()
0620 07:01:17.401867 (+ 25us) write_op.cc:276] Timestamp: P: 1781938865621801 usec, L: 0
0620 07:01:17.402012 (+ 145us) write_op.cc:270] Start()
0620 07:01:17.402031 (+ 19us) write_op.cc:276] Timestamp: P: 1781938865622491 usec, L: 0
0620 07:01:17.402188 (+ 157us) write_op.cc:270] Start()
0620 07:01:17.402214 (+ 26us) write_op.cc:276] Timestamp: P: 1781938865633855 usec, L: 0
0620 07:01:17.414131 (+ 11917us) write_op.cc:270] Start()
0620 07:01:17.414178 (+ 47us) write_op.cc:276] Timestamp: P: 1781938865634495 usec, L: 0
0620 07:01:17.414390 (+ 212us) write_op.cc:270] Start()
0620 07:01:17.414427 (+ 37us) write_op.cc:276] Timestamp: P: 1781938865644452 usec, L: 0
0620 07:01:17.414566 (+ 139us) write_op.cc:270] Start()
0620 07:01:17.414589 (+ 23us) write_op.cc:276] Timestamp: P: 1781938865663743 usec, L: 0
0620 07:01:17.414751 (+ 162us) write_op.cc:270] Start()
0620 07:01:17.414775 (+ 24us) write_op.cc:276] Timestamp: P: 1781938865676684 usec, L: 0
0620 07:01:17.420156 (+ 5381us) write_op.cc:270] Start()
0620 07:01:17.420206 (+ 50us) write_op.cc:276] Timestamp: P: 1781938865705137 usec, L: 0
0620 07:01:17.420464 (+ 258us) write_op.cc:270] Start()
0620 07:01:17.420490 (+ 26us) write_op.cc:276] Timestamp: P: 1781938865713709 usec, L: 0
0620 07:01:17.420620 (+ 130us) write_op.cc:270] Start()
0620 07:01:17.420645 (+ 25us) write_op.cc:276] Timestamp: P: 1781938865734006 usec, L: 0
0620 07:01:17.420794 (+ 149us) write_op.cc:270] Start()
0620 07:01:17.420816 (+ 22us) write_op.cc:276] Timestamp: P: 1781938865735325 usec, L: 0
0620 07:01:17.420954 (+ 138us) write_op.cc:270] Start()
0620 07:01:17.420977 (+ 23us) write_op.cc:276] Timestamp: P: 1781938865736241 usec, L: 0
0620 07:01:17.421172 (+ 195us) write_op.cc:270] Start()
0620 07:01:17.421193 (+ 21us) write_op.cc:276] Timestamp: P: 1781938865737337 usec, L: 0
0620 07:01:17.421336 (+ 143us) write_op.cc:270] Start()
0620 07:01:17.421359 (+ 23us) write_op.cc:276] Timestamp: P: 1781938865738179 usec, L: 0
0620 07:01:17.421495 (+ 136us) write_op.cc:270] Start()
0620 07:01:17.421518 (+ 23us) write_op.cc:276] Timestamp: P: 1781938865883619 usec, L: 0
0620 07:01:17.421644 (+ 126us) write_op.cc:270] Start()
0620 07:01:17.421667 (+ 23us) write_op.cc:276] Timestamp: P: 1781938865939349 usec, L: 0
0620 07:01:17.421841 (+ 174us) write_op.cc:270] Start()
0620 07:01:17.421866 (+ 25us) write_op.cc:276] Timestamp: P: 1781938865940480 usec, L: 0
0620 07:01:17.422004 (+ 138us) write_op.cc:270] Start()
0620 07:01:17.427648 (+ 5644us) write_op.cc:276] Timestamp: P: 1781938866001918 usec, L: 0
0620 07:01:17.427978 (+ 330us) write_op.cc:270] Start()
0620 07:01:17.428041 (+ 63us) write_op.cc:276] Timestamp: P: 1781938866012366 usec, L: 0
0620 07:01:17.428198 (+ 157us) write_op.cc:270] Start()
0620 07:01:17.428223 (+ 25us) write_op.cc:276] Timestamp: P: 1781938866037275 usec, L: 0
0620 07:01:17.428382 (+ 159us) write_op.cc:270] Start()
0620 07:01:17.428405 (+ 23us) write_op.cc:276] Timestamp: P: 1781938866038982 usec, L: 0
0620 07:01:17.428533 (+ 128us) write_op.cc:270] Start()
0620 07:01:17.428555 (+ 22us) write_op.cc:276] Timestamp: P: 1781938866039986 usec, L: 0
0620 07:01:17.428701 (+ 146us) write_op.cc:270] Start()
0620 07:01:17.428724 (+ 23us) write_op.cc:276] Timestamp: P: 1781938866090413 usec, L: 0
0620 07:01:17.428852 (+ 128us) write_op.cc:270] Start()
0620 07:01:17.428874 (+ 22us) write_op.cc:276] Timestamp: P: 1781938866092467 usec, L: 0
0620 07:01:17.429040 (+ 166us) write_op.cc:270] Start()
0620 07:01:17.429083 (+ 43us) write_op.cc:276] Timestamp: P: 1781938866094878 usec, L: 0
0620 07:01:17.429237 (+ 154us) write_op.cc:270] Start()
0620 07:01:17.429260 (+ 23us) write_op.cc:276] Timestamp: P: 1781938866119228 usec, L: 0
0620 07:01:17.429395 (+ 135us) write_op.cc:270] Start()
0620 07:01:17.429418 (+ 23us) write_op.cc:276] Timestamp: P: 1781938866139140 usec, L: 0
0620 07:01:17.429569 (+ 151us) write_op.cc:270] Start()
0620 07:01:17.429591 (+ 22us) write_op.cc:276] Timestamp: P: 1781938866150459 usec, L: 0
0620 07:01:17.429761 (+ 170us) write_op.cc:270] Start()
0620 07:01:17.429785 (+ 24us) write_op.cc:276] Timestamp: P: 1781938866155459 usec, L: 0
0620 07:01:17.429918 (+ 133us) write_op.cc:270] Start()
0620 07:01:17.429941 (+ 23us) write_op.cc:276] Timestamp: P: 1781938866157548 usec, L: 0
0620 07:01:17.430532 (+ 591us) write_op.cc:270] Start()
0620 07:01:17.430552 (+ 20us) write_op.cc:276] Timestamp: P: 1781938866159812 usec, L: 0
0620 07:01:17.430719 (+ 167us) write_op.cc:270] Start()
0620 07:01:17.430744 (+ 25us) write_op.cc:276] Timestamp: P: 1781938866160424 usec, L: 0
0620 07:01:17.430967 (+ 223us) write_op.cc:270] Start()
0620 07:01:17.430992 (+ 25us) write_op.cc:276] Timestamp: P: 1781938866160984 usec, L: 0
0620 07:01:17.431144 (+ 152us) write_op.cc:270] Start()
0620 07:01:17.431171 (+ 27us) write_op.cc:276] Timestamp: P: 1781938866277103 usec, L: 0
0620 07:01:17.431303 (+ 132us) write_op.cc:270] Start()
0620 07:01:17.431326 (+ 23us) write_op.cc:276] Timestamp: P: 1781938866277773 usec, L: 0
0620 07:01:17.431463 (+ 137us) write_op.cc:270] Start()
0620 07:01:17.431485 (+ 22us) write_op.cc:276] Timestamp: P: 1781938866300079 usec, L: 0
0620 07:01:17.438954 (+ 7469us) write_op.cc:270] Start()
0620 07:01:17.438999 (+ 45us) write_op.cc:276] Timestamp: P: 1781938866324047 usec, L: 0
0620 07:01:17.439171 (+ 172us) write_op.cc:270] Start()
0620 07:01:17.439189 (+ 18us) write_op.cc:276] Timestamp: P: 1781938866471128 usec, L: 0
0620 07:01:17.439423 (+ 234us) write_op.cc:270] Start()
0620 07:01:17.439446 (+ 23us) write_op.cc:276] Timestamp: P: 1781938866471992 usec, L: 0
0620 07:01:17.439567 (+ 121us) write_op.cc:270] Start()
0620 07:01:17.439585 (+ 18us) write_op.cc:276] Timestamp: P: 1781938866474089 usec, L: 0
0620 07:01:17.439728 (+ 143us) write_op.cc:270] Start()
0620 07:01:17.439748 (+ 20us) write_op.cc:276] Timestamp: P: 1781938866475225 usec, L: 0
0620 07:01:17.439876 (+ 128us) write_op.cc:270] Start()
0620 07:01:17.439891 (+ 15us) write_op.cc:276] Timestamp: P: 1781938866477212 usec, L: 0
0620 07:01:17.439984 (+ 93us) write_op.cc:270] Start()
0620 07:01:17.439999 (+ 15us) write_op.cc:276] Timestamp: P: 1781938866478568 usec, L: 0
0620 07:01:17.440102 (+ 103us) write_op.cc:270] Start()
0620 07:01:17.440128 (+ 26us) write_op.cc:276] Timestamp: P: 1781938866504129 usec, L: 0
0620 07:01:17.440232 (+ 104us) write_op.cc:270] Start()
0620 07:01:17.440248 (+ 16us) write_op.cc:276] Timestamp: P: 1781938866504643 usec, L: 0
0620 07:01:17.440352 (+ 104us) write_op.cc:270] Start()
0620 07:01:17.440368 (+ 16us) write_op.cc:276] Timestamp: P: 1781938866507874 usec, L: 0
0620 07:01:17.440473 (+ 105us) write_op.cc:270] Start()
0620 07:01:17.440490 (+ 17us) write_op.cc:276] Timestamp: P: 1781938866510737 usec, L: 0
0620 07:01:17.440582 (+ 92us) write_op.cc:270] Start()
0620 07:01:17.440620 (+ 38us) write_op.cc:276] Timestamp: P: 1781938866543810 usec, L: 0
0620 07:01:17.440878 (+ 258us) write_op.cc:270] Start()
0620 07:01:17.440897 (+ 19us) write_op.cc:276] Timestamp: P: 1781938866567853 usec, L: 0
0620 07:01:17.441023 (+ 126us) write_op.cc:270] Start()
0620 07:01:17.441039 (+ 16us) write_op.cc:276] Timestamp: P: 1781938866578725 usec, L: 0
0620 07:01:17.441134 (+ 95us) write_op.cc:270] Start()
0620 07:01:17.441148 (+ 14us) write_op.cc:276] Timestamp: P: 1781938866579845 usec, L: 0
0620 07:01:17.441247 (+ 99us) write_op.cc:270] Start()
0620 07:01:17.441262 (+ 15us) write_op.cc:276] Timestamp: P: 1781938866581184 usec, L: 0
0620 07:01:17.441372 (+ 110us) write_op.cc:270] Start()
0620 07:01:17.441386 (+ 14us) write_op.cc:276] Timestamp: P: 1781938866582098 usec, L: 0
0620 07:01:17.441481 (+ 95us) write_op.cc:270] Start()
0620 07:01:17.441501 (+ 20us) write_op.cc:276] Timestamp: P: 1781938866583890 usec, L: 0
0620 07:01:17.441629 (+ 128us) write_op.cc:270] Start()
0620 07:01:17.441648 (+ 19us) write_op.cc:276] Timestamp: P: 1781938866584404 usec, L: 0
0620 07:01:17.441777 (+ 129us) write_op.cc:270] Start()
0620 07:01:17.441796 (+ 19us) write_op.cc:276] Timestamp: P: 1781938866584887 usec, L: 0
0620 07:01:17.441922 (+ 126us) write_op.cc:270] Start()
0620 07:01:17.441942 (+ 20us) write_op.cc:276] Timestamp: P: 1781938866602564 usec, L: 0
0620 07:01:17.442051 (+ 109us) write_op.cc:270] Start()
0620 07:01:17.442075 (+ 24us) write_op.cc:276] Timestamp: P: 1781938866772308 usec, L: 0
0620 07:01:17.442180 (+ 105us) write_op.cc:270] Start()
0620 07:01:17.442197 (+ 17us) write_op.cc:276] Timestamp: P: 1781938866773080 usec, L: 0
0620 07:01:17.442305 (+ 108us) write_op.cc:270] Start()
0620 07:01:17.442326 (+ 21us) write_op.cc:276] Timestamp: P: 1781938866774702 usec, L: 0
0620 07:01:17.442422 (+ 96us) write_op.cc:270] Start()
0620 07:01:17.442444 (+ 22us) write_op.cc:276] Timestamp: P: 1781938866775585 usec, L: 0
0620 07:01:17.442552 (+ 108us) write_op.cc:270] Start()
0620 07:01:17.442567 (+ 15us) write_op.cc:276] Timestamp: P: 1781938866776106 usec, L: 0
0620 07:01:17.442688 (+ 121us) write_op.cc:270] Start()
0620 07:01:17.442707 (+ 19us) write_op.cc:276] Timestamp: P: 1781938866777793 usec, L: 0
0620 07:01:17.442864 (+ 157us) write_op.cc:270] Start()
0620 07:01:17.442883 (+ 19us) write_op.cc:276] Timestamp: P: 1781938866778287 usec, L: 0
0620 07:01:17.451464 (+ 8581us) write_op.cc:270] Start()
0620 07:01:17.451499 (+ 35us) write_op.cc:276] Timestamp: P: 1781938866895014 usec, L: 0
0620 07:01:17.451643 (+ 144us) write_op.cc:270] Start()
0620 07:01:17.451660 (+ 17us) write_op.cc:276] Timestamp: P: 1781938866895692 usec, L: 0
0620 07:01:17.451781 (+ 121us) write_op.cc:270] Start()
0620 07:01:17.451827 (+ 46us) write_op.cc:276] Timestamp: P: 1781938866928930 usec, L: 0
0620 07:01:17.451954 (+ 127us) write_op.cc:270] Start()
0620 07:01:17.451972 (+ 18us) write_op.cc:276] Timestamp: P: 1781938866929798 usec, L: 0
0620 07:01:17.452093 (+ 121us) write_op.cc:270] Start()
0620 07:01:17.452111 (+ 18us) write_op.cc:276] Timestamp: P: 1781938867089604 usec, L: 0
0620 07:01:17.452222 (+ 111us) write_op.cc:270] Start()
0620 07:01:17.452240 (+ 18us) write_op.cc:276] Timestamp: P: 1781938867111381 usec, L: 0
0620 07:01:17.452345 (+ 105us) write_op.cc:270] Start()
0620 07:01:17.452361 (+ 16us) write_op.cc:276] Timestamp: P: 1781938867112131 usec, L: 0
0620 07:01:17.452472 (+ 111us) write_op.cc:270] Start()
0620 07:01:17.452488 (+ 16us) write_op.cc:276] Timestamp: P: 1781938867112643 usec, L: 0
0620 07:01:17.452618 (+ 130us) write_op.cc:270] Start()
0620 07:01:17.459913 (+ 7295us) write_op.cc:276] Timestamp: P: 1781938867113153 usec, L: 0
0620 07:01:17.460146 (+ 233us) write_op.cc:270] Start()
0620 07:01:17.460172 (+ 26us) write_op.cc:276] Timestamp: P: 1781938867113676 usec, L: 0
0620 07:01:17.460293 (+ 121us) write_op.cc:270] Start()
0620 07:01:17.460310 (+ 17us) write_op.cc:276] Timestamp: P: 1781938867114216 usec, L: 0
0620 07:01:17.460416 (+ 106us) write_op.cc:270] Start()
0620 07:01:17.460437 (+ 21us) write_op.cc:276] Timestamp: P: 1781938867136998 usec, L: 0
0620 07:01:17.460545 (+ 108us) write_op.cc:270] Start()
0620 07:01:17.460560 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867213208 usec, L: 0
0620 07:01:17.460659 (+ 99us) write_op.cc:270] Start()
0620 07:01:17.460674 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867318837 usec, L: 0
0620 07:01:17.460794 (+ 120us) write_op.cc:270] Start()
0620 07:01:17.460813 (+ 19us) write_op.cc:276] Timestamp: P: 1781938867327710 usec, L: 0
0620 07:01:17.460925 (+ 112us) write_op.cc:270] Start()
0620 07:01:17.460940 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867328417 usec, L: 0
0620 07:01:17.461050 (+ 110us) write_op.cc:270] Start()
0620 07:01:17.461067 (+ 17us) write_op.cc:276] Timestamp: P: 1781938867329057 usec, L: 0
0620 07:01:17.461208 (+ 141us) write_op.cc:270] Start()
0620 07:01:17.461224 (+ 16us) write_op.cc:276] Timestamp: P: 1781938867329589 usec, L: 0
0620 07:01:17.461356 (+ 132us) write_op.cc:270] Start()
0620 07:01:17.461372 (+ 16us) write_op.cc:276] Timestamp: P: 1781938867386273 usec, L: 0
0620 07:01:17.461506 (+ 134us) write_op.cc:270] Start()
0620 07:01:17.461523 (+ 17us) write_op.cc:276] Timestamp: P: 1781938867463290 usec, L: 0
0620 07:01:17.461629 (+ 106us) write_op.cc:270] Start()
0620 07:01:17.461644 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867490968 usec, L: 0
0620 07:01:17.461755 (+ 111us) write_op.cc:270] Start()
0620 07:01:17.461770 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867506429 usec, L: 0
0620 07:01:17.461858 (+ 88us) write_op.cc:270] Start()
0620 07:01:17.461872 (+ 14us) write_op.cc:276] Timestamp: P: 1781938867518890 usec, L: 0
0620 07:01:17.461965 (+ 93us) write_op.cc:270] Start()
0620 07:01:17.461980 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867597856 usec, L: 0
0620 07:01:17.462078 (+ 98us) write_op.cc:270] Start()
0620 07:01:17.462093 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867606583 usec, L: 0
0620 07:01:17.462214 (+ 121us) write_op.cc:270] Start()
0620 07:01:17.462230 (+ 16us) write_op.cc:276] Timestamp: P: 1781938867607422 usec, L: 0
0620 07:01:17.462335 (+ 105us) write_op.cc:270] Start()
0620 07:01:17.462349 (+ 14us) write_op.cc:276] Timestamp: P: 1781938867610703 usec, L: 0
0620 07:01:17.462445 (+ 96us) write_op.cc:270] Start()
0620 07:01:17.462460 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867613836 usec, L: 0
0620 07:01:17.462552 (+ 92us) write_op.cc:270] Start()
0620 07:01:17.462567 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867614468 usec, L: 0
0620 07:01:17.462658 (+ 91us) write_op.cc:270] Start()
0620 07:01:17.462672 (+ 14us) write_op.cc:276] Timestamp: P: 1781938867626170 usec, L: 0
0620 07:01:17.462779 (+ 107us) write_op.cc:270] Start()
0620 07:01:17.466118 (+ 3339us) write_op.cc:276] Timestamp: P: 1781938867642162 usec, L: 0
0620 07:01:17.466314 (+ 196us) write_op.cc:270] Start()
0620 07:01:17.466334 (+ 20us) write_op.cc:276] Timestamp: P: 1781938867654857 usec, L: 0
0620 07:01:17.466438 (+ 104us) write_op.cc:270] Start()
0620 07:01:17.466453 (+ 15us) write_op.cc:276] Timestamp: P: 1781938867659276 usec, L: 0
0620 07:01:17.466559 (+ 106us) write_op.cc:270] Start()
0620 07:01:17.466577 (+ 18us) write_op.cc:276] Timestamp: P: 1781938867660038 usec, L: 0
0620 07:01:17.466694 (+ 117us) write_op.cc:270] Start()
0620 07:01:17.466711 (+ 17us) write_op.cc:276] Timestamp: P: 1781938867670824 usec, L: 0
0620 07:01:17.466837 (+ 126us) write_op.cc:270] Start()
0620 07:01:17.466862 (+ 25us) write_op.cc:276] Timestamp: P: 1781938867677377 usec, L: 0
0620 07:01:17.467007 (+ 145us) write_op.cc:270] Start()
0620 07:01:17.467030 (+ 23us) write_op.cc:276] Timestamp: P: 1781938867678101 usec, L: 0
0620 07:01:17.467171 (+ 141us) write_op.cc:270] Start()
0620 07:01:17.467190 (+ 19us) write_op.cc:276] Timestamp: P: 1781938867678727 usec, L: 0
0620 07:01:17.467328 (+ 138us) write_op.cc:270] Start()
0620 07:01:17.467353 (+ 25us) write_op.cc:276] Timestamp: P: 1781938867679395 usec, L: 0
0620 07:01:17.467524 (+ 171us) write_op.cc:270] Start()
0620 07:01:17.467565 (+ 41us) write_op.cc:276] Timestamp: P: 1781938867693449 usec, L: 0
0620 07:01:17.467743 (+ 178us) write_op.cc:270] Start()
0620 07:01:17.467770 (+ 27us) write_op.cc:276] Timestamp: P: 1781938867701301 usec, L: 0
0620 07:01:17.467915 (+ 145us) write_op.cc:270] Start()
0620 07:01:17.467933 (+ 18us) write_op.cc:276] Timestamp: P: 1781938867742126 usec, L: 0
0620 07:01:17.468071 (+ 138us) write_op.cc:270] Start()
0620 07:01:17.468095 (+ 24us) write_op.cc:276] Timestamp: P: 1781938867773357 usec, L: 0
0620 07:01:17.468222 (+ 127us) write_op.cc:270] Start()
0620 07:01:17.468246 (+ 24us) write_op.cc:276] Timestamp: P: 1781938867774738 usec, L: 0
0620 07:01:17.468403 (+ 157us) write_op.cc:270] Start()
0620 07:01:17.468427 (+ 24us) write_op.cc:276] Timestamp: P: 1781938867866265 usec, L: 0
0620 07:01:17.468580 (+ 153us) write_op.cc:270] Start()
0620 07:01:17.468603 (+ 23us) write_op.cc:276] Timestamp: P: 1781938867873794 usec, L: 0
0620 07:01:17.468747 (+ 144us) write_op.cc:270] Start()
0620 07:01:17.481137 (+ 12390us) write_op.cc:276] Timestamp: P: 1781938867920783 usec, L: 0
0620 07:01:17.481424 (+ 287us) write_op.cc:270] Start()
0620 07:01:17.481526 (+ 102us) write_op.cc:276] Timestamp: P: 1781938867922597 usec, L: 0
0620 07:01:17.481694 (+ 168us) write_op.cc:270] Start()
0620 07:01:17.481718 (+ 24us) write_op.cc:276] Timestamp: P: 1781938867934577 usec, L: 0
0620 07:01:17.512642 (+ 30924us) write_op.cc:270] Start()
0620 07:01:17.512694 (+ 52us) write_op.cc:276] Timestamp: P: 1781938867951702 usec, L: 0
0620 07:01:17.513084 (+ 390us) write_op.cc:270] Start()
0620 07:01:17.513122 (+ 38us) write_op.cc:276] Timestamp: P: 1781938867953519 usec, L: 0
0620 07:01:17.513312 (+ 190us) write_op.cc:270] Start()
0620 07:01:17.513331 (+ 19us) write_op.cc:276] Timestamp: P: 1781938867972705 usec, L: 0
0620 07:01:17.513511 (+ 180us) write_op.cc:270] Start()
0620 07:01:17.513530 (+ 19us) write_op.cc:276] Timestamp: P: 1781938868098357 usec, L: 0
0620 07:01:17.513637 (+ 107us) write_op.cc:270] Start()
0620 07:01:17.513653 (+ 16us) write_op.cc:276] Timestamp: P: 1781938868099880 usec, L: 0
0620 07:01:17.513781 (+ 128us) write_op.cc:270] Start()
0620 07:01:17.513815 (+ 34us) write_op.cc:276] Timestamp: P: 1781938868150823 usec, L: 0
0620 07:01:17.513988 (+ 173us) write_op.cc:270] Start()
0620 07:01:17.514010 (+ 22us) write_op.cc:276] Timestamp: P: 1781938868151436 usec, L: 0
0620 07:01:17.514167 (+ 157us) write_op.cc:270] Start()
0620 07:01:17.514192 (+ 25us) write_op.cc:276] Timestamp: P: 1781938868155557 usec, L: 0
0620 07:01:17.514340 (+ 148us) write_op.cc:270] Start()
0620 07:01:17.514363 (+ 23us) write_op.cc:276] Timestamp: P: 1781938868156140 usec, L: 0
0620 07:01:17.514498 (+ 135us) write_op.cc:270] Start()
0620 07:01:17.514517 (+ 19us) write_op.cc:276] Timestamp: P: 1781938868156635 usec, L: 0
0620 07:01:17.514739 (+ 222us) write_op.cc:270] Start()
0620 07:01:17.514763 (+ 24us) write_op.cc:276] Timestamp: P: 1781938868157116 usec, L: 0
0620 07:01:17.532851 (+ 18088us) write_op.cc:270] Start()
0620 07:01:17.532904 (+ 53us) write_op.cc:276] Timestamp: P: 1781938868157566 usec, L: 0
0620 07:01:17.533074 (+ 170us) write_op.cc:270] Start()
0620 07:01:17.533097 (+ 23us) write_op.cc:276] Timestamp: P: 1781938868158032 usec, L: 0
0620 07:01:17.533234 (+ 137us) write_op.cc:270] Start()
0620 07:01:17.533253 (+ 19us) write_op.cc:276] Timestamp: P: 1781938868158567 usec, L: 0
0620 07:01:17.533374 (+ 121us) write_op.cc:270] Start()
0620 07:01:17.533392 (+ 18us) write_op.cc:276] Timestamp: P: 1781938868189164 usec, L: 0
0620 07:01:17.533493 (+ 101us) write_op.cc:270] Start()
0620 07:01:17.533509 (+ 16us) write_op.cc:276] Timestamp: P: 1781938868419543 usec, L: 0
0620 07:01:17.533603 (+ 94us) write_op.cc:270] Start()
0620 07:01:17.533617 (+ 14us) write_op.cc:276] Timestamp: P: 1781938868426838 usec, L: 0
0620 07:01:17.533713 (+ 96us) write_op.cc:270] Start()
0620 07:01:17.533728 (+ 15us) write_op.cc:276] Timestamp: P: 1781938868427602 usec, L: 0
0620 07:01:17.533830 (+ 102us) write_op.cc:270] Start()
0620 07:01:17.533846 (+ 16us) write_op.cc:276] Timestamp: P: 1781938868428477 usec, L: 0
0620 07:01:17.533989 (+ 143us) write_op.cc:270] Start()
0620 07:01:17.534009 (+ 20us) write_op.cc:276] Timestamp: P: 1781938868514527 usec, L: 0
0620 07:01:17.534172 (+ 163us) write_op.cc:270] Start()
0620 07:01:17.534191 (+ 19us) write_op.cc:276] Timestamp: P: 1781938868563666 usec, L: 0
0620 07:01:17.534324 (+ 133us) write_op.cc:270] Start()
0620 07:01:17.534343 (+ 19us) write_op.cc:276] Timestamp: P: 1781938868564557 usec, L: 0
0620 07:01:17.534475 (+ 132us) write_op.cc:270] Start()
0620 07:01:17.534497 (+ 22us) write_op.cc:276] Timestamp: P: 1781938868606793 usec, L: 0
0620 07:01:17.534614 (+ 117us) write_op.cc:270] Start()
0620 07:01:17.534631 (+ 17us) write_op.cc:276] Timestamp: P: 1781938868618888 usec, L: 0
0620 07:01:17.534757 (+ 126us) write_op.cc:270] Start()
0620 07:01:17.534777 (+ 20us) write_op.cc:276] Timestamp: P: 1781938868660001 usec, L: 0
0620 07:01:17.534941 (+ 164us) write_op.cc:270] Start()
0620 07:01:17.534963 (+ 22us) write_op.cc:276] Timestamp: P: 1781938868743863 usec, L: 0
0620 07:01:17.535097 (+ 134us) write_op.cc:270] Start()
0620 07:01:17.535119 (+ 22us) write_op.cc:276] Timestamp: P: 1781938868771563 usec, L: 0
0620 07:01:17.535299 (+ 180us) write_op.cc:270] Start()
0620 07:01:17.535325 (+ 26us) write_op.cc:276] Timestamp: P: 1781938868777491 usec, L: 0
0620 07:01:17.535456 (+ 131us) write_op.cc:270] Start()
0620 07:01:17.535479 (+ 23us) write_op.cc:276] Timestamp: P: 1781938868778123 usec, L: 0
0620 07:01:17.535607 (+ 128us) write_op.cc:270] Start()
0620 07:01:17.535626 (+ 19us) write_op.cc:276] Timestamp: P: 1781938868778666 usec, L: 0
0620 07:01:17.535746 (+ 120us) write_op.cc:270] Start()
0620 07:01:17.535766 (+ 20us) write_op.cc:276] Timestamp: P: 1781938868787979 usec, L: 0
0620 07:01:17.535875 (+ 109us) write_op.cc:270] Start()
0620 07:01:17.535909 (+ 34us) write_op.cc:276] Timestamp: P: 1781938868798975 usec, L: 0
0620 07:01:17.536029 (+ 120us) write_op.cc:270] Start()
0620 07:01:17.536056 (+ 27us) write_op.cc:276] Timestamp: P: 1781938868832749 usec, L: 0
0620 07:01:17.536184 (+ 128us) write_op.cc:270] Start()
0620 07:01:17.536203 (+ 19us) write_op.cc:276] Timestamp: P: 1781938868853125 usec, L: 0
0620 07:01:17.536316 (+ 113us) write_op.cc:270] Start()
0620 07:01:17.536334 (+ 18us) write_op.cc:276] Timestamp: P: 1781938868871168 usec, L: 0
0620 07:01:17.552190 (+ 15856us) write_op.cc:270] Start()
0620 07:01:17.552238 (+ 48us) write_op.cc:276] Timestamp: P: 1781938868889152 usec, L: 0
0620 07:01:17.552448 (+ 210us) write_op.cc:270] Start()
0620 07:01:17.552469 (+ 21us) write_op.cc:276] Timestamp: P: 1781938868898967 usec, L: 0
0620 07:01:17.552598 (+ 129us) write_op.cc:270] Start()
0620 07:01:17.552616 (+ 18us) write_op.cc:276] Timestamp: P: 1781938868904258 usec, L: 0
0620 07:01:17.552729 (+ 113us) write_op.cc:270] Start()
0620 07:01:17.552775 (+ 46us) write_op.cc:276] Timestamp: P: 1781938868915549 usec, L: 0
0620 07:01:17.552928 (+ 153us) write_op.cc:270] Start()
0620 07:01:17.552947 (+ 19us) write_op.cc:276] Timestamp: P: 1781938868921849 usec, L: 0
0620 07:01:17.553052 (+ 105us) write_op.cc:270] Start()
0620 07:01:17.555568 (+ 2516us) write_op.cc:276] Timestamp: P: 1781938868930817 usec, L: 0
0620 07:01:17.555820 (+ 252us) write_op.cc:270] Start()
0620 07:01:17.555928 (+ 108us) write_op.cc:276] Timestamp: P: 1781938868939635 usec, L: 0
0620 07:01:17.556088 (+ 160us) write_op.cc:270] Start()
0620 07:01:17.556106 (+ 18us) write_op.cc:276] Timestamp: P: 1781938868948750 usec, L: 0
0620 07:01:17.556220 (+ 114us) write_op.cc:270] Start()
0620 07:01:17.556236 (+ 16us) write_op.cc:276] Timestamp: P: 1781938869017569 usec, L: 0
0620 07:01:17.556340 (+ 104us) write_op.cc:270] Start()
0620 07:01:17.556360 (+ 20us) write_op.cc:276] Timestamp: P: 1781938869018264 usec, L: 0
0620 07:01:17.556474 (+ 114us) write_op.cc:270] Start()
0620 07:01:17.556490 (+ 16us) write_op.cc:276] Timestamp: P: 1781938869021261 usec, L: 0
0620 07:01:17.556587 (+ 97us) write_op.cc:270] Start()
0620 07:01:17.556604 (+ 17us) write_op.cc:276] Timestamp: P: 1781938869024288 usec, L: 0
0620 07:01:17.556708 (+ 104us) write_op.cc:270] Start()
0620 07:01:17.556730 (+ 22us) write_op.cc:276] Timestamp: P: 1781938869028006 usec, L: 0
0620 07:01:17.556834 (+ 104us) write_op.cc:270] Start()
0620 07:01:17.556850 (+ 16us) write_op.cc:276] Timestamp: P: 1781938869033181 usec, L: 0
0620 07:01:17.556998 (+ 148us) write_op.cc:270] Start()
0620 07:01:17.557016 (+ 18us) write_op.cc:276] Timestamp: P: 1781938869062387 usec, L: 0
0620 07:01:17.557135 (+ 119us) write_op.cc:270] Start()
0620 07:01:17.557155 (+ 20us) write_op.cc:276] Timestamp: P: 1781938869070076 usec, L: 0
0620 07:01:17.557268 (+ 113us) write_op.cc:270] Start()
0620 07:01:17.557285 (+ 17us) write_op.cc:276] Timestamp: P: 1781938869078949 usec, L: 0
0620 07:01:17.557451 (+ 166us) write_op.cc:270] Start()
0620 07:01:17.557469 (+ 18us) write_op.cc:276] Timestamp: P: 1781938869082874 usec, L: 0
0620 07:01:17.557608 (+ 139us) write_op.cc:270] Start()
0620 07:01:17.557625 (+ 17us) write_op.cc:276] Timestamp: P: 1781938869083686 usec, L: 0
0620 07:01:17.557737 (+ 112us) write_op.cc:270] Start()
0620 07:01:17.557754 (+ 17us) write_op.cc:276] Timestamp: P: 1781938869084605 usec, L: 0
0620 07:01:17.557857 (+ 103us) write_op.cc:270] Start()
0620 07:01:17.557872 (+ 15us) write_op.cc:276] Timestamp: P: 1781938869087888 usec, L: 0
0620 07:01:17.557997 (+ 125us) write_op.cc:270] Start()
0620 07:01:17.558016 (+ 19us) write_op.cc:276] Timestamp: P: 1781938869112149 usec, L: 0
0620 07:01:17.558139 (+ 123us) write_op.cc:270] Start()
0620 07:01:17.558156 (+ 17us) write_op.cc:276] Timestamp: P: 1781938869121674 usec, L: 0
0620 07:01:17.558286 (+ 130us) write_op.cc:270] Start()
0620 07:01:17.558304 (+ 18us) write_op.cc:276] Timestamp: P: 1781938869188945 usec, L: 0
0620 07:01:17.558442 (+ 138us) write_op.cc:270] Start()
0620 07:01:17.558460 (+ 18us) write_op.cc:276] Timestamp: P: 1781938869209435 usec, L: 0
0620 07:01:17.558579 (+ 119us) write_op.cc:270] Start()
0620 07:01:17.558608 (+ 29us) write_op.cc:276] Timestamp: P: 1781938869218015 usec, L: 0
0620 07:01:17.558732 (+ 124us) write_op.cc:270] Start()
0620 07:01:17.558761 (+ 29us) write_op.cc:276] Timestamp: P: 1781938869220827 usec, L: 0
0620 07:01:17.558952 (+ 191us) write_op.cc:270] Start()
0620 07:01:17.558983 (+ 31us) write_op.cc:276] Timestamp: P: 1781938869223914 usec, L: 0
0620 07:01:17.559177 (+ 194us) write_op.cc:270] Start()
0620 07:01:17.559197 (+ 20us) write_op.cc:276] Timestamp: P: 1781938869228044 usec, L: 0
0620 07:01:17.559322 (+ 125us) write_op.cc:270] Start()
0620 07:01:17.559342 (+ 20us) write_op.cc:276] Timestamp: P: 1781938869245510 usec, L: 0
0620 07:01:17.580915 (+ 21573us) write_op.cc:270] Start()
0620 07:01:17.580961 (+ 46us) write_op.cc:276] Timestamp: P: 1781938869259071 usec, L: 0
0620 07:01:17.581147 (+ 186us) write_op.cc:270] Start()
0620 07:01:17.581177 (+ 30us) write_op.cc:276] Timestamp: P: 1781938869636772 usec, L: 0
0620 07:01:17.581341 (+ 164us) write_op.cc:270] Start()
0620 07:01:17.581372 (+ 31us) write_op.cc:276] Timestamp: P: 1781938869654976 usec, L: 0
0620 07:01:17.592231 (+ 10859us) write_op.cc:270] Start()
0620 07:01:17.592281 (+ 50us) write_op.cc:276] Timestamp: P: 1781938869656778 usec, L: 0
0620 07:01:17.592784 (+ 503us) write_op.cc:270] Start()
0620 07:01:17.592823 (+ 39us) write_op.cc:276] Timestamp: P: 1781938869657347 usec, L: 0
0620 07:01:17.592996 (+ 173us) write_op.cc:270] Start()
0620 07:01:17.593022 (+ 26us) write_op.cc:276] Timestamp: P: 1781938869657856 usec, L: 0
0620 07:01:17.593159 (+ 137us) write_op.cc:270] Start()
0620 07:01:17.593181 (+ 22us) write_op.cc:276] Timestamp: P: 1781938
I20260620 07:01:18.828429 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2f5c0f1c20f46b7b62fccea47f857d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.828995 1170 tablet_bootstrap.cc:492] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:18.830579 1170 tablet_bootstrap.cc:654] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.835425 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 (table default.Table_642c62b94c31483480661843e4bcbe5c [id=aec61ada90ac43b6b4ca3d6c297c8bd3]) successfully deleted
W20260620 07:01:18.835842 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b4b60d2a45944a09a60a2826a9a45738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4b60d2a45944a09a60a2826a9a45738 already in progress: creating tablet
W20260620 07:01:18.836117 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f already in progress: creating tablet
I20260620 07:01:18.835480 1166 tablet_replica.cc:330] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:18.839027 1908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:01:18.839314 1908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: LEADER
I20260620 07:01:18.848057 2450 raft_consensus.cc:2726] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:18.848924 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 73641.5us
I20260620 07:01:18.870940 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74990dfb3d774dd0b7bb4666afde5797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.871729 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.872033 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ded117a6342e473e992c6a9d192462f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.872284 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e98a39613e04c919a7c3e6579796240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.872466 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2f5c0f1c20f46b7b62fccea47f857d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.872655 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c55ae1fd8ab44a84811657b6cfbe721a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.874681 1167 tablet_bootstrap.cc:654] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:18.875666 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ce4142ad2cb4e0daa65ab051adc005d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.878964 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2915c0e3604565a48dffef8c670219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.884663 1166 raft_consensus.cc:2229] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:18.885020 1166 raft_consensus.cc:2258] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.886771 861 tablet_service.cc:1467] Processing CreateTablet for tablet e15c284581d84b11bca1a7847c55b9cb (DEFAULT_TABLE table=default.Table_aeeb14e2b08a485cb1c6a913b384d45b [id=47c4da174aaa4865ad16e56db3614e66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.890283 860 tablet_service.cc:1467] Processing CreateTablet for tablet 1f5203b20332450faadaf3eef2a3e84c (DEFAULT_TABLE table=default.Table_761dbedd508c4c35b1528aa0be191f6a [id=c13e36d573e441989ccf4396dad92f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.890980 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0621724505b34d10bced5c920b46442f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.767426 2366 raft_consensus.cc:504] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.892997 2366 leader_election.cc:288] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.893162 1166 ts_tablet_manager.cc:1905] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.894768 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6bae5090f81417cbcf4b4d598b438da" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:18.895390 830 leader_election.cc:341] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.888353 865 tablet_service.cc:1467] Processing CreateTablet for tablet 791b70bb1e364c4ebba9b85d400fc146 (DEFAULT_TABLE table=default.Table_de6c16eb4d8e49f59c88af00c2d27547 [id=90a2ed416d014895ae3ef4cf419a2284]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:18.899430 969 leader_election.cc:341] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 04db48e910514d46bb4deb9acf54f7c0
I20260620 07:01:18.899585 969 leader_election.cc:302] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:18.899909 1999 raft_consensus.cc:2726] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:18.888947 1168 consensus_queue.cc:260] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.905360 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2816955770f74f52b3d1077078728736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.906613 2366 raft_consensus.cc:482] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.918946 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba2228150b9543e78c81b12e2592484a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.913501 1166 ts_tablet_manager.cc:1918] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:18.924495 1166 log.cc:1196] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/a292d66ee14a48959c1f6a63e0a0f492
I20260620 07:01:18.924927 1166 ts_tablet_manager.cc:1939] T a292d66ee14a48959c1f6a63e0a0f492 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:18.925778 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 801) took 5544 ms. Trace:
I20260620 07:01:18.925884 1166 rpcz_store.cc:276] 0620 07:01:13.381086 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.381132 (+ 46us) service_pool.cc:227] Handling call
0620 07:01:18.816909 (+5435777us) ts_tablet_manager.cc:1145] Deleting tablet a292d66ee14a48959c1f6a63e0a0f492
0620 07:01:18.818314 (+ 1405us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.896202 (+ 77888us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.913425 (+ 17223us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.925760 (+ 12335us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5432293}
I20260620 07:01:18.935015 1166 tablet_replica.cc:330] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:18.935257 1166 raft_consensus.cc:2229] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:18.935614 1166 raft_consensus.cc:2258] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.936172 1166 ts_tablet_manager.cc:1905] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.942332 1166 ts_tablet_manager.cc:1918] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:18.942469 1166 log.cc:1196] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/cfff2a14b1184d39bd7ac1091ef749c9
W20260620 07:01:18.859216 2448 log.cc:924] Time spent T a1c683a2169e4938b6941f83308cd392 P 2b84cae646b24bc7bd424eb8434ad425: Append to log took a long time: real 0.050s user 0.001s sys 0.000s
I20260620 07:01:18.869715 723 tablet_service.cc:1467] Processing CreateTablet for tablet 4f8767b1f8cb41e3ad3aebfd269fd2ef (DEFAULT_TABLE table=default.Table_8ed3b3839c1c4c85ae6723e50d955079 [id=101551dac4b645c5a244321d95120f93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.949065 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f8767b1f8cb41e3ad3aebfd269fd2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.950549 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 62ef9a12e3684d27b6696f631c68a5af (table default.Table_6f3b64370ac34819971c81edfb087f5f [id=01b6d66971e346cd98085dba5d3376ad]) successfully deleted
W20260620 07:01:18.950762 412 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 81241.7us
I20260620 07:01:18.885655 727 tablet_service.cc:1467] Processing CreateTablet for tablet 0b5c83ccfccc4bf1be5a31f21bb3faa2 (DEFAULT_TABLE table=default.Table_e931da372abe49fe8893c6abb65fe7dc [id=99ef4196a2254f46bb372cc2d610195e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.951192 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b5c83ccfccc4bf1be5a31f21bb3faa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.952890 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 1f5203b20332450faadaf3eef2a3e84c (DEFAULT_TABLE table=default.Table_761dbedd508c4c35b1528aa0be191f6a [id=c13e36d573e441989ccf4396dad92f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.953274 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f5203b20332450faadaf3eef2a3e84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.888564 719 tablet_service.cc:1467] Processing CreateTablet for tablet 791b70bb1e364c4ebba9b85d400fc146 (DEFAULT_TABLE table=default.Table_de6c16eb4d8e49f59c88af00c2d27547 [id=90a2ed416d014895ae3ef4cf419a2284]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.955247 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791b70bb1e364c4ebba9b85d400fc146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.958182 2436 catalog_manager.cc:1259] Loaded cluster ID: f5f6212dc8bc4fbd93e00bcd73ee0625
I20260620 07:01:18.958271 2436 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: loading cluster ID for follower catalog manager: success
W20260620 07:01:18.909166 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 68372.8us
I20260620 07:01:18.868695 2359 raft_consensus.cc:686] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:18.959206 2359 consensus_queue.cc:237] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.913044 720 tablet_service.cc:1467] Processing CreateTablet for tablet d217a23adfda4bfebc1b480028e7649d (DEFAULT_TABLE table=default.Table_db252cfad66a4f05ae3924ff1bd71ff7 [id=dc72a986f69e4655958f0722d7c34016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.959738 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d217a23adfda4bfebc1b480028e7649d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.960237 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6bae5090f81417cbcf4b4d598b438da" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:18.891212 729 tablet_service.cc:1467] Processing CreateTablet for tablet 1f5203b20332450faadaf3eef2a3e84c (DEFAULT_TABLE table=default.Table_761dbedd508c4c35b1528aa0be191f6a [id=c13e36d573e441989ccf4396dad92f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.960724 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f5203b20332450faadaf3eef2a3e84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.914439 721 tablet_service.cc:1467] Processing CreateTablet for tablet f0876d36e48a4d7fa78a1448fbeee4c2 (DEFAULT_TABLE table=default.Table_9a8785defc83404485359d8702fa2ddb [id=c49a02da5b58408da89606d2238f35f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.965638 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0876d36e48a4d7fa78a1448fbeee4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.916945 730 tablet_service.cc:1467] Processing CreateTablet for tablet 4de362c8b3da4128bf06022f7263e284 (DEFAULT_TABLE table=default.Table_7fa5ed394e58488599dee907c0b79367 [id=a18c5dfb9623436e97526cc3ad7616ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.969684 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4de362c8b3da4128bf06022f7263e284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.972731 1166 ts_tablet_manager.cc:1939] T cfff2a14b1184d39bd7ac1091ef749c9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:18.973702 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 802) took 5592 ms. Trace:
I20260620 07:01:18.973790 1166 rpcz_store.cc:276] 0620 07:01:13.381474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.381536 (+ 62us) service_pool.cc:227] Handling call
0620 07:01:18.934967 (+5553431us) ts_tablet_manager.cc:1145] Deleting tablet cfff2a14b1184d39bd7ac1091ef749c9
0620 07:01:18.934978 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.939327 (+ 4349us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.942224 (+ 2897us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.973681 (+ 31457us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5553257}
I20260620 07:01:18.974182 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 803) took 5475 ms. Trace:
I20260620 07:01:18.974253 1166 rpcz_store.cc:276] 0620 07:01:13.498259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.498593 (+ 334us) service_pool.cc:227] Handling call
0620 07:01:18.974061 (+5475468us) ts_tablet_manager.cc:1145] Deleting tablet 5f04603a2fe84988ac9c9975e94ce9ae
0620 07:01:18.974073 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.974167 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5475296}
I20260620 07:01:18.974561 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 806) took 5476 ms. Trace:
I20260620 07:01:18.974628 1166 rpcz_store.cc:276] 0620 07:01:13.498547 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.498812 (+ 265us) service_pool.cc:227] Handling call
0620 07:01:18.974472 (+5475660us) ts_tablet_manager.cc:1145] Deleting tablet f4f77b677ab34d9b8554de0da6564fb1
0620 07:01:18.974481 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.974548 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5475495}
I20260620 07:01:18.974924 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 805) took 5476 ms. Trace:
I20260620 07:01:18.921478 732 tablet_service.cc:1467] Processing CreateTablet for tablet 1cc718ed16674b9fb1f8f77ed32e1c71 (DEFAULT_TABLE table=default.Table_7f4e45654c564d97a4acee1989b9b9dc [id=94820f6d2da547459abfd88ae6c57afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.974992 1166 rpcz_store.cc:276] 0620 07:01:13.498473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.498966 (+ 493us) service_pool.cc:227] Handling call
0620 07:01:18.974836 (+5475870us) ts_tablet_manager.cc:1145] Deleting tablet b40e1ea4d1c74be2906381064c73f8c5
0620 07:01:18.974846 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.974912 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5475707}
I20260620 07:01:18.975270 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 804) took 5476 ms. Trace:
I20260620 07:01:18.975342 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cc718ed16674b9fb1f8f77ed32e1c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.975344 1166 rpcz_store.cc:276] 0620 07:01:13.498379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.498737 (+ 358us) service_pool.cc:227] Handling call
0620 07:01:18.975184 (+5476447us) ts_tablet_manager.cc:1145] Deleting tablet 64addb9379b247dfa678e2a0ae1af0cf
0620 07:01:18.975193 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.975256 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5475996}
I20260620 07:01:18.975626 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 807) took 5419 ms. Trace:
I20260620 07:01:18.975692 1166 rpcz_store.cc:276] 0620 07:01:13.555992 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.556057 (+ 65us) service_pool.cc:227] Handling call
0620 07:01:18.975543 (+5419486us) ts_tablet_manager.cc:1145] Deleting tablet cf978ab301954866aeb77b7abaf2c77e
0620 07:01:18.975552 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.975614 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5419255}
I20260620 07:01:18.975961 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 808) took 5418 ms. Trace:
I20260620 07:01:18.976027 1166 rpcz_store.cc:276] 0620 07:01:13.557996 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.558059 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:18.975873 (+5417814us) ts_tablet_manager.cc:1145] Deleting tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7
0620 07:01:18.975882 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.975946 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5417609}
I20260620 07:01:18.976256 1166 tablet_replica.cc:330] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:18.976491 1166 raft_consensus.cc:2229] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:18.976778 1166 pending_rounds.cc:62] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:18.976815 1166 pending_rounds.cc:68] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821625242165248 op_type: NO_OP noop_request { }
I20260620 07:01:18.976922 1166 raft_consensus.cc:2866] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:18.976996 1166 raft_consensus.cc:2258] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:18.977500 1166 ts_tablet_manager.cc:1905] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:18.924358 726 tablet_service.cc:1467] Processing CreateTablet for tablet 3aec5cd1f16a44a88477dfa750db60de (DEFAULT_TABLE table=default.Table_2bd50406a4304cd7927462a2bf47aaae [id=13254efcd34c41c88047746da3958351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.979359 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aec5cd1f16a44a88477dfa750db60de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.980053 999 tablet_service.cc:1467] Processing CreateTablet for tablet e15c284581d84b11bca1a7847c55b9cb (DEFAULT_TABLE table=default.Table_aeeb14e2b08a485cb1c6a913b384d45b [id=47c4da174aaa4865ad16e56db3614e66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.980394 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e15c284581d84b11bca1a7847c55b9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.983053 2253 raft_consensus.cc:482] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.983057 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 4f8767b1f8cb41e3ad3aebfd269fd2ef (DEFAULT_TABLE table=default.Table_8ed3b3839c1c4c85ae6723e50d955079 [id=101551dac4b645c5a244321d95120f93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.983207 2253 raft_consensus.cc:504] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.983418 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f8767b1f8cb41e3ad3aebfd269fd2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.983930 2253 leader_election.cc:288] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.860338 2449 raft_consensus.cc:482] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:18.984284 2449 raft_consensus.cc:504] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.984583 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 0b5c83ccfccc4bf1be5a31f21bb3faa2 (DEFAULT_TABLE table=default.Table_e931da372abe49fe8893c6abb65fe7dc [id=99ef4196a2254f46bb372cc2d610195e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.984925 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b5c83ccfccc4bf1be5a31f21bb3faa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.984912 2449 leader_election.cc:288] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.887212 716 tablet_service.cc:1467] Processing CreateTablet for tablet e15c284581d84b11bca1a7847c55b9cb (DEFAULT_TABLE table=default.Table_aeeb14e2b08a485cb1c6a913b384d45b [id=47c4da174aaa4865ad16e56db3614e66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.985387 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e15c284581d84b11bca1a7847c55b9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:18.903957 1170 tablet_bootstrap.cc:492] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:18.988246 1170 ts_tablet_manager.cc:1397] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.159s user 0.001s sys 0.004s
I20260620 07:01:18.988966 1170 raft_consensus.cc:348] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.989182 1170 raft_consensus.cc:374] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:18.992244 1168 ts_tablet_manager.cc:1428] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.242s user 0.000s sys 0.003s
I20260620 07:01:18.993686 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97e01aa120cc4c189017236ad57de811" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:18.994284 681 leader_election.cc:341] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:18.898916 862 tablet_service.cc:1467] Processing CreateTablet for tablet 0b5c83ccfccc4bf1be5a31f21bb3faa2 (DEFAULT_TABLE table=default.Table_e931da372abe49fe8893c6abb65fe7dc [id=99ef4196a2254f46bb372cc2d610195e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.906759 2366 raft_consensus.cc:504] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:18.998025 2366 leader_election.cc:288] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:18.999153 867 tablet_service.cc:1467] Processing CreateTablet for tablet f0876d36e48a4d7fa78a1448fbeee4c2 (DEFAULT_TABLE table=default.Table_9a8785defc83404485359d8702fa2ddb [id=c49a02da5b58408da89606d2238f35f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:18.989231 1170 raft_consensus.cc:729] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:18.999799 1169 ts_tablet_manager.cc:1918] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:18.999912 1169 log.cc:1196] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/c2e38178b9244152915d4c0a9dcf59dc
I20260620 07:01:18.999773 1170 consensus_queue.cc:260] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.000432 1170 ts_tablet_manager.cc:1428] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
W20260620 07:01:19.000671 831 leader_election.cc:341] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.000774 831 leader_election.cc:302] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.001021 1169 ts_tablet_manager.cc:1939] T c2e38178b9244152915d4c0a9dcf59dc P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:19.001343 2366 raft_consensus.cc:2726] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.002822 1168 tablet_bootstrap.cc:492] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:19.003538 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a96030064de046e5873bdaab6f3dff60" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:19.003696 1170 tablet_bootstrap.cc:492] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.003867 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d9d4b5a69484176a7b0f4fded010867" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:19.005131 1170 tablet_bootstrap.cc:654] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.006757 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d9d4b5a69484176a7b0f4fded010867" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:19.006940 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a96030064de046e5873bdaab6f3dff60" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.007899 830 leader_election.cc:341] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:19.008368 830 leader_election.cc:341] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.008580 1166 ts_tablet_manager.cc:1918] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:19.008708 1166 log.cc:1196] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/b5014cf5cc70466bafb6921c9d46ba72
I20260620 07:01:19.009073 1166 ts_tablet_manager.cc:1939] T b5014cf5cc70466bafb6921c9d46ba72 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:19.009124 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 791b70bb1e364c4ebba9b85d400fc146 (DEFAULT_TABLE table=default.Table_de6c16eb4d8e49f59c88af00c2d27547 [id=90a2ed416d014895ae3ef4cf419a2284]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.009877 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 826) took 5216 ms. Trace:
I20260620 07:01:19.009985 1166 rpcz_store.cc:276] 0620 07:01:13.793534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.793585 (+ 51us) service_pool.cc:227] Handling call
0620 07:01:18.976221 (+5182636us) ts_tablet_manager.cc:1145] Deleting tablet b5014cf5cc70466bafb6921c9d46ba72
0620 07:01:18.976229 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.005113 (+ 28884us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.008478 (+ 3365us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.009855 (+ 1377us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5164935}
I20260620 07:01:19.010334 1166 tablet_replica.cc:330] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:19.010525 1166 raft_consensus.cc:2229] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.011303 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e15c284581d84b11bca1a7847c55b9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.012001 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f8767b1f8cb41e3ad3aebfd269fd2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.012223 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0876d36e48a4d7fa78a1448fbeee4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.019165 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 935) took 2878 ms. Trace:
I20260620 07:01:19.019295 1169 rpcz_store.cc:276] 0620 07:01:16.141069 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.144066 (+ 2997us) service_pool.cc:227] Handling call
0620 07:01:18.764124 (+2620058us) ts_tablet_manager.cc:1145] Deleting tablet c2e38178b9244152915d4c0a9dcf59dc
0620 07:01:18.764133 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:18.985114 (+220981us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:18.999704 (+ 14590us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.019143 (+ 19439us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2619420}
I20260620 07:01:19.000535 871 tablet_service.cc:1467] Processing CreateTablet for tablet d217a23adfda4bfebc1b480028e7649d (DEFAULT_TABLE table=default.Table_db252cfad66a4f05ae3924ff1bd71ff7 [id=dc72a986f69e4655958f0722d7c34016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.019645 1169 tablet_replica.cc:330] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:19.020390 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97e01aa120cc4c189017236ad57de811" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:19.020654 893 raft_consensus.cc:2454] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
W20260620 07:01:19.020787 831 leader_election.cc:341] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.020907 831 leader_election.cc:302] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:19.021272 831 leader_election.cc:341] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.021374 831 leader_election.cc:302] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.022184 2253 raft_consensus.cc:2726] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.022361 2253 raft_consensus.cc:2726] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.023401 858 tablet_service.cc:1467] Processing CreateTablet for tablet 4de362c8b3da4128bf06022f7263e284 (DEFAULT_TABLE table=default.Table_7fa5ed394e58488599dee907c0b79367 [id=a18c5dfb9623436e97526cc3ad7616ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.019842 1169 raft_consensus.cc:2229] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:19.025873 1169 raft_consensus.cc:2258] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.026214 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet c2e38178b9244152915d4c0a9dcf59dc (table default.Table_1016b85ff6404fc0aff750ab23813534 [id=202a9df145344ba48e0563ba13f1849f]) successfully deleted
I20260620 07:01:19.026412 857 tablet_service.cc:1467] Processing CreateTablet for tablet 3aec5cd1f16a44a88477dfa750db60de (DEFAULT_TABLE table=default.Table_2bd50406a4304cd7927462a2bf47aaae [id=13254efcd34c41c88047746da3958351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.023001 874 tablet_service.cc:1467] Processing CreateTablet for tablet 1cc718ed16674b9fb1f8f77ed32e1c71 (DEFAULT_TABLE table=default.Table_7f4e45654c564d97a4acee1989b9b9dc [id=94820f6d2da547459abfd88ae6c57afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.026692 1169 ts_tablet_manager.cc:1905] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.028616 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791b70bb1e364c4ebba9b85d400fc146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.028837 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f5203b20332450faadaf3eef2a3e84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.029363 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aec5cd1f16a44a88477dfa750db60de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.030498 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cc718ed16674b9fb1f8f77ed32e1c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.030653 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d217a23adfda4bfebc1b480028e7649d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.031486 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4de362c8b3da4128bf06022f7263e284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.038009 683 leader_election.cc:302] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:19.010660 1166 raft_consensus.cc:2258] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.038292 2450 raft_consensus.cc:2781] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:19.038380 2450 raft_consensus.cc:482] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:19.038443 2450 raft_consensus.cc:3037] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:19.038913 1166 ts_tablet_manager.cc:1905] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.040887 2450 raft_consensus.cc:504] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.041893 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97e01aa120cc4c189017236ad57de811" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:19.042169 1170 tablet_bootstrap.cc:492] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:19.042194 893 raft_consensus.cc:3037] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:19.042275 1170 ts_tablet_manager.cc:1397] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.001s
I20260620 07:01:19.043176 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97e01aa120cc4c189017236ad57de811" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:19.043327 1169 ts_tablet_manager.cc:1918] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:19.043417 1169 log.cc:1196] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/a9d4ef3ba51e432f889fb927a6af8b49
I20260620 07:01:19.043773 1169 ts_tablet_manager.cc:1939] T a9d4ef3ba51e432f889fb927a6af8b49 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:19.044852 893 raft_consensus.cc:2454] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:19.044094 681 leader_election.cc:341] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.044391 1170 raft_consensus.cc:348] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.044561 2450 leader_election.cc:288] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.051827 1170 raft_consensus.cc:374] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.051920 1170 raft_consensus.cc:729] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.052124 1170 consensus_queue.cc:260] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.052698 1170 ts_tablet_manager.cc:1428] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260620 07:01:19.053283 1170 tablet_bootstrap.cc:492] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.054045 2366 raft_consensus.cc:482] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.054169 2366 raft_consensus.cc:504] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.054756 1170 tablet_bootstrap.cc:654] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.054803 2366 leader_election.cc:288] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.055446 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9d344f9e4b444e4b6018fdf0cf762fd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.056030 830 leader_election.cc:341] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.059619 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 936) took 2901 ms. Trace:
I20260620 07:01:19.061877 1169 rpcz_store.cc:276] 0620 07:01:16.158007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.159963 (+ 1956us) service_pool.cc:227] Handling call
0620 07:01:19.019606 (+2859643us) ts_tablet_manager.cc:1145] Deleting tablet a9d4ef3ba51e432f889fb927a6af8b49
0620 07:01:19.019615 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.029666 (+ 10051us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.043222 (+ 13556us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.059590 (+ 16368us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2858958}
I20260620 07:01:19.063082 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]) successfully deleted
I20260620 07:01:19.063625 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 937) took 2833 ms. Trace:
I20260620 07:01:19.062258 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9d344f9e4b444e4b6018fdf0cf762fd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:19.062194 683 leader_election.cc:302] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:19.064630 1169 rpcz_store.cc:276] 0620 07:01:16.230047 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.230107 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:19.063512 (+2833405us) ts_tablet_manager.cc:1145] Deleting tablet 5046d808d01f4af3803cb3edf425f777
0620 07:01:19.063523 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.063609 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2833151}
I20260620 07:01:19.064865 2359 raft_consensus.cc:2781] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:19.065191 2359 raft_consensus.cc:686] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
W20260620 07:01:19.065418 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5046d808d01f4af3803cb3edf425f777 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5046d808d01f4af3803cb3edf425f777 already in progress: creating tablet
I20260620 07:01:19.065418 2359 consensus_queue.cc:237] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:19.066720 831 leader_election.cc:341] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.066963 831 leader_election.cc:302] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.067265 2366 raft_consensus.cc:2726] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.093437 1168 tablet_bootstrap.cc:654] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.095129 2366 raft_consensus.cc:482] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.095345 2366 raft_consensus.cc:504] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.096057 2366 leader_election.cc:288] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.096912 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c083ebc2e054e09a531a8768802dcb1" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.097676 830 leader_election.cc:341] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.098555 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c083ebc2e054e09a531a8768802dcb1" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:19.099241 831 leader_election.cc:341] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.099411 831 leader_election.cc:302] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.100033 2366 raft_consensus.cc:2726] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.106222 1167 tablet_bootstrap.cc:492] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.106462 1167 ts_tablet_manager.cc:1397] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.338s user 0.007s sys 0.001s
I20260620 07:01:19.107257 1167 raft_consensus.cc:348] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.107548 1167 raft_consensus.cc:374] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.107647 1167 raft_consensus.cc:729] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.107940 1167 consensus_queue.cc:260] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.108676 1167 ts_tablet_manager.cc:1428] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:19.109630 1167 tablet_bootstrap.cc:492] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:19.120277 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b5c83ccfccc4bf1be5a31f21bb3faa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.121402 2366 raft_consensus.cc:482] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.121541 2366 raft_consensus.cc:504] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.122248 2366 leader_election.cc:288] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.123100 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8659e903084f15ac3d9ea8c4c0dc0f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:19.123380 1168 tablet_bootstrap.cc:492] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:19.123498 1168 ts_tablet_manager.cc:1397] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.121s user 0.003s sys 0.003s
I20260620 07:01:19.124313 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8659e903084f15ac3d9ea8c4c0dc0f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:19.124855 831 leader_election.cc:341] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:19.125841 830 leader_election.cc:341] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.125948 830 leader_election.cc:302] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.126344 2366 raft_consensus.cc:2726] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.126453 1168 raft_consensus.cc:348] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.126652 1168 raft_consensus.cc:374] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.126715 1168 raft_consensus.cc:729] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.127099 1168 consensus_queue.cc:260] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.128545 1168 ts_tablet_manager.cc:1428] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 07:01:19.128878 1168 tablet_bootstrap.cc:492] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:19.130563 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 938) took 2864 ms. Trace:
I20260620 07:01:19.130673 1169 rpcz_store.cc:276] 0620 07:01:16.266024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.275285 (+ 9261us) service_pool.cc:227] Handling call
0620 07:01:19.130399 (+2855114us) ts_tablet_manager.cc:1145] Deleting tablet 6c0d1d8a5e244f1985ca6279bd1dda77
0620 07:01:19.130416 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.130534 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2854888}
I20260620 07:01:19.131145 1169 tablet_replica.cc:330] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:01:19.131160 2000 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.97.62:36007 timed out after 0.567s (SENT)
W20260620 07:01:19.131381 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 6c0d1d8a5e244f1985ca6279bd1dda77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c0d1d8a5e244f1985ca6279bd1dda77 already in progress: creating tablet
I20260620 07:01:19.131453 1169 raft_consensus.cc:2229] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.131615 1169 raft_consensus.cc:2258] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.132158 1169 ts_tablet_manager.cc:1905] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.138550 1169 ts_tablet_manager.cc:1918] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:19.138686 1169 log.cc:1196] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/864c95b908674e4f8425d765444c281b
I20260620 07:01:19.152412 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 4de362c8b3da4128bf06022f7263e284 (DEFAULT_TABLE table=default.Table_7fa5ed394e58488599dee907c0b79367 [id=a18c5dfb9623436e97526cc3ad7616ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.152524 994 tablet_service.cc:1467] Processing CreateTablet for tablet 1cc718ed16674b9fb1f8f77ed32e1c71 (DEFAULT_TABLE table=default.Table_7f4e45654c564d97a4acee1989b9b9dc [id=94820f6d2da547459abfd88ae6c57afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.154702 436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2395d394cd84440ebae89d1ecfa13fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 1068 } } ignore_live_leader: false dest_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" is_pre_election: true
I20260620 07:01:19.157500 1012 tablet_service.cc:1467] Processing CreateTablet for tablet f0876d36e48a4d7fa78a1448fbeee4c2 (DEFAULT_TABLE table=default.Table_9a8785defc83404485359d8702fa2ddb [id=c49a02da5b58408da89606d2238f35f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.158630 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 3aec5cd1f16a44a88477dfa750db60de (DEFAULT_TABLE table=default.Table_2bd50406a4304cd7927462a2bf47aaae [id=13254efcd34c41c88047746da3958351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.164237 1004 tablet_service.cc:1467] Processing CreateTablet for tablet d217a23adfda4bfebc1b480028e7649d (DEFAULT_TABLE table=default.Table_db252cfad66a4f05ae3924ff1bd71ff7 [id=dc72a986f69e4655958f0722d7c34016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.167099 1170 tablet_bootstrap.cc:492] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:19.167320 1170 ts_tablet_manager.cc:1397] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.114s user 0.012s sys 0.014s
I20260620 07:01:19.172298 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791b70bb1e364c4ebba9b85d400fc146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.172636 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4de362c8b3da4128bf06022f7263e284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.176148 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cc718ed16674b9fb1f8f77ed32e1c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.180387 1167 tablet_bootstrap.cc:654] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.181854 1166 ts_tablet_manager.cc:1918] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:19.181973 1166 log.cc:1196] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/b4ee5c79e2a6419ea3847cbebdeced79
I20260620 07:01:19.182269 1166 ts_tablet_manager.cc:1939] T b4ee5c79e2a6419ea3847cbebdeced79 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:19.182999 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 827) took 5388 ms. Trace:
I20260620 07:01:19.183123 1166 rpcz_store.cc:276] 0620 07:01:13.794186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.794231 (+ 45us) service_pool.cc:227] Handling call
0620 07:01:19.010287 (+5216056us) ts_tablet_manager.cc:1145] Deleting tablet b4ee5c79e2a6419ea3847cbebdeced79
0620 07:01:19.010298 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.176009 (+165711us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.181764 (+ 5755us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.182981 (+ 1217us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5198542}
I20260620 07:01:19.183588 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 830) took 5224 ms. Trace:
I20260620 07:01:19.183679 1166 rpcz_store.cc:276] 0620 07:01:13.959189 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.959549 (+ 360us) service_pool.cc:227] Handling call
0620 07:01:19.183445 (+5223896us) ts_tablet_manager.cc:1145] Deleting tablet 02584f8ac08f4759a5f9a5aa699d0039
0620 07:01:19.183455 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.183574 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5223018}
I20260620 07:01:19.184042 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 831) took 5217 ms. Trace:
I20260620 07:01:19.184122 1166 rpcz_store.cc:276] 0620 07:01:13.966663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.966713 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:19.183945 (+5217232us) ts_tablet_manager.cc:1145] Deleting tablet de6ccea1cd074afb9fef17c8e07f444f
0620 07:01:19.183955 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.184029 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5216937}
I20260620 07:01:19.184435 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 832) took 5205 ms. Trace:
I20260620 07:01:19.184512 1166 rpcz_store.cc:276] 0620 07:01:13.978751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.979268 (+ 517us) service_pool.cc:227] Handling call
0620 07:01:19.184338 (+5205070us) ts_tablet_manager.cc:1145] Deleting tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6
0620 07:01:19.184348 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.184423 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5204843}
I20260620 07:01:19.184818 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 833) took 5193 ms. Trace:
I20260620 07:01:19.184895 1166 rpcz_store.cc:276] 0620 07:01:13.991119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:13.991232 (+ 113us) service_pool.cc:227] Handling call
0620 07:01:19.184729 (+5193497us) ts_tablet_manager.cc:1145] Deleting tablet 8aa5c040d5e84006935e9f06424a34b4
0620 07:01:19.184738 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.184805 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5193239}
I20260620 07:01:19.185212 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 834) took 5183 ms. Trace:
I20260620 07:01:19.185289 1166 rpcz_store.cc:276] 0620 07:01:14.001555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.001645 (+ 90us) service_pool.cc:227] Handling call
0620 07:01:19.185097 (+5183452us) ts_tablet_manager.cc:1145] Deleting tablet ba93e22c4720417c99d471b9c8b49b86
0620 07:01:19.185106 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.185197 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5183215}
I20260620 07:01:19.185580 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 835) took 5178 ms. Trace:
I20260620 07:01:19.185644 1166 rpcz_store.cc:276] 0620 07:01:14.006849 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.006953 (+ 104us) service_pool.cc:227] Handling call
0620 07:01:19.185493 (+5178540us) ts_tablet_manager.cc:1145] Deleting tablet d51c7488711b4db697b48025a5ba6e9d
0620 07:01:19.185503 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.185568 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5178329}
I20260620 07:01:19.185925 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 836) took 4970 ms. Trace:
I20260620 07:01:19.185998 1166 rpcz_store.cc:276] 0620 07:01:14.215613 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.215870 (+ 257us) service_pool.cc:227] Handling call
0620 07:01:19.185839 (+4969969us) ts_tablet_manager.cc:1145] Deleting tablet ebd9df1a33ed4e7b997a386158460a9a
0620 07:01:19.185848 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.185912 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4969733}
I20260620 07:01:19.186230 1166 tablet_replica.cc:330] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:19.186436 1166 raft_consensus.cc:2229] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:19.188262 1170 raft_consensus.cc:348] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.188503 1170 raft_consensus.cc:374] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.188555 1170 raft_consensus.cc:729] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.188767 1170 consensus_queue.cc:260] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.196436 1170 ts_tablet_manager.cc:1428] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
W20260620 07:01:19.198671 414 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 016029eafa1d438da54d963a64767ec5 (table default.Table_bd22b312cebb4018ab48bb331771a41a [id=ea5bc9bef9654a9d8c7db871ef5835cd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 016029eafa1d438da54d963a64767ec5 consensus state has no leader
I20260620 07:01:19.199008 2366 raft_consensus.cc:482] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.199136 2366 raft_consensus.cc:504] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.199572 1168 tablet_bootstrap.cc:654] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.199739 2366 leader_election.cc:288] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.202456 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390a327225344afda3076c341202cc1d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:19.203076 831 leader_election.cc:341] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.204668 1170 tablet_bootstrap.cc:492] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.206718 1170 tablet_bootstrap.cc:654] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.210891 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet a292d66ee14a48959c1f6a63e0a0f492 (table default.Table_a31b6fbb7c36401aae31f37d6bcb978e [id=f178692be04f4e4db4933fb296012ddd]) successfully deleted
W20260620 07:01:19.211119 412 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 54205.8us
I20260620 07:01:19.211925 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet cfff2a14b1184d39bd7ac1091ef749c9 (table default.Table_625f2cf95ae74282910b8556035bc856 [id=dfd2898601854be0ba91e18aca844d9f]) successfully deleted
W20260620 07:01:19.212253 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f4f77b677ab34d9b8554de0da6564fb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4f77b677ab34d9b8554de0da6564fb1 already in progress: creating tablet
W20260620 07:01:19.212473 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b40e1ea4d1c74be2906381064c73f8c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b40e1ea4d1c74be2906381064c73f8c5 already in progress: creating tablet
W20260620 07:01:19.212659 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 64addb9379b247dfa678e2a0ae1af0cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64addb9379b247dfa678e2a0ae1af0cf already in progress: creating tablet
W20260620 07:01:19.212858 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet cf978ab301954866aeb77b7abaf2c77e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf978ab301954866aeb77b7abaf2c77e already in progress: creating tablet
I20260620 07:01:19.212917 1170 tablet_bootstrap.cc:492] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:01:19.213032 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d3f4e2dafe84eeda8f6d6cf0d029cb7 already in progress: creating tablet
I20260620 07:01:19.213200 1168 tablet_bootstrap.cc:492] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:19.213188 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet b5014cf5cc70466bafb6921c9d46ba72 (table default.Table_833694b1c9684acb97bca68ebefecb45 [id=0d5d9534e45441a290f21fca41209793]) successfully deleted
I20260620 07:01:19.213195 1170 ts_tablet_manager.cc:1397] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260620 07:01:19.213335 1168 ts_tablet_manager.cc:1397] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.085s user 0.002s sys 0.002s
I20260620 07:01:19.213462 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet b4ee5c79e2a6419ea3847cbebdeced79 (table default.Table_34eaeb05ad0243cb9f083eb279a8ba73 [id=5a23c89228964939bd74b5079dd25881]) successfully deleted
W20260620 07:01:19.213681 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 02584f8ac08f4759a5f9a5aa699d0039 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02584f8ac08f4759a5f9a5aa699d0039 already in progress: creating tablet
W20260620 07:01:19.213896 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet de6ccea1cd074afb9fef17c8e07f444f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de6ccea1cd074afb9fef17c8e07f444f already in progress: creating tablet
W20260620 07:01:19.214107 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b74cc2f2abb48d88bcf1abaac9a1bb6 already in progress: creating tablet
W20260620 07:01:19.214289 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8aa5c040d5e84006935e9f06424a34b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aa5c040d5e84006935e9f06424a34b4 already in progress: creating tablet
I20260620 07:01:19.214129 1168 raft_consensus.cc:348] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.214416 1168 raft_consensus.cc:374] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.214478 1168 raft_consensus.cc:729] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.214237 1170 raft_consensus.cc:348] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.214671 1170 raft_consensus.cc:374] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.214766 1170 raft_consensus.cc:729] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.214735 1168 consensus_queue.cc:260] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.215421 1168 ts_tablet_manager.cc:1428] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:19.216015 1170 consensus_queue.cc:260] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.218925 2366 raft_consensus.cc:482] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.219048 2366 raft_consensus.cc:504] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.219635 2366 leader_election.cc:288] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.220144 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a3ccec08ee4c8480a808b1402eb4a9" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:19.220645 831 leader_election.cc:341] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.221220 1170 ts_tablet_manager.cc:1428] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260620 07:01:19.224802 1168 tablet_bootstrap.cc:492] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:19.227550 1170 tablet_bootstrap.cc:492] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.230567 2436 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: acquiring CA information for follower catalog manager: success
I20260620 07:01:19.230661 1168 tablet_bootstrap.cc:654] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.239863 1168 tablet_bootstrap.cc:492] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:19.240015 1168 ts_tablet_manager.cc:1397] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260620 07:01:19.240741 1168 raft_consensus.cc:348] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.240986 1168 raft_consensus.cc:374] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.241043 1168 raft_consensus.cc:729] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.241317 1168 consensus_queue.cc:260] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.241868 1168 ts_tablet_manager.cc:1428] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:19.243979 1168 tablet_bootstrap.cc:492] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:19.245334 1168 tablet_bootstrap.cc:654] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:19.214464 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ba93e22c4720417c99d471b9c8b49b86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba93e22c4720417c99d471b9c8b49b86 already in progress: creating tablet
W20260620 07:01:19.247884 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d51c7488711b4db697b48025a5ba6e9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d51c7488711b4db697b48025a5ba6e9d already in progress: creating tablet
I20260620 07:01:19.248268 2450 raft_consensus.cc:482] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.253284 1168 tablet_bootstrap.cc:492] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:19.253537 1168 ts_tablet_manager.cc:1397] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20260620 07:01:19.254267 1168 raft_consensus.cc:348] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.254563 1168 raft_consensus.cc:374] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.254690 1168 raft_consensus.cc:729] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.255093 1168 consensus_queue.cc:260] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.248400 2450 raft_consensus.cc:504] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.255937 1168 ts_tablet_manager.cc:1428] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:19.256114 2450 leader_election.cc:288] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.256186 1168 tablet_bootstrap.cc:492] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:19.257081 683 leader_election.cc:341] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 35cb81ac0ebd4865b9d53259ed5787d1
I20260620 07:01:19.258131 1170 tablet_bootstrap.cc:654] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.186739 1166 pending_rounds.cc:62] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:19.186937 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0876d36e48a4d7fa78a1448fbeee4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.258917 1166 pending_rounds.cc:68] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821628564193280 op_type: NO_OP noop_request { }
I20260620 07:01:19.259044 1166 raft_consensus.cc:2866] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:19.259135 1166 raft_consensus.cc:2258] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.259145 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d217a23adfda4bfebc1b480028e7649d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.195178 1167 tablet_bootstrap.cc:492] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.259385 1167 ts_tablet_manager.cc:1397] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.150s user 0.006s sys 0.002s
I20260620 07:01:19.259706 1166 ts_tablet_manager.cc:1905] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.260162 1167 raft_consensus.cc:348] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.260371 1167 raft_consensus.cc:374] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.260426 1167 raft_consensus.cc:729] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.260632 1167 consensus_queue.cc:260] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.261197 1167 ts_tablet_manager.cc:1428] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:19.203893 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390a327225344afda3076c341202cc1d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:19.220144 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a3ccec08ee4c8480a808b1402eb4a9" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.261752 830 leader_election.cc:341] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.261871 830 leader_election.cc:302] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.261945 1167 tablet_bootstrap.cc:492] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:19.262209 830 leader_election.cc:341] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.262305 830 leader_election.cc:302] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.262574 2366 raft_consensus.cc:2726] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.262706 2366 raft_consensus.cc:2726] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.257680 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb81ac0ebd4865b9d53259ed5787d1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:19.263494 1167 tablet_bootstrap.cc:654] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:19.263613 681 leader_election.cc:341] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.263752 681 leader_election.cc:302] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:19.264212 2450 raft_consensus.cc:2726] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.264503 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aec5cd1f16a44a88477dfa750db60de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.271935 436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2395d394cd84440ebae89d1ecfa13fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 1068 } } ignore_live_leader: false dest_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" is_pre_election: true
I20260620 07:01:19.272461 1169 ts_tablet_manager.cc:1939] T 864c95b908674e4f8425d765444c281b P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:19.273406 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 939) took 2990 ms. Trace:
I20260620 07:01:19.273604 1169 rpcz_store.cc:276] 0620 07:01:16.282598 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.283626 (+ 1028us) service_pool.cc:227] Handling call
0620 07:01:19.131101 (+2847475us) ts_tablet_manager.cc:1145] Deleting tablet 864c95b908674e4f8425d765444c281b
0620 07:01:19.131110 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.135606 (+ 4496us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.138452 (+ 2846us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.273384 (+134932us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2842377}
I20260620 07:01:19.274075 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 940) took 2963 ms. Trace:
I20260620 07:01:19.274163 1169 rpcz_store.cc:276] 0620 07:01:16.310730 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.310879 (+ 149us) service_pool.cc:227] Handling call
0620 07:01:19.273956 (+2963077us) ts_tablet_manager.cc:1145] Deleting tablet 25adb514cb22461bbcbecad7d74e643c
0620 07:01:19.273966 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.274060 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2889238}
I20260620 07:01:19.274413 1169 tablet_replica.cc:330] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:19.274606 1169 raft_consensus.cc:2229] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.274753 1169 raft_consensus.cc:2258] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.275460 1169 ts_tablet_manager.cc:1905] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.276871 2000 leader_election.cc:302] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2395d394cd84440ebae89d1ecfa13fb5; no voters: 2fe29008ed9b430ea13d40e54e3ddfcc, f32c3995c70946c38ce1a3094aaaffb1
I20260620 07:01:19.277812 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 864c95b908674e4f8425d765444c281b (table default.Table_3af42fa4c4614dab89c7853707b243cb [id=f3a3145cdeb841329b0b4af9d9aa4235]) successfully deleted
W20260620 07:01:19.278193 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 25adb514cb22461bbcbecad7d74e643c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25adb514cb22461bbcbecad7d74e643c already in progress: creating tablet
I20260620 07:01:19.290175 1170 tablet_bootstrap.cc:492] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:19.290416 1170 ts_tablet_manager.cc:1397] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.069s user 0.008s sys 0.000s
I20260620 07:01:19.291327 1170 raft_consensus.cc:348] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.294639 1168 tablet_bootstrap.cc:654] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.294871 1170 raft_consensus.cc:374] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.295156 1170 raft_consensus.cc:729] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.301666 419 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42866 (request call id 1278) took 1191 ms. Trace:
I20260620 07:01:19.301872 419 rpcz_store.cc:276] 0620 07:01:18.110370 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.639535 (+529165us) service_pool.cc:227] Handling call
0620 07:01:18.640444 (+ 909us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 07:01:18.640932 (+ 488us) catalog_manager.cc:2121] Created new table and tablet info
0620 07:01:19.301314 (+660382us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 07:01:19.301477 (+ 163us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 07:01:19.301602 (+ 125us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:18.846192 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:18.846335 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:18.846341 (+ 6us) write_op.cc:435] Acquired schema lock
0620 07:01:18.846343 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:18.846473 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:18.846483 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:18.846511 (+ 28us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:18.846609 (+ 98us) tablet.cc:699] Row locks acquired
0620 07:01:18.846611 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:18.846667 (+ 56us) write_op.cc:270] Start()
0620 07:01:18.846721 (+ 54us) write_op.cc:276] Timestamp: P: 1781938878846616 usec, L: 0
0620 07:01:18.846725 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:18.866924 (+ 20199us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x6160000328a0. stack: 00007f2486e7566e 00007f2486e75430 00007f2485efc5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f24922e2155 00007f24923a815c 00007f24923842f7 00007f2492383ba5 00007f24936b67f1 00007f24936b5359 00007f24936bd1bb 00007f24936bd038 00000000009edb7c 00007f2486ebb344
0620 07:01:18.867439 (+ 515us) log.cc:842] Serialized 433 byte log entry
0620 07:01:19.299356 (+431917us) op_driver.cc:444] REPLICATION: finished
0620 07:01:19.300521 (+ 1165us) write_op.cc:301] APPLY: starting
0620 07:01:19.300535 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:19.300571 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:19.300576 (+ 5us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:19.300729 (+ 153us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:19.300773 (+ 44us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 07:01:19.300783 (+ 10us) write_op.cc:312] APPLY: finished
0620 07:01:19.300877 (+ 94us) log.cc:842] Serialized 29 byte log entry
0620 07:01:19.301158 (+ 281us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:19.301188 (+ 30us) write_op.cc:454] Released schema lock
0620 07:01:19.301199 (+ 11us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1105,"num_ops":2,"prepare.queue_time_us":204728,"prepare.run_cpu_time_us":1541,"prepare.run_wall_time_us":21382,"replication_time_us":452608,"spinlock_wait_cycles":45160320,"thread_start_us":1000,"threads_started":1}]]}
I20260620 07:01:19.305234 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f8be5f41f1d64d918b727e3eef18738e
I20260620 07:01:19.306049 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet f8be5f41f1d64d918b727e3eef18738e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.308029 732 tablet_service.cc:1514] Processing DeleteTablet for tablet f8be5f41f1d64d918b727e3eef18738e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.309554 2070 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" instance_seqno: 1781938853072211) as {username='slave'} at 127.0.97.1:55543; Asking this server to re-register.
I20260620 07:01:19.311178 801 heartbeater.cc:464] Registering TS with master...
I20260620 07:01:19.316840 2470 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 07:01:19.318487 2072 ts_manager.cc:194] Registered new tserver with Master: 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:19.321012 2074 ts_manager.cc:194] Registered new tserver with Master: 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:19.326143 862 tablet_service.cc:1514] Processing DeleteTablet for tablet f8be5f41f1d64d918b727e3eef18738e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.337101 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d144332acb344f88a25fec5a8a588cef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.337940 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d144332acb344f88a25fec5a8a588cef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:19.346369 681 consensus_peers.cc:487] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:19.346621 393 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 47127.2us
I20260620 07:01:19.347237 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b22b28a2d04a4711a63d53d14cbca67a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.348073 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b22b28a2d04a4711a63d53d14cbca67a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.348203 2253 raft_consensus.cc:482] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.348276 1169 ts_tablet_manager.cc:1918] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:19.348384 1169 log.cc:1196] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/fe3b70b1674e43768b29dea84b09a1a0
I20260620 07:01:19.348345 2253 raft_consensus.cc:504] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.348975 2253 leader_election.cc:288] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.349858 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4260b0c953c14a198dbf9b64a30e7e05" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:19.350368 831 leader_election.cc:341] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.350629 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4260b0c953c14a198dbf9b64a30e7e05" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.351294 830 leader_election.cc:341] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.351400 830 leader_election.cc:302] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.351796 2253 raft_consensus.cc:2726] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.352785 2482 tablet.cc:1722] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:19.352945 1168 tablet_bootstrap.cc:492] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:19.353107 1168 ts_tablet_manager.cc:1397] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.097s user 0.005s sys 0.001s
I20260620 07:01:19.353766 2483 tablet.cc:1722] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:19.354477 1165 ts_tablet_manager.cc:1918] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:19.355482 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f0876d36e48a4d7fa78a1448fbeee4c2
I20260620 07:01:19.355881 421 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b] alter complete (version 3)
I20260620 07:01:19.356109 426 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42866 (request call id 1283) took 1016 ms. Trace:
I20260620 07:01:19.356475 1169 ts_tablet_manager.cc:1939] T fe3b70b1674e43768b29dea84b09a1a0 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:19.356434 732 tablet_service.cc:1514] Processing DeleteTablet for tablet f0876d36e48a4d7fa78a1448fbeee4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.356249 426 rpcz_store.cc:276] 0620 07:01:18.339984 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.705721 (+365737us) service_pool.cc:227] Handling call
0620 07:01:18.706215 (+ 494us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 07:01:18.706431 (+ 216us) catalog_manager.cc:2752] Modifying in-memory table state
0620 07:01:18.706482 (+ 51us) catalog_manager.cc:2761] Locking tablets
0620 07:01:18.706626 (+ 144us) catalog_manager.cc:2775] Removing table and tablets from system table
0620 07:01:19.355234 (+648608us) catalog_manager.cc:2793] Removing table from by-name map
0620 07:01:19.355339 (+ 105us) catalog_manager.cc:2809] Committing in-memory state
0620 07:01:19.355383 (+ 44us) catalog_manager.cc:2813] Aborting table tasks
0620 07:01:19.356044 (+ 661us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:18.903826 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:18.903958 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:18.903964 (+ 6us) write_op.cc:435] Acquired schema lock
0620 07:01:18.903969 (+ 5us) tablet.cc:660] Decoding operations
0620 07:01:18.904103 (+ 134us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:18.904115 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:18.904125 (+ 10us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:18.904220 (+ 95us) tablet.cc:699] Row locks acquired
0620 07:01:18.904224 (+ 4us) write_op.cc:260] PREPARE: finished
0620 07:01:18.904264 (+ 40us) write_op.cc:270] Start()
0620 07:01:18.904297 (+ 33us) write_op.cc:276] Timestamp: P: 1781938878904204 usec, L: 0
0620 07:01:18.904301 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:18.904478 (+ 177us) log.cc:842] Serialized 722 byte log entry
0620 07:01:19.336544 (+432066us) op_driver.cc:444] REPLICATION: finished
0620 07:01:19.354694 (+ 18150us) write_op.cc:301] APPLY: starting
0620 07:01:19.354711 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:19.354771 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:19.354832 (+ 61us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:19.354918 (+ 86us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:19.354957 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0620 07:01:19.354964 (+ 7us) write_op.cc:312] APPLY: finished
0620 07:01:19.355063 (+ 99us) log.cc:842] Serialized 29 byte log entry
0620 07:01:19.355130 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:19.355150 (+ 20us) write_op.cc:454] Released schema lock
0620 07:01:19.355158 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:19.355213 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:19.355217 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":18102,"apply.run_cpu_time_us":569,"apply.run_wall_time_us":569,"num_ops":2,"prepare.queue_time_us":196497,"prepare.run_cpu_time_us":729,"prepare.run_wall_time_us":729,"replication_time_us":432215}]]}
I20260620 07:01:19.357173 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_676ef4f879c44d9a94d209ec74b4da67" } modify_external_catalogs: true
I20260620 07:01:19.357354 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 941) took 3021 ms. Trace:
I20260620 07:01:19.357396 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_676ef4f879c44d9a94d209ec74b4da67" } modify_external_catalogs: true
I20260620 07:01:19.357455 1169 rpcz_store.cc:276] 0620 07:01:16.335806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.335877 (+ 71us) service_pool.cc:227] Handling call
0620 07:01:19.274373 (+2938496us) ts_tablet_manager.cc:1145] Deleting tablet fe3b70b1674e43768b29dea84b09a1a0
0620 07:01:19.274384 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.308579 (+ 34195us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.348160 (+ 39581us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.357332 (+ 9172us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2887357}
W20260620 07:01:19.357755 421 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.1:52621 (request call id 119) took 939 ms (client timeout 1000 ms). Trace:
W20260620 07:01:19.357867 421 rpcz_store.cc:269] 0620 07:01:18.418642 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.508913 (+ 90271us) service_pool.cc:227] Handling call
0620 07:01:19.357690 (+848777us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:18.620104 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:18.667271 (+ 47167us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:18.667323 (+ 52us) write_op.cc:435] Acquired schema lock
0620 07:01:18.667327 (+ 4us) tablet.cc:660] Decoding operations
0620 07:01:18.667707 (+ 380us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:18.667765 (+ 58us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:18.667770 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:18.667976 (+ 206us) tablet.cc:699] Row locks acquired
0620 07:01:18.667981 (+ 5us) write_op.cc:260] PREPARE: finished
0620 07:01:18.668108 (+ 127us) write_op.cc:270] Start()
0620 07:01:18.668198 (+ 90us) write_op.cc:276] Timestamp: P: 1781938878668032 usec, L: 0
0620 07:01:18.668204 (+ 6us) op_driver.cc:331] REPLICATION: starting
0620 07:01:18.668749 (+ 545us) log.cc:842] Serialized 524 byte log entry
0620 07:01:18.743421 (+ 74672us) op_driver.cc:444] REPLICATION: finished
0620 07:01:18.743577 (+ 156us) write_op.cc:301] APPLY: starting
0620 07:01:18.743592 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:18.743632 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:18.743662 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:18.743716 (+ 54us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:18.743752 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:18.743763 (+ 11us) write_op.cc:312] APPLY: finished
0620 07:01:18.743868 (+ 105us) log.cc:842] Serialized 23 byte log entry
0620 07:01:18.743941 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:18.743958 (+ 17us) write_op.cc:454] Released schema lock
0620 07:01:18.743964 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:18.744016 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:18.744019 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0620 07:01:18.904589 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:18.904684 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:18.904689 (+ 5us) write_op.cc:435] Acquired schema lock
0620 07:01:18.904691 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:18.904766 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:18.906831 (+ 2065us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:18.906838 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:18.906909 (+ 71us) tablet.cc:699] Row locks acquired
0620 07:01:18.906911 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:18.906942 (+ 31us) write_op.cc:270] Start()
0620 07:01:18.906969 (+ 27us) write_op.cc:276] Timestamp: P: 1781938878906887 usec, L: 0
0620 07:01:18.906973 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:18.907252 (+ 279us) log.cc:842] Serialized 356 byte log entry
0620 07:01:19.336615 (+429363us) op_driver.cc:444] REPLICATION: finished
0620 07:01:19.355292 (+ 18677us) write_op.cc:301] APPLY: starting
0620 07:01:19.355311 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:19.355339 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:19.355363 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:19.355418 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:19.355451 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:19.355472 (+ 21us) write_op.cc:312] APPLY: finished
0620 07:01:19.355536 (+ 64us) log.cc:842] Serialized 23 byte log entry
0620 07:01:19.355667 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:19.355680 (+ 13us) write_op.cc:454] Released schema lock
0620 07:01:19.355685 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":18,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":489,"apply.run_wall_time_us":488,"num_ops":1,"prepare.queue_time_us":101408,"prepare.run_cpu_time_us":1402,"prepare.run_wall_time_us":48817,"replication_time_us":75152}],["op",{"apply.queue_time_us":18646,"num_ops":1,"prepare.queue_time_us":158120,"prepare.run_cpu_time_us":586,"prepare.run_wall_time_us":2729,"replication_time_us":429623}]]}
I20260620 07:01:19.358960 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 3456cf91d65a4413a35efe94513c723d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.359156 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 95a109e7871241ec9467858dca467bbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.359344 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 333eef8b98da4a279acceaead9405149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.359463 727 tablet_service.cc:1514] Processing DeleteTablet for tablet a9d4ef3ba51e432f889fb927a6af8b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.359576 730 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0bae39e1634710af12de493f7f58d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 394a20b5d4814305b347c5718731d551) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:19.359598 422 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.2:45945 (request call id 134) took 915 ms (client timeout 1000 ms). Trace:
I20260620 07:01:19.359681 720 tablet_service.cc:1514] Processing DeleteTablet for tablet cd75e318982a4fb9bf28cb35b030642f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:19.359697 422 rpcz_store.cc:269] 0620 07:01:18.444469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.546622 (+102153us) service_pool.cc:227] Handling call
0620 07:01:19.359534 (+812912us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":5}
I20260620 07:01:19.359839 732 tablet_service.cc:1514] Processing DeleteTablet for tablet f793a91ab247408bbe4a9f7cb370fffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.359987 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:19.360432 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet fe3b70b1674e43768b29dea84b09a1a0 (table default.Table_ec98cedea527437ebc2237e75dcc45ec [id=55c4c9a5f69b4cf7bb05ce4157f8a5e8]) successfully deleted
I20260620 07:01:19.362125 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bdcd7c3ed4c84fac94f54a305c27f042"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.362779 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdcd7c3ed4c84fac94f54a305c27f042 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.366159 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet eb0f7d4b6fa14811a1f02456418f95a4 (table default.Table_a7132339336c4cde8e1bf9740c940062 [id=ea9135e430a142ab992288c43fe54bf7]). Expected version 1 got 0
I20260620 07:01:19.366322 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet b5014cf5cc70466bafb6921c9d46ba72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.357914 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 943) took 3003 ms. Trace:
I20260620 07:01:19.366637 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet b39e682e71ed4776a786f7d30158e7e0 with delete_type TABLET_DATA_DELETED (replaced by tablet d9a7fab4d1684604be1b81d4d4bbe560) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.366707 1169 rpcz_store.cc:276] 0620 07:01:16.354576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.354646 (+ 70us) service_pool.cc:227] Handling call
0620 07:01:19.357783 (+3003137us) ts_tablet_manager.cc:1145] Deleting tablet 06fd96feb4a74b9f8d3243b7d774f388
0620 07:01:19.357794 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.357898 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2970478}
I20260620 07:01:19.366529 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ac2df841f29b4ea287cce829a29ba718" } new_table_name: "default.Table_01e9f7064a4f4b23baa77ab1467cffe2" modify_external_catalogs: true
I20260620 07:01:19.367507 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 959) took 2608 ms. Trace:
I20260620 07:01:19.367597 1169 rpcz_store.cc:276] 0620 07:01:16.758731 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.758822 (+ 91us) service_pool.cc:227] Handling call
0620 07:01:19.367358 (+2608536us) ts_tablet_manager.cc:1145] Deleting tablet 3de447b04fc944688d6034db69fe2907
0620 07:01:19.367370 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.367484 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2607409}
I20260620 07:01:19.367843 1169 tablet_replica.cc:330] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:19.368022 1169 raft_consensus.cc:2229] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.368158 1169 raft_consensus.cc:2258] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.368697 422 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:19.368765 1169 ts_tablet_manager.cc:1905] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:19.368932 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 06fd96feb4a74b9f8d3243b7d774f388 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06fd96feb4a74b9f8d3243b7d774f388 already in progress: creating tablet
W20260620 07:01:19.369257 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3de447b04fc944688d6034db69fe2907 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3de447b04fc944688d6034db69fe2907 already in progress: creating tablet
I20260620 07:01:19.356706 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet f0876d36e48a4d7fa78a1448fbeee4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.370909 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7d067448ff3c4faea9579eaaf29cd29f
I20260620 07:01:19.370844 2019 raft_consensus.cc:482] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.371030 2019 raft_consensus.cc:504] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.371374 418 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42866 (request call id 1282) took 1031 ms. Trace:
I20260620 07:01:19.371694 2019 leader_election.cc:288] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:19.371755 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d067448ff3c4faea9579eaaf29cd29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.371515 418 rpcz_store.cc:276] 0620 07:01:18.339911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.649662 (+309751us) service_pool.cc:227] Handling call
0620 07:01:18.650138 (+ 476us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 07:01:18.650316 (+ 178us) catalog_manager.cc:2752] Modifying in-memory table state
0620 07:01:18.650373 (+ 57us) catalog_manager.cc:2761] Locking tablets
0620 07:01:18.650516 (+ 143us) catalog_manager.cc:2775] Removing table and tablets from system table
0620 07:01:19.370650 (+720134us) catalog_manager.cc:2793] Removing table from by-name map
0620 07:01:19.370745 (+ 95us) catalog_manager.cc:2809] Committing in-memory state
0620 07:01:19.370846 (+ 101us) catalog_manager.cc:2813] Aborting table tasks
0620 07:01:19.371326 (+ 480us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:18.897649 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:18.897744 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:18.897748 (+ 4us) write_op.cc:435] Acquired schema lock
0620 07:01:18.897751 (+ 3us) tablet.cc:660] Decoding operations
0620 07:01:18.897851 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:18.897859 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:18.897864 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:18.897947 (+ 83us) tablet.cc:699] Row locks acquired
0620 07:01:18.897949 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:18.897975 (+ 26us) write_op.cc:270] Start()
0620 07:01:18.898000 (+ 25us) write_op.cc:276] Timestamp: P: 1781938878897922 usec, L: 0
0620 07:01:18.898004 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:18.898151 (+ 147us) log.cc:842] Serialized 722 byte log entry
0620 07:01:19.304354 (+406203us) op_driver.cc:444] REPLICATION: finished
0620 07:01:19.335335 (+ 30981us) write_op.cc:301] APPLY: starting
0620 07:01:19.335359 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:19.335417 (+ 58us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:19.335471 (+ 54us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:19.335610 (+ 139us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:19.335664 (+ 54us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0620 07:01:19.335674 (+ 10us) write_op.cc:312] APPLY: finished
0620 07:01:19.335830 (+ 156us) log.cc:842] Serialized 29 byte log entry
0620 07:01:19.370530 (+ 34700us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:19.370549 (+ 19us) write_op.cc:454] Released schema lock
0620 07:01:19.370557 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":30916,"num_ops":2,"prepare.queue_time_us":246450,"prepare.run_cpu_time_us":567,"prepare.run_wall_time_us":566,"replication_time_us":406336,"spinlock_wait_cycles":768,"thread_start_us":32100,"threads_started":1}]]}
W20260620 07:01:19.373314 968 leader_election.cc:341] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: b39e682e71ed4776a786f7d30158e7e0
I20260620 07:01:19.376139 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d067448ff3c4faea9579eaaf29cd29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.376255 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_429878e6e23b45ddb2516c8cae448bf2" } new_table_name: "default.Table_34d75b1dc00c47d48614d1fe73e514dc" modify_external_catalogs: true
I20260620 07:01:19.376343 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet c2e38178b9244152915d4c0a9dcf59dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.376343 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2f0c28057b4534a8a400d1ca7f3991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.376657 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d6f7f2b5b3473aa010b8982a03aa5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.378091 1167 tablet_bootstrap.cc:492] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.378279 1167 ts_tablet_manager.cc:1397] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.116s user 0.001s sys 0.011s
I20260620 07:01:19.379693 1167 raft_consensus.cc:348] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.382699 1167 raft_consensus.cc:374] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.295840 1170 consensus_queue.cc:260] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.383293 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6f6ace27f2824931a73aa8b2546c3db1" } new_table_name: "default.Table_0a2bf60c5def4608bdcaf85341a43520" modify_external_catalogs: true
I20260620 07:01:19.383581 1167 raft_consensus.cc:729] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.383657 1170 ts_tablet_manager.cc:1428] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.093s user 0.002s sys 0.000s
I20260620 07:01:19.383988 1170 tablet_bootstrap.cc:492] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.385629 424 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42866 (request call id 1277) took 1319 ms. Trace:
I20260620 07:01:19.385741 424 rpcz_store.cc:276] 0620 07:01:18.068163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.561372 (+493209us) service_pool.cc:227] Handling call
0620 07:01:18.562212 (+ 840us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 07:01:18.562676 (+ 464us) catalog_manager.cc:2121] Created new table and tablet info
0620 07:01:19.385369 (+822693us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 07:01:19.385474 (+ 105us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 07:01:19.385561 (+ 87us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:18.844815 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:18.845050 (+ 235us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:18.845081 (+ 31us) write_op.cc:435] Acquired schema lock
0620 07:01:18.845084 (+ 3us) tablet.cc:660] Decoding operations
0620 07:01:18.845272 (+ 188us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:18.845289 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:18.845295 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:18.845472 (+ 177us) tablet.cc:699] Row locks acquired
0620 07:01:18.845475 (+ 3us) write_op.cc:260] PREPARE: finished
0620 07:01:18.845541 (+ 66us) write_op.cc:270] Start()
0620 07:01:18.845606 (+ 65us) write_op.cc:276] Timestamp: P: 1781938878845465 usec, L: 0
0620 07:01:18.845611 (+ 5us) op_driver.cc:331] REPLICATION: starting
0620 07:01:18.846009 (+ 398us) log.cc:842] Serialized 433 byte log entry
0620 07:01:19.296556 (+450547us) op_driver.cc:444] REPLICATION: finished
0620 07:01:19.299515 (+ 2959us) write_op.cc:301] APPLY: starting
0620 07:01:19.299542 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:19.299605 (+ 63us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:19.299644 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:19.299812 (+ 168us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:19.299864 (+ 52us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 07:01:19.299875 (+ 11us) write_op.cc:312] APPLY: finished
0620 07:01:19.300014 (+ 139us) log.cc:842] Serialized 29 byte log entry
0620 07:01:19.304360 (+ 4346us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:19.304377 (+ 17us) write_op.cc:454] Released schema lock
0620 07:01:19.304384 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2899,"num_ops":2,"prepare.queue_time_us":281617,"prepare.run_cpu_time_us":1073,"prepare.run_wall_time_us":1369,"replication_time_us":450917,"thread_start_us":2679,"threads_started":1}]]}
I20260620 07:01:19.386477 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c89bab52a82c4a8faed799b663c0fc47" } new_table_name: "default.Table_beece644de974db4af5d5b9b37777364" modify_external_catalogs: true
I20260620 07:01:19.387755 1167 consensus_queue.cc:260] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.380219 1166 ts_tablet_manager.cc:1918] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260620 07:01:19.382073 969 leader_election.cc:341] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b39e682e71ed4776a786f7d30158e7e0
I20260620 07:01:19.390223 969 leader_election.cc:302] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:19.390601 2019 raft_consensus.cc:2726] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.390239 1166 log.cc:1196] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/2910da33bbdb4410a4a90ff9747a7de1
I20260620 07:01:19.391571 1166 ts_tablet_manager.cc:1939] T 2910da33bbdb4410a4a90ff9747a7de1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:19.395145 1167 ts_tablet_manager.cc:1428] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
W20260620 07:01:19.399330 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2816955770f74f52b3d1077078728736 consensus state has no leader
I20260620 07:01:19.399672 420 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:42866 (request call id 1279) took 1213 ms. Trace:
I20260620 07:01:19.399983 420 rpcz_store.cc:276] 0620 07:01:18.186167 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.642098 (+455931us) service_pool.cc:227] Handling call
0620 07:01:18.642522 (+ 424us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 07:01:18.642734 (+ 212us) catalog_manager.cc:3616] Apply alter schema
0620 07:01:18.642925 (+ 191us) catalog_manager.cc:3639] Acquired catalog manager lock
0620 07:01:18.643020 (+ 95us) catalog_manager.cc:3786] Updating metadata on disk
0620 07:01:19.399038 (+756018us) catalog_manager.cc:3817] Committing alterations to in-memory state
0620 07:01:19.399624 (+ 586us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:18.883129 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:18.883269 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:18.883278 (+ 9us) write_op.cc:435] Acquired schema lock
0620 07:01:18.883281 (+ 3us) tablet.cc:660] Decoding operations
0620 07:01:18.883418 (+ 137us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:18.883435 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:18.883443 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:18.895934 (+ 12491us) tablet.cc:699] Row locks acquired
0620 07:01:18.895938 (+ 4us) write_op.cc:260] PREPARE: finished
0620 07:01:18.895986 (+ 48us) write_op.cc:270] Start()
0620 07:01:18.896029 (+ 43us) write_op.cc:276] Timestamp: P: 1781938878895928 usec, L: 0
0620 07:01:18.896033 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:18.896275 (+ 242us) log.cc:842] Serialized 405 byte log entry
0620 07:01:19.300490 (+404215us) op_driver.cc:444] REPLICATION: finished
0620 07:01:19.303595 (+ 3105us) write_op.cc:301] APPLY: starting
0620 07:01:19.303612 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:19.303652 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:19.303686 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:19.303739 (+ 53us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:19.303776 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:19.303786 (+ 10us) write_op.cc:312] APPLY: finished
0620 07:01:19.303864 (+ 78us) log.cc:842] Serialized 23 byte log entry
0620 07:01:19.398901 (+ 95037us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:19.398930 (+ 29us) write_op.cc:454] Released schema lock
0620 07:01:19.398939 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:19.399017 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:19.399020 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3061,"apply.run_cpu_time_us":555,"apply.run_wall_time_us":95482,"num_ops":1,"prepare.queue_time_us":239527,"prepare.run_cpu_time_us":901,"prepare.run_wall_time_us":13255,"replication_time_us":404437,"thread_start_us":3713,"threads_started":1}]]}
I20260620 07:01:19.401362 1167 tablet_bootstrap.cc:492] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:19.401432 2486 tablet.cc:1722] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:19.402654 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_14c9ff1d977443ba914900cfb627c5e7" } modify_external_catalogs: true
I20260620 07:01:19.403434 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_14c9ff1d977443ba914900cfb627c5e7" } modify_external_catalogs: true
I20260620 07:01:19.406045 2452 raft_consensus.cc:482] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.406179 2452 raft_consensus.cc:504] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.406769 2452 leader_election.cc:288] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.407625 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da80903ac124d1aae937c2329f9b13e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.408216 681 leader_election.cc:341] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.410507 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 704e8aaabe6d40138b6611bdc30abf16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.404887 1170 tablet_bootstrap.cc:654] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.412950 1167 tablet_bootstrap.cc:654] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.417975 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 837) took 5109 ms. Trace:
I20260620 07:01:19.418123 1166 rpcz_store.cc:276] 0620 07:01:14.308187 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.311835 (+ 3648us) service_pool.cc:227] Handling call
0620 07:01:19.186193 (+4874358us) ts_tablet_manager.cc:1145] Deleting tablet 2910da33bbdb4410a4a90ff9747a7de1
0620 07:01:19.186202 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.279836 (+ 93634us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.380117 (+100281us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.417945 (+ 37828us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20168,"tablet-delete.queue_time_us":4871106}
I20260620 07:01:19.421123 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 2910da33bbdb4410a4a90ff9747a7de1 (table default.Table_28d4fe83bbd14c4a9421d93152913831 [id=1ea85162a49a4c878f71da1e778af3e7]) successfully deleted
I20260620 07:01:19.418617 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 838) took 4942 ms. Trace:
I20260620 07:01:19.423034 1166 rpcz_store.cc:276] 0620 07:01:14.476708 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.480030 (+ 3322us) service_pool.cc:227] Handling call
0620 07:01:19.418502 (+4938472us) ts_tablet_manager.cc:1145] Deleting tablet 7f85c8a0ea484b57bb50425867e2774e
0620 07:01:19.418512 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.418603 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4930844}
W20260620 07:01:19.423348 683 leader_election.cc:341] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 9da80903ac124d1aae937c2329f9b13e
I20260620 07:01:19.423476 683 leader_election.cc:302] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:19.424103 2452 raft_consensus.cc:2726] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.428503 1167 tablet_bootstrap.cc:492] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.428736 1167 ts_tablet_manager.cc:1397] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260620 07:01:19.429519 1167 raft_consensus.cc:348] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.429811 1167 raft_consensus.cc:374] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.429919 1167 raft_consensus.cc:729] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.430152 1167 consensus_queue.cc:260] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.430833 2019 raft_consensus.cc:482] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.430943 2019 raft_consensus.cc:504] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.431437 2019 leader_election.cc:288] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:19.432958 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704e8aaabe6d40138b6611bdc30abf16" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:19.433073 1167 ts_tablet_manager.cc:1428] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:01:19.433193 751 raft_consensus.cc:2454] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:19.433336 1167 tablet_bootstrap.cc:492] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:19.433732 969 leader_election.cc:341] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 704e8aaabe6d40138b6611bdc30abf16
I20260620 07:01:19.434180 968 leader_election.cc:302] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:19.435034 2019 raft_consensus.cc:2781] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:19.435111 2019 raft_consensus.cc:482] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:19.435170 2019 raft_consensus.cc:3037] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:19.436142 1170 tablet_bootstrap.cc:492] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:19.436275 1170 ts_tablet_manager.cc:1397] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.000s
I20260620 07:01:19.423506 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 839) took 4922 ms. Trace:
I20260620 07:01:19.436363 1166 rpcz_store.cc:276] 0620 07:01:14.501527 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.501596 (+ 69us) service_pool.cc:227] Handling call
0620 07:01:19.423371 (+4921775us) ts_tablet_manager.cc:1145] Deleting tablet ddd53657848a4ab291d48956d5778d7b
0620 07:01:19.423385 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.423490 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4892313}
I20260620 07:01:19.437613 1166 tablet_replica.cc:330] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:19.437786 1166 raft_consensus.cc:2229] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.437811 2019 raft_consensus.cc:504] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.438334 2019 leader_election.cc:288] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:19.439749 969 leader_election.cc:341] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 704e8aaabe6d40138b6611bdc30abf16
I20260620 07:01:19.440336 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704e8aaabe6d40138b6611bdc30abf16" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:19.440514 751 raft_consensus.cc:3037] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:19.443524 751 raft_consensus.cc:2454] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:19.444052 968 leader_election.cc:302] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:19.446873 1170 raft_consensus.cc:348] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.447225 1170 raft_consensus.cc:374] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.447343 1170 raft_consensus.cc:729] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.437925 1166 raft_consensus.cc:2258] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.447698 1170 consensus_queue.cc:260] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.448170 1166 ts_tablet_manager.cc:1905] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.448410 1167 tablet_bootstrap.cc:654] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.450516 1170 ts_tablet_manager.cc:1428] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
W20260620 07:01:19.424926 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7f85c8a0ea484b57bb50425867e2774e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f85c8a0ea484b57bb50425867e2774e already in progress: creating tablet
I20260620 07:01:19.425525 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_29fca646d60048d9800e8358e72cdcdd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.451241 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ddd53657848a4ab291d48956d5778d7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddd53657848a4ab291d48956d5778d7b already in progress: creating tablet
W20260620 07:01:19.451561 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29fca646d60048d9800e8358e72cdcdd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.452623 2490 raft_consensus.cc:2781] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:19.426546 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fe79bcf487fc4d118a91f4c62628d8a5
I20260620 07:01:19.427038 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1f0edbec60db4755a61673582bcf331e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.459280 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f0edbec60db4755a61673582bcf331e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.459596 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet fe79bcf487fc4d118a91f4c62628d8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.459695 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet ba93e22c4720417c99d471b9c8b49b86 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e6ca6c0a0e40a68e8c6501af7d28c5) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:19.427284 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f6cfeccac77b48be87f3f59810c806ee consensus state has no leader
I20260620 07:01:19.460980 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4724fbd4e77543c48430fe63d4c0ba9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.461524 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4724fbd4e77543c48430fe63d4c0ba9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:19.444967 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5672e784e8b14e2bb540a68b0ee991ed consensus state has no leader
I20260620 07:01:19.428301 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c538a75449ac4a319a7ef093a9847ecd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:19.463270 424 master_service.cc:946] ReplaceTablet: received request to replace tablet ef4e6fda73ba45c6892273b33b37a688 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:19.445158 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3f9d7421b549468e8a7782f467473bdb
I20260620 07:01:19.463932 2490 raft_consensus.cc:686] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:19.464114 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 71b2d6ea3dab4bb8b544a59a5e433cdc from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:19.427774 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b9222f1374e4e96bd760af1a52f3a1c consensus state has no leader
I20260620 07:01:19.465008 418 master_service.cc:946] ReplaceTablet: received request to replace tablet e6bae5090f81417cbcf4b4d598b438da from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:19.465044 2490 consensus_queue.cc:237] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:19.428562 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a043d035b0c84d6290041d1c7c03bc35 consensus state has no leader
I20260620 07:01:19.466277 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f9d7421b549468e8a7782f467473bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:19.463485 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c538a75449ac4a319a7ef093a9847ecd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.467599 1170 tablet_bootstrap.cc:492] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.454242 732 tablet_service.cc:1514] Processing DeleteTablet for tablet fe79bcf487fc4d118a91f4c62628d8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.465636 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f9d7421b549468e8a7782f467473bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.474067 426 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_a48735bdc4c54529aa2a8ee62db1c4b0 [id=5c8493166f2448dea6f711457ba8c1bc] alter complete (version 3)
I20260620 07:01:19.475404 1170 tablet_bootstrap.cc:654] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.480274 2452 consensus_queue.cc:1035] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:19.493144 2436 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 07:01:19.504681 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6f137eb5fc0241e0911941c9b92797f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.505313 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f137eb5fc0241e0911941c9b92797f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.507321 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4eba92ab3a61458986cd0d77a674634c" } modify_external_catalogs: true
I20260620 07:01:19.507544 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4eba92ab3a61458986cd0d77a674634c" } modify_external_catalogs: true
I20260620 07:01:19.510462 1170 tablet_bootstrap.cc:492] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:19.510653 1170 ts_tablet_manager.cc:1397] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20260620 07:01:19.511559 1170 raft_consensus.cc:348] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.513518 1170 raft_consensus.cc:374] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.513661 1170 raft_consensus.cc:729] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.513965 1170 consensus_queue.cc:260] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.514626 1170 ts_tablet_manager.cc:1428] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260620 07:01:19.515590 1170 tablet_bootstrap.cc:492] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.517472 1170 tablet_bootstrap.cc:654] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.518245 1166 ts_tablet_manager.cc:1918] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:19.518388 1166 log.cc:1196] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/eea1525b54cc42b78180ba6867957f76
I20260620 07:01:19.518699 1166 ts_tablet_manager.cc:1939] T eea1525b54cc42b78180ba6867957f76 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:19.538244 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 840) took 4892 ms. Trace:
I20260620 07:01:19.538390 1166 rpcz_store.cc:276] 0620 07:01:14.645728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.645794 (+ 66us) service_pool.cc:227] Handling call
0620 07:01:19.437570 (+4791776us) ts_tablet_manager.cc:1145] Deleting tablet eea1525b54cc42b78180ba6867957f76
0620 07:01:19.437581 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.482612 (+ 45031us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.518135 (+ 35523us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.538218 (+ 20083us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4791578}
I20260620 07:01:19.540071 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet eea1525b54cc42b78180ba6867957f76 (table default.Table_f71c0f1f32364fcf80dc7bcbcf3e9da6 [id=9ccc7eaea2334670b3c18570de5dcb3b]) successfully deleted
I20260620 07:01:19.541891 2450 raft_consensus.cc:482] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.542032 2450 raft_consensus.cc:504] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.542543 2450 leader_election.cc:288] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:19.543787 683 leader_election.cc:341] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3651ef9790d342ec96f554134ae714dc
I20260620 07:01:19.543985 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3651ef9790d342ec96f554134ae714dc" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:19.538815 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 841) took 4878 ms. Trace:
W20260620 07:01:19.544593 681 leader_election.cc:341] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.544503 1166 rpcz_store.cc:276] 0620 07:01:14.660550 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.660845 (+ 295us) service_pool.cc:227] Handling call
0620 07:01:19.538677 (+4877832us) ts_tablet_manager.cc:1145] Deleting tablet 1d7cec62aea048d3bbe38ab2f83f7656
0620 07:01:19.538688 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.538779 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4877650}
W20260620 07:01:19.544996 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1d7cec62aea048d3bbe38ab2f83f7656 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d7cec62aea048d3bbe38ab2f83f7656 already in progress: creating tablet
I20260620 07:01:19.545246 681 leader_election.cc:302] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:19.545660 2450 raft_consensus.cc:2726] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.546411 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 843) took 4885 ms. Trace:
I20260620 07:01:19.546495 1166 rpcz_store.cc:276] 0620 07:01:14.660754 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.660805 (+ 51us) service_pool.cc:227] Handling call
0620 07:01:19.544765 (+4883960us) ts_tablet_manager.cc:1145] Deleting tablet 294f8a632f9d4191b925d1da605bd80e
0620 07:01:19.546277 (+ 1512us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.546395 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4883629}
W20260620 07:01:19.546864 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 294f8a632f9d4191b925d1da605bd80e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 294f8a632f9d4191b925d1da605bd80e already in progress: creating tablet
I20260620 07:01:19.547832 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 842) took 4887 ms. Trace:
I20260620 07:01:19.547917 1166 rpcz_store.cc:276] 0620 07:01:14.660649 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.660812 (+ 163us) service_pool.cc:227] Handling call
0620 07:01:19.546715 (+4885903us) ts_tablet_manager.cc:1145] Deleting tablet b17bbf2f844b4c01ad5d6dc36e096ee5
0620 07:01:19.547733 (+ 1018us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.547817 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4746788}
I20260620 07:01:19.548192 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 848) took 4746 ms. Trace:
I20260620 07:01:19.548259 1166 rpcz_store.cc:276] 0620 07:01:14.801732 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.801803 (+ 71us) service_pool.cc:227] Handling call
0620 07:01:19.548117 (+4746314us) ts_tablet_manager.cc:1145] Deleting tablet e6881c5b6560467c8b8e52777976b5da
0620 07:01:19.548125 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.548182 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4746165}
W20260620 07:01:19.548368 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b17bbf2f844b4c01ad5d6dc36e096ee5 already in progress: creating tablet
I20260620 07:01:19.548518 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 847) took 4746 ms. Trace:
I20260620 07:01:19.548573 1166 rpcz_store.cc:276] 0620 07:01:14.801663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.801779 (+ 116us) service_pool.cc:227] Handling call
0620 07:01:19.548446 (+4746667us) ts_tablet_manager.cc:1145] Deleting tablet f0e6ef65b5f44f6d9f2100dd404b2e5f
0620 07:01:19.548454 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.548508 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4737087}
W20260620 07:01:19.548610 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet e6881c5b6560467c8b8e52777976b5da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6881c5b6560467c8b8e52777976b5da already in progress: creating tablet
I20260620 07:01:19.548794 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 849) took 4728 ms. Trace:
I20260620 07:01:19.548846 1166 rpcz_store.cc:276] 0620 07:01:14.820056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.820128 (+ 72us) service_pool.cc:227] Handling call
0620 07:01:19.548730 (+4728602us) ts_tablet_manager.cc:1145] Deleting tablet ceb24f7e7be24b6f97b3c00f6552bbaa
0620 07:01:19.548737 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.548785 (+ 48us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4728437}
W20260620 07:01:19.548866 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0e6ef65b5f44f6d9f2100dd404b2e5f already in progress: creating tablet
I20260620 07:01:19.549073 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 864) took 4709 ms. Trace:
W20260620 07:01:19.549100 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ceb24f7e7be24b6f97b3c00f6552bbaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ceb24f7e7be24b6f97b3c00f6552bbaa already in progress: creating tablet
I20260620 07:01:19.549126 1166 rpcz_store.cc:276] 0620 07:01:14.839274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.839304 (+ 30us) service_pool.cc:227] Handling call
0620 07:01:19.549007 (+4709703us) ts_tablet_manager.cc:1145] Deleting tablet 0532a5d9ae484bd186f5c64bebd1b66c
0620 07:01:19.549014 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.549064 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4709518}
I20260620 07:01:19.549364 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 865) took 4704 ms. Trace:
I20260620 07:01:19.549434 1166 rpcz_store.cc:276] 0620 07:01:14.845437 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.845500 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:19.549293 (+4703793us) ts_tablet_manager.cc:1145] Deleting tablet b5c1567e0c9448dca870bd3d8502bf02
0620 07:01:19.549301 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.549354 (+ 53us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4703607}
I20260620 07:01:19.549710 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 866) took 4704 ms. Trace:
W20260620 07:01:19.549783 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0532a5d9ae484bd186f5c64bebd1b66c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0532a5d9ae484bd186f5c64bebd1b66c already in progress: creating tablet
I20260620 07:01:19.549767 1166 rpcz_store.cc:276] 0620 07:01:14.845569 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:14.845730 (+ 161us) service_pool.cc:227] Handling call
0620 07:01:19.549616 (+4703886us) ts_tablet_manager.cc:1145] Deleting tablet 4d23f06461284d6cb950b258e8b39540
0620 07:01:19.549641 (+ 25us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.549699 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4697722}
I20260620 07:01:19.549981 1166 tablet_replica.cc:330] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
W20260620 07:01:19.550032 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b5c1567e0c9448dca870bd3d8502bf02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5c1567e0c9448dca870bd3d8502bf02 already in progress: creating tablet
I20260620 07:01:19.550146 1166 raft_consensus.cc:2229] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
W20260620 07:01:19.550314 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4d23f06461284d6cb950b258e8b39540 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d23f06461284d6cb950b258e8b39540 already in progress: creating tablet
I20260620 07:01:19.550408 1166 raft_consensus.cc:2258] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.550930 1166 ts_tablet_manager.cc:1905] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.555866 1170 tablet_bootstrap.cc:492] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:19.556057 1170 ts_tablet_manager.cc:1397] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.003s
I20260620 07:01:19.556788 1170 raft_consensus.cc:348] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.557042 1170 raft_consensus.cc:374] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.557128 1170 raft_consensus.cc:729] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.557351 1170 consensus_queue.cc:260] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.557986 421 master_service.cc:946] ReplaceTablet: received request to replace tablet e6881c5b6560467c8b8e52777976b5da from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:19.558684 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_514c9eb90e114a17a13236a3372c2731" } modify_external_catalogs: true
I20260620 07:01:19.558902 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_514c9eb90e114a17a13236a3372c2731" } modify_external_catalogs: true
I20260620 07:01:19.559448 1170 ts_tablet_manager.cc:1428] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:19.560760 1170 tablet_bootstrap.cc:492] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.562347 1170 tablet_bootstrap.cc:654] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.567242 2490 raft_consensus.cc:482] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.567531 2490 raft_consensus.cc:504] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.569216 2450 raft_consensus.cc:482] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:19.569398 969 leader_election.cc:341] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 9b2f0c28057b4534a8a400d1ca7f3991
I20260620 07:01:19.569351 2450 raft_consensus.cc:504] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.569536 2490 leader_election.cc:288] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:19.569941 2450 leader_election.cc:288] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:19.570006 968 leader_election.cc:341] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 9b2f0c28057b4534a8a400d1ca7f3991
I20260620 07:01:19.570098 968 leader_election.cc:302] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:19.571995 683 leader_election.cc:341] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7b781d0578834708ae64b24419959cca
I20260620 07:01:19.572269 2490 raft_consensus.cc:2726] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.573015 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b781d0578834708ae64b24419959cca" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.573992 681 leader_election.cc:341] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.573958 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b2adb95fecb348c4a8a50e1630795dbb" } modify_external_catalogs: true
I20260620 07:01:19.574107 681 leader_election.cc:302] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:19.574175 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b2adb95fecb348c4a8a50e1630795dbb" } modify_external_catalogs: true
I20260620 07:01:19.574606 2450 raft_consensus.cc:2726] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.585132 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_00dcbe8974684255be9b138fcaf02050"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:19.587854 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_307a2d6eb71340839ef3275ce36ae2f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:19.589768 1170 tablet_bootstrap.cc:492] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:19.590075 1170 ts_tablet_manager.cc:1397] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.004s
I20260620 07:01:19.591569 1170 raft_consensus.cc:348] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.592027 1170 raft_consensus.cc:374] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.592180 1170 raft_consensus.cc:729] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.592729 1170 consensus_queue.cc:260] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.595909 1170 ts_tablet_manager.cc:1428] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:19.598076 1170 tablet_bootstrap.cc:492] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.615939 1167 tablet_bootstrap.cc:492] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.616106 1167 ts_tablet_manager.cc:1397] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.183s user 0.016s sys 0.026s
I20260620 07:01:19.616832 1167 raft_consensus.cc:348] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.617023 1167 raft_consensus.cc:374] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.617069 1167 raft_consensus.cc:729] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.617256 1167 consensus_queue.cc:260] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.617728 1167 ts_tablet_manager.cc:1428] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:19.617978 1167 tablet_bootstrap.cc:492] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:19.620199 1165 log.cc:1196] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/06fd96feb4a74b9f8d3243b7d774f388
I20260620 07:01:19.620575 1165 ts_tablet_manager.cc:1939] T 06fd96feb4a74b9f8d3243b7d774f388 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:19.620913 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1021) took 1221 ms. Trace:
I20260620 07:01:19.620992 1165 rpcz_store.cc:276] 0620 07:01:18.399030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.400168 (+ 1138us) service_pool.cc:227] Handling call
0620 07:01:18.713061 (+312893us) ts_tablet_manager.cc:1145] Deleting tablet 06fd96feb4a74b9f8d3243b7d774f388
0620 07:01:18.713068 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.223732 (+510664us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.354384 (+130652us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.620893 (+266509us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":312749}
I20260620 07:01:19.621500 1165 tablet_replica.cc:330] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:19.621515 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 06fd96feb4a74b9f8d3243b7d774f388 (table default.Table_55a40d12ea5d42b8b6b51b6b11ae4f7b [id=d2b994c9f22b4fa7a068b180dc980bbd]) successfully deleted
I20260620 07:01:19.621681 1165 raft_consensus.cc:2229] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.621832 1165 raft_consensus.cc:2258] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.353789 1168 raft_consensus.cc:348] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.622216 1168 raft_consensus.cc:374] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.622294 1168 raft_consensus.cc:729] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.622345 1165 ts_tablet_manager.cc:1905] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.622493 1168 consensus_queue.cc:260] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.622545 1170 tablet_bootstrap.cc:654] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.623014 1168 ts_tablet_manager.cc:1428] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.270s user 0.001s sys 0.001s
I20260620 07:01:19.359129 862 tablet_service.cc:1514] Processing DeleteTablet for tablet f0876d36e48a4d7fa78a1448fbeee4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.371927 861 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.375223 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d067448ff3c4faea9579eaaf29cd29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.375404 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d9d4b5a69484176a7b0f4fded010867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.375520 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ec769f903c4438bc1186d5fc1c5108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.375622 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 4260b0c953c14a198dbf9b64a30e7e05 with delete_type TABLET_DATA_DELETED (replaced by tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.375713 871 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.377264 872 tablet_service.cc:1514] Processing DeleteTablet for tablet c9d344f9e4b444e4b6018fdf0cf762fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.461067 858 tablet_service.cc:1514] Processing DeleteTablet for tablet fe79bcf487fc4d118a91f4c62628d8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.466773 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f9d7421b549468e8a7782f467473bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.486951 2253 raft_consensus.cc:482] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.624068 2253 raft_consensus.cc:504] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.624677 1168 tablet_bootstrap.cc:492] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:19.625124 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0f7d4b6fa14811a1f02456418f95a4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:19.625275 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0f7d4b6fa14811a1f02456418f95a4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.625742 831 leader_election.cc:341] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.626050 1168 tablet_bootstrap.cc:654] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:19.628185 830 leader_election.cc:341] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.628298 830 leader_election.cc:302] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.628676 2366 raft_consensus.cc:2726] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.629161 1167 tablet_bootstrap.cc:654] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.624691 2253 leader_election.cc:288] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.635191 1166 ts_tablet_manager.cc:1918] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 07:01:19.636631 1166 log.cc:1196] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/83451bba9a3c4c209dddf4250fea8806
I20260620 07:01:19.641752 1166 ts_tablet_manager.cc:1939] T 83451bba9a3c4c209dddf4250fea8806 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:19.642966 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00dcbe8974684255be9b138fcaf02050 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:19.652732 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_307a2d6eb71340839ef3275ce36ae2f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.661679 1167 tablet_bootstrap.cc:492] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.661916 1167 ts_tablet_manager.cc:1397] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.004s
I20260620 07:01:19.661844 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8bc65d975d544ad5b8dfc8aea392bc27" } new_table_name: "default.Table_e972d40e3f06413c9a1a824db15e456f" modify_external_catalogs: true
I20260620 07:01:19.662732 1167 raft_consensus.cc:348] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.662966 1167 raft_consensus.cc:374] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.663061 1167 raft_consensus.cc:729] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.663345 1167 consensus_queue.cc:260] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.665051 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b1e5202267514b5ea0f730fe14d3ae1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.665897 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1e5202267514b5ea0f730fe14d3ae1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.666314 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet a9daee42d5c748ceaed7dc94f551c0d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.671113 1169 ts_tablet_manager.cc:1918] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:19.672168 1167 ts_tablet_manager.cc:1428] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260620 07:01:19.672761 1167 tablet_bootstrap.cc:492] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:19.677454 1169 log.cc:1196] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/4302edba0ec04d7abc2789bc7be1beca
I20260620 07:01:19.677942 1169 ts_tablet_manager.cc:1939] T 4302edba0ec04d7abc2789bc7be1beca P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:19.678433 1167 tablet_bootstrap.cc:654] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.683269 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 960) took 2878 ms. Trace:
I20260620 07:01:19.683445 1169 rpcz_store.cc:276] 0620 07:01:16.804771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.804974 (+ 203us) service_pool.cc:227] Handling call
0620 07:01:19.367804 (+2562830us) ts_tablet_manager.cc:1145] Deleting tablet 4302edba0ec04d7abc2789bc7be1beca
0620 07:01:19.367814 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.636869 (+269055us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.671000 (+ 34131us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.683244 (+ 12244us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2562608}
I20260620 07:01:19.683843 1165 ts_tablet_manager.cc:1918] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:19.684424 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 4302edba0ec04d7abc2789bc7be1beca (table default.Table_4d3d2172df004ee39d7e56f81179364f [id=d553eceadb64462ba38a1e7026cb0a83]) successfully deleted
I20260620 07:01:19.685154 1165 log.cc:1196] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/7294e5678ad44622a3249c1113b5e297
I20260620 07:01:19.685374 1169 tablet_replica.cc:330] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:19.685606 1169 raft_consensus.cc:2229] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.686025 1165 ts_tablet_manager.cc:1939] T 7294e5678ad44622a3249c1113b5e297 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:19.686380 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3b70b1674e43768b29dea84b09a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.686546 1169 raft_consensus.cc:2258] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:19.693681 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96ff206179a84e0f949023048f2433a4 consensus state has no leader
I20260620 07:01:19.694227 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_eebd6f7c3a2347b083f35e0b12c9518f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.695016 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eebd6f7c3a2347b083f35e0b12c9518f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.696529 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 728e7997b9e442669f9b5bda602311ce
I20260620 07:01:19.696619 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1022) took 1297 ms. Trace:
I20260620 07:01:19.697866 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 728e7997b9e442669f9b5bda602311ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.697474 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 728e7997b9e442669f9b5bda602311ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.698551 1169 ts_tablet_manager.cc:1905] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.699290 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 71b2d6ea3dab4bb8b544a59a5e433cdc
I20260620 07:01:19.699294 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 728e7997b9e442669f9b5bda602311ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.699983 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc with delete_type TABLET_DATA_DELETED (replaced by tablet 1c390114ac2646619cb50ce1873e72f7) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.700176 420 catalog_manager.cc:6565] ReplaceTablet: tablet 71b2d6ea3dab4bb8b544a59a5e433cdc deleted and replaced by tablet 1c390114ac2646619cb50ce1873e72f7
I20260620 07:01:19.696715 1165 rpcz_store.cc:276] 0620 07:01:18.399133 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.402838 (+ 3705us) service_pool.cc:227] Handling call
0620 07:01:19.621455 (+1218617us) ts_tablet_manager.cc:1145] Deleting tablet 7294e5678ad44622a3249c1113b5e297
0620 07:01:19.621466 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.664819 (+ 43353us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.676809 (+ 11990us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.696596 (+ 19787us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1218469}
I20260620 07:01:19.700472 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc with delete_type TABLET_DATA_DELETED (replaced by tablet 1c390114ac2646619cb50ce1873e72f7) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.700502 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5cc308b9274141e4b97046f12359f301" } modify_external_catalogs: true
I20260620 07:01:19.700681 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5cc308b9274141e4b97046f12359f301" } modify_external_catalogs: true
I20260620 07:01:19.702080 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc with delete_type TABLET_DATA_DELETED (replaced by tablet 1c390114ac2646619cb50ce1873e72f7) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.702904 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 7294e5678ad44622a3249c1113b5e297 (table default.Table_51c799b6e1ca4b06828745a6337bdaa0 [id=15a7bd9071df42ba9ad669edd278e5f1]) successfully deleted
I20260620 07:01:19.703519 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_021ff3a24757452b9136ef50a3be98bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.704149 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_021ff3a24757452b9136ef50a3be98bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.705147 1165 tablet_replica.cc:330] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:19.705376 1165 raft_consensus.cc:2229] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.705564 1165 raft_consensus.cc:2258] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.706123 1165 ts_tablet_manager.cc:1905] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.709892 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8c0b0969fb784dba96459ea441f88ae9
I20260620 07:01:19.710587 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e1384dba2785444ea6cdb6dec7fd171d" } new_table_name: "default.Table_7d3ce5452e594f3fa51e09d6a0f521d9" modify_external_catalogs: true
I20260620 07:01:19.710621 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c0b0969fb784dba96459ea441f88ae9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.711195 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c0b0969fb784dba96459ea441f88ae9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.711484 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c0b0969fb784dba96459ea441f88ae9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.715116 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 01b82aa3a0ba48f7bf61401713aca6bc
I20260620 07:01:19.716630 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b82aa3a0ba48f7bf61401713aca6bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.716559 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6db2de0b2a534fa99a3ea6ee35d2c508" } new_table_name: "default.Table_ba656e51715e4fc3a2a0088c69a346a0" modify_external_catalogs: true
I20260620 07:01:19.716889 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b82aa3a0ba48f7bf61401713aca6bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.716885 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b82aa3a0ba48f7bf61401713aca6bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.718025 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d4bf2488466f4efa97a5dfa13576e493" } modify_external_catalogs: true
I20260620 07:01:19.718248 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d4bf2488466f4efa97a5dfa13576e493" } modify_external_catalogs: true
I20260620 07:01:19.721297 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e88c7789790e41a9a67d7a1a01cedc02" } new_table_name: "default.Table_183340ef4f634865953699cc2800f48a" modify_external_catalogs: true
I20260620 07:01:19.724644 1169 ts_tablet_manager.cc:1918] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:19.726138 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a76e5fada5c24c4f94cf995134ab8a96" } new_table_name: "default.Table_efe64c28b0f94bb18450b32c0da904b6" modify_external_catalogs: true
I20260620 07:01:19.728994 1165 ts_tablet_manager.cc:1918] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:19.729120 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 19b0d00db64b4114876bf4acf300919a consensus state has no leader
I20260620 07:01:19.729591 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_88b66d2bbc794b5a9681c73bf871b8dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.730115 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88b66d2bbc794b5a9681c73bf871b8dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.733211 1167 tablet_bootstrap.cc:492] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:01:19.733346 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f73cad102c5a410f904c1332ba92941d consensus state has no leader
I20260620 07:01:19.733371 1167 ts_tablet_manager.cc:1397] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.017s
I20260620 07:01:19.735082 1169 log.cc:1196] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/6229a52adf8d4b17bdf89347e01621ed
I20260620 07:01:19.735477 1169 ts_tablet_manager.cc:1939] T 6229a52adf8d4b17bdf89347e01621ed P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:19.736083 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c8dacf3eb56c4be49eeff770e4abd5b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.736660 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8dacf3eb56c4be49eeff770e4abd5b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.736732 1167 raft_consensus.cc:348] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.736967 1167 raft_consensus.cc:374] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.737020 1167 raft_consensus.cc:729] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.737253 1167 consensus_queue.cc:260] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.738722 422 catalog_manager.cc:5495] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:19.739212 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 97e01aa120cc4c189017236ad57de811 (table default.Table_b19a46e2d20e4f75a3d170cbb543ca71 [id=19dd20742533400980193075baec1956]). Expected version 1 got 0
I20260620 07:01:19.739477 422 catalog_manager.cc:5495] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:19.739924 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a9e70b585def4a4a9081a0938af8ce5b (table default.Table_e673aadd5ad94cfd870f850dc0d14201 [id=a876d134592d456ea2e7b8336037020f]). Expected version 3 got 0
I20260620 07:01:19.740190 422 catalog_manager.cc:5495] T b6e2c297072741eb927dff9bcf6a573f P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:19.740608 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:19.740811 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 2e0891d6911d4bf8887f7e88a605aed5 (table default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119]). Expected version 1 got 0
I20260620 07:01:19.737790 1167 ts_tablet_manager.cc:1428] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:19.741770 1167 tablet_bootstrap.cc:492] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:19.744027 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 210a09d394d8485989bb90e4949720fb (DEFAULT_TABLE table=default.Table_2889b3fc6d5a48d0a1eab791cc561be7 [id=192b94991ac24dc58bb6b8f7fc56ba9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.751000 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2feb83cb7d0b427eaa936f326f83aad0
I20260620 07:01:19.751296 1165 log.cc:1196] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/d53c90eff33044479838ff67dea93057
I20260620 07:01:19.751689 1165 ts_tablet_manager.cc:1939] T d53c90eff33044479838ff67dea93057 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:19.751726 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 2feb83cb7d0b427eaa936f326f83aad0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.752236 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 2feb83cb7d0b427eaa936f326f83aad0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.753278 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 210a09d394d8485989bb90e4949720fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.754145 2490 raft_consensus.cc:482] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.754287 2490 raft_consensus.cc:504] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.754925 2490 leader_election.cc:288] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:19.758867 2490 raft_consensus.cc:482] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.759017 2490 raft_consensus.cc:504] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:19.759482 969 leader_election.cc:341] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: fe3b70b1674e43768b29dea84b09a1a0
I20260620 07:01:19.759615 2490 leader_election.cc:288] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:19.759934 968 leader_election.cc:341] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: fe3b70b1674e43768b29dea84b09a1a0
I20260620 07:01:19.760037 968 leader_election.cc:302] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:19.760556 2490 raft_consensus.cc:2726] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.762740 1167 tablet_bootstrap.cc:654] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.752230 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 2feb83cb7d0b427eaa936f326f83aad0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:19.765575 968 leader_election.cc:341] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: a9daee42d5c748ceaed7dc94f551c0d1
W20260620 07:01:19.765707 969 leader_election.cc:341] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a9daee42d5c748ceaed7dc94f551c0d1
I20260620 07:01:19.765795 968 leader_election.cc:302] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:19.766185 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 069b271c96ab49d8802ba3ae31c324d0 consensus state has no leader
I20260620 07:01:19.766258 2490 raft_consensus.cc:2726] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.766963 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 961) took 2962 ms. Trace:
I20260620 07:01:19.767802 1168 tablet_bootstrap.cc:492] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:19.767952 1168 ts_tablet_manager.cc:1397] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.143s user 0.001s sys 0.005s
I20260620 07:01:19.768657 1168 raft_consensus.cc:348] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.768915 1168 raft_consensus.cc:374] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.768989 1168 raft_consensus.cc:729] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.769205 1168 consensus_queue.cc:260] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.769837 1168 ts_tablet_manager.cc:1428] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:19.769949 2253 raft_consensus.cc:482] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.770182 2253 raft_consensus.cc:504] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.771598 2253 leader_election.cc:288] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.772183 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ec769f903c4438bc1186d5fc1c5108" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.772758 830 leader_election.cc:341] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.771281 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ec769f903c4438bc1186d5fc1c5108" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:19.775116 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1020) took 1376 ms. Trace:
I20260620 07:01:19.775274 1169 rpcz_store.cc:276] 0620 07:01:16.804917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.804980 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:19.684737 (+2879757us) ts_tablet_manager.cc:1145] Deleting tablet 6229a52adf8d4b17bdf89347e01621ed
0620 07:01:19.684751 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.717736 (+ 32985us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.724495 (+ 6759us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.766937 (+ 42442us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2879510}
I20260620 07:01:19.775514 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 873) took 4543 ms. Trace:
I20260620 07:01:19.775629 1166 rpcz_store.cc:276] 0620 07:01:15.232204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.234525 (+ 2321us) service_pool.cc:227] Handling call
0620 07:01:19.549949 (+4315424us) ts_tablet_manager.cc:1145] Deleting tablet 83451bba9a3c4c209dddf4250fea8806
0620 07:01:19.549957 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.554054 (+ 4097us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.631854 (+ 77800us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.775487 (+143633us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4315181}
I20260620 07:01:19.775906 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 6229a52adf8d4b17bdf89347e01621ed (table default.Table_7eafc8e838624e3e9873bc01998b5daa [id=e4ea9f9e77f74312a2ead7c22390b268]) successfully deleted
I20260620 07:01:19.776034 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 874) took 4454 ms. Trace:
I20260620 07:01:19.776319 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 83451bba9a3c4c209dddf4250fea8806 (table default.Table_dcd39517a9e640af985a7a77e18673e3 [id=04c170b69f3b43eb88b51e1654ec86df]) successfully deleted
I20260620 07:01:19.776507 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 964) took 2929 ms. Trace:
I20260620 07:01:19.776104 1166 rpcz_store.cc:276] 0620 07:01:15.321299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.321475 (+ 176us) service_pool.cc:227] Handling call
0620 07:01:19.775918 (+4454443us) ts_tablet_manager.cc:1145] Deleting tablet c73bcb81a0c84cdfb4dea0561647828a
0620 07:01:19.775928 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.776021 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4431802}
I20260620 07:01:19.776700 1165 rpcz_store.cc:276] 0620 07:01:18.398909 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.403010 (+ 4101us) service_pool.cc:227] Handling call
0620 07:01:19.705097 (+1302087us) ts_tablet_manager.cc:1145] Deleting tablet d53c90eff33044479838ff67dea93057
0620 07:01:19.705109 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.725795 (+ 20686us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.728900 (+ 3105us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.775096 (+ 46196us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1301966}
W20260620 07:01:19.776978 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c73bcb81a0c84cdfb4dea0561647828a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c73bcb81a0c84cdfb4dea0561647828a already in progress: creating tablet
I20260620 07:01:19.777149 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 875) took 4390 ms. Trace:
W20260620 07:01:19.777271 681 consensus_peers.cc:487] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:19.777244 1166 rpcz_store.cc:276] 0620 07:01:15.386264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.386311 (+ 47us) service_pool.cc:227] Handling call
0620 07:01:19.776696 (+4390385us) ts_tablet_manager.cc:1145] Deleting tablet fc40cf4ca353452590c770c86be0814c
0620 07:01:19.776705 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.776797 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4352,"tablet-delete.queue_time_us":4321694}
W20260620 07:01:19.777652 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fc40cf4ca353452590c770c86be0814c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc40cf4ca353452590c770c86be0814c already in progress: creating tablet
I20260620 07:01:19.776973 1169 rpcz_store.cc:276] 0620 07:01:16.847203 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.847263 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:19.776320 (+2929057us) ts_tablet_manager.cc:1145] Deleting tablet 5db9a7df42e04949934b6962c9253196
0620 07:01:19.776332 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.776488 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2928790}
W20260620 07:01:19.778815 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5db9a7df42e04949934b6962c9253196 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5db9a7df42e04949934b6962c9253196 already in progress: creating tablet
W20260620 07:01:19.776392 831 leader_election.cc:341] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.779124 1168 tablet_bootstrap.cc:492] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:19.779086 831 leader_election.cc:302] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:19.780431 2253 raft_consensus.cc:2726] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.780786 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d19cb15909754e9ea35d90bcdd7f1209"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.781411 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d19cb15909754e9ea35d90bcdd7f1209 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.782430 1168 tablet_bootstrap.cc:654] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.783951 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 54bb495eea4c49b7ad7bf2300ad0e60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.784029 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1a1fd54d4e8940a7bd95dbcac8738be0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.784788 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a1fd54d4e8940a7bd95dbcac8738be0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.787292 2450 consensus_queue.cc:1035] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:19.789495 857 tablet_service.cc:1467] Processing CreateTablet for tablet 210a09d394d8485989bb90e4949720fb (DEFAULT_TABLE table=default.Table_2889b3fc6d5a48d0a1eab791cc561be7 [id=192b94991ac24dc58bb6b8f7fc56ba9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.789944 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 210a09d394d8485989bb90e4949720fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.791584 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet d53c90eff33044479838ff67dea93057 (table default.Table_7a520f90f9534374822183a6768a4d99 [id=22da0fcad0664913b2d2c6f80e9f1801]) successfully deleted
I20260620 07:01:19.791591 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1031) took 1139 ms. Trace:
I20260620 07:01:19.791707 1165 rpcz_store.cc:276] 0620 07:01:18.652188 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.652252 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:19.791450 (+1139198us) ts_tablet_manager.cc:1145] Deleting tablet 2d1bad6b34f14270a060ce7245ff0c0f
0620 07:01:19.791463 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.791569 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139001}
I20260620 07:01:19.792341 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 963) took 2946 ms. Trace:
I20260620 07:01:19.798341 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ad35110902bf4afcb9b78e44e466a26d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.799330 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad35110902bf4afcb9b78e44e466a26d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.801223 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 3bea07eca0fd4cef817f21486bf85dba (DEFAULT_TABLE table=default.Table_f8f12d1a288545379b3034aa4b6e6e68 [id=a6f77719b1b543049bf844caac12c378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.801645 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bea07eca0fd4cef817f21486bf85dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.797621 720 tablet_service.cc:1467] Processing CreateTablet for tablet 210a09d394d8485989bb90e4949720fb (DEFAULT_TABLE table=default.Table_2889b3fc6d5a48d0a1eab791cc561be7 [id=192b94991ac24dc58bb6b8f7fc56ba9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.801733 732 tablet_service.cc:1467] Processing CreateTablet for tablet 3bea07eca0fd4cef817f21486bf85dba (DEFAULT_TABLE table=default.Table_f8f12d1a288545379b3034aa4b6e6e68 [id=a6f77719b1b543049bf844caac12c378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.803329 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 210a09d394d8485989bb90e4949720fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.803555 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bea07eca0fd4cef817f21486bf85dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.807780 2450 raft_consensus.cc:482] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.807929 2450 raft_consensus.cc:504] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.808550 2450 leader_election.cc:288] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.809393 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0c41bf6a8a448ad809292d66ebf9c0e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:19.809864 1169 rpcz_store.cc:276] 0620 07:01:16.846156 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.858184 (+ 12028us) service_pool.cc:227] Handling call
0620 07:01:19.792178 (+2933994us) ts_tablet_manager.cc:1145] Deleting tablet 1936a2b27a1f4fda9ceb295c9c00acf8
0620 07:01:19.792193 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.792314 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2933748}
I20260620 07:01:19.810511 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 376e21ba4ccb4a858888cdcb832eab99 (DEFAULT_TABLE table=default.Table_82448b58ee6d41c3b20be9d9a5a49592 [id=532ca7ee610d4d46aa715d1aabff58eb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:19.810918 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1936a2b27a1f4fda9ceb295c9c00acf8 already in progress: creating tablet
I20260620 07:01:19.811026 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 376e21ba4ccb4a858888cdcb832eab99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.803427 857 tablet_service.cc:1467] Processing CreateTablet for tablet 3bea07eca0fd4cef817f21486bf85dba (DEFAULT_TABLE table=default.Table_f8f12d1a288545379b3034aa4b6e6e68 [id=a6f77719b1b543049bf844caac12c378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.811415 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1037) took 1158 ms. Trace:
I20260620 07:01:19.811456 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bea07eca0fd4cef817f21486bf85dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.811517 1165 rpcz_store.cc:276] 0620 07:01:18.652885 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.653997 (+ 1112us) service_pool.cc:227] Handling call
0620 07:01:19.811280 (+1157283us) ts_tablet_manager.cc:1145] Deleting tablet 8dad7e6437ab4328b9b88d5e6febe8a0
0620 07:01:19.811292 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.811393 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1157082}
I20260620 07:01:19.811793 1165 tablet_replica.cc:330] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:19.811981 1165 raft_consensus.cc:2229] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:19.812320 1165 raft_consensus.cc:2258] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.812887 1165 ts_tablet_manager.cc:1905] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:19.809993 681 leader_election.cc:341] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:19.814229 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2d1bad6b34f14270a060ce7245ff0c0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1bad6b34f14270a060ce7245ff0c0f already in progress: creating tablet
W20260620 07:01:19.814546 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8dad7e6437ab4328b9b88d5e6febe8a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dad7e6437ab4328b9b88d5e6febe8a0 already in progress: creating tablet
I20260620 07:01:19.814719 858 tablet_service.cc:1467] Processing CreateTablet for tablet 376e21ba4ccb4a858888cdcb832eab99 (DEFAULT_TABLE table=default.Table_82448b58ee6d41c3b20be9d9a5a49592 [id=532ca7ee610d4d46aa715d1aabff58eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.815094 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 376e21ba4ccb4a858888cdcb832eab99. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:19.819650 683 leader_election.cc:341] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d0c41bf6a8a448ad809292d66ebf9c0e
I20260620 07:01:19.819803 683 leader_election.cc:302] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:19.820259 2450 raft_consensus.cc:2726] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.824913 420 master_service.cc:946] ReplaceTablet: received request to replace tablet ca86563e5b014bb88ccb74c628670c46 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:19.827039 1169 tablet_replica.cc:330] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:19.827365 1169 raft_consensus.cc:2229] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.827607 1169 raft_consensus.cc:2258] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.828286 1169 ts_tablet_manager.cc:1905] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.829550 720 tablet_service.cc:1467] Processing CreateTablet for tablet 376e21ba4ccb4a858888cdcb832eab99 (DEFAULT_TABLE table=default.Table_82448b58ee6d41c3b20be9d9a5a49592 [id=532ca7ee610d4d46aa715d1aabff58eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.826846 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 878) took 4201 ms. Trace:
I20260620 07:01:19.829841 1166 rpcz_store.cc:276] 0620 07:01:15.625570 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.625627 (+ 57us) service_pool.cc:227] Handling call
0620 07:01:19.777459 (+4151832us) ts_tablet_manager.cc:1145] Deleting tablet 0f8ddfba5500406eba8f184bd5039170
0620 07:01:19.777466 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.826821 (+ 49355us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4102264}
I20260620 07:01:19.830196 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 376e21ba4ccb4a858888cdcb832eab99. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:19.830319 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0f8ddfba5500406eba8f184bd5039170 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f8ddfba5500406eba8f184bd5039170 already in progress: creating tablet
I20260620 07:01:19.831568 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 877) took 4206 ms. Trace:
I20260620 07:01:19.831676 1166 rpcz_store.cc:276] 0620 07:01:15.625447 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.635361 (+ 9914us) service_pool.cc:227] Handling call
0620 07:01:19.831419 (+4196058us) ts_tablet_manager.cc:1145] Deleting tablet 0e8e9256a3c0466abfacc2b4266a5db2
0620 07:01:19.831431 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.831544 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4155966}
W20260620 07:01:19.832111 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0e8e9256a3c0466abfacc2b4266a5db2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e8e9256a3c0466abfacc2b4266a5db2 already in progress: creating tablet
I20260620 07:01:19.832274 1167 tablet_bootstrap.cc:492] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.832410 1167 ts_tablet_manager.cc:1397] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.091s user 0.002s sys 0.002s
I20260620 07:01:19.833310 1167 raft_consensus.cc:348] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.833542 1167 raft_consensus.cc:374] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.833601 1167 raft_consensus.cc:729] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.833842 1167 consensus_queue.cc:260] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.834374 1167 ts_tablet_manager.cc:1428] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:19.834651 1167 tablet_bootstrap.cc:492] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:19.836586 1167 tablet_bootstrap.cc:654] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.838100 1170 tablet_bootstrap.cc:492] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:19.838266 1170 ts_tablet_manager.cc:1397] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.241s user 0.004s sys 0.001s
I20260620 07:01:19.839416 1170 raft_consensus.cc:348] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.839641 1170 raft_consensus.cc:374] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.839720 1170 raft_consensus.cc:729] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.839931 1170 consensus_queue.cc:260] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.840514 1170 ts_tablet_manager.cc:1428] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:19.840816 1170 tablet_bootstrap.cc:492] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:19.850317 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e6bae5090f81417cbcf4b4d598b438da
I20260620 07:01:19.850885 418 catalog_manager.cc:6565] ReplaceTablet: tablet e6bae5090f81417cbcf4b4d598b438da deleted and replaced by tablet ffb66de2e72b4d13ad4c58bec2720b5a
I20260620 07:01:19.851581 857 tablet_service.cc:1467] Processing CreateTablet for tablet 37ee274737634eb1a5f9aac99ab4705b (DEFAULT_TABLE table=default.Table_e7168442aafd4cfe8abca1a1b570fa44 [id=438953a58d20458bba7f7704802eca6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.851974 858 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bae5090f81417cbcf4b4d598b438da with delete_type TABLET_DATA_DELETED (replaced by tablet ffb66de2e72b4d13ad4c58bec2720b5a) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.852056 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ee274737634eb1a5f9aac99ab4705b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.851594 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 37ee274737634eb1a5f9aac99ab4705b (DEFAULT_TABLE table=default.Table_e7168442aafd4cfe8abca1a1b570fa44 [id=438953a58d20458bba7f7704802eca6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.852469 732 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bae5090f81417cbcf4b4d598b438da with delete_type TABLET_DATA_DELETED (replaced by tablet ffb66de2e72b4d13ad4c58bec2720b5a) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.853356 1170 tablet_bootstrap.cc:654] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.855342 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bae5090f81417cbcf4b4d598b438da with delete_type TABLET_DATA_DELETED (replaced by tablet ffb66de2e72b4d13ad4c58bec2720b5a) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:19.855630 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ee274737634eb1a5f9aac99ab4705b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.860065 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 879) took 4216 ms. Trace:
I20260620 07:01:19.860394 732 tablet_service.cc:1467] Processing CreateTablet for tablet 37ee274737634eb1a5f9aac99ab4705b (DEFAULT_TABLE table=default.Table_e7168442aafd4cfe8abca1a1b570fa44 [id=438953a58d20458bba7f7704802eca6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.860780 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ee274737634eb1a5f9aac99ab4705b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:19.863690 681 consensus_peers.cc:487] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:19.869356 1169 ts_tablet_manager.cc:1918] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:19.869489 1169 log.cc:1196] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/88c6aeea7c504f36964e8bf41b0fc4f9
I20260620 07:01:19.869860 1169 ts_tablet_manager.cc:1939] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:19.860175 1166 rpcz_store.cc:276] 0620 07:01:15.643908 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.643961 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:19.859927 (+4215966us) ts_tablet_manager.cc:1145] Deleting tablet 17c337e52ace48f99316960e655dd264
0620 07:01:19.859937 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.860043 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4184120}
I20260620 07:01:19.871150 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 880) took 4210 ms. Trace:
I20260620 07:01:19.871245 1166 rpcz_store.cc:276] 0620 07:01:15.660747 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.661005 (+ 258us) service_pool.cc:227] Handling call
0620 07:01:19.871007 (+4210002us) ts_tablet_manager.cc:1145] Deleting tablet cf0bae39e1634710af12de493f7f58d5
0620 07:01:19.871022 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.871131 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4194871}
I20260620 07:01:19.871572 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 881) took 4186 ms. Trace:
I20260620 07:01:19.871637 1166 rpcz_store.cc:276] 0620 07:01:15.685283 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.685649 (+ 366us) service_pool.cc:227] Handling call
0620 07:01:19.871483 (+4185834us) ts_tablet_manager.cc:1145] Deleting tablet fbb2fd1a8bb14f3e883a2efb6560d184
0620 07:01:19.871491 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.871559 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4143417}
I20260620 07:01:19.871934 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 884) took 4186 ms. Trace:
I20260620 07:01:19.872020 1166 rpcz_store.cc:276] 0620 07:01:15.685584 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.685763 (+ 179us) service_pool.cc:227] Handling call
0620 07:01:19.871828 (+4186065us) ts_tablet_manager.cc:1145] Deleting tablet 7a554c1eebd542619bb1989987a3d9a6
0620 07:01:19.871838 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.871901 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4143600}
I20260620 07:01:19.872304 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 882) took 4186 ms. Trace:
I20260620 07:01:19.872385 1166 rpcz_store.cc:276] 0620 07:01:15.685407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.685877 (+ 470us) service_pool.cc:227] Handling call
0620 07:01:19.872203 (+4186326us) ts_tablet_manager.cc:1145] Deleting tablet 70f09b7dfdc1467eb47b8d7acb214919
0620 07:01:19.872211 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.872273 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4143844}
I20260620 07:01:19.872709 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 883) took 4187 ms. Trace:
I20260620 07:01:19.872826 1166 rpcz_store.cc:276] 0620 07:01:15.685485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.685962 (+ 477us) service_pool.cc:227] Handling call
0620 07:01:19.872592 (+4186630us) ts_tablet_manager.cc:1145] Deleting tablet 702e78bcd01f41c1846294deadca1b54
0620 07:01:19.872601 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.872670 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4144108}
I20260620 07:01:19.872884 1165 ts_tablet_manager.cc:1918] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:19.872988 1165 log.cc:1196] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f8be5f41f1d64d918b727e3eef18738e
I20260620 07:01:19.873111 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 885) took 4169 ms. Trace:
I20260620 07:01:19.873198 1166 rpcz_store.cc:276] 0620 07:01:15.703969 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.704028 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:19.873013 (+4168985us) ts_tablet_manager.cc:1145] Deleting tablet 7fb2d5c0f6d24969a0fea05a34fea00f
0620 07:01:19.873021 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.873081 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4143952}
I20260620 07:01:19.873338 1165 ts_tablet_manager.cc:1939] T f8be5f41f1d64d918b727e3eef18738e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:19.873944 1165 tablet_replica.cc:330] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:19.874127 1165 raft_consensus.cc:2229] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.874284 1165 raft_consensus.cc:2258] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.874447 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d161383246cd40ec8ad6511e9959e18b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.875049 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d161383246cd40ec8ad6511e9959e18b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:19.876345 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet cf0bae39e1634710af12de493f7f58d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf0bae39e1634710af12de493f7f58d5 already in progress: creating tablet
W20260620 07:01:19.876578 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fbb2fd1a8bb14f3e883a2efb6560d184 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbb2fd1a8bb14f3e883a2efb6560d184 already in progress: creating tablet
W20260620 07:01:19.876820 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7a554c1eebd542619bb1989987a3d9a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a554c1eebd542619bb1989987a3d9a6 already in progress: creating tablet
W20260620 07:01:19.877048 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 70f09b7dfdc1467eb47b8d7acb214919 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70f09b7dfdc1467eb47b8d7acb214919 already in progress: creating tablet
I20260620 07:01:19.881801 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ef4e6fda73ba45c6892273b33b37a688
I20260620 07:01:19.882274 424 catalog_manager.cc:6565] ReplaceTablet: tablet ef4e6fda73ba45c6892273b33b37a688 deleted and replaced by tablet dfdcc3deb4f14f90b54fc412cd533948
I20260620 07:01:19.883176 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f8be5f41f1d64d918b727e3eef18738e (table default.Table_3122a50618184dc7bf7cb696dca2a55b [id=d55d6c70a1b34227b4820944e280fde8]) successfully deleted
W20260620 07:01:19.883451 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f0876d36e48a4d7fa78a1448fbeee4c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0876d36e48a4d7fa78a1448fbeee4c2 already in progress: creating tablet
I20260620 07:01:19.884572 857 tablet_service.cc:1514] Processing DeleteTablet for tablet ef4e6fda73ba45c6892273b33b37a688 with delete_type TABLET_DATA_DELETED (replaced by tablet dfdcc3deb4f14f90b54fc412cd533948) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.887326 732 tablet_service.cc:1514] Processing DeleteTablet for tablet ef4e6fda73ba45c6892273b33b37a688 with delete_type TABLET_DATA_DELETED (replaced by tablet dfdcc3deb4f14f90b54fc412cd533948) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.887578 1166 tablet_replica.cc:330] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:19.887652 1167 tablet_bootstrap.cc:492] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.887776 1167 ts_tablet_manager.cc:1397] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.006s
I20260620 07:01:19.887807 1166 raft_consensus.cc:2229] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:19.889528 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_54f575fa497442c689c436cf87257384"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.890269 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54f575fa497442c689c436cf87257384 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.892086 1168 tablet_bootstrap.cc:492] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:19.892341 1168 ts_tablet_manager.cc:1397] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.113s user 0.004s sys 0.008s
I20260620 07:01:19.892645 1166 raft_consensus.cc:2258] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:19.892979 1167 raft_consensus.cc:348] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.893249 1167 raft_consensus.cc:374] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.893424 1167 raft_consensus.cc:729] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.893734 1167 consensus_queue.cc:260] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.894942 732 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4af5f22c1348998cf08fb52a8f02cb (DEFAULT_TABLE table=default.Table_9781a7cd64e242389d7bab889fe0781d [id=b9a341d794884273b4ff867cb03f68db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.896840 1167 ts_tablet_manager.cc:1428] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260620 07:01:19.897372 1167 tablet_bootstrap.cc:492] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:19.897687 720 tablet_service.cc:1467] Processing CreateTablet for tablet e6856f19058a42e8bb25751325fc8b7e (DEFAULT_TABLE table=default.Table_d62c7ea251d64d68b6cfb78275ee57b4 [id=cf2b5876ea4a435598f80196be9a2d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.899165 857 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4af5f22c1348998cf08fb52a8f02cb (DEFAULT_TABLE table=default.Table_9781a7cd64e242389d7bab889fe0781d [id=b9a341d794884273b4ff867cb03f68db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.899571 1167 tablet_bootstrap.cc:654] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.899612 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4af5f22c1348998cf08fb52a8f02cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.901712 1165 ts_tablet_manager.cc:1905] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.902825 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f96688ac7c91450cb34afd5f40b9826c
I20260620 07:01:19.904801 730 tablet_service.cc:1514] Processing DeleteTablet for tablet f96688ac7c91450cb34afd5f40b9826c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.908278 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8a84b5a849c74f1a87f5300033268d83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:19.909543 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a84b5a849c74f1a87f5300033268d83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:19.910513 2452 raft_consensus.cc:482] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.910666 2452 raft_consensus.cc:504] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.911368 2452 leader_election.cc:288] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.912536 1168 raft_consensus.cc:348] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.912788 1168 raft_consensus.cc:374] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.913024 1168 raft_consensus.cc:729] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.913321 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fbd069552314f2c9ee010c054386644" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:19.915902 681 leader_election.cc:341] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:19.893272 1166 ts_tablet_manager.cc:1905] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:19.917052 730 tablet_service.cc:1467] Processing CreateTablet for tablet 9ac70d0657b842e6acbeaef5e2ef68e7 (DEFAULT_TABLE table=default.Table_3478a0c2fd4b42f597345cfc8ef000aa [id=e2782a58aa4944978f5382356a2cb161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.919318 1170 tablet_bootstrap.cc:492] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:19.919560 1170 ts_tablet_manager.cc:1397] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.003s
I20260620 07:01:19.920667 1170 raft_consensus.cc:348] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.923414 858 tablet_service.cc:1467] Processing CreateTablet for tablet e6856f19058a42e8bb25751325fc8b7e (DEFAULT_TABLE table=default.Table_d62c7ea251d64d68b6cfb78275ee57b4 [id=cf2b5876ea4a435598f80196be9a2d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.922377 872 tablet_service.cc:1467] Processing CreateTablet for tablet 9ac70d0657b842e6acbeaef5e2ef68e7 (DEFAULT_TABLE table=default.Table_3478a0c2fd4b42f597345cfc8ef000aa [id=e2782a58aa4944978f5382356a2cb161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.927302 857 tablet_service.cc:1514] Processing DeleteTablet for tablet f96688ac7c91450cb34afd5f40b9826c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:19.929397 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:19.931428 1167 tablet_bootstrap.cc:492] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.931664 1167 ts_tablet_manager.cc:1397] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.001s
I20260620 07:01:19.931813 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b5d2eb86f6bc4e668432323c020f4560" } new_table_name: "default.Table_88c48b399c144128a94d6be759a09d58" modify_external_catalogs: true
I20260620 07:01:19.932677 1167 raft_consensus.cc:348] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.932883 1167 raft_consensus.cc:374] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.932932 1167 raft_consensus.cc:729] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.933305 2253 raft_consensus.cc:482] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.933600 1167 consensus_queue.cc:260] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.935679 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bdcd7c3ed4c84fac94f54a305c27f042" } modify_external_catalogs: true
I20260620 07:01:19.936072 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bdcd7c3ed4c84fac94f54a305c27f042" } modify_external_catalogs: true
I20260620 07:01:19.941061 1167 ts_tablet_manager.cc:1428] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260620 07:01:19.941486 1167 tablet_bootstrap.cc:492] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:19.943270 1167 tablet_bootstrap.cc:654] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:19.924638 683 leader_election.cc:341] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 6fbd069552314f2c9ee010c054386644
I20260620 07:01:19.953329 683 leader_election.cc:302] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:19.930948 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b781d0578834708ae64b24419959cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.930996 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.931052 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c51ecf0f006400597f0e7f776698854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.931103 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da80903ac124d1aae937c2329f9b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 95ba8444d70342f781bd84edefbca71f) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.931143 729 tablet_service.cc:1514] Processing DeleteTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e with delete_type TABLET_DATA_DELETED (replaced by tablet 74eaa712962245b4bb14d17e4cdd8485) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:19.945397 719 tablet_service.cc:1467] Processing CreateTablet for tablet fed9c92307d04ca6afe9900020cf9d9c (DEFAULT_TABLE table=default.Table_0a1890bc1daa402480e753409ee074df [id=fd8202c73c504cdba7e0826aa67804e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.925004 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4af5f22c1348998cf08fb52a8f02cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.959298 729 tablet_service.cc:1467] Processing CreateTablet for tablet ce7a85d8951f4cfa88c2a2efa1a6ba17 (DEFAULT_TABLE table=default.Table_69de24cd01774857909747c287120f79 [id=c85df46b112949fbbbf1d1c5f6768f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.959704 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce7a85d8951f4cfa88c2a2efa1a6ba17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.963528 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fed9c92307d04ca6afe9900020cf9d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.965520 1167 tablet_bootstrap.cc:492] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:19.965651 1167 ts_tablet_manager.cc:1397] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20260620 07:01:19.966426 1167 raft_consensus.cc:348] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.966631 1167 raft_consensus.cc:374] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.966677 1167 raft_consensus.cc:729] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.967123 716 tablet_service.cc:1467] Processing CreateTablet for tablet 67c694e93fb845438460e8b3e71b016f (DEFAULT_TABLE table=default.Table_21200189c9d144febf4465b5dd0ba8e7 [id=265b029247ba409898bcece855b15a2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.967516 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67c694e93fb845438460e8b3e71b016f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.967765 1167 consensus_queue.cc:260] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:19.970106 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4af5f22c1348998cf08fb52a8f02cb (DEFAULT_TABLE table=default.Table_9781a7cd64e242389d7bab889fe0781d [id=b9a341d794884273b4ff867cb03f68db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.970851 1167 ts_tablet_manager.cc:1428] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 07:01:19.972826 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4af5f22c1348998cf08fb52a8f02cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.974135 1167 tablet_bootstrap.cc:492] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:19.974392 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ac70d0657b842e6acbeaef5e2ef68e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.978763 1167 tablet_bootstrap.cc:654] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:19.980756 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet ef4e6fda73ba45c6892273b33b37a688 with delete_type TABLET_DATA_DELETED (replaced by tablet dfdcc3deb4f14f90b54fc412cd533948) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:19.981321 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 052c0fc25dc5419d9e6a5c28a3b8a662 consensus state has no leader
I20260620 07:01:19.981374 1011 tablet_service.cc:1467] Processing CreateTablet for tablet e6856f19058a42e8bb25751325fc8b7e (DEFAULT_TABLE table=default.Table_d62c7ea251d64d68b6cfb78275ee57b4 [id=cf2b5876ea4a435598f80196be9a2d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.981812 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6856f19058a42e8bb25751325fc8b7e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:19.983146 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 702e78bcd01f41c1846294deadca1b54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 702e78bcd01f41c1846294deadca1b54 already in progress: creating tablet
W20260620 07:01:19.983395 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7fb2d5c0f6d24969a0fea05a34fea00f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fb2d5c0f6d24969a0fea05a34fea00f already in progress: creating tablet
I20260620 07:01:19.983394 726 tablet_service.cc:1467] Processing CreateTablet for tablet 885e6e80fd5449b5a2913165a14b76d8 (DEFAULT_TABLE table=default.Table_d2938b69b1084b4ca3c8877f6c5cf511 [id=01401a6bf7b84b5aab3091569bdbc8e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.920969 1170 raft_consensus.cc:374] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:19.983649 1170 raft_consensus.cc:729] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:19.983770 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 885e6e80fd5449b5a2913165a14b76d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.984026 1170 consensus_queue.cc:260] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.984597 2452 raft_consensus.cc:2726] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:19.984661 2450 raft_consensus.cc:482] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:19.984614 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 59991.6us
I20260620 07:01:19.985631 2359 raft_consensus.cc:482] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.985752 2359 raft_consensus.cc:504] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.986333 2359 leader_election.cc:288] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.984759 2450 raft_consensus.cc:504] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.988893 2450 leader_election.cc:288] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.990162 2253 raft_consensus.cc:504] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.991966 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390a327225344afda3076c341202cc1d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:19.992517 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c51ecf0f006400597f0e7f776698854" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:19.994131 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "967cc8f19ad64278910c86ffc4cb3ed2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:19.990772 2253 leader_election.cc:288] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.991099 2366 raft_consensus.cc:482] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:19.995014 2366 raft_consensus.cc:504] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:19.995607 2366 leader_election.cc:288] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.991125 871 tablet_service.cc:1467] Processing CreateTablet for tablet ce7a85d8951f4cfa88c2a2efa1a6ba17 (DEFAULT_TABLE table=default.Table_69de24cd01774857909747c287120f79 [id=c85df46b112949fbbbf1d1c5f6768f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.991307 867 tablet_service.cc:1467] Processing CreateTablet for tablet 67c694e93fb845438460e8b3e71b016f (DEFAULT_TABLE table=default.Table_21200189c9d144febf4465b5dd0ba8e7 [id=265b029247ba409898bcece855b15a2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.991460 860 tablet_service.cc:1467] Processing CreateTablet for tablet 885e6e80fd5449b5a2913165a14b76d8 (DEFAULT_TABLE table=default.Table_d2938b69b1084b4ca3c8877f6c5cf511 [id=01401a6bf7b84b5aab3091569bdbc8e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:19.994524 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390a327225344afda3076c341202cc1d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:19.997099 894 raft_consensus.cc:2454] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:19.998621 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6856f19058a42e8bb25751325fc8b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:19.998831 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6856f19058a42e8bb25751325fc8b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.000017 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67c694e93fb845438460e8b3e71b016f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.001927 1165 ts_tablet_manager.cc:1918] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.002061 1165 log.cc:1196] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f6bdcd8cd2574acf867b7ec487559db2
I20260620 07:01:20.002388 1165 ts_tablet_manager.cc:1939] T f6bdcd8cd2574acf867b7ec487559db2 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:20.003846 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 885e6e80fd5449b5a2913165a14b76d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.006852 1165 tablet_replica.cc:330] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:20.006930 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce7a85d8951f4cfa88c2a2efa1a6ba17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.007079 1165 raft_consensus.cc:2229] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.007243 1165 raft_consensus.cc:2258] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.007797 1165 ts_tablet_manager.cc:1905] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.011224 857 tablet_service.cc:1467] Processing CreateTablet for tablet fed9c92307d04ca6afe9900020cf9d9c (DEFAULT_TABLE table=default.Table_0a1890bc1daa402480e753409ee074df [id=fd8202c73c504cdba7e0826aa67804e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.011710 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fed9c92307d04ca6afe9900020cf9d9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:20.012054 681 leader_election.cc:341] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:20.012362 681 leader_election.cc:341] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.013113 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f6bdcd8cd2574acf867b7ec487559db2 (table default.Table_a1392579a049482496f7035d9dacbb76 [id=017e06014ef0443086ed5034c5dc1a37]) successfully deleted
W20260620 07:01:20.013505 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7d067448ff3c4faea9579eaaf29cd29f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d067448ff3c4faea9579eaaf29cd29f already in progress: creating tablet
W20260620 07:01:20.014389 683 leader_election.cc:341] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0c51ecf0f006400597f0e7f776698854
I20260620 07:01:20.014433 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bc3dd1306af4e49a9fec197b5740374" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:20.014508 683 leader_election.cc:302] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.015578 2452 raft_consensus.cc:2726] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:20.016489 831 leader_election.cc:341] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.017297 1165 ts_tablet_manager.cc:1918] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.020004 683 leader_election.cc:302] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:20.020632 2452 raft_consensus.cc:2781] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:20.020707 2452 raft_consensus.cc:482] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:20.020766 2452 raft_consensus.cc:3037] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:20.027740 2452 raft_consensus.cc:504] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.029019 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390a327225344afda3076c341202cc1d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:20.029626 681 leader_election.cc:341] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.029807 2452 leader_election.cc:288] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:20.017526 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ac70d0657b842e6acbeaef5e2ef68e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.029960 1165 log.cc:1196] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/1d9d4b5a69484176a7b0f4fded010867
I20260620 07:01:20.030333 1165 ts_tablet_manager.cc:1939] T 1d9d4b5a69484176a7b0f4fded010867 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:20.030834 1165 tablet_replica.cc:330] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:20.031049 1165 raft_consensus.cc:2229] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.031220 1165 raft_consensus.cc:2258] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.034956 2359 raft_consensus.cc:482] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:20.023439 831 leader_election.cc:341] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.035112 2359 raft_consensus.cc:504] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.035372 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 1d9d4b5a69484176a7b0f4fded010867 (table default.Table_e027fe5ccca8447d86ad610b8cec54f0 [id=a974a44b8ef1483883a25d46c2673d20]) successfully deleted
I20260620 07:01:20.035656 894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390a327225344afda3076c341202cc1d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:20.035727 2359 leader_election.cc:288] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:20.035849 1170 ts_tablet_manager.cc:1428] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.116s user 0.002s sys 0.000s
I20260620 07:01:20.035897 894 raft_consensus.cc:3037] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:20.035919 2359 raft_consensus.cc:482] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.036041 2359 raft_consensus.cc:504] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.036257 1170 tablet_bootstrap.cc:492] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:20.036650 2359 leader_election.cc:288] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:19.913395 1168 consensus_queue.cc:260] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.037166 1168 ts_tablet_manager.cc:1428] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.145s user 0.001s sys 0.001s
I20260620 07:01:20.038357 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0435678022914e6991c974e116d1a9f7" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:20.038920 894 raft_consensus.cc:2454] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:20.039713 874 tablet_service.cc:1467] Processing CreateTablet for tablet 2abce486e28845a3b61554827150882e (DEFAULT_TABLE table=default.Table_8bdf0be41ce54dcaba30e6e3a59b743c [id=24b506f449de45fe95b8c7f813fb1757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.042960 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06fd96feb4a74b9f8d3243b7d774f388" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:20.046181 681 leader_election.cc:341] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:20.046425 681 leader_election.cc:341] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.048406 865 tablet_service.cc:1467] Processing CreateTablet for tablet 5d746724e5d347c18a67761e5009c120 (DEFAULT_TABLE table=default.Table_04102f1fee5f4618a55d7381082bf5de [id=3935d75d55504c2fad3c07877ff38350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.050390 861 tablet_service.cc:1467] Processing CreateTablet for tablet c4d4fe8f8a0d44a2ba6a8ed742c472fe (DEFAULT_TABLE table=default.Table_c549664d74264eefb4f82ade7cbde2ac [id=cb8927a149c74e3f9aa1fe36b04754f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.050679 683 leader_election.cc:302] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:20.051198 2359 raft_consensus.cc:2781] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:20.051204 729 tablet_service.cc:1467] Processing CreateTablet for tablet c4d4fe8f8a0d44a2ba6a8ed742c472fe (DEFAULT_TABLE table=default.Table_c549664d74264eefb4f82ade7cbde2ac [id=cb8927a149c74e3f9aa1fe36b04754f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.051371 2359 raft_consensus.cc:686] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:20.051689 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d4fe8f8a0d44a2ba6a8ed742c472fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.051608 2359 consensus_queue.cc:237] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.059257 730 tablet_service.cc:1467] Processing CreateTablet for tablet 5d746724e5d347c18a67761e5009c120 (DEFAULT_TABLE table=default.Table_04102f1fee5f4618a55d7381082bf5de [id=3935d75d55504c2fad3c07877ff38350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.059839 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d746724e5d347c18a67761e5009c120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.061941 1166 ts_tablet_manager.cc:1918] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.062155 1166 log.cc:1196] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/2ee94c1a799a47f997469f96005167dc
I20260620 07:01:20.062186 862 tablet_service.cc:1467] Processing CreateTablet for tablet 8cfe808698374bcf8afc45c71b576721 (DEFAULT_TABLE table=default.Table_022c97d0b49b4f8a8fb16b578c3a9bd3 [id=b690804992624ab2b97a53ce35d1b97c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.062609 1166 ts_tablet_manager.cc:1939] T 2ee94c1a799a47f997469f96005167dc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:20.063297 729 tablet_service.cc:1467] Processing CreateTablet for tablet 8cfe808698374bcf8afc45c71b576721 (DEFAULT_TABLE table=default.Table_022c97d0b49b4f8a8fb16b578c3a9bd3 [id=b690804992624ab2b97a53ce35d1b97c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.063874 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cfe808698374bcf8afc45c71b576721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.073226 864 tablet_service.cc:1467] Processing CreateTablet for tablet 8afdfa2c293e4a19978bbf85a68753f7 (DEFAULT_TABLE table=default.Table_a4f3e4033b514356b31b22033f8bd248 [id=c09c12eaaa2b4fa8a9df97ca78bddd51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.073669 726 tablet_service.cc:1467] Processing CreateTablet for tablet 8afdfa2c293e4a19978bbf85a68753f7 (DEFAULT_TABLE table=default.Table_a4f3e4033b514356b31b22033f8bd248 [id=c09c12eaaa2b4fa8a9df97ca78bddd51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.075644 1170 tablet_bootstrap.cc:654] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:20.076004 999 tablet_service.cc:1467] Processing CreateTablet for tablet fed9c92307d04ca6afe9900020cf9d9c (DEFAULT_TABLE table=default.Table_0a1890bc1daa402480e753409ee074df [id=fd8202c73c504cdba7e0826aa67804e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.076473 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fed9c92307d04ca6afe9900020cf9d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.076685 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 8cfe808698374bcf8afc45c71b576721 (DEFAULT_TABLE table=default.Table_022c97d0b49b4f8a8fb16b578c3a9bd3 [id=b690804992624ab2b97a53ce35d1b97c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.076738 995 tablet_service.cc:1467] Processing CreateTablet for tablet 8afdfa2c293e4a19978bbf85a68753f7 (DEFAULT_TABLE table=default.Table_a4f3e4033b514356b31b22033f8bd248 [id=c09c12eaaa2b4fa8a9df97ca78bddd51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.077030 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cfe808698374bcf8afc45c71b576721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.077209 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8afdfa2c293e4a19978bbf85a68753f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.077564 1012 tablet_service.cc:1467] Processing CreateTablet for tablet 9ac70d0657b842e6acbeaef5e2ef68e7 (DEFAULT_TABLE table=default.Table_3478a0c2fd4b42f597345cfc8ef000aa [id=e2782a58aa4944978f5382356a2cb161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.077859 1012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ac70d0657b842e6acbeaef5e2ef68e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.079015 1010 tablet_service.cc:1467] Processing CreateTablet for tablet ce7a85d8951f4cfa88c2a2efa1a6ba17 (DEFAULT_TABLE table=default.Table_69de24cd01774857909747c287120f79 [id=c85df46b112949fbbbf1d1c5f6768f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.079334 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce7a85d8951f4cfa88c2a2efa1a6ba17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.080664 1001 tablet_service.cc:1467] Processing CreateTablet for tablet c4d4fe8f8a0d44a2ba6a8ed742c472fe (DEFAULT_TABLE table=default.Table_c549664d74264eefb4f82ade7cbde2ac [id=cb8927a149c74e3f9aa1fe36b04754f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.080981 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d4fe8f8a0d44a2ba6a8ed742c472fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.082866 2490 raft_consensus.cc:482] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.083024 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 67c694e93fb845438460e8b3e71b016f (DEFAULT_TABLE table=default.Table_21200189c9d144febf4465b5dd0ba8e7 [id=265b029247ba409898bcece855b15a2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.083370 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67c694e93fb845438460e8b3e71b016f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.083840 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet eeb082e189304f13909d115f7197c5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:20.084966 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bc3dd1306af4e49a9fec197b5740374" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:20.085978 859 tablet_service.cc:1467] Processing CreateTablet for tablet b6e15d20302b4f8c837a13f69dade0ef (DEFAULT_TABLE table=default.Table_30d1afddb5ab451e977a6d13dacc3f1c [id=bb97ce992c1147a482e1a81e9b4a6e46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.088333 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "967cc8f19ad64278910c86ffc4cb3ed2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:20.088466 868 tablet_service.cc:1467] Processing CreateTablet for tablet 40346cc521344d32b5eff74042339644 (DEFAULT_TABLE table=default.Table_900d2a2ae8934a659e9cb9a906c1480e [id=458eda7a015d44dd89fb16c999153748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.091181 994 tablet_service.cc:1467] Processing CreateTablet for tablet 5d746724e5d347c18a67761e5009c120 (DEFAULT_TABLE table=default.Table_04102f1fee5f4618a55d7381082bf5de [id=3935d75d55504c2fad3c07877ff38350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.091570 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d746724e5d347c18a67761e5009c120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.091533 875 tablet_service.cc:1467] Processing CreateTablet for tablet cc287ba0c0ed4928b44014ac8b0e9d63 (DEFAULT_TABLE table=default.Table_637bc4c2642d48fe9086bac631bc9b8f [id=6a4168f4610f4a4fa1b572689aff2210]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:20.091713 830 leader_election.cc:341] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.091910 830 leader_election.cc:302] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:20.092424 830 leader_election.cc:341] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.092557 830 leader_election.cc:302] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:20.093212 2253 raft_consensus.cc:2726] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:20.093465 2253 raft_consensus.cc:2726] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:20.094432 876 tablet_service.cc:1467] Processing CreateTablet for tablet 45132bf99b184d2980ed0f270f30d26b (DEFAULT_TABLE table=default.Table_2f3beeb172c74e62bdfa32b0f78ee03e [id=58c2ccd340a841cb8f9d50f1f99208f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.096112 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 2abce486e28845a3b61554827150882e (DEFAULT_TABLE table=default.Table_8bdf0be41ce54dcaba30e6e3a59b743c [id=24b506f449de45fe95b8c7f813fb1757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.096488 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2abce486e28845a3b61554827150882e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.096643 869 tablet_service.cc:1467] Processing CreateTablet for tablet 51290bc3d96246e4968326cb8344fce8 (DEFAULT_TABLE table=default.Table_1a65dfcfbc4448d284b3d53d977f42fa [id=92c627294424440dbae9de4ad97a0f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.097054 1006 tablet_service.cc:1467] Processing CreateTablet for tablet cc287ba0c0ed4928b44014ac8b0e9d63 (DEFAULT_TABLE table=default.Table_637bc4c2642d48fe9086bac631bc9b8f [id=6a4168f4610f4a4fa1b572689aff2210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.097191 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 45132bf99b184d2980ed0f270f30d26b (DEFAULT_TABLE table=default.Table_2f3beeb172c74e62bdfa32b0f78ee03e [id=58c2ccd340a841cb8f9d50f1f99208f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.097419 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc287ba0c0ed4928b44014ac8b0e9d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.097621 1003 tablet_service.cc:1467] Processing CreateTablet for tablet b6e15d20302b4f8c837a13f69dade0ef (DEFAULT_TABLE table=default.Table_30d1afddb5ab451e977a6d13dacc3f1c [id=bb97ce992c1147a482e1a81e9b4a6e46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.097934 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e15d20302b4f8c837a13f69dade0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.099625 996 tablet_service.cc:1467] Processing CreateTablet for tablet 885e6e80fd5449b5a2913165a14b76d8 (DEFAULT_TABLE table=default.Table_d2938b69b1084b4ca3c8877f6c5cf511 [id=01401a6bf7b84b5aab3091569bdbc8e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.099972 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 885e6e80fd5449b5a2913165a14b76d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.100271 997 tablet_service.cc:1467] Processing CreateTablet for tablet 51290bc3d96246e4968326cb8344fce8 (DEFAULT_TABLE table=default.Table_1a65dfcfbc4448d284b3d53d977f42fa [id=92c627294424440dbae9de4ad97a0f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.100626 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51290bc3d96246e4968326cb8344fce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.103011 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45132bf99b184d2980ed0f270f30d26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.083029 2490 raft_consensus.cc:504] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.103704 2490 leader_election.cc:288] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:20.104141 863 tablet_service.cc:1467] Processing CreateTablet for tablet 5889c0b321604b82ac12918ae3030405 (DEFAULT_TABLE table=default.Table_fecf267dd00c407eaf57602a2584181b [id=970a178ca3a949c1804c11f092eea79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.104950 2490 raft_consensus.cc:482] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.104141 870 tablet_service.cc:1467] Processing CreateTablet for tablet 268bb66234ff4d069f5d1cd831c292fe (DEFAULT_TABLE table=default.Table_41998d0ef447409ca36946bbe2f01936 [id=6c430f7c19294418947cc740b8fdbd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.105072 2490 raft_consensus.cc:504] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:20.105386 968 leader_election.cc:341] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 54bb495eea4c49b7ad7bf2300ad0e60a
I20260620 07:01:20.105616 2490 leader_election.cc:288] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:20.106082 995 tablet_service.cc:1467] Processing CreateTablet for tablet 40346cc521344d32b5eff74042339644 (DEFAULT_TABLE table=default.Table_900d2a2ae8934a659e9cb9a906c1480e [id=458eda7a015d44dd89fb16c999153748]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:20.106302 968 leader_election.cc:341] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 8cca283f4d2645c0b59f750949b7e263
I20260620 07:01:20.106918 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 5889c0b321604b82ac12918ae3030405 (DEFAULT_TABLE table=default.Table_fecf267dd00c407eaf57602a2584181b [id=970a178ca3a949c1804c11f092eea79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.107585 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 268bb66234ff4d069f5d1cd831c292fe (DEFAULT_TABLE table=default.Table_41998d0ef447409ca36946bbe2f01936 [id=6c430f7c19294418947cc740b8fdbd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.107618 873 tablet_service.cc:1467] Processing CreateTablet for tablet ab49b43f54524be097f863851cfa223a (DEFAULT_TABLE table=default.Table_bbd40332020c4274afc8e651e5fa33d7 [id=b30154e106e64a5b8e5dcf36227b60d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.108012 1008 tablet_service.cc:1467] Processing CreateTablet for tablet ab49b43f54524be097f863851cfa223a (DEFAULT_TABLE table=default.Table_bbd40332020c4274afc8e651e5fa33d7 [id=b30154e106e64a5b8e5dcf36227b60d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.108363 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab49b43f54524be097f863851cfa223a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.111869 866 tablet_service.cc:1467] Processing CreateTablet for tablet bd884617649443f9959bc4512c219042 (DEFAULT_TABLE table=default.Table_67eedfddcbdc4b76b0c7c0b2ee310376 [id=a53c280e99794cd3b96118cd7d5cb1e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.112342 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet f96688ac7c91450cb34afd5f40b9826c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:20.112692 1003 tablet_service.cc:1467] Processing CreateTablet for tablet bd884617649443f9959bc4512c219042 (DEFAULT_TABLE table=default.Table_67eedfddcbdc4b76b0c7c0b2ee310376 [id=a53c280e99794cd3b96118cd7d5cb1e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.113013 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd884617649443f9959bc4512c219042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.120596 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5889c0b321604b82ac12918ae3030405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.121191 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 268bb66234ff4d069f5d1cd831c292fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.122213 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40346cc521344d32b5eff74042339644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.133361 1165 ts_tablet_manager.cc:1905] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.143579 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8f52009921d54b0cb21a5f60133b32ef" } modify_external_catalogs: true
I20260620 07:01:20.143868 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8f52009921d54b0cb21a5f60133b32ef" } modify_external_catalogs: true
I20260620 07:01:20.147240 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:20.147614 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 390a327225344afda3076c341202cc1d (table default.Table_4563e27d87354007895f9d9819e8d8a0 [id=d7198485f2104c2092955ef5305900cf]). Expected version 1 got 0
I20260620 07:01:20.147939 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a9e70b585def4a4a9081a0938af8ce5b (table default.Table_e673aadd5ad94cfd870f850dc0d14201 [id=a876d134592d456ea2e7b8336037020f]). Expected version 3 got 0
I20260620 07:01:20.084463 732 tablet_service.cc:1467] Processing CreateTablet for tablet b6e15d20302b4f8c837a13f69dade0ef (DEFAULT_TABLE table=default.Table_30d1afddb5ab451e977a6d13dacc3f1c [id=bb97ce992c1147a482e1a81e9b4a6e46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.089625 716 tablet_service.cc:1467] Processing CreateTablet for tablet 40346cc521344d32b5eff74042339644 (DEFAULT_TABLE table=default.Table_900d2a2ae8934a659e9cb9a906c1480e [id=458eda7a015d44dd89fb16c999153748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.151660 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b112301348ea4d389930b5ecdc98183d" } modify_external_catalogs: true
I20260620 07:01:20.151602 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 886) took 4411 ms. Trace:
I20260620 07:01:20.151902 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b112301348ea4d389930b5ecdc98183d" } modify_external_catalogs: true
I20260620 07:01:20.154652 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fbd069552314f2c9ee010c054386644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.091972 719 tablet_service.cc:1467] Processing CreateTablet for tablet cc287ba0c0ed4928b44014ac8b0e9d63 (DEFAULT_TABLE table=default.Table_637bc4c2642d48fe9086bac631bc9b8f [id=6a4168f4610f4a4fa1b572689aff2210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.151934 1166 rpcz_store.cc:276] 0620 07:01:15.739970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.740029 (+ 59us) service_pool.cc:227] Handling call
0620 07:01:19.887450 (+4147421us) ts_tablet_manager.cc:1145] Deleting tablet 2ee94c1a799a47f997469f96005167dc
0620 07:01:19.887508 (+ 58us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.966916 (+ 79408us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.061804 (+ 94888us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.151454 (+ 89650us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4133111}
I20260620 07:01:20.155826 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 889) took 4301 ms. Trace:
I20260620 07:01:20.155916 1166 rpcz_store.cc:276] 0620 07:01:15.854701 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.854754 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:20.155682 (+4300928us) ts_tablet_manager.cc:1145] Deleting tablet 8b2a9d1b793f4cb0a1ff7298e10c3162
0620 07:01:20.155694 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.155807 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4183443}
I20260620 07:01:20.156242 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 888) took 4313 ms. Trace:
I20260620 07:01:20.094080 721 tablet_service.cc:1467] Processing CreateTablet for tablet 45132bf99b184d2980ed0f270f30d26b (DEFAULT_TABLE table=default.Table_2f3beeb172c74e62bdfa32b0f78ee03e [id=58c2ccd340a841cb8f9d50f1f99208f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.156311 1166 rpcz_store.cc:276] 0620 07:01:15.842915 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.845503 (+ 2588us) service_pool.cc:227] Handling call
0620 07:01:20.156140 (+4310637us) ts_tablet_manager.cc:1145] Deleting tablet 361dff84507843b5aeb2404b7245bf60
0620 07:01:20.156150 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.156226 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4183787}
I20260620 07:01:20.095904 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8afdfa2c293e4a19978bbf85a68753f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.156652 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 890) took 4224 ms. Trace:
I20260620 07:01:20.156726 1166 rpcz_store.cc:276] 0620 07:01:15.932179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.932254 (+ 75us) service_pool.cc:227] Handling call
0620 07:01:20.156566 (+4224312us) ts_tablet_manager.cc:1145] Deleting tablet 0fd4539155d74bd082a0ce934e3126c5
0620 07:01:20.156574 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.156638 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4184152}
I20260620 07:01:20.156984 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 891) took 4214 ms. Trace:
I20260620 07:01:20.157049 1166 rpcz_store.cc:276] 0620 07:01:15.942116 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:15.942188 (+ 72us) service_pool.cc:227] Handling call
0620 07:01:20.156902 (+4214714us) ts_tablet_manager.cc:1145] Deleting tablet ffe453ce52ce406fad5206bdedad9ef0
0620 07:01:20.156910 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.156972 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4184434}
I20260620 07:01:20.157284 1166 tablet_replica.cc:330] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:20.157472 1166 raft_consensus.cc:2229] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.157620 1166 raft_consensus.cc:2258] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.158120 1166 ts_tablet_manager.cc:1905] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.161842 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 970) took 3211 ms. Trace:
I20260620 07:01:20.162070 1169 rpcz_store.cc:276] 0620 07:01:16.950724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.950831 (+ 107us) service_pool.cc:227] Handling call
0620 07:01:19.813513 (+2862682us) ts_tablet_manager.cc:1145] Deleting tablet 88c6aeea7c504f36964e8bf41b0fc4f9
0620 07:01:19.826983 (+ 13470us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:19.866515 (+ 39532us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:19.869276 (+ 2761us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.161807 (+292531us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":176237,"tablet-delete.queue_time_us":2862422}
I20260620 07:01:20.100859 727 tablet_service.cc:1467] Processing CreateTablet for tablet 5889c0b321604b82ac12918ae3030405 (DEFAULT_TABLE table=default.Table_fecf267dd00c407eaf57602a2584181b [id=970a178ca3a949c1804c11f092eea79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.097536 729 tablet_service.cc:1467] Processing CreateTablet for tablet 51290bc3d96246e4968326cb8344fce8 (DEFAULT_TABLE table=default.Table_1a65dfcfbc4448d284b3d53d977f42fa [id=92c627294424440dbae9de4ad97a0f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.163318 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51290bc3d96246e4968326cb8344fce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.104926 723 tablet_service.cc:1467] Processing CreateTablet for tablet 268bb66234ff4d069f5d1cd831c292fe (DEFAULT_TABLE table=default.Table_41998d0ef447409ca36946bbe2f01936 [id=6c430f7c19294418947cc740b8fdbd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.110481 722 tablet_service.cc:1467] Processing CreateTablet for tablet ab49b43f54524be097f863851cfa223a (DEFAULT_TABLE table=default.Table_bbd40332020c4274afc8e651e5fa33d7 [id=b30154e106e64a5b8e5dcf36227b60d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.112941 733 tablet_service.cc:1467] Processing CreateTablet for tablet bd884617649443f9959bc4512c219042 (DEFAULT_TABLE table=default.Table_67eedfddcbdc4b76b0c7c0b2ee310376 [id=a53c280e99794cd3b96118cd7d5cb1e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.123200 2359 raft_consensus.cc:482] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.163654 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5889c0b321604b82ac12918ae3030405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.164259 2359 raft_consensus.cc:504] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.165267 2359 leader_election.cc:288] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:20.167289 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6bdcd8cd2574acf867b7ec487559db2" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:20.167750 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 2ee94c1a799a47f997469f96005167dc (table default.Table_09cf5a5a891a4f53be1f8c6f66b3759f [id=2db058e1a08d4e8288b418a29915ae2a]) successfully deleted
W20260620 07:01:20.168033 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b2a9d1b793f4cb0a1ff7298e10c3162 already in progress: creating tablet
W20260620 07:01:20.168256 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 361dff84507843b5aeb2404b7245bf60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 361dff84507843b5aeb2404b7245bf60 already in progress: creating tablet
I20260620 07:01:20.168357 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd884617649443f9959bc4512c219042. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:20.168450 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0fd4539155d74bd082a0ce934e3126c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd4539155d74bd082a0ce934e3126c5 already in progress: creating tablet
W20260620 07:01:20.168663 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ffe453ce52ce406fad5206bdedad9ef0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffe453ce52ce406fad5206bdedad9ef0 already in progress: creating tablet
W20260620 07:01:20.169543 681 leader_election.cc:341] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.169816 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab49b43f54524be097f863851cfa223a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.170936 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc287ba0c0ed4928b44014ac8b0e9d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.175230 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 88c6aeea7c504f36964e8bf41b0fc4f9 (table default.Table_b0ba90ad7d404eefaffdd72e2bbd6645 [id=b6dc41e1ec4b4b8c9aa8583c725fa886]) successfully deleted
I20260620 07:01:20.175640 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40346cc521344d32b5eff74042339644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.178071 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45132bf99b184d2980ed0f270f30d26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.179050 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e15d20302b4f8c837a13f69dade0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.179165 2359 raft_consensus.cc:482] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.179678 2359 raft_consensus.cc:504] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.180964 2359 leader_election.cc:288] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:20.182134 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 268bb66234ff4d069f5d1cd831c292fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.185734 425 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:20.185997 425 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a9e70b585def4a4a9081a0938af8ce5b (table default.Table_e673aadd5ad94cfd870f850dc0d14201 [id=a876d134592d456ea2e7b8336037020f]). Expected version 3 got 0
I20260620 07:01:20.187106 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a36a5319a044e9da7dc7b666484e257" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:20.187964 681 leader_election.cc:341] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.189608 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bc3dd1306af4e49a9fec197b5740374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:20.193178 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_17870f344fa9455bb22f8a230770a29e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.195106 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17870f344fa9455bb22f8a230770a29e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.195278 2490 raft_consensus.cc:482] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.195413 2490 raft_consensus.cc:504] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:20.195999 2490 leader_election.cc:288] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:20.196652 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f8c4955c164e6b9061ac607bbe081c with delete_type TABLET_DATA_DELETED (replaced by tablet 0e864cac7431439b9eb18d0cd98a7755) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:20.197964 968 leader_election.cc:341] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ba93e22c4720417c99d471b9c8b49b86
I20260620 07:01:20.198858 2490 raft_consensus.cc:482] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.198974 2490 raft_consensus.cc:504] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:20.199501 2490 leader_election.cc:288] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:20.200424 968 leader_election.cc:341] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: c2e38178b9244152915d4c0a9dcf59dc
I20260620 07:01:20.204975 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet d51c7488711b4db697b48025a5ba6e9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:20.205569 720 tablet_service.cc:1467] Processing CreateTablet for tablet 2abce486e28845a3b61554827150882e (DEFAULT_TABLE table=default.Table_8bdf0be41ce54dcaba30e6e3a59b743c [id=24b506f449de45fe95b8c7f813fb1757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.206091 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2abce486e28845a3b61554827150882e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.207073 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ca86563e5b014bb88ccb74c628670c46
I20260620 07:01:20.207583 420 catalog_manager.cc:6565] ReplaceTablet: tablet ca86563e5b014bb88ccb74c628670c46 deleted and replaced by tablet ceb16b2060f34a32870bcf6fb143efe7
W20260620 07:01:20.208407 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 36a5dde9352f48a19f7a379dc40cf491 (table default.Table_7d80e3481b2146b289e99842ce23a03e [id=3c0fe45f7132421ca2348b19a84abf91], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 36a5dde9352f48a19f7a379dc40cf491 consensus state has no leader
I20260620 07:01:20.209187 857 tablet_service.cc:1514] Processing DeleteTablet for tablet ca86563e5b014bb88ccb74c628670c46 with delete_type TABLET_DATA_DELETED (replaced by tablet ceb16b2060f34a32870bcf6fb143efe7) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:20.217260 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 3651ef9790d342ec96f554134ae714dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.222976 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a36a5319a044e9da7dc7b666484e257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.223351 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 0435678022914e6991c974e116d1a9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:20.224926 969 leader_election.cc:341] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8cca283f4d2645c0b59f750949b7e263
I20260620 07:01:20.225070 969 leader_election.cc:302] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:20.225224 969 raft_consensus.cc:2670] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 07:01:20.225206 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc287ba0c0ed4928b44014ac8b0e9d63. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:20.225481 969 leader_election.cc:341] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 54bb495eea4c49b7ad7bf2300ad0e60a
I20260620 07:01:20.225582 969 leader_election.cc:302] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.225927 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.231029 727 tablet_service.cc:1514] Processing DeleteTablet for tablet ca86563e5b014bb88ccb74c628670c46 with delete_type TABLET_DATA_DELETED (replaced by tablet ceb16b2060f34a32870bcf6fb143efe7) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.232484 1170 tablet_bootstrap.cc:492] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:20.232656 1170 ts_tablet_manager.cc:1397] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.197s user 0.004s sys 0.000s
I20260620 07:01:20.235157 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_69902e5c120e458c9214c5efb7e85edc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:20.235399 2490 raft_consensus.cc:2726] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:20.235783 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69902e5c120e458c9214c5efb7e85edc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.233434 1170 raft_consensus.cc:348] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.239403 1170 raft_consensus.cc:374] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.239495 1170 raft_consensus.cc:729] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.240784 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_064c212329924eecb592fc2ba757c492" } new_table_name: "default.Table_a7b2b32e8a5c46dd901a9511cd6954d6" modify_external_catalogs: true
I20260620 07:01:20.241989 1170 consensus_queue.cc:260] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:20.250396 683 leader_election.cc:341] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 06fd96feb4a74b9f8d3243b7d774f388
I20260620 07:01:20.250664 683 leader_election.cc:302] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.251003 2359 raft_consensus.cc:2726] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:20.251461 683 leader_election.cc:341] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0435678022914e6991c974e116d1a9f7
I20260620 07:01:20.251628 683 leader_election.cc:302] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.251888 2359 raft_consensus.cc:2726] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:20.252807 683 leader_election.cc:341] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f6bdcd8cd2574acf867b7ec487559db2
I20260620 07:01:20.253789 683 leader_election.cc:302] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.254073 2359 raft_consensus.cc:2726] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:20.254469 683 leader_election.cc:341] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 6a36a5319a044e9da7dc7b666484e257
I20260620 07:01:20.254632 683 leader_election.cc:302] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.254923 2359 raft_consensus.cc:2726] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:20.258320 1170 ts_tablet_manager.cc:1428] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260620 07:01:20.261193 1165 ts_tablet_manager.cc:1918] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.268775 1170 tablet_bootstrap.cc:492] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:20.270160 1166 ts_tablet_manager.cc:1918] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.270303 1166 log.cc:1196] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/8cca283f4d2645c0b59f750949b7e263
I20260620 07:01:20.270625 1166 ts_tablet_manager.cc:1939] T 8cca283f4d2645c0b59f750949b7e263 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:20.274953 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_04102f1fee5f4618a55d7381082bf5de" } new_table_name: "default.Table_31437e5187e04f28808c593b1ef4412b" modify_external_catalogs: true
I20260620 07:01:20.276149 1170 tablet_bootstrap.cc:654] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:20.279963 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 394d3124d03a438aa31d94967487b4be consensus state has no leader
I20260620 07:01:20.280818 422 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet b9badb7773644d48ac967f35a1e7d2f5
I20260620 07:01:20.281414 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b2f5c0f1c20f46b7b62fccea47f857d9
I20260620 07:01:20.282290 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5773d09ad37c45198d62886624c87eea
I20260620 07:01:20.282896 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e0772efedd3549978812c7a65c3dc594"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.283540 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0772efedd3549978812c7a65c3dc594 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.284152 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1254e74518114bba933f842f6e7c7bac" } modify_external_catalogs: true
I20260620 07:01:20.284337 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1254e74518114bba933f842f6e7c7bac" } modify_external_catalogs: true
I20260620 07:01:20.282903 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_99e410bd8d664e959bf46121c9ee79ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:20.284965 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_72d11279e6754a32aadd5966adbb5aaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.285473 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72d11279e6754a32aadd5966adbb5aaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.286489 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_69de24cd01774857909747c287120f79" } new_table_name: "default.Table_0354236cf8854458b38d46f5e4ce7582" modify_external_catalogs: true
W20260620 07:01:20.287709 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99e410bd8d664e959bf46121c9ee79ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.291752 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0e5d141713ad4e5ca15dac2497f41f13" } modify_external_catalogs: true
I20260620 07:01:20.292047 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0e5d141713ad4e5ca15dac2497f41f13" } modify_external_catalogs: true
I20260620 07:01:20.301048 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ac84d5816b2c4ac5aa5ab2dd2ece9b0c" } new_table_name: "default.Table_0569cb7b2f444670b815ff5763aade99" modify_external_catalogs: true
I20260620 07:01:20.304327 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8d07844409574a23bfbc41cbf9c95168"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.305089 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d07844409574a23bfbc41cbf9c95168 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.307196 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_76fb70ea47a3453ba83413761b3012ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.307901 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76fb70ea47a3453ba83413761b3012ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:20.309638 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce7a85d8951f4cfa88c2a2efa1a6ba17 consensus state has no leader
W20260620 07:01:20.310287 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b77b7ecb5cc47a88dac7181322a7a2b consensus state has no leader
W20260620 07:01:20.310765 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d746724e5d347c18a67761e5009c120 consensus state has no leader
I20260620 07:01:20.311920 1165 log.cc:1196] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/08ec769f903c4438bc1186d5fc1c5108
I20260620 07:01:20.312968 1170 tablet_bootstrap.cc:492] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:20.269977 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2abce486e28845a3b61554827150882e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.313580 1165 ts_tablet_manager.cc:1939] T 08ec769f903c4438bc1186d5fc1c5108 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:20.315199 1165 tablet_replica.cc:330] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:20.315479 1170 ts_tablet_manager.cc:1397] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.002s
I20260620 07:01:20.316442 1170 raft_consensus.cc:348] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.319739 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8afdfa2c293e4a19978bbf85a68753f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.319741 1165 raft_consensus.cc:2229] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.320151 1165 raft_consensus.cc:2258] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.320637 1170 raft_consensus.cc:374] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.320722 1170 raft_consensus.cc:729] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.322134 1170 consensus_queue.cc:260] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.323243 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 0532a5d9ae484bd186f5c64bebd1b66c from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:20.325696 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 898) took 4263 ms. Trace:
I20260620 07:01:20.327168 1170 ts_tablet_manager.cc:1428] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260620 07:01:20.327457 1170 tablet_bootstrap.cc:492] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:20.330852 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d4fe8f8a0d44a2ba6a8ed742c472fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.332293 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab49b43f54524be097f863851cfa223a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.333426 1165 ts_tablet_manager.cc:1905] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.333855 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cfe808698374bcf8afc45c71b576721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.336738 1166 rpcz_store.cc:276] 0620 07:01:16.061950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.063792 (+ 1842us) service_pool.cc:227] Handling call
0620 07:01:20.157237 (+4093445us) ts_tablet_manager.cc:1145] Deleting tablet 8cca283f4d2645c0b59f750949b7e263
0620 07:01:20.157253 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.253290 (+ 96037us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.270051 (+ 16761us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.325671 (+ 55620us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4093209}
I20260620 07:01:20.337217 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 899) took 4269 ms. Trace:
I20260620 07:01:20.337309 1166 rpcz_store.cc:276] 0620 07:01:16.067670 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.067863 (+ 193us) service_pool.cc:227] Handling call
0620 07:01:20.337077 (+4269214us) ts_tablet_manager.cc:1145] Deleting tablet b4b60d2a45944a09a60a2826a9a45738
0620 07:01:20.337090 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.337202 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4268993}
I20260620 07:01:20.337608 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 900) took 4268 ms. Trace:
I20260620 07:01:20.337667 1166 rpcz_store.cc:276] 0620 07:01:16.069023 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.069073 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:20.337508 (+4268435us) ts_tablet_manager.cc:1145] Deleting tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa
0620 07:01:20.337519 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.337596 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4268239}
I20260620 07:01:20.337904 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 903) took 4230 ms. Trace:
I20260620 07:01:20.337988 1166 rpcz_store.cc:276] 0620 07:01:16.107609 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.122304 (+ 14695us) service_pool.cc:227] Handling call
0620 07:01:20.337829 (+4215525us) ts_tablet_manager.cc:1145] Deleting tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f
0620 07:01:20.337836 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.337893 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4210811}
I20260620 07:01:20.338248 1166 tablet_replica.cc:330] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:20.338466 1166 raft_consensus.cc:2229] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.338642 1166 raft_consensus.cc:2258] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.339221 1166 ts_tablet_manager.cc:1905] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.339716 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40346cc521344d32b5eff74042339644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.343009 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d746724e5d347c18a67761e5009c120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.343680 1170 tablet_bootstrap.cc:654] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:20.347208 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd884617649443f9959bc4512c219042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.351110 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 268bb66234ff4d069f5d1cd831c292fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:20.351503 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0621724505b34d10bced5c920b46442f consensus state has no leader
I20260620 07:01:20.362614 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45132bf99b184d2980ed0f270f30d26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.363274 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51290bc3d96246e4968326cb8344fce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.363875 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5889c0b321604b82ac12918ae3030405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.364331 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e15d20302b4f8c837a13f69dade0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.365096 2490 raft_consensus.cc:482] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.365386 2490 raft_consensus.cc:504] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:20.366863 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9d7421b549468e8a7782f467473bdb" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:20.367820 1170 tablet_bootstrap.cc:492] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:20.367820 2490 leader_election.cc:288] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:20.367964 1170 ts_tablet_manager.cc:1397] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260620 07:01:20.368506 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 5773d09ad37c45198d62886624c87eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.368660 1170 raft_consensus.cc:348] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.368872 1170 raft_consensus.cc:374] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.368934 1170 raft_consensus.cc:729] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.370509 1170 consensus_queue.cc:260] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.373834 1170 ts_tablet_manager.cc:1428] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:20.374125 1170 tablet_bootstrap.cc:492] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:20.375550 1170 tablet_bootstrap.cc:654] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:20.375808 727 tablet_service.cc:1514] Processing DeleteTablet for tablet b2f5c0f1c20f46b7b62fccea47f857d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.376183 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 08ec769f903c4438bc1186d5fc1c5108 (table default.Table_6265551265c24c08b658f79709b7887d [id=654e042eb7604d72a01475f1d80bb47c]) successfully deleted
I20260620 07:01:20.376724 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 877a71e8db5f4bf689df39f83735f326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:20.384795 1165 ts_tablet_manager.cc:1918] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.385614 1165 log.cc:1196] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/4260b0c953c14a198dbf9b64a30e7e05
I20260620 07:01:20.386202 1165 ts_tablet_manager.cc:1939] T 4260b0c953c14a198dbf9b64a30e7e05 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:20.389863 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1062) took 1014 ms. Trace:
I20260620 07:01:20.390089 1170 tablet_bootstrap.cc:492] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:20.390247 1170 ts_tablet_manager.cc:1397] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260620 07:01:20.390560 1165 rpcz_store.cc:276] 0620 07:01:19.375387 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.375599 (+ 212us) service_pool.cc:227] Handling call
0620 07:01:20.315123 (+939524us) ts_tablet_manager.cc:1145] Deleting tablet 4260b0c953c14a198dbf9b64a30e7e05
0620 07:01:20.315131 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.360061 (+ 44930us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.384661 (+ 24600us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.389818 (+ 5157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":691332}
I20260620 07:01:20.392014 1170 raft_consensus.cc:348] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.392253 1170 raft_consensus.cc:374] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.392316 1170 raft_consensus.cc:729] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.392614 1165 tablet_replica.cc:330] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:20.393186 1165 raft_consensus.cc:2229] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.392508 1170 consensus_queue.cc:260] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.396792 1170 ts_tablet_manager.cc:1428] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:20.397121 1170 tablet_bootstrap.cc:492] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:20.397369 1165 raft_consensus.cc:2258] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.400492 2490 raft_consensus.cc:482] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.400763 2490 raft_consensus.cc:504] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.402451 1170 tablet_bootstrap.cc:654] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:20.402456 968 leader_election.cc:341] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 9e8cd4ec5619416a8983e1bc1b6b6a09
I20260620 07:01:20.402961 2490 leader_election.cc:288] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:20.403579 1165 ts_tablet_manager.cc:1905] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.406872 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 4260b0c953c14a198dbf9b64a30e7e05 (table default.Table_d66e26edeccc4a138950de609d6c107f [id=dbe2ab45243b4aeca16c961149135563]) successfully deleted
I20260620 07:01:20.411922 1170 tablet_bootstrap.cc:492] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:20.412071 1170 ts_tablet_manager.cc:1397] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20260620 07:01:20.412703 1170 raft_consensus.cc:348] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.412918 1170 raft_consensus.cc:374] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.412973 1170 raft_consensus.cc:729] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.413671 1166 ts_tablet_manager.cc:1918] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:20.413792 1166 log.cc:1196] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/a9d4ef3ba51e432f889fb927a6af8b49
I20260620 07:01:20.414113 1166 ts_tablet_manager.cc:1939] T a9d4ef3ba51e432f889fb927a6af8b49 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:20.416414 867 tablet_service.cc:1514] Processing DeleteTablet for tablet b2f5c0f1c20f46b7b62fccea47f857d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:20.416723 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 5773d09ad37c45198d62886624c87eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:20.413153 1170 consensus_queue.cc:260] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.419375 1170 ts_tablet_manager.cc:1428] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260620 07:01:20.419663 1170 tablet_bootstrap.cc:492] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:20.419703 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 906) took 4264 ms. Trace:
I20260620 07:01:20.419806 1166 rpcz_store.cc:276] 0620 07:01:16.154841 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.155423 (+ 582us) service_pool.cc:227] Handling call
0620 07:01:20.338197 (+4182774us) ts_tablet_manager.cc:1145] Deleting tablet a9d4ef3ba51e432f889fb927a6af8b49
0620 07:01:20.338209 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.342720 (+ 4511us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.413519 (+ 70799us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.419676 (+ 6157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4182555}
I20260620 07:01:20.420162 1166 tablet_replica.cc:330] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:20.420324 1166 raft_consensus.cc:2229] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.420475 1166 raft_consensus.cc:2258] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.421012 1166 ts_tablet_manager.cc:1905] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.421314 1170 tablet_bootstrap.cc:654] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:20.427439 2490 raft_consensus.cc:482] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.427661 2490 raft_consensus.cc:504] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:20.429162 968 leader_election.cc:341] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ab60101b34144f85b0afd2e8c4846e48
I20260620 07:01:20.429579 2490 leader_election.cc:288] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:20.444697 422 master_service.cc:946] ReplaceTablet: received request to replace tablet c9d344f9e4b444e4b6018fdf0cf762fd from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:20.445545 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6c58dbd76d954a0795909e2dadcd02ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.446126 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c58dbd76d954a0795909e2dadcd02ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.451717 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 971) took 3190 ms. Trace:
I20260620 07:01:20.451938 1169 rpcz_store.cc:276] 0620 07:01:16.973350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.973412 (+ 62us) service_pool.cc:227] Handling call
0620 07:01:20.162908 (+3189496us) ts_tablet_manager.cc:1145] Deleting tablet 354937ee58ca4970b9ac211a369f1030
0620 07:01:20.162929 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.163378 (+ 449us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3189272}
I20260620 07:01:20.452661 1169 tablet_replica.cc:330] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:20.453102 1169 raft_consensus.cc:2229] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.453363 1169 raft_consensus.cc:2258] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.454075 1169 ts_tablet_manager.cc:1905] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:20.455410 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 354937ee58ca4970b9ac211a369f1030 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 354937ee58ca4970b9ac211a369f1030 already in progress: creating tablet
I20260620 07:01:20.470281 1168 tablet_bootstrap.cc:492] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:20.472929 2359 consensus_queue.cc:1035] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:20.479419 420 catalog_manager.cc:5495] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:20.479876 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 390a327225344afda3076c341202cc1d (table default.Table_4563e27d87354007895f9d9819e8d8a0 [id=d7198485f2104c2092955ef5305900cf]). Expected version 1 got 0
I20260620 07:01:20.484320 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1e3d4ea81afe43a2a6101e21cbd08f97
I20260620 07:01:20.491021 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 31c56e80a73c442aa3cc65126a76c8be
I20260620 07:01:20.501631 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3d4ea81afe43a2a6101e21cbd08f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.504051 727 tablet_service.cc:1467] Processing CreateTablet for tablet ef297ddf4b394e8ba9b610dfac05ebba (DEFAULT_TABLE table=default.Table_d19cb15909754e9ea35d90bcdd7f1209 [id=4360448d19fe4133ac1b8af1ed46b731]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.504562 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef297ddf4b394e8ba9b610dfac05ebba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.511772 1166 ts_tablet_manager.cc:1918] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.511854 1170 tablet_bootstrap.cc:492] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:20.511894 1166 log.cc:1196] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/9e8cd4ec5619416a8983e1bc1b6b6a09
I20260620 07:01:20.511989 1170 ts_tablet_manager.cc:1397] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.092s user 0.021s sys 0.006s
I20260620 07:01:20.512171 1166 ts_tablet_manager.cc:1939] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:20.512624 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 907) took 4295 ms. Trace:
I20260620 07:01:20.512727 1166 rpcz_store.cc:276] 0620 07:01:16.216966 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.217731 (+ 765us) service_pool.cc:227] Handling call
0620 07:01:20.420117 (+4202386us) ts_tablet_manager.cc:1145] Deleting tablet 9e8cd4ec5619416a8983e1bc1b6b6a09
0620 07:01:20.420128 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.424566 (+ 4438us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.511665 (+ 87099us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.512604 (+ 939us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4202115}
I20260620 07:01:20.512758 1170 raft_consensus.cc:348] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.512979 1170 raft_consensus.cc:374] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.513119 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 908) took 4284 ms. Trace:
I20260620 07:01:20.513204 1166 rpcz_store.cc:276] 0620 07:01:16.229022 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.229075 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:20.512999 (+4283924us) ts_tablet_manager.cc:1145] Deleting tablet 5046d808d01f4af3803cb3edf425f777
0620 07:01:20.513010 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.513104 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4283716}
I20260620 07:01:20.513504 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 909) took 4252 ms. Trace:
I20260620 07:01:20.513581 1166 rpcz_store.cc:276] 0620 07:01:16.261348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.261459 (+ 111us) service_pool.cc:227] Handling call
0620 07:01:20.513413 (+4251954us) ts_tablet_manager.cc:1145] Deleting tablet 6c0d1d8a5e244f1985ca6279bd1dda77
0620 07:01:20.513423 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.513490 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4251745}
I20260620 07:01:20.513873 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 910) took 4221 ms. Trace:
I20260620 07:01:20.513954 1166 rpcz_store.cc:276] 0620 07:01:16.292834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.292918 (+ 84us) service_pool.cc:227] Handling call
0620 07:01:20.513788 (+4220870us) ts_tablet_manager.cc:1145] Deleting tablet 25adb514cb22461bbcbecad7d74e643c
0620 07:01:20.513796 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.513860 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4220589}
I20260620 07:01:20.513037 1170 raft_consensus.cc:729] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.513854 733 tablet_service.cc:1467] Processing CreateTablet for tablet 8cdadce450a64a89b773680b73a541bc (DEFAULT_TABLE table=default.Table_ad35110902bf4afcb9b78e44e466a26d [id=d1f9e030612f481eaf325023495cdcde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.515460 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cdadce450a64a89b773680b73a541bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.515358 1170 consensus_queue.cc:260] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.518953 1170 ts_tablet_manager.cc:1428] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 07:01:20.520608 1170 tablet_bootstrap.cc:492] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:20.522356 1170 tablet_bootstrap.cc:654] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:20.528345 875 tablet_service.cc:1467] Processing CreateTablet for tablet e2b7794b60cc46d2bf936ff4be71d4cc (DEFAULT_TABLE table=default.Table_c8dacf3eb56c4be49eeff770e4abd5b0 [id=c24562fad40b4ee995a47c691c2a6042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.528736 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 31c56e80a73c442aa3cc65126a76c8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:20.529191 871 tablet_service.cc:1467] Processing CreateTablet for tablet 8cdadce450a64a89b773680b73a541bc (DEFAULT_TABLE table=default.Table_ad35110902bf4afcb9b78e44e466a26d [id=d1f9e030612f481eaf325023495cdcde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.529737 1165 ts_tablet_manager.cc:1918] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.529877 1165 log.cc:1196] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/8b8659e903084f15ac3d9ea8c4c0dc0f
I20260620 07:01:20.530215 1165 ts_tablet_manager.cc:1939] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:20.531127 867 tablet_service.cc:1467] Processing CreateTablet for tablet 32d2e96c6b6746c38bf503e28b849cc1 (DEFAULT_TABLE table=default.Table_eebd6f7c3a2347b083f35e0b12c9518f [id=34eb8891e66c45ddb8dd7e58e072a3b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.532192 873 tablet_service.cc:1467] Processing CreateTablet for tablet 014740af9b8046fabb0621d4c9b1f224 (DEFAULT_TABLE table=default.Table_b1e5202267514b5ea0f730fe14d3ae1d [id=e34a32e469674579a73f982be1aeb1a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.514232 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 911) took 4161 ms. Trace:
I20260620 07:01:20.536520 1166 rpcz_store.cc:276] 0620 07:01:16.353159 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.353258 (+ 99us) service_pool.cc:227] Handling call
0620 07:01:20.514148 (+4160890us) ts_tablet_manager.cc:1145] Deleting tablet 06fd96feb4a74b9f8d3243b7d774f388
0620 07:01:20.514157 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.514219 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4153456}
I20260620 07:01:20.536737 2366 raft_consensus.cc:482] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.536891 1166 tablet_replica.cc:330] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:20.537093 1166 raft_consensus.cc:2229] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.536908 2366 raft_consensus.cc:504] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.537247 1166 raft_consensus.cc:2258] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.537756 2366 leader_election.cc:288] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:20.537810 1166 ts_tablet_manager.cc:1905] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.538162 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877a71e8db5f4bf689df39f83735f326" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:20.538981 831 leader_election.cc:341] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.533167 862 tablet_service.cc:1467] Processing CreateTablet for tablet ef297ddf4b394e8ba9b610dfac05ebba (DEFAULT_TABLE table=default.Table_d19cb15909754e9ea35d90bcdd7f1209 [id=4360448d19fe4133ac1b8af1ed46b731]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.535208 874 tablet_service.cc:1467] Processing CreateTablet for tablet 79b20da76264416293f68c93c30cf929 (DEFAULT_TABLE table=default.Table_00dcbe8974684255be9b138fcaf02050 [id=da6d68e8caf64b7cb50faa2123f106e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.535743 864 tablet_service.cc:1467] Processing CreateTablet for tablet 510c096ae5d348adbb8c9e8be51487c5 (DEFAULT_TABLE table=default.Table_6f137eb5fc0241e0911941c9b92797f6 [id=3e4af80141854c18ab7d5260931bf64d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.543331 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3d4ea81afe43a2a6101e21cbd08f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:20.546415 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cdadce450a64a89b773680b73a541bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.549297 859 tablet_service.cc:1467] Processing CreateTablet for tablet 37f9c0e92fed48ed9ed193b1e4f9347e (DEFAULT_TABLE table=default.Table_d3eea3be2a8c4190a262d1af2221fd3b [id=c3397ee2f84542208eab31925220c3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.549749 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37f9c0e92fed48ed9ed193b1e4f9347e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.550112 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79b20da76264416293f68c93c30cf929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.550347 869 tablet_service.cc:1467] Processing CreateTablet for tablet f3b6f9ff89124c1d9a92d60c1edc6ff0 (DEFAULT_TABLE table=default.Table_8dab0fdb88604443b6f8e8deb4ae4537 [id=f38bc051457644999d7ba417391f3dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.550711 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3b6f9ff89124c1d9a92d60c1edc6ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.551118 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32d2e96c6b6746c38bf503e28b849cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.555145 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 510c096ae5d348adbb8c9e8be51487c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.555539 876 tablet_service.cc:1467] Processing CreateTablet for tablet d0c4715518c04397bfe0fe6026ffaabd (DEFAULT_TABLE table=default.Table_c538a75449ac4a319a7ef093a9847ecd [id=024efaff8e164769be4bd9b6bbbd4356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.555967 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0c4715518c04397bfe0fe6026ffaabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.555145 870 tablet_service.cc:1467] Processing CreateTablet for tablet b873da5b6ce243738d0a274c6ce6eac3 (DEFAULT_TABLE table=default.Table_1f0edbec60db4755a61673582bcf331e [id=8d985d6670be4ac29c9e86ba5a52e0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.562659 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b873da5b6ce243738d0a274c6ce6eac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.563575 2490 consensus_queue.cc:1035] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:20.566282 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1063) took 1190 ms. Trace:
I20260620 07:01:20.566402 1165 rpcz_store.cc:276] 0620 07:01:19.375456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.375686 (+ 230us) service_pool.cc:227] Handling call
0620 07:01:20.392535 (+1016849us) ts_tablet_manager.cc:1145] Deleting tablet 8b8659e903084f15ac3d9ea8c4c0dc0f
0620 07:01:20.392548 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.467592 (+ 75044us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.529611 (+ 62019us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.566240 (+ 36629us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":768698}
I20260620 07:01:20.567067 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 8b8659e903084f15ac3d9ea8c4c0dc0f (table default.Table_5d2a4e7b8377498685861a195b5c2401 [id=91c7f13bfdb84770a1ef410a269a10e0]) successfully deleted
I20260620 07:01:20.566767 1165 tablet_replica.cc:330] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:20.568372 1165 raft_consensus.cc:2229] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.570441 1165 raft_consensus.cc:2258] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.571081 868 tablet_service.cc:1467] Processing CreateTablet for tablet 1c390114ac2646619cb50ce1873e72f7 (DEFAULT_TABLE table=default.Table_715948cd71c24a039a15b1a9598243ae [id=577676d7bf474665a4d1c87ed156bd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.571460 1165 ts_tablet_manager.cc:1905] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.568070 861 tablet_service.cc:1467] Processing CreateTablet for tablet 3cb947de89ae439db3e70ec3d9da68d5 (DEFAULT_TABLE table=default.Table_29fca646d60048d9800e8358e72cdcdd [id=3a845fa4a7f44e18a79f431ff38d923f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.569479 865 tablet_service.cc:1467] Processing CreateTablet for tablet f6c4d0bd88784a05aa76e48398e412e9 (DEFAULT_TABLE table=default.Table_88b66d2bbc794b5a9681c73bf871b8dc [id=b735d7580c39409e8eb7a17654c900c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.573949 872 tablet_service.cc:1467] Processing CreateTablet for tablet e79c0765aeb145339df20b6dc1e18141 (DEFAULT_TABLE table=default.Table_1a1fd54d4e8940a7bd95dbcac8738be0 [id=b5458545a9a74eb0829b34a19ebec17b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.570437 858 tablet_service.cc:1467] Processing CreateTablet for tablet 1e6c3e833f454748a51a08d88ba91a02 (DEFAULT_TABLE table=default.Table_d144332acb344f88a25fec5a8a588cef [id=382c7ea2e41448beae1a1eb4a5a91c38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.570686 860 tablet_service.cc:1467] Processing CreateTablet for tablet 8060eb27937d4eeea2f6ca68782e06ce (DEFAULT_TABLE table=default.Table_4724fbd4e77543c48430fe63d4c0ba9a [id=1df4b47178484771a862dfd87e5a9ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.568423 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 014740af9b8046fabb0621d4c9b1f224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.567822 866 tablet_service.cc:1467] Processing CreateTablet for tablet ebc9dbca6edb402c970aa5226275a3c1 (DEFAULT_TABLE table=default.Table_307a2d6eb71340839ef3275ce36ae2f9 [id=a7443271154e460484aca7d21ac34dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.575623 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6c4d0bd88784a05aa76e48398e412e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.575845 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e79c0765aeb145339df20b6dc1e18141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.576063 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cb947de89ae439db3e70ec3d9da68d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.576323 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e6c3e833f454748a51a08d88ba91a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.580405 1166 ts_tablet_manager.cc:1918] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.580545 1166 log.cc:1196] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/5208f3136bcd45579de49b8b10745122
I20260620 07:01:20.580873 1166 ts_tablet_manager.cc:1939] T 5208f3136bcd45579de49b8b10745122 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:20.581697 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 929) took 3935 ms. Trace:
I20260620 07:01:20.581796 1166 rpcz_store.cc:276] 0620 07:01:16.646438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.646491 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:20.536840 (+3890349us) ts_tablet_manager.cc:1145] Deleting tablet 5208f3136bcd45579de49b8b10745122
0620 07:01:20.536854 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.552387 (+ 15533us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.580295 (+ 27908us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.581664 (+ 1369us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3890091}
I20260620 07:01:20.582238 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 930) took 3914 ms. Trace:
I20260620 07:01:20.582315 1166 rpcz_store.cc:276] 0620 07:01:16.668025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.681961 (+ 13936us) service_pool.cc:227] Handling call
0620 07:01:20.582104 (+3900143us) ts_tablet_manager.cc:1145] Deleting tablet 3de447b04fc944688d6034db69fe2907
0620 07:01:20.582115 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.582220 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3853823}
I20260620 07:01:20.582634 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 932) took 3808 ms. Trace:
I20260620 07:01:20.582722 1166 rpcz_store.cc:276] 0620 07:01:16.774407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.774464 (+ 57us) service_pool.cc:227] Handling call
0620 07:01:20.582535 (+3808071us) ts_tablet_manager.cc:1145] Deleting tablet 1936a2b27a1f4fda9ceb295c9c00acf8
0620 07:01:20.582545 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.582619 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3807704}
I20260620 07:01:20.583073 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 933) took 3795 ms. Trace:
I20260620 07:01:20.583094 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebc9dbca6edb402c970aa5226275a3c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.585974 857 tablet_service.cc:1467] Processing CreateTablet for tablet 7e69ff3b3fd74138b2ddf61df9c46c18 (DEFAULT_TABLE table=default.Table_021ff3a24757452b9136ef50a3be98bb [id=16a2115419d5492f984d041703ee1d2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.586419 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e69ff3b3fd74138b2ddf61df9c46c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.589308 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8060eb27937d4eeea2f6ca68782e06ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.590939 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2b7794b60cc46d2bf936ff4be71d4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.595222 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef297ddf4b394e8ba9b610dfac05ebba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.596211 1031 raft_consensus.cc:3037] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:20.583159 1166 rpcz_store.cc:276] 0620 07:01:16.787387 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.788310 (+ 923us) service_pool.cc:227] Handling call
0620 07:01:20.582978 (+3794668us) ts_tablet_manager.cc:1145] Deleting tablet 5db9a7df42e04949934b6962c9253196
0620 07:01:20.582988 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.583059 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3794292}
I20260620 07:01:20.603201 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 938) took 3567 ms. Trace:
I20260620 07:01:20.603327 1166 rpcz_store.cc:276] 0620 07:01:17.035407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.035526 (+ 119us) service_pool.cc:227] Handling call
0620 07:01:20.603052 (+3567526us) ts_tablet_manager.cc:1145] Deleting tablet 88c6aeea7c504f36964e8bf41b0fc4f9
0620 07:01:20.603066 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.603177 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3567302}
I20260620 07:01:20.603534 1168 tablet_bootstrap.cc:654] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:20.603739 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 939) took 3565 ms. Trace:
I20260620 07:01:20.603847 1166 rpcz_store.cc:276] 0620 07:01:17.038513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.038566 (+ 53us) service_pool.cc:227] Handling call
0620 07:01:20.603616 (+3565050us) ts_tablet_manager.cc:1145] Deleting tablet 354937ee58ca4970b9ac211a369f1030
0620 07:01:20.603627 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.603720 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3564843}
I20260620 07:01:20.604209 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 940) took 3479 ms. Trace:
I20260620 07:01:20.604295 1166 rpcz_store.cc:276] 0620 07:01:17.124362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.126843 (+ 2481us) service_pool.cc:227] Handling call
0620 07:01:20.604103 (+3477260us) ts_tablet_manager.cc:1145] Deleting tablet 848a456e584e466387057f98eeec44ba
0620 07:01:20.604113 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.604193 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3477053}
I20260620 07:01:20.604570 1166 tablet_replica.cc:330] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:20.604787 1166 raft_consensus.cc:2229] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.604938 1166 raft_consensus.cc:2258] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.605479 1166 ts_tablet_manager.cc:1905] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.626624 1165 ts_tablet_manager.cc:1918] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.637178 1166 ts_tablet_manager.cc:1918] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.637323 1166 log.cc:1196] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/b5e08a38c42d4e3da20292343bf085b9
I20260620 07:01:20.637647 1166 ts_tablet_manager.cc:1939] T b5e08a38c42d4e3da20292343bf085b9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:20.637950 1165 log.cc:1196] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/c9d344f9e4b444e4b6018fdf0cf762fd
I20260620 07:01:20.638381 1165 ts_tablet_manager.cc:1939] T c9d344f9e4b444e4b6018fdf0cf762fd P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:20.628877 1168 tablet_bootstrap.cc:492] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:20.638487 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 941) took 3504 ms. Trace:
I20260620 07:01:20.638432 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c390114ac2646619cb50ce1873e72f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.638574 1166 rpcz_store.cc:276] 0620 07:01:17.133788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.133844 (+ 56us) service_pool.cc:227] Handling call
0620 07:01:20.604520 (+3470676us) ts_tablet_manager.cc:1145] Deleting tablet b5e08a38c42d4e3da20292343bf085b9
0620 07:01:20.604533 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.617708 (+ 13175us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.637069 (+ 19361us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.638464 (+ 1395us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3470453}
I20260620 07:01:20.638736 1168 ts_tablet_manager.cc:1397] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.171s user 0.004s sys 0.000s
I20260620 07:01:20.639058 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 942) took 3383 ms. Trace:
I20260620 07:01:20.639153 1166 rpcz_store.cc:276] 0620 07:01:17.256010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.256060 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:20.638910 (+3382850us) ts_tablet_manager.cc:1145] Deleting tablet a590f553b9e041c4830234897dbbf09f
0620 07:01:20.638924 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.639042 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3382606}
I20260620 07:01:20.639457 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 953) took 2542 ms. Trace:
I20260620 07:01:20.639539 1166 rpcz_store.cc:276] 0620 07:01:18.096711 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.096778 (+ 67us) service_pool.cc:227] Handling call
0620 07:01:20.639367 (+2542589us) ts_tablet_manager.cc:1145] Deleting tablet 2e05786efb6341ea85fb3d3c42bd85d7
0620 07:01:20.639376 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.639444 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2542376}
I20260620 07:01:20.639797 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 952) took 2543 ms. Trace:
I20260620 07:01:20.639876 1166 rpcz_store.cc:276] 0620 07:01:18.096587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.111528 (+ 14941us) service_pool.cc:227] Handling call
0620 07:01:20.639714 (+2528186us) ts_tablet_manager.cc:1145] Deleting tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263
0620 07:01:20.639723 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.639784 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2527928}
I20260620 07:01:20.639976 1168 raft_consensus.cc:348] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.640205 1168 raft_consensus.cc:374] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.640196 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 951) took 2543 ms. Trace:
I20260620 07:01:20.640275 1168 raft_consensus.cc:729] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.640272 1166 rpcz_store.cc:276] 0620 07:01:18.096459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.111859 (+ 15400us) service_pool.cc:227] Handling call
0620 07:01:20.640095 (+2528236us) ts_tablet_manager.cc:1145] Deleting tablet 29eb0db9b60f413ebce9ce16fe50aea4
0620 07:01:20.640104 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.640182 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2528076}
I20260620 07:01:20.640547 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 958) took 2396 ms. Trace:
I20260620 07:01:20.640494 1168 consensus_queue.cc:260] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.641104 1168 ts_tablet_manager.cc:1428] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:20.643406 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 31c56e80a73c442aa3cc65126a76c8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.644415 1168 tablet_bootstrap.cc:492] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:20.646283 1166 rpcz_store.cc:276] 0620 07:01:18.244256 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.244443 (+ 187us) service_pool.cc:227] Handling call
0620 07:01:20.640462 (+2396019us) ts_tablet_manager.cc:1145] Deleting tablet c2a1e6f386db42e6ba9e4aa29d9f986f
0620 07:01:20.640470 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.640534 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2395826}
I20260620 07:01:20.646413 1170 tablet_bootstrap.cc:492] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:20.646616 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 959) took 2402 ms. Trace:
I20260620 07:01:20.646687 1166 rpcz_store.cc:276] 0620 07:01:18.244377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.244671 (+ 294us) service_pool.cc:227] Handling call
0620 07:01:20.646535 (+2401864us) ts_tablet_manager.cc:1145] Deleting tablet ba907170f2df4bd0b5e42d4c2d29b21e
0620 07:01:20.646546 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.646602 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2401731}
I20260620 07:01:20.646934 1166 tablet_replica.cc:330] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:20.646905 1170 ts_tablet_manager.cc:1397] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.128s user 0.034s sys 0.006s
I20260620 07:01:20.647099 1166 raft_consensus.cc:2229] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.647233 1166 raft_consensus.cc:2258] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.647704 1166 ts_tablet_manager.cc:1905] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.649876 1170 raft_consensus.cc:348] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.650818 1170 raft_consensus.cc:374] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.651042 1170 raft_consensus.cc:729] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.651979 1170 consensus_queue.cc:260] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.654167 2452 raft_consensus.cc:482] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.654313 2452 raft_consensus.cc:504] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.654821 1170 ts_tablet_manager.cc:1428] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260620 07:01:20.655043 2452 leader_election.cc:288] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:20.656848 1170 tablet_bootstrap.cc:492] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:20.656980 683 leader_election.cc:341] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7294e5678ad44622a3249c1113b5e297
I20260620 07:01:20.659510 863 tablet_service.cc:1467] Processing CreateTablet for tablet dfdcc3deb4f14f90b54fc412cd533948 (DEFAULT_TABLE table=default.Table_45a3fdc28a0143deb5a12984f8fd8144 [id=dc2e07584fb642de943bcfa4e41183c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.661056 716 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:20.662034 1166 ts_tablet_manager.cc:1918] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.662143 1166 log.cc:1196] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/89f5e2f055fb469dbbb935bba724dcb5
I20260620 07:01:20.662514 1166 ts_tablet_manager.cc:1939] T 89f5e2f055fb469dbbb935bba724dcb5 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:20.665723 716 tablet_service.cc:1467] Processing CreateTablet for tablet e2b7794b60cc46d2bf936ff4be71d4cc (DEFAULT_TABLE table=default.Table_c8dacf3eb56c4be49eeff770e4abd5b0 [id=c24562fad40b4ee995a47c691c2a6042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.666182 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2b7794b60cc46d2bf936ff4be71d4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.667413 1170 tablet_bootstrap.cc:654] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:20.677064 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 966) took 2354 ms. Trace:
I20260620 07:01:20.677205 1166 rpcz_store.cc:276] 0620 07:01:18.323055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.323626 (+ 571us) service_pool.cc:227] Handling call
0620 07:01:20.646886 (+2323260us) ts_tablet_manager.cc:1145] Deleting tablet 89f5e2f055fb469dbbb935bba724dcb5
0620 07:01:20.646905 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.658630 (+ 11725us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.661923 (+ 3293us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.677031 (+ 15108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322893}
I20260620 07:01:20.677558 1166 tablet_replica.cc:330] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:20.677752 1166 raft_consensus.cc:2229] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.681123 1166 raft_consensus.cc:2258] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.681803 1166 ts_tablet_manager.cc:1905] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.685206 1170 tablet_bootstrap.cc:492] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:20.686028 1170 ts_tablet_manager.cc:1397] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.003s
W20260620 07:01:20.687179 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 461657us
W20260620 07:01:20.687768 969 leader_election.cc:341] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ba93e22c4720417c99d471b9c8b49b86
I20260620 07:01:20.688234 969 leader_election.cc:302] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:20.689440 969 leader_election.cc:341] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c2e38178b9244152915d4c0a9dcf59dc
I20260620 07:01:20.689666 2520 raft_consensus.cc:2726] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:20.689945 969 leader_election.cc:302] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.691311 2450 raft_consensus.cc:482] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.691455 2450 raft_consensus.cc:504] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.691627 2520 raft_consensus.cc:2726] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:20.692104 2450 leader_election.cc:288] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:20.692041 995 tablet_service.cc:1514] Processing DeleteTablet for tablet ca86563e5b014bb88ccb74c628670c46 with delete_type TABLET_DATA_DELETED (replaced by tablet ceb16b2060f34a32870bcf6fb143efe7) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:20.692797 995 tablet_service.cc:1514] Processing DeleteTablet for tablet ab60101b34144f85b0afd2e8c4846e48 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fc99f79e7b4df2b74a79468656b6ab) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:20.693460 995 tablet_service.cc:1514] Processing DeleteTablet for tablet b2f5c0f1c20f46b7b62fccea47f857d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:20.693549 683 leader_election.cc:341] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d53c90eff33044479838ff67dea93057
I20260620 07:01:20.692814 1170 raft_consensus.cc:348] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.693840 1170 raft_consensus.cc:374] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.694231 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 5773d09ad37c45198d62886624c87eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:20.694132 1170 raft_consensus.cc:729] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.695420 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3d4ea81afe43a2a6101e21cbd08f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:20.695186 1170 consensus_queue.cc:260] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.697857 2450 raft_consensus.cc:482] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.697993 2450 raft_consensus.cc:504] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.698635 2450 leader_election.cc:288] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:20.698503 1170 ts_tablet_manager.cc:1428] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
W20260620 07:01:20.699854 683 leader_election.cc:341] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 033c8b817757441ea7ebc2dbf77aa2dd
I20260620 07:01:20.698988 995 tablet_service.cc:1467] Processing CreateTablet for tablet ef297ddf4b394e8ba9b610dfac05ebba (DEFAULT_TABLE table=default.Table_d19cb15909754e9ea35d90bcdd7f1209 [id=4360448d19fe4133ac1b8af1ed46b731]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.699927 1170 tablet_bootstrap.cc:492] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:20.700589 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 8cdadce450a64a89b773680b73a541bc (DEFAULT_TABLE table=default.Table_ad35110902bf4afcb9b78e44e466a26d [id=d1f9e030612f481eaf325023495cdcde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.700966 994 tablet_service.cc:1467] Processing CreateTablet for tablet e2b7794b60cc46d2bf936ff4be71d4cc (DEFAULT_TABLE table=default.Table_c8dacf3eb56c4be49eeff770e4abd5b0 [id=c24562fad40b4ee995a47c691c2a6042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.701334 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2b7794b60cc46d2bf936ff4be71d4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.702183 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef297ddf4b394e8ba9b610dfac05ebba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.702831 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 32d2e96c6b6746c38bf503e28b849cc1 (DEFAULT_TABLE table=default.Table_eebd6f7c3a2347b083f35e0b12c9518f [id=34eb8891e66c45ddb8dd7e58e072a3b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.703013 999 tablet_service.cc:1467] Processing CreateTablet for tablet 014740af9b8046fabb0621d4c9b1f224 (DEFAULT_TABLE table=default.Table_b1e5202267514b5ea0f730fe14d3ae1d [id=e34a32e469674579a73f982be1aeb1a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.703151 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32d2e96c6b6746c38bf503e28b849cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.703294 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 014740af9b8046fabb0621d4c9b1f224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.704010 996 tablet_service.cc:1467] Processing CreateTablet for tablet 79b20da76264416293f68c93c30cf929 (DEFAULT_TABLE table=default.Table_00dcbe8974684255be9b138fcaf02050 [id=da6d68e8caf64b7cb50faa2123f106e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.704310 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79b20da76264416293f68c93c30cf929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.700187 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 31c56e80a73c442aa3cc65126a76c8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:20.706359 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cdadce450a64a89b773680b73a541bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.712118 999 tablet_service.cc:1467] Processing CreateTablet for tablet 510c096ae5d348adbb8c9e8be51487c5 (DEFAULT_TABLE table=default.Table_6f137eb5fc0241e0911941c9b92797f6 [id=3e4af80141854c18ab7d5260931bf64d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.712764 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 510c096ae5d348adbb8c9e8be51487c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.713376 996 tablet_service.cc:1467] Processing CreateTablet for tablet d0c4715518c04397bfe0fe6026ffaabd (DEFAULT_TABLE table=default.Table_c538a75449ac4a319a7ef093a9847ecd [id=024efaff8e164769be4bd9b6bbbd4356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.714108 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0c4715518c04397bfe0fe6026ffaabd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:20.718215 719 consensus_meta.cc:287] T cc287ba0c0ed4928b44014ac8b0e9d63 P 2b84cae646b24bc7bd424eb8434ad425: Time spent flushing consensus metadata: real 0.544s user 0.004s sys 0.000s
W20260620 07:01:20.718801 723 consensus_meta.cc:287] T 268bb66234ff4d069f5d1cd831c292fe P 2b84cae646b24bc7bd424eb8434ad425: Time spent flushing consensus metadata: real 0.533s user 0.005s sys 0.000s
W20260620 07:01:20.719174 726 consensus_meta.cc:287] T 8afdfa2c293e4a19978bbf85a68753f7 P 2b84cae646b24bc7bd424eb8434ad425: Time spent flushing consensus metadata: real 0.559s user 0.001s sys 0.003s
W20260620 07:01:20.719563 721 consensus_meta.cc:287] T 45132bf99b184d2980ed0f270f30d26b P 2b84cae646b24bc7bd424eb8434ad425: Time spent flushing consensus metadata: real 0.538s user 0.004s sys 0.000s
I20260620 07:01:20.720053 994 tablet_service.cc:1467] Processing CreateTablet for tablet b873da5b6ce243738d0a274c6ce6eac3 (DEFAULT_TABLE table=default.Table_1f0edbec60db4755a61673582bcf331e [id=8d985d6670be4ac29c9e86ba5a52e0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.720495 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b873da5b6ce243738d0a274c6ce6eac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.721398 1007 tablet_service.cc:1467] Processing CreateTablet for tablet f3b6f9ff89124c1d9a92d60c1edc6ff0 (DEFAULT_TABLE table=default.Table_8dab0fdb88604443b6f8e8deb4ae4537 [id=f38bc051457644999d7ba417391f3dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.721855 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3b6f9ff89124c1d9a92d60c1edc6ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.722854 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 37f9c0e92fed48ed9ed193b1e4f9347e (DEFAULT_TABLE table=default.Table_d3eea3be2a8c4190a262d1af2221fd3b [id=c3397ee2f84542208eab31925220c3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.723145 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37f9c0e92fed48ed9ed193b1e4f9347e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.727046 1008 tablet_service.cc:1467] Processing CreateTablet for tablet ebc9dbca6edb402c970aa5226275a3c1 (DEFAULT_TABLE table=default.Table_307a2d6eb71340839ef3275ce36ae2f9 [id=a7443271154e460484aca7d21ac34dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.727385 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebc9dbca6edb402c970aa5226275a3c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.730348 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 3cb947de89ae439db3e70ec3d9da68d5 (DEFAULT_TABLE table=default.Table_29fca646d60048d9800e8358e72cdcdd [id=3a845fa4a7f44e18a79f431ff38d923f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.730651 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cb947de89ae439db3e70ec3d9da68d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.730973 1013 tablet_service.cc:1467] Processing CreateTablet for tablet 8060eb27937d4eeea2f6ca68782e06ce (DEFAULT_TABLE table=default.Table_4724fbd4e77543c48430fe63d4c0ba9a [id=1df4b47178484771a862dfd87e5a9ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.731318 1013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8060eb27937d4eeea2f6ca68782e06ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.734004 997 tablet_service.cc:1467] Processing CreateTablet for tablet dfdcc3deb4f14f90b54fc412cd533948 (DEFAULT_TABLE table=default.Table_45a3fdc28a0143deb5a12984f8fd8144 [id=dc2e07584fb642de943bcfa4e41183c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.734300 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdcc3deb4f14f90b54fc412cd533948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.735121 721 tablet_service.cc:1467] Processing CreateTablet for tablet 014740af9b8046fabb0621d4c9b1f224 (DEFAULT_TABLE table=default.Table_b1e5202267514b5ea0f730fe14d3ae1d [id=e34a32e469674579a73f982be1aeb1a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.735477 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 014740af9b8046fabb0621d4c9b1f224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.736168 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 1e6c3e833f454748a51a08d88ba91a02 (DEFAULT_TABLE table=default.Table_d144332acb344f88a25fec5a8a588cef [id=382c7ea2e41448beae1a1eb4a5a91c38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.736498 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e6c3e833f454748a51a08d88ba91a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.739022 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 7e69ff3b3fd74138b2ddf61df9c46c18 (DEFAULT_TABLE table=default.Table_021ff3a24757452b9136ef50a3be98bb [id=16a2115419d5492f984d041703ee1d2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.739374 1000 tablet_service.cc:1467] Processing CreateTablet for tablet e79c0765aeb145339df20b6dc1e18141 (DEFAULT_TABLE table=default.Table_1a1fd54d4e8940a7bd95dbcac8738be0 [id=b5458545a9a74eb0829b34a19ebec17b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.739374 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e69ff3b3fd74138b2ddf61df9c46c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.742762 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e79c0765aeb145339df20b6dc1e18141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.744071 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 64901fd17de342339c511368d61a9eb3 (DEFAULT_TABLE table=default.Table_3291c3f046e145a4bd25965836d3e9eb [id=21d86c8441f34381a40032e26a134f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.744433 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64901fd17de342339c511368d61a9eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.746006 997 tablet_service.cc:1467] Processing CreateTablet for tablet ffb66de2e72b4d13ad4c58bec2720b5a (DEFAULT_TABLE table=default.Table_2887bc68d41444e7a3da02fea7842d8d [id=e872cbca26c7448ea0b1e65fd692f96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.746857 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffb66de2e72b4d13ad4c58bec2720b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.746920 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 8cca283f4d2645c0b59f750949b7e263 (table default.Table_e5288a8179334813988c13c09263d3fb [id=c1fc89d0749e49239f909c0b75349ec3]) successfully deleted
W20260620 07:01:20.748406 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b4b60d2a45944a09a60a2826a9a45738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4b60d2a45944a09a60a2826a9a45738 already in progress: creating tablet
W20260620 07:01:20.750234 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b6a0adb24e64d4fa05f26d2ccce3c4f already in progress: creating tablet
I20260620 07:01:20.752292 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9d7421b549468e8a7782f467473bdb" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:20.753656 1167 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.774s user 0.086s sys 0.161s
W20260620 07:01:20.753751 1167 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.774s user 0.086s sys 0.161s
I20260620 07:01:20.753773 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 28fb5cf9393d4a579db91149d236bbde (DEFAULT_TABLE table=default.Table_b22b28a2d04a4711a63d53d14cbca67a [id=ea1a53f9a29a49bcab57d60c585161db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.754208 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28fb5cf9393d4a579db91149d236bbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.754392 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet a9d4ef3ba51e432f889fb927a6af8b49 (table default.Table_ecf861541ad040c68363a1ed9fe3fb70 [id=705e29f50b13486ea45548ea2cccb107]) successfully deleted
I20260620 07:01:20.756119 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 9e8cd4ec5619416a8983e1bc1b6b6a09 (table default.Table_2411c7dd68274c07a75cd0b3ae3e2d32 [id=804a023058a643b189246bf7c6a98af6]) successfully deleted
W20260620 07:01:20.757082 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5046d808d01f4af3803cb3edf425f777 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5046d808d01f4af3803cb3edf425f777 already in progress: creating tablet
I20260620 07:01:20.757362 726 tablet_service.cc:1467] Processing CreateTablet for tablet 510c096ae5d348adbb8c9e8be51487c5 (DEFAULT_TABLE table=default.Table_6f137eb5fc0241e0911941c9b92797f6 [id=3e4af80141854c18ab7d5260931bf64d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.757763 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 510c096ae5d348adbb8c9e8be51487c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:20.758116 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6c0d1d8a5e244f1985ca6279bd1dda77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c0d1d8a5e244f1985ca6279bd1dda77 already in progress: creating tablet
W20260620 07:01:20.759152 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 25adb514cb22461bbcbecad7d74e643c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25adb514cb22461bbcbecad7d74e643c already in progress: creating tablet
W20260620 07:01:20.760241 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 06fd96feb4a74b9f8d3243b7d774f388 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06fd96feb4a74b9f8d3243b7d774f388 already in progress: creating tablet
I20260620 07:01:20.761220 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 5208f3136bcd45579de49b8b10745122 (table default.Table_6559046a0e474633ad24c9215e23b506 [id=47d63992f58d45c3aef24a7a606ce4bf]) successfully deleted
W20260620 07:01:20.762271 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3de447b04fc944688d6034db69fe2907 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3de447b04fc944688d6034db69fe2907 already in progress: creating tablet
W20260620 07:01:20.763563 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1936a2b27a1f4fda9ceb295c9c00acf8 already in progress: creating tablet
W20260620 07:01:20.764818 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5db9a7df42e04949934b6962c9253196 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5db9a7df42e04949934b6962c9253196 already in progress: creating tablet
W20260620 07:01:20.765933 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 88c6aeea7c504f36964e8bf41b0fc4f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88c6aeea7c504f36964e8bf41b0fc4f9 already in progress: creating tablet
I20260620 07:01:20.766697 994 tablet_service.cc:1467] Processing CreateTablet for tablet f6c4d0bd88784a05aa76e48398e412e9 (DEFAULT_TABLE table=default.Table_88b66d2bbc794b5a9681c73bf871b8dc [id=b735d7580c39409e8eb7a17654c900c7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:20.767088 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 354937ee58ca4970b9ac211a369f1030 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 354937ee58ca4970b9ac211a369f1030 already in progress: creating tablet
I20260620 07:01:20.767567 2366 raft_consensus.cc:482] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.767714 2366 raft_consensus.cc:504] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:20.768044 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 848a456e584e466387057f98eeec44ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 848a456e584e466387057f98eeec44ba already in progress: creating tablet
I20260620 07:01:20.768450 2366 leader_election.cc:288] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:20.769313 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91f8c4955c164e6b9061ac607bbe081c" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:20.769644 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet b5e08a38c42d4e3da20292343bf085b9 (table default.Table_17a1cb1a99834485911d40165811a7f1 [id=7ce4d1b95a984ccabd629f933ccaff8c]) successfully deleted
W20260620 07:01:20.770112 831 leader_election.cc:341] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:20.770470 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a590f553b9e041c4830234897dbbf09f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a590f553b9e041c4830234897dbbf09f already in progress: creating tablet
W20260620 07:01:20.771512 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2e05786efb6341ea85fb3d3c42bd85d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e05786efb6341ea85fb3d3c42bd85d7 already in progress: creating tablet
I20260620 07:01:20.771878 1170 tablet_bootstrap.cc:654] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:20.772068 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6c4d0bd88784a05aa76e48398e412e9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:20.772446 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 already in progress: creating tablet
W20260620 07:01:20.773343 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 29eb0db9b60f413ebce9ce16fe50aea4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29eb0db9b60f413ebce9ce16fe50aea4 already in progress: creating tablet
W20260620 07:01:20.774286 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c2a1e6f386db42e6ba9e4aa29d9f986f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2a1e6f386db42e6ba9e4aa29d9f986f already in progress: creating tablet
W20260620 07:01:20.775275 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ba907170f2df4bd0b5e42d4c2d29b21e because the tablet was not found. No further retry: Not found: Tablet not found: ba907170f2df4bd0b5e42d4c2d29b21e
I20260620 07:01:20.775632 721 tablet_service.cc:1467] Processing CreateTablet for tablet 79b20da76264416293f68c93c30cf929 (DEFAULT_TABLE table=default.Table_00dcbe8974684255be9b138fcaf02050 [id=da6d68e8caf64b7cb50faa2123f106e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.776149 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79b20da76264416293f68c93c30cf929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.776252 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 89f5e2f055fb469dbbb935bba724dcb5 (table default.Table_361c16a82c8b4f518117b6747d4aa3bc [id=24b0b6eb9f944dbb971530ee8f603c0e]) successfully deleted
W20260620 07:01:20.779183 730 consensus_meta.cc:287] T 5d746724e5d347c18a67761e5009c120 P 2b84cae646b24bc7bd424eb8434ad425: Time spent flushing consensus metadata: real 0.628s user 0.003s sys 0.001s
I20260620 07:01:20.782537 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1057) took 1419 ms. Trace:
I20260620 07:01:20.785789 1166 ts_tablet_manager.cc:1918] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.787987 1166 log.cc:1196] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/04db48e910514d46bb4deb9acf54f7c0
I20260620 07:01:20.788781 1166 ts_tablet_manager.cc:1939] T 04db48e910514d46bb4deb9acf54f7c0 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:20.789860 727 tablet_service.cc:1467] Processing CreateTablet for tablet 32d2e96c6b6746c38bf503e28b849cc1 (DEFAULT_TABLE table=default.Table_eebd6f7c3a2347b083f35e0b12c9518f [id=34eb8891e66c45ddb8dd7e58e072a3b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.790716 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32d2e96c6b6746c38bf503e28b849cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.790753 869 tablet_service.cc:1467] Processing CreateTablet for tablet ffb66de2e72b4d13ad4c58bec2720b5a (DEFAULT_TABLE table=default.Table_2887bc68d41444e7a3da02fea7842d8d [id=e872cbca26c7448ea0b1e65fd692f96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.782637 1165 rpcz_store.cc:276] 0620 07:01:19.363312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.376456 (+ 13144us) service_pool.cc:227] Handling call
0620 07:01:20.566706 (+1190250us) ts_tablet_manager.cc:1145] Deleting tablet c9d344f9e4b444e4b6018fdf0cf762fd
0620 07:01:20.566718 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.590521 (+ 23803us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.626447 (+ 35926us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.782517 (+156070us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":942824}
I20260620 07:01:20.791498 1165 tablet_replica.cc:330] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:20.791712 1165 raft_consensus.cc:2229] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.791935 1165 raft_consensus.cc:2258] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.792402 716 tablet_service.cc:1467] Processing CreateTablet for tablet b873da5b6ce243738d0a274c6ce6eac3 (DEFAULT_TABLE table=default.Table_1f0edbec60db4755a61673582bcf331e [id=8d985d6670be4ac29c9e86ba5a52e0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.792490 1165 ts_tablet_manager.cc:1905] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.792737 859 tablet_service.cc:1467] Processing CreateTablet for tablet 64901fd17de342339c511368d61a9eb3 (DEFAULT_TABLE table=default.Table_3291c3f046e145a4bd25965836d3e9eb [id=21d86c8441f34381a40032e26a134f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.792852 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 968) took 2467 ms. Trace:
I20260620 07:01:20.792934 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b873da5b6ce243738d0a274c6ce6eac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.792933 1166 rpcz_store.cc:276] 0620 07:01:18.325130 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.325471 (+ 341us) service_pool.cc:227] Handling call
0620 07:01:20.677507 (+2352036us) ts_tablet_manager.cc:1145] Deleting tablet 04db48e910514d46bb4deb9acf54f7c0
0620 07:01:20.677520 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.717587 (+ 40067us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.785688 (+ 68101us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.792833 (+ 7145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2351806}
I20260620 07:01:20.793229 1166 tablet_replica.cc:330] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:20.793406 1166 raft_consensus.cc:2229] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.793531 1166 raft_consensus.cc:2258] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.794044 1166 ts_tablet_manager.cc:1905] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:20.775713 1167 tablet_bootstrap.cc:492] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:20.794871 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet c9d344f9e4b444e4b6018fdf0cf762fd (table default.Table_f9c3eac07b6040a280cd24392454206b [id=9010989df9a341b986e65d49b59a5cd0]) successfully deleted
I20260620 07:01:20.795279 1167 ts_tablet_manager.cc:1397] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.821s user 0.088s sys 0.162s
W20260620 07:01:20.789196 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 183412us
I20260620 07:01:20.797240 1167 raft_consensus.cc:348] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:20.797927 1167 raft_consensus.cc:374] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.798118 1167 raft_consensus.cc:729] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.798614 1167 consensus_queue.cc:260] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:20.799698 733 tablet_service.cc:1467] Processing CreateTablet for tablet d0c4715518c04397bfe0fe6026ffaabd (DEFAULT_TABLE table=default.Table_c538a75449ac4a319a7ef093a9847ecd [id=024efaff8e164769be4bd9b6bbbd4356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.802013 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0c4715518c04397bfe0fe6026ffaabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.802477 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877a71e8db5f4bf689df39f83735f326" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:20.804832 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91f8c4955c164e6b9061ac607bbe081c" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:20.805701 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7294e5678ad44622a3249c1113b5e297" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:20.805689 858 tablet_service.cc:1467] Processing CreateTablet for tablet 28fb5cf9393d4a579db91149d236bbde (DEFAULT_TABLE table=default.Table_b22b28a2d04a4711a63d53d14cbca67a [id=ea1a53f9a29a49bcab57d60c585161db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.806664 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d53c90eff33044479838ff67dea93057" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:20.808876 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033c8b817757441ea7ebc2dbf77aa2dd" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:20.809640 681 leader_election.cc:341] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.809763 681 leader_election.cc:302] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.810252 2450 raft_consensus.cc:2726] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:20.811167 681 leader_election.cc:341] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.811275 681 leader_election.cc:302] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.812997 420 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 97e01aa120cc4c189017236ad57de811 (table default.Table_b19a46e2d20e4f75a3d170cbb543ca71 [id=19dd20742533400980193075baec1956]). Expected version 1 got 0
I20260620 07:01:20.813781 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9119ee82f72b4b72af5a4e92cd7b4025"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.814348 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9119ee82f72b4b72af5a4e92cd7b4025 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.814399 723 tablet_service.cc:1467] Processing CreateTablet for tablet 3cb947de89ae439db3e70ec3d9da68d5 (DEFAULT_TABLE table=default.Table_29fca646d60048d9800e8358e72cdcdd [id=3a845fa4a7f44e18a79f431ff38d923f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.814834 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cb947de89ae439db3e70ec3d9da68d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.815603 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cd8dc35255134c60bc9c00d66e87c86b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.816116 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd8dc35255134c60bc9c00d66e87c86b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.817139 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_88c48b399c144128a94d6be759a09d58" } new_table_name: "default.Table_d8dadf1def774fa98f22aca6faf3dc46" modify_external_catalogs: true
I20260620 07:01:20.817768 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 1c390114ac2646619cb50ce1873e72f7 (DEFAULT_TABLE table=default.Table_715948cd71c24a039a15b1a9598243ae [id=577676d7bf474665a4d1c87ed156bd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.818150 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c390114ac2646619cb50ce1873e72f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.818292 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b2ccc4a1e0b04597931d5b0e14de403c" } modify_external_catalogs: true
I20260620 07:01:20.818476 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b2ccc4a1e0b04597931d5b0e14de403c" } modify_external_catalogs: true
I20260620 07:01:20.819795 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3eb70a87d7cb4c31a43bd0e4f84c769d" } modify_external_catalogs: true
I20260620 07:01:20.819949 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3eb70a87d7cb4c31a43bd0e4f84c769d" } modify_external_catalogs: true
I20260620 07:01:20.821189 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6869be958bdd44afb01f9c589118fa06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:20.821420 729 tablet_service.cc:1467] Processing CreateTablet for tablet 37f9c0e92fed48ed9ed193b1e4f9347e (DEFAULT_TABLE table=default.Table_d3eea3be2a8c4190a262d1af2221fd3b [id=c3397ee2f84542208eab31925220c3c5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:20.821678 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6869be958bdd44afb01f9c589118fa06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.821803 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37f9c0e92fed48ed9ed193b1e4f9347e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.822715 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fd8c2ecfd1974bc5b245d954dff52f99" } modify_external_catalogs: true
I20260620 07:01:20.822896 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_fd8c2ecfd1974bc5b245d954dff52f99" } modify_external_catalogs: true
I20260620 07:01:20.824081 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b77f861dcbb84f6dac56b5be789a7553"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.824590 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b77f861dcbb84f6dac56b5be789a7553 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.825659 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bb68c71e75fa4c80b07fee25fa7a1578"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.826129 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb68c71e75fa4c80b07fee25fa7a1578 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.827548 719 tablet_service.cc:1467] Processing CreateTablet for tablet 1c390114ac2646619cb50ce1873e72f7 (DEFAULT_TABLE table=default.Table_715948cd71c24a039a15b1a9598243ae [id=577676d7bf474665a4d1c87ed156bd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.827958 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c390114ac2646619cb50ce1873e72f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.831310 732 tablet_service.cc:1467] Processing CreateTablet for tablet 8060eb27937d4eeea2f6ca68782e06ce (DEFAULT_TABLE table=default.Table_4724fbd4e77543c48430fe63d4c0ba9a [id=1df4b47178484771a862dfd87e5a9ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.831646 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8060eb27937d4eeea2f6ca68782e06ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.832837 2450 raft_consensus.cc:2726] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:20.833274 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d77be1066b784bc0a04db10d6ddd1483"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.833778 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d77be1066b784bc0a04db10d6ddd1483 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.835251 722 tablet_service.cc:1467] Processing CreateTablet for tablet 1e6c3e833f454748a51a08d88ba91a02 (DEFAULT_TABLE table=default.Table_d144332acb344f88a25fec5a8a588cef [id=382c7ea2e41448beae1a1eb4a5a91c38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.835575 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e6c3e833f454748a51a08d88ba91a02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:20.837697 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 394d3124d03a438aa31d94967487b4be consensus state has no leader
I20260620 07:01:20.839278 734 tablet_service.cc:1467] Processing CreateTablet for tablet e79c0765aeb145339df20b6dc1e18141 (DEFAULT_TABLE table=default.Table_1a1fd54d4e8940a7bd95dbcac8738be0 [id=b5458545a9a74eb0829b34a19ebec17b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.839298 731 tablet_service.cc:1467] Processing CreateTablet for tablet 7e69ff3b3fd74138b2ddf61df9c46c18 (DEFAULT_TABLE table=default.Table_021ff3a24757452b9136ef50a3be98bb [id=16a2115419d5492f984d041703ee1d2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.839681 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e79c0765aeb145339df20b6dc1e18141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.839911 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e69ff3b3fd74138b2ddf61df9c46c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.841223 875 tablet_service.cc:1467] Processing CreateTablet for tablet 59717a2e5c104946b7382f9b9c52bfe9 (DEFAULT_TABLE table=default.Table_6c58dbd76d954a0795909e2dadcd02ba [id=9d501762b11e47dca21f1196dd4e349d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.843544 725 tablet_service.cc:1467] Processing CreateTablet for tablet ffb66de2e72b4d13ad4c58bec2720b5a (DEFAULT_TABLE table=default.Table_2887bc68d41444e7a3da02fea7842d8d [id=e872cbca26c7448ea0b1e65fd692f96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.843984 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffb66de2e72b4d13ad4c58bec2720b5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:20.845908 681 leader_election.cc:341] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.846015 681 leader_election.cc:302] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.846375 2450 raft_consensus.cc:2726] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:20.789860 720 consensus_meta.cc:287] T 2abce486e28845a3b61554827150882e P 2b84cae646b24bc7bd424eb8434ad425: Time spent flushing consensus metadata: real 0.580s user 0.003s sys 0.000s
I20260620 07:01:20.847267 2520 raft_consensus.cc:482] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.847424 2520 raft_consensus.cc:504] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:20.847514 715 tablet_service.cc:1467] Processing CreateTablet for tablet 28fb5cf9393d4a579db91149d236bbde (DEFAULT_TABLE table=default.Table_b22b28a2d04a4711a63d53d14cbca67a [id=ea1a53f9a29a49bcab57d60c585161db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.847857 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28fb5cf9393d4a579db91149d236bbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.848059 2520 leader_election.cc:288] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:20.852859 968 leader_election.cc:341] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: eeb082e189304f13909d115f7197c5a1
I20260620 07:01:20.859138 726 tablet_service.cc:1467] Processing CreateTablet for tablet ebc9dbca6edb402c970aa5226275a3c1 (DEFAULT_TABLE table=default.Table_307a2d6eb71340839ef3275ce36ae2f9 [id=a7443271154e460484aca7d21ac34dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.859607 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebc9dbca6edb402c970aa5226275a3c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.860040 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 04db48e910514d46bb4deb9acf54f7c0 (table default.Table_e398e5c359f8400eac47c32d10c9a432 [id=41c90959790840acbf26b2339272e8ae]) successfully deleted
I20260620 07:01:20.863437 723 tablet_service.cc:1467] Processing CreateTablet for tablet dfdcc3deb4f14f90b54fc412cd533948 (DEFAULT_TABLE table=default.Table_45a3fdc28a0143deb5a12984f8fd8144 [id=dc2e07584fb642de943bcfa4e41183c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.863976 1170 tablet_bootstrap.cc:492] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:01:20.866469 830 leader_election.cc:341] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:20.866628 830 leader_election.cc:302] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:20.867012 2366 raft_consensus.cc:2726] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:20.867825 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1ddd2a4884e54fd28958caa1ff0cbee9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.868405 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ddd2a4884e54fd28958caa1ff0cbee9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.869673 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b9fb248283f045a98de6bafa82727011" } new_table_name: "default.Table_3d5201c0850244a9942fe26795fe7b97" modify_external_catalogs: true
I20260620 07:01:20.870190 1170 ts_tablet_manager.cc:1397] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.171s user 0.002s sys 0.005s
I20260620 07:01:20.870903 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_72beaf5462364dd7930966b62a3d6717" } new_table_name: "default.Table_d6685b2f201549f5a05100236f76d5bd" modify_external_catalogs: true
I20260620 07:01:20.864046 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdcc3deb4f14f90b54fc412cd533948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.867719 720 tablet_service.cc:1467] Processing CreateTablet for tablet 64901fd17de342339c511368d61a9eb3 (DEFAULT_TABLE table=default.Table_3291c3f046e145a4bd25965836d3e9eb [id=21d86c8441f34381a40032e26a134f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.873344 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64901fd17de342339c511368d61a9eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.874540 969 leader_election.cc:302] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.880156 730 tablet_service.cc:1467] Processing CreateTablet for tablet f3b6f9ff89124c1d9a92d60c1edc6ff0 (DEFAULT_TABLE table=default.Table_8dab0fdb88604443b6f8e8deb4ae4537 [id=f38bc051457644999d7ba417391f3dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.880656 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3b6f9ff89124c1d9a92d60c1edc6ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.881945 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7a024765ed144281a81db3b75cd271bf
I20260620 07:01:20.883217 861 tablet_service.cc:1467] Processing CreateTablet for tablet 5a94ee2e2e374ac5ba4f6d64af670f5a (DEFAULT_TABLE table=default.Table_76fb70ea47a3453ba83413761b3012ef [id=a53c79cd71e041fe8e8f6283ffc60ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.892446 1166 ts_tablet_manager.cc:1918] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:20.896726 870 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a024765ed144281a81db3b75cd271bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:20.896927 857 tablet_service.cc:1467] Processing CreateTablet for tablet a7210c4167634485bb5ebaf061325ca4 (DEFAULT_TABLE table=default.Table_e0772efedd3549978812c7a65c3dc594 [id=b053fc00d55349af8c2044dd9abfc1f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.897161 870 tablet_service.cc:1467] Processing CreateTablet for tablet 0d8f22971825484fa0ff700d01db3908 (DEFAULT_TABLE table=default.Table_54f575fa497442c689c436cf87257384 [id=83c2d34ca2394d0bbd8617676c9d81f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.897693 874 tablet_service.cc:1467] Processing CreateTablet for tablet e4a4b2ca8d704db6b031f5b90d02f043 (DEFAULT_TABLE table=default.Table_17870f344fa9455bb22f8a230770a29e [id=8f715d2491ad45ff8c3cb5a68d33695c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.900656 1170 raft_consensus.cc:348] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.901253 1170 raft_consensus.cc:374] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:20.901471 1170 raft_consensus.cc:729] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:20.901921 1170 consensus_queue.cc:260] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:20.904624 867 tablet_service.cc:1467] Processing CreateTablet for tablet c38a977723ef4ef7a86c045770b1720e (DEFAULT_TABLE table=default.Table_69902e5c120e458c9214c5efb7e85edc [id=26177b8718ca44f3b274b229f0046b36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.906282 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_dee364706a7749e88746a0779bb44a36" } new_table_name: "default.Table_63763f9222b540e8bdf206733bcd6a85" modify_external_catalogs: true
I20260620 07:01:20.906394 721 tablet_service.cc:1467] Processing CreateTablet for tablet f6c4d0bd88784a05aa76e48398e412e9 (DEFAULT_TABLE table=default.Table_88b66d2bbc794b5a9681c73bf871b8dc [id=b735d7580c39409e8eb7a17654c900c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.911154 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6c4d0bd88784a05aa76e48398e412e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:20.911550 871 tablet_service.cc:1467] Processing CreateTablet for tablet 56a0e874b9744266b6eb4422b918d385 (DEFAULT_TABLE table=default.Table_8a84b5a849c74f1a87f5300033268d83 [id=63b2d547d8cf485fbef2d947e56bc15c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.918920 866 tablet_service.cc:1467] Processing CreateTablet for tablet c0f594983a7540db9c245c64a87a3edd (DEFAULT_TABLE table=default.Table_8d07844409574a23bfbc41cbf9c95168 [id=77704e40acab45039ff73244fc9575de]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:20.891499 969 consensus_peers.cc:487] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 704e8aaabe6d40138b6611bdc30abf16. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:20.920425 969 leader_election.cc:341] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 9e8cd4ec5619416a8983e1bc1b6b6a09
I20260620 07:01:20.920573 969 leader_election.cc:302] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:20.920740 969 raft_consensus.cc:2670] T 9e8cd4ec5619416a8983e1bc1b6b6a09 P 06a32ef63b2b495a9ade1de48c024ae9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 07:01:20.921377 969 leader_election.cc:341] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ab60101b34144f85b0afd2e8c4846e48
I20260620 07:01:20.921486 969 leader_election.cc:302] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:20.921723 2531 raft_consensus.cc:2726] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:20.922914 2529 raft_consensus.cc:2726] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:20.907629 1167 ts_tablet_manager.cc:1428] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.112s user 0.002s sys 0.001s
I20260620 07:01:20.926908 1167 tablet_bootstrap.cc:492] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:20.928180 1166 log.cc:1196] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/c38c628514c44c6fa5aff64928e515d9
I20260620 07:01:20.930387 1167 tablet_bootstrap.cc:654] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:20.936342 862 tablet_service.cc:1467] Processing CreateTablet for tablet 87b65473790e4c199ca49152a679ece7 (DEFAULT_TABLE table=default.Table_d161383246cd40ec8ad6511e9959e18b [id=376949e76e014af9832126d6f1e81b01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.941372 872 tablet_service.cc:1467] Processing CreateTablet for tablet ceb16b2060f34a32870bcf6fb143efe7 (DEFAULT_TABLE table=default.Table_078c21840d2f416da60744754f4b25b2 [id=81b33eb4aa244515a1fa2baf7d11124e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.943998 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 3ebca13b8fb646778c1e8b9db404904f
I20260620 07:01:20.944741 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_dea72b45670847ea9b89dd25e200f407"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:20.945366 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dea72b45670847ea9b89dd25e200f407 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:20.947008 1166 ts_tablet_manager.cc:1939] T c38c628514c44c6fa5aff64928e515d9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:20.947029 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3beace102a7e4806ad2bb54d4e46dea9" } new_table_name: "default.Table_56256eb001fd478c8def98b816480c4b" modify_external_catalogs: true
I20260620 07:01:20.948237 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4u_93S/build/asan/bin/kudu pid 1194
I20260620 07:01:20.948414 2529 raft_consensus.cc:482] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:20.948982 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ebca13b8fb646778c1e8b9db404904f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:20.953384 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 978) took 2433 ms. Trace:
I20260620 07:01:20.953699 1166 rpcz_store.cc:276] 0620 07:01:18.520146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.526672 (+ 6526us) service_pool.cc:227] Handling call
0620 07:01:20.793193 (+2266521us) ts_tablet_manager.cc:1145] Deleting tablet c38c628514c44c6fa5aff64928e515d9
0620 07:01:20.793203 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.889165 (+ 95962us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.892340 (+ 3175us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:20.953326 (+ 60986us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2266286}
I20260620 07:01:20.954614 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 981) took 2284 ms. Trace:
I20260620 07:01:20.954890 1166 rpcz_store.cc:276] 0620 07:01:18.669657 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.669720 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:20.954371 (+2284651us) ts_tablet_manager.cc:1145] Deleting tablet 2d1bad6b34f14270a060ce7245ff0c0f
0620 07:01:20.954406 (+ 35us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.954570 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2284397}
I20260620 07:01:20.955878 865 tablet_service.cc:1467] Processing CreateTablet for tablet 2f1be61424224fa6a2e14985266defbb (DEFAULT_TABLE table=default.Table_72d11279e6754a32aadd5966adbb5aaf [id=ccba097645644a8a9745cfcf20afca03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:20.974123 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 988) took 2283 ms. Trace:
I20260620 07:01:20.975366 1166 rpcz_store.cc:276] 0620 07:01:18.690075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.690144 (+ 69us) service_pool.cc:227] Handling call
0620 07:01:20.955458 (+2265314us) ts_tablet_manager.cc:1145] Deleting tablet 8dad7e6437ab4328b9b88d5e6febe8a0
0620 07:01:20.973240 (+ 17782us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.973988 (+ 748us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2265038}
I20260620 07:01:20.979297 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1006) took 1673 ms. Trace:
I20260620 07:01:20.980684 1166 rpcz_store.cc:276] 0620 07:01:19.305904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.305991 (+ 87us) service_pool.cc:227] Handling call
0620 07:01:20.977495 (+1671504us) ts_tablet_manager.cc:1145] Deleting tablet f8be5f41f1d64d918b727e3eef18738e
0620 07:01:20.977754 (+ 259us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.979271 (+ 1517us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1671026}
I20260620 07:01:20.985836 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1008) took 1619 ms. Trace:
I20260620 07:01:20.986982 1166 rpcz_store.cc:276] 0620 07:01:19.366213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.366261 (+ 48us) service_pool.cc:227] Handling call
0620 07:01:20.984559 (+1618298us) ts_tablet_manager.cc:1145] Deleting tablet b5014cf5cc70466bafb6921c9d46ba72
0620 07:01:20.984753 (+ 194us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.985635 (+ 882us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1617882}
I20260620 07:01:20.990157 1166 tablet_replica.cc:330] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:20.992515 1166 raft_consensus.cc:2229] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:20.994604 1166 raft_consensus.cc:2258] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:20.995633 1170 ts_tablet_manager.cc:1428] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.125s user 0.003s sys 0.000s
I20260620 07:01:20.996984 1170 tablet_bootstrap.cc:492] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:20.948666 2529 raft_consensus.cc:504] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:21.006007 968 leader_election.cc:341] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: d51c7488711b4db697b48025a5ba6e9d
I20260620 07:01:21.006340 2529 leader_election.cc:288] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:21.005926 1169 ts_tablet_manager.cc:1918] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.011104 1169 log.cc:1196] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/b5c1567e0c9448dca870bd3d8502bf02
W20260620 07:01:21.018821 681 consensus_peers.cc:487] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:21.020741 2452 consensus_queue.cc:1035] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:21.029145 1166 ts_tablet_manager.cc:1905] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.044130 726 tablet_service.cc:1467] Processing CreateTablet for tablet e4a4b2ca8d704db6b031f5b90d02f043 (DEFAULT_TABLE table=default.Table_17870f344fa9455bb22f8a230770a29e [id=8f715d2491ad45ff8c3cb5a68d33695c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.044663 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4a4b2ca8d704db6b031f5b90d02f043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.045341 1169 ts_tablet_manager.cc:1939] T b5c1567e0c9448dca870bd3d8502bf02 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:21.046274 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 972) took 4072 ms. Trace:
I20260620 07:01:21.046379 1169 rpcz_store.cc:276] 0620 07:01:16.973802 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:16.973854 (+ 52us) service_pool.cc:227] Handling call
0620 07:01:20.452602 (+3478748us) ts_tablet_manager.cc:1145] Deleting tablet b5c1567e0c9448dca870bd3d8502bf02
0620 07:01:20.452617 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:20.764437 (+311820us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.005808 (+241371us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.046245 (+ 40437us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3478596}
I20260620 07:01:21.047796 730 tablet_service.cc:1467] Processing CreateTablet for tablet 5a94ee2e2e374ac5ba4f6d64af670f5a (DEFAULT_TABLE table=default.Table_76fb70ea47a3453ba83413761b3012ef [id=a53c79cd71e041fe8e8f6283ffc60ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.048410 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a94ee2e2e374ac5ba4f6d64af670f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.051998 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a024765ed144281a81db3b75cd271bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.052788 873 tablet_service.cc:1467] Processing CreateTablet for tablet 05c0ff06297f4a0d9aebcb0f6cabce33 (DEFAULT_TABLE table=default.Table_99e410bd8d664e959bf46121c9ee79ce [id=50afe8e88fcd407a9655db8f6247570c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.055843 727 tablet_service.cc:1467] Processing CreateTablet for tablet 59717a2e5c104946b7382f9b9c52bfe9 (DEFAULT_TABLE table=default.Table_6c58dbd76d954a0795909e2dadcd02ba [id=9d501762b11e47dca21f1196dd4e349d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.056365 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59717a2e5c104946b7382f9b9c52bfe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.057878 716 tablet_service.cc:1467] Processing CreateTablet for tablet 0d8f22971825484fa0ff700d01db3908 (DEFAULT_TABLE table=default.Table_54f575fa497442c689c436cf87257384 [id=83c2d34ca2394d0bbd8617676c9d81f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.058286 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d8f22971825484fa0ff700d01db3908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.058223 734 tablet_service.cc:1467] Processing CreateTablet for tablet 05c0ff06297f4a0d9aebcb0f6cabce33 (DEFAULT_TABLE table=default.Table_99e410bd8d664e959bf46121c9ee79ce [id=50afe8e88fcd407a9655db8f6247570c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.058331 729 tablet_service.cc:1467] Processing CreateTablet for tablet 56a0e874b9744266b6eb4422b918d385 (DEFAULT_TABLE table=default.Table_8a84b5a849c74f1a87f5300033268d83 [id=63b2d547d8cf485fbef2d947e56bc15c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.058727 722 tablet_service.cc:1467] Processing CreateTablet for tablet c0f594983a7540db9c245c64a87a3edd (DEFAULT_TABLE table=default.Table_8d07844409574a23bfbc41cbf9c95168 [id=77704e40acab45039ff73244fc9575de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.058902 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05c0ff06297f4a0d9aebcb0f6cabce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.059226 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0f594983a7540db9c245c64a87a3edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.063356 733 tablet_service.cc:1467] Processing CreateTablet for tablet a7210c4167634485bb5ebaf061325ca4 (DEFAULT_TABLE table=default.Table_e0772efedd3549978812c7a65c3dc594 [id=b053fc00d55349af8c2044dd9abfc1f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.063526 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56a0e874b9744266b6eb4422b918d385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.063930 723 tablet_service.cc:1467] Processing CreateTablet for tablet c38a977723ef4ef7a86c045770b1720e (DEFAULT_TABLE table=default.Table_69902e5c120e458c9214c5efb7e85edc [id=26177b8718ca44f3b274b229f0046b36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.070429 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7210c4167634485bb5ebaf061325ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.079890 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 973) took 3894 ms. Trace:
I20260620 07:01:21.089102 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c38a977723ef4ef7a86c045770b1720e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.090207 1169 rpcz_store.cc:276] 0620 07:01:17.185735 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.185819 (+ 84us) service_pool.cc:227] Handling call
0620 07:01:21.079693 (+3893874us) ts_tablet_manager.cc:1145] Deleting tablet 848a456e584e466387057f98eeec44ba
0620 07:01:21.079712 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.079860 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3794750}
I20260620 07:01:21.098747 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet b5c1567e0c9448dca870bd3d8502bf02 (table default.Table_064fe848c6a04392901aeeb0168f99b4 [id=4315970d1a304e3d8d41ff5b0e452ebd]) successfully deleted
I20260620 07:01:21.100956 1170 tablet_bootstrap.cc:654] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.120352 1169 tablet_replica.cc:330] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:21.137729 1167 tablet_bootstrap.cc:492] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.137892 1167 ts_tablet_manager.cc:1397] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.211s user 0.006s sys 0.010s
I20260620 07:01:21.139073 1167 raft_consensus.cc:348] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.139289 1167 raft_consensus.cc:374] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.139359 1167 raft_consensus.cc:729] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.139550 1167 consensus_queue.cc:260] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.140169 1167 ts_tablet_manager.cc:1428] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 07:01:21.149279 2548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fe29008ed9b430ea13d40e54e3ddfcc)
I20260620 07:01:21.149590 1167 tablet_bootstrap.cc:492] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.149595 2548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } }
I20260620 07:01:21.150593 2548 leader_election.cc:288] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fe29008ed9b430ea13d40e54e3ddfcc (127.0.97.62:36007), f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775)
I20260620 07:01:21.151332 1167 tablet_bootstrap.cc:654] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:21.152868 969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 230961us
W20260620 07:01:21.153571 830 leader_election.cc:341] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.153702 830 leader_election.cc:302] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:21.154282 2366 raft_consensus.cc:2726] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.160081 995 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a024765ed144281a81db3b75cd271bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.160513 1003 tablet_service.cc:1467] Processing CreateTablet for tablet e4a4b2ca8d704db6b031f5b90d02f043 (DEFAULT_TABLE table=default.Table_17870f344fa9455bb22f8a230770a29e [id=8f715d2491ad45ff8c3cb5a68d33695c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.160880 995 tablet_service.cc:1467] Processing CreateTablet for tablet a7210c4167634485bb5ebaf061325ca4 (DEFAULT_TABLE table=default.Table_e0772efedd3549978812c7a65c3dc594 [id=b053fc00d55349af8c2044dd9abfc1f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.161217 999 tablet_service.cc:1467] Processing CreateTablet for tablet 5a94ee2e2e374ac5ba4f6d64af670f5a (DEFAULT_TABLE table=default.Table_76fb70ea47a3453ba83413761b3012ef [id=a53c79cd71e041fe8e8f6283ffc60ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.162411 994 tablet_service.cc:1467] Processing CreateTablet for tablet 0d8f22971825484fa0ff700d01db3908 (DEFAULT_TABLE table=default.Table_54f575fa497442c689c436cf87257384 [id=83c2d34ca2394d0bbd8617676c9d81f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.162477 1445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2395d394cd84440ebae89d1ecfa13fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 1393 } } ignore_live_leader: false dest_uuid: "f32c3995c70946c38ce1a3094aaaffb1" is_pre_election: true
I20260620 07:01:21.162847 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 59717a2e5c104946b7382f9b9c52bfe9 (DEFAULT_TABLE table=default.Table_6c58dbd76d954a0795909e2dadcd02ba [id=9d501762b11e47dca21f1196dd4e349d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.162966 1002 tablet_service.cc:1467] Processing CreateTablet for tablet c38a977723ef4ef7a86c045770b1720e (DEFAULT_TABLE table=default.Table_69902e5c120e458c9214c5efb7e85edc [id=26177b8718ca44f3b274b229f0046b36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.167260 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 56a0e874b9744266b6eb4422b918d385 (DEFAULT_TABLE table=default.Table_8a84b5a849c74f1a87f5300033268d83 [id=63b2d547d8cf485fbef2d947e56bc15c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.167912 996 tablet_service.cc:1467] Processing CreateTablet for tablet 05c0ff06297f4a0d9aebcb0f6cabce33 (DEFAULT_TABLE table=default.Table_99e410bd8d664e959bf46121c9ee79ce [id=50afe8e88fcd407a9655db8f6247570c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.168009 997 tablet_service.cc:1467] Processing CreateTablet for tablet c0f594983a7540db9c245c64a87a3edd (DEFAULT_TABLE table=default.Table_8d07844409574a23bfbc41cbf9c95168 [id=77704e40acab45039ff73244fc9575de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.168430 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 87b65473790e4c199ca49152a679ece7 (DEFAULT_TABLE table=default.Table_d161383246cd40ec8ad6511e9959e18b [id=376949e76e014af9832126d6f1e81b01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.169173 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ebca13b8fb646778c1e8b9db404904f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.169324 1000 tablet_service.cc:1467] Processing CreateTablet for tablet ceb16b2060f34a32870bcf6fb143efe7 (DEFAULT_TABLE table=default.Table_078c21840d2f416da60744754f4b25b2 [id=81b33eb4aa244515a1fa2baf7d11124e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.169471 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7210c4167634485bb5ebaf061325ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.169648 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb16b2060f34a32870bcf6fb143efe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.169857 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c38a977723ef4ef7a86c045770b1720e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.170019 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d8f22971825484fa0ff700d01db3908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.170171 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0f594983a7540db9c245c64a87a3edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.170318 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87b65473790e4c199ca49152a679ece7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.170531 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4a4b2ca8d704db6b031f5b90d02f043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.170667 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56a0e874b9744266b6eb4422b918d385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.170825 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a94ee2e2e374ac5ba4f6d64af670f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.171218 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05c0ff06297f4a0d9aebcb0f6cabce33. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:21.171789 969 leader_election.cc:341] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d51c7488711b4db697b48025a5ba6e9d
I20260620 07:01:21.171931 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 2f1be61424224fa6a2e14985266defbb (DEFAULT_TABLE table=default.Table_72d11279e6754a32aadd5966adbb5aaf [id=ccba097645644a8a9745cfcf20afca03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.171931 969 leader_election.cc:302] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.172586 2531 raft_consensus.cc:2726] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:21.172742 969 leader_election.cc:341] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: eeb082e189304f13909d115f7197c5a1
I20260620 07:01:21.172856 969 leader_election.cc:302] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.173058 2531 raft_consensus.cc:2726] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.173538 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59717a2e5c104946b7382f9b9c52bfe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.191119 1169 raft_consensus.cc:2229] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.191342 1169 raft_consensus.cc:2258] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.191864 1169 ts_tablet_manager.cc:1905] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.201901 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f1be61424224fa6a2e14985266defbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.216380 1166 ts_tablet_manager.cc:1918] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.217370 1166 log.cc:1196] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/b39e682e71ed4776a786f7d30158e7e0
I20260620 07:01:21.217669 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64901fd17de342339c511368d61a9eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.217935 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f1be61424224fa6a2e14985266defbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.218138 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdcc3deb4f14f90b54fc412cd533948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.218292 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d8f22971825484fa0ff700d01db3908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.218562 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7210c4167634485bb5ebaf061325ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.223033 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4a4b2ca8d704db6b031f5b90d02f043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.224594 1168 tablet_bootstrap.cc:654] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.225381 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffb66de2e72b4d13ad4c58bec2720b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.229409 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59717a2e5c104946b7382f9b9c52bfe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.229588 1166 ts_tablet_manager.cc:1939] T b39e682e71ed4776a786f7d30158e7e0 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.230446 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1009) took 1864 ms. Trace:
I20260620 07:01:21.230571 1166 rpcz_store.cc:276] 0620 07:01:19.366358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.366564 (+ 206us) service_pool.cc:227] Handling call
0620 07:01:20.989728 (+1623164us) ts_tablet_manager.cc:1145] Deleting tablet b39e682e71ed4776a786f7d30158e7e0
0620 07:01:20.989742 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.122407 (+132665us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.215482 (+ 93075us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.230422 (+ 14940us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1622782}
I20260620 07:01:21.230883 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb16b2060f34a32870bcf6fb143efe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.231062 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1007) took 1874 ms. Trace:
I20260620 07:01:21.231154 1166 rpcz_store.cc:276] 0620 07:01:19.356299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.356628 (+ 329us) service_pool.cc:227] Handling call
0620 07:01:21.230933 (+1874305us) ts_tablet_manager.cc:1145] Deleting tablet f0876d36e48a4d7fa78a1448fbeee4c2
0620 07:01:21.230943 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.231047 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1861302}
I20260620 07:01:21.233016 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a94ee2e2e374ac5ba4f6d64af670f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.233071 1166 tablet_replica.cc:330] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.234112 1166 raft_consensus.cc:2229] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.234315 1166 raft_consensus.cc:2258] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.234426 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87b65473790e4c199ca49152a679ece7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.234865 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05c0ff06297f4a0d9aebcb0f6cabce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.234972 1166 ts_tablet_manager.cc:1905] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.235455 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c38a977723ef4ef7a86c045770b1720e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.236549 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0f594983a7540db9c245c64a87a3edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.237952 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28fb5cf9393d4a579db91149d236bbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.152287 436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2395d394cd84440ebae89d1ecfa13fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 1393 } } ignore_live_leader: false dest_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" is_pre_election: true
W20260620 07:01:21.238107 413 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 139355us
I20260620 07:01:21.154332 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet c38c628514c44c6fa5aff64928e515d9 (table default.Table_5a07e98698e24414a5ac54521c1b251c [id=a6be77da33394794ac37a31806294616]) successfully deleted
W20260620 07:01:21.238363 412 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 84033.9us
W20260620 07:01:21.238889 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2d1bad6b34f14270a060ce7245ff0c0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1bad6b34f14270a060ce7245ff0c0f already in progress: creating tablet
W20260620 07:01:21.239112 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8dad7e6437ab4328b9b88d5e6febe8a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dad7e6437ab4328b9b88d5e6febe8a0 already in progress: creating tablet
W20260620 07:01:21.239280 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f8be5f41f1d64d918b727e3eef18738e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8be5f41f1d64d918b727e3eef18738e already in progress: creating tablet
W20260620 07:01:21.239398 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 848a456e584e466387057f98eeec44ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 848a456e584e466387057f98eeec44ba already in progress: creating tablet
W20260620 07:01:21.239444 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b5014cf5cc70466bafb6921c9d46ba72 because the tablet was not found. No further retry: Not found: Tablet not found: b5014cf5cc70466bafb6921c9d46ba72
I20260620 07:01:21.240097 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet b39e682e71ed4776a786f7d30158e7e0 (table default.Table_982eb8abebd34542b51573e542ad6085 [id=a7902aafbaad4905a6b5b03ad669eeae]) successfully deleted
W20260620 07:01:21.240278 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f0876d36e48a4d7fa78a1448fbeee4c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0876d36e48a4d7fa78a1448fbeee4c2 already in progress: creating tablet
W20260620 07:01:21.227345 414 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2de8ddbab4c6462999b074d9b375b3f6 (table default.Table_6817cdda2b4448508cc2226285e89f46 [id=24bd02bfb1b5486a8cc6b4272c74d2e9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2de8ddbab4c6462999b074d9b375b3f6 consensus state has no leader
I20260620 07:01:21.240823 2000 leader_election.cc:302] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2395d394cd84440ebae89d1ecfa13fb5; no voters: 2fe29008ed9b430ea13d40e54e3ddfcc, f32c3995c70946c38ce1a3094aaaffb1
I20260620 07:01:21.241986 853 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45966 (request call id 226) took 1111 ms. Trace:
I20260620 07:01:21.242089 853 rpcz_store.cc:276] 0620 07:01:20.130189 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.130285 (+ 96us) service_pool.cc:227] Handling call
0620 07:01:21.241929 (+1111644us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 07:01:21.244524 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87
I20260620 07:01:21.245448 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ebca13b8fb646778c1e8b9db404904f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.245915 727 tablet_service.cc:1467] Processing CreateTablet for tablet 2f1be61424224fa6a2e14985266defbb (DEFAULT_TABLE table=default.Table_72d11279e6754a32aadd5966adbb5aaf [id=ccba097645644a8a9745cfcf20afca03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.246340 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f1be61424224fa6a2e14985266defbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.251386 865 tablet_service.cc:1514] Processing DeleteTablet for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:21.251858 1168 tablet_bootstrap.cc:492] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.252002 1168 ts_tablet_manager.cc:1397] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.608s user 0.028s sys 0.018s
I20260620 07:01:21.252969 999 tablet_service.cc:1514] Processing DeleteTablet for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.252949 1168 raft_consensus.cc:348] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.253345 1168 raft_consensus.cc:374] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.253463 1168 raft_consensus.cc:729] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.253789 1168 consensus_queue.cc:260] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.254465 1168 ts_tablet_manager.cc:1428] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:21.254830 1168 tablet_bootstrap.cc:492] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.262668 1166 ts_tablet_manager.cc:1918] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.262915 2359 raft_consensus.cc:482] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.262974 1166 log.cc:1196] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/c2e38178b9244152915d4c0a9dcf59dc
I20260620 07:01:21.263062 2359 raft_consensus.cc:504] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.264046 1166 ts_tablet_manager.cc:1939] T c2e38178b9244152915d4c0a9dcf59dc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.265712 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1012) took 1889 ms. Trace:
I20260620 07:01:21.265872 2452 raft_consensus.cc:482] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.266000 2452 raft_consensus.cc:504] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.265906 1166 rpcz_store.cc:276] 0620 07:01:19.376242 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.376305 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:21.231390 (+1855085us) ts_tablet_manager.cc:1145] Deleting tablet c2e38178b9244152915d4c0a9dcf59dc
0620 07:01:21.232990 (+ 1600us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.256420 (+ 23430us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.262268 (+ 5848us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.265573 (+ 3305us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1854016}
I20260620 07:01:21.266434 1166 tablet_replica.cc:330] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.266471 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet c2e38178b9244152915d4c0a9dcf59dc (table default.Table_1016b85ff6404fc0aff750ab23813534 [id=202a9df145344ba48e0563ba13f1849f]) successfully deleted
I20260620 07:01:21.266594 2452 leader_election.cc:288] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.266765 1166 raft_consensus.cc:2229] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.267026 1166 raft_consensus.cc:2258] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:21.267737 683 leader_election.cc:341] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8d2c706414684bb1bacc6f9b870fc9c1
I20260620 07:01:21.268077 1166 ts_tablet_manager.cc:1905] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.268806 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d2c706414684bb1bacc6f9b870fc9c1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:21.269290 681 leader_election.cc:341] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.269408 681 leader_election.cc:302] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.270037 2450 raft_consensus.cc:2726] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.274605 2359 leader_election.cc:288] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.274235 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c083ebc2e054e09a531a8768802dcb1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:21.277122 681 leader_election.cc:341] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.277981 1166 ts_tablet_manager.cc:1918] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.278142 1166 log.cc:1196] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/9b2f0c28057b4534a8a400d1ca7f3991
I20260620 07:01:21.278889 1166 ts_tablet_manager.cc:1939] T 9b2f0c28057b4534a8a400d1ca7f3991 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.278944 2548 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2395d394cd84440ebae89d1ecfa13fb5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 07:01:21.280220 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1011) took 1904 ms. Trace:
I20260620 07:01:21.280403 1166 rpcz_store.cc:276] 0620 07:01:19.376132 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.376306 (+ 174us) service_pool.cc:227] Handling call
0620 07:01:21.266359 (+1890053us) ts_tablet_manager.cc:1145] Deleting tablet 9b2f0c28057b4534a8a400d1ca7f3991
0620 07:01:21.266374 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.272905 (+ 6531us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.277793 (+ 4888us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.280198 (+ 2405us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1888898}
I20260620 07:01:21.280927 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 9b2f0c28057b4534a8a400d1ca7f3991 (table default.Table_8e6e4c363d6f44828436c4fca5227174 [id=e2675f19e2dd4de2b88dca72b4b16a97]) successfully deleted
I20260620 07:01:21.281132 1166 tablet_replica.cc:330] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.281620 1166 raft_consensus.cc:2229] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.281925 1166 raft_consensus.cc:2258] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.282931 1166 ts_tablet_manager.cc:1905] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.287694 2359 raft_consensus.cc:482] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.287878 2359 raft_consensus.cc:504] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:21.289415 683 leader_election.cc:341] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3eda988492234d6aaeaee87f84f99d06
I20260620 07:01:21.290212 1167 tablet_bootstrap.cc:492] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:01:21.292338 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b54ee547016d41d9abeb94ea26d0960f consensus state has no leader
I20260620 07:01:21.292752 1167 ts_tablet_manager.cc:1397] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.143s user 0.004s sys 0.003s
I20260620 07:01:21.293648 1167 raft_consensus.cc:348] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:21.294169 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d354a36489014c16abf22e244349c95e consensus state has no leader
I20260620 07:01:21.294296 2359 leader_election.cc:288] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.294414 418 master_service.cc:946] ReplaceTablet: received request to replace tablet b99781ba1ed44f6895af7da082618616 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:21.295631 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b42347720fd49d8a2d0a3425cc6f185 consensus state has no leader
I20260620 07:01:21.294776 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3eda988492234d6aaeaee87f84f99d06" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:21.295948 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_29524262208149ff87cf1a63d2d9f6e4" } modify_external_catalogs: true
I20260620 07:01:21.296109 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_29524262208149ff87cf1a63d2d9f6e4" } modify_external_catalogs: true
I20260620 07:01:21.296145 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e8cbdbd27e8345578bf36803fa9777b4" } modify_external_catalogs: true
W20260620 07:01:21.296198 681 leader_election.cc:341] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.296298 681 leader_election.cc:302] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.296304 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e8cbdbd27e8345578bf36803fa9777b4" } modify_external_catalogs: true
I20260620 07:01:21.296695 2452 raft_consensus.cc:2726] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.296855 1167 raft_consensus.cc:374] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.296919 1167 raft_consensus.cc:729] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.296818 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_285bef485f9245a9af76437cdd971673"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.297369 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_285bef485f9245a9af76437cdd971673 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.297722 1167 consensus_queue.cc:260] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.300613 1167 ts_tablet_manager.cc:1428] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260620 07:01:21.301055 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e3bac62777904f028c5af42ef8b750cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.301599 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3bac62777904f028c5af42ef8b750cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.302094 733 tablet_service.cc:1514] Processing DeleteTablet for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:20 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.302484 1167 tablet_bootstrap.cc:492] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.304229 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4c9adf5632e1496ba74dab0d3973432d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.304795 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c9adf5632e1496ba74dab0d3973432d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.306852 1167 tablet_bootstrap.cc:654] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.307787 720 tablet_service.cc:1467] Processing CreateTablet for tablet ceb16b2060f34a32870bcf6fb143efe7 (DEFAULT_TABLE table=default.Table_078c21840d2f416da60744754f4b25b2 [id=81b33eb4aa244515a1fa2baf7d11124e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.308229 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb16b2060f34a32870bcf6fb143efe7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:21.310364 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 969b2e5291d14d86bcaa4de5f419c41d consensus state has no leader
I20260620 07:01:21.311949 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_4563e27d87354007895f9d9819e8d8a0" } new_table_name: "default.Table_6065a383cd53439fb9ad92441a4d3c8f" modify_external_catalogs: true
I20260620 07:01:21.293655 1166 ts_tablet_manager.cc:1918] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.312295 1166 log.cc:1196] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/a2d6f7f2b5b3473aa010b8982a03aa5e
I20260620 07:01:21.312626 1166 ts_tablet_manager.cc:1939] T a2d6f7f2b5b3473aa010b8982a03aa5e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.313233 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d5d5e550e63747639ad05d1e42f47abe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.313840 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5d5e550e63747639ad05d1e42f47abe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.313264 716 tablet_service.cc:1467] Processing CreateTablet for tablet 87b65473790e4c199ca49152a679ece7 (DEFAULT_TABLE table=default.Table_d161383246cd40ec8ad6511e9959e18b [id=376949e76e014af9832126d6f1e81b01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.315167 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87b65473790e4c199ca49152a679ece7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.319357 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1013) took 1942 ms. Trace:
I20260620 07:01:21.319471 1166 rpcz_store.cc:276] 0620 07:01:19.376580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.376624 (+ 44us) service_pool.cc:227] Handling call
0620 07:01:21.281051 (+1904427us) ts_tablet_manager.cc:1145] Deleting tablet a2d6f7f2b5b3473aa010b8982a03aa5e
0620 07:01:21.281064 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.288700 (+ 7636us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.293471 (+ 4771us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.319331 (+ 25860us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1903453}
I20260620 07:01:21.319903 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet a2d6f7f2b5b3473aa010b8982a03aa5e (table default.Table_0f52b588d09748288097316c7b3de423 [id=7abc3167416745d0871a33a335f880c6]) successfully deleted
I20260620 07:01:21.320647 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1010) took 1944 ms. Trace:
I20260620 07:01:21.320739 1166 rpcz_store.cc:276] 0620 07:01:19.376026 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.376081 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:21.320521 (+1944440us) ts_tablet_manager.cc:1145] Deleting tablet 7d067448ff3c4faea9579eaaf29cd29f
0620 07:01:21.320531 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.320628 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1942869}
W20260620 07:01:21.321128 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7d067448ff3c4faea9579eaaf29cd29f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d067448ff3c4faea9579eaaf29cd29f already in progress: creating tablet
I20260620 07:01:21.323630 1170 tablet_bootstrap.cc:492] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.324414 1170 ts_tablet_manager.cc:1397] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.328s user 0.004s sys 0.002s
I20260620 07:01:21.325475 1166 tablet_replica.cc:330] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.325680 1166 raft_consensus.cc:2229] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:21.325984 1166 raft_consensus.cc:2258] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.326014 1167 tablet_bootstrap.cc:492] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.325881 1170 raft_consensus.cc:348] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.326285 1170 raft_consensus.cc:374] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.326418 1170 raft_consensus.cc:729] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.326610 1167 ts_tablet_manager.cc:1397] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260620 07:01:21.327313 1167 raft_consensus.cc:348] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.327584 1167 raft_consensus.cc:374] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.327679 1167 raft_consensus.cc:729] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.328300 1167 consensus_queue.cc:260] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.328859 1167 ts_tablet_manager.cc:1428] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:21.331077 1167 tablet_bootstrap.cc:492] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.335207 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ac08547b5a874d02b9bc1ca762ce6eba" } modify_external_catalogs: true
I20260620 07:01:21.335423 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ac08547b5a874d02b9bc1ca762ce6eba" } modify_external_catalogs: true
I20260620 07:01:21.335466 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c95b908674e4f8425d765444c281b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.335703 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.335299 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b6c578055d4f95b44c85eba8e92ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.337177 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 97e01aa120cc4c189017236ad57de811 (table default.Table_b19a46e2d20e4f75a3d170cbb543ca71 [id=19dd20742533400980193075baec1956]). Expected version 1 got 0
I20260620 07:01:21.342667 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]). Expected version 1 got 0
I20260620 07:01:21.344053 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet b5c1567e0c9448dca870bd3d8502bf02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.344451 997 tablet_service.cc:1467] Processing CreateTablet for tablet 223a1984728144eda1e2f1873061ffa9 (DEFAULT_TABLE table=default.Table_cd8dc35255134c60bc9c00d66e87c86b [id=3172816b146042dcaee64f4cbb138223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.344921 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 223a1984728144eda1e2f1873061ffa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.347630 730 tablet_service.cc:1467] Processing CreateTablet for tablet 223a1984728144eda1e2f1873061ffa9 (DEFAULT_TABLE table=default.Table_cd8dc35255134c60bc9c00d66e87c86b [id=3172816b146042dcaee64f4cbb138223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.347882 723 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eda988492234d6aaeaee87f84f99d06 with delete_type TABLET_DATA_DELETED (replaced by tablet a590f553b9e041c4830234897dbbf09f) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.348071 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d2c706414684bb1bacc6f9b870fc9c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.348213 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 7294e5678ad44622a3249c1113b5e297 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.348335 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 223a1984728144eda1e2f1873061ffa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.348363 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 033c8b817757441ea7ebc2dbf77aa2dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.348748 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 712c252b492141a6a81499d19428cf72 (DEFAULT_TABLE table=default.Table_9119ee82f72b4b72af5a4e92cd7b4025 [id=21553edaf7a4464eaac6e7f34f688dd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.349152 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 712c252b492141a6a81499d19428cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.349721 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 058b05ffae80472c81a82ace8c6b81d1 (DEFAULT_TABLE table=default.Table_6869be958bdd44afb01f9c589118fa06 [id=a7c6bbf22447489298abbf004ca030d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.349905 727 tablet_service.cc:1514] Processing DeleteTablet for tablet d53c90eff33044479838ff67dea93057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.350011 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 058b05ffae80472c81a82ace8c6b81d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.350067 733 tablet_service.cc:1514] Processing DeleteTablet for tablet c9d344f9e4b444e4b6018fdf0cf762fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.352383 733 tablet_service.cc:1467] Processing CreateTablet for tablet 058b05ffae80472c81a82ace8c6b81d1 (DEFAULT_TABLE table=default.Table_6869be958bdd44afb01f9c589118fa06 [id=a7c6bbf22447489298abbf004ca030d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.352732 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 058b05ffae80472c81a82ace8c6b81d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.355361 727 tablet_service.cc:1467] Processing CreateTablet for tablet 712c252b492141a6a81499d19428cf72 (DEFAULT_TABLE table=default.Table_9119ee82f72b4b72af5a4e92cd7b4025 [id=21553edaf7a4464eaac6e7f34f688dd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.355685 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 712c252b492141a6a81499d19428cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.362039 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 390a327225344afda3076c341202cc1d (table default.Table_4563e27d87354007895f9d9819e8d8a0 [id=d7198485f2104c2092955ef5305900cf]). Expected version 1 got 0
I20260620 07:01:21.363806 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 302adda3630e44289d371de591061692 (table default.Table_443cffc65b664caf91066d86837262e1 [id=92e4f74224ab4135982722f846eb9e73]). Expected version 3 got 0
I20260620 07:01:21.364679 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 390a327225344afda3076c341202cc1d (table default.Table_4563e27d87354007895f9d9819e8d8a0 [id=d7198485f2104c2092955ef5305900cf]). Expected version 1 got 0
I20260620 07:01:21.365648 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 97e01aa120cc4c189017236ad57de811 (table default.Table_b19a46e2d20e4f75a3d170cbb543ca71 [id=19dd20742533400980193075baec1956]). Expected version 1 got 0
I20260620 07:01:21.375029 1167 tablet_bootstrap.cc:654] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.255059 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56a0e874b9744266b6eb4422b918d385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.299347 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c083ebc2e054e09a531a8768802dcb1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:21.345577 865 tablet_service.cc:1467] Processing CreateTablet for tablet 058b05ffae80472c81a82ace8c6b81d1 (DEFAULT_TABLE table=default.Table_6869be958bdd44afb01f9c589118fa06 [id=a7c6bbf22447489298abbf004ca030d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.376240 888 raft_consensus.cc:2454] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:21.352842 864 tablet_service.cc:1467] Processing CreateTablet for tablet 712c252b492141a6a81499d19428cf72 (DEFAULT_TABLE table=default.Table_9119ee82f72b4b72af5a4e92cd7b4025 [id=21553edaf7a4464eaac6e7f34f688dd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.377319 683 leader_election.cc:302] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:21.377605 2359 raft_consensus.cc:2781] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:21.377678 2359 raft_consensus.cc:482] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:21.377745 2359 raft_consensus.cc:3037] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:21.380105 1168 tablet_bootstrap.cc:654] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.380314 2359 raft_consensus.cc:504] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.381184 2359 leader_election.cc:288] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.373054 869 tablet_service.cc:1467] Processing CreateTablet for tablet 223a1984728144eda1e2f1873061ffa9 (DEFAULT_TABLE table=default.Table_cd8dc35255134c60bc9c00d66e87c86b [id=3172816b146042dcaee64f4cbb138223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.381597 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c083ebc2e054e09a531a8768802dcb1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:21.382196 681 leader_election.cc:341] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.382501 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c083ebc2e054e09a531a8768802dcb1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:21.382688 888 raft_consensus.cc:3037] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:21.384868 1166 ts_tablet_manager.cc:1905] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.385339 888 raft_consensus.cc:2454] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:21.385797 683 leader_election.cc:302] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:21.393996 1167 tablet_bootstrap.cc:492] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.394142 1167 ts_tablet_manager.cc:1397] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.002s
I20260620 07:01:21.394979 1167 raft_consensus.cc:348] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.395180 1167 raft_consensus.cc:374] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.395226 1167 raft_consensus.cc:729] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.395500 1167 consensus_queue.cc:260] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.396697 1167 ts_tablet_manager.cc:1428] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:21.396942 1167 tablet_bootstrap.cc:492] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.399471 2452 raft_consensus.cc:2781] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:21.399597 2452 raft_consensus.cc:686] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:21.399817 2452 consensus_queue.cc:237] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.402834 1167 tablet_bootstrap.cc:654] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.408150 2450 raft_consensus.cc:482] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.408296 2450 raft_consensus.cc:504] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.408835 2450 leader_election.cc:288] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.409355 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "302adda3630e44289d371de591061692" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:21.409894 681 leader_election.cc:341] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.414626 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "302adda3630e44289d371de591061692" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:21.414891 888 raft_consensus.cc:2454] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:21.417816 683 leader_election.cc:302] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:21.418406 2450 raft_consensus.cc:2781] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:21.418510 2450 raft_consensus.cc:482] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:21.418587 2450 raft_consensus.cc:3037] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:21.421103 2450 raft_consensus.cc:504] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.422252 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "302adda3630e44289d371de591061692" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:21.423130 681 leader_election.cc:341] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.423487 2450 leader_election.cc:288] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.423595 1167 tablet_bootstrap.cc:492] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.423790 1167 ts_tablet_manager.cc:1397] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.001s
I20260620 07:01:21.424275 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "302adda3630e44289d371de591061692" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:21.424475 888 raft_consensus.cc:3037] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:21.426970 2359 raft_consensus.cc:482] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.427146 888 raft_consensus.cc:2454] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:21.427131 2359 raft_consensus.cc:504] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.427939 1167 raft_consensus.cc:348] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.428184 1167 raft_consensus.cc:374] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.428265 1167 raft_consensus.cc:729] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.428369 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bc3dd1306af4e49a9fec197b5740374" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:21.428561 1167 consensus_queue.cc:260] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:21.428887 681 leader_election.cc:341] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.429081 2359 leader_election.cc:288] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.429257 1167 ts_tablet_manager.cc:1428] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 07:01:21.429713 683 leader_election.cc:302] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:21.429702 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bc3dd1306af4e49a9fec197b5740374" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:21.429877 888 raft_consensus.cc:2454] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:21.430341 1167 tablet_bootstrap.cc:492] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.430723 683 leader_election.cc:302] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:21.431142 2450 raft_consensus.cc:2781] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:21.432087 2359 raft_consensus.cc:2781] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:21.432212 2359 raft_consensus.cc:482] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:21.432334 2359 raft_consensus.cc:3037] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:21.432674 1166 ts_tablet_manager.cc:1918] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:21.432785 1166 log.cc:1196] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/704e8aaabe6d40138b6611bdc30abf16
I20260620 07:01:21.432822 1167 tablet_bootstrap.cc:654] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.433135 1166 ts_tablet_manager.cc:1939] T 704e8aaabe6d40138b6611bdc30abf16 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.433983 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1014) took 2023 ms. Trace:
I20260620 07:01:21.434095 1166 rpcz_store.cc:276] 0620 07:01:19.410392 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.410444 (+ 52us) service_pool.cc:227] Handling call
0620 07:01:21.325423 (+1914979us) ts_tablet_manager.cc:1145] Deleting tablet 704e8aaabe6d40138b6611bdc30abf16
0620 07:01:21.325434 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.408131 (+ 82697us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.432549 (+ 24418us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.433959 (+ 1410us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1914779}
I20260620 07:01:21.434630 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 704e8aaabe6d40138b6611bdc30abf16 (table default.Table_5345217f0b8545a29bddb73746b3d846 [id=6a49cf444e3b409bbf2fc6a73764cfe6]) successfully deleted
I20260620 07:01:21.449255 2531 raft_consensus.cc:482] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.449470 2531 raft_consensus.cc:504] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.450222 2531 leader_election.cc:288] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:21.451254 969 leader_election.cc:341] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: b5c1567e0c9448dca870bd3d8502bf02
W20260620 07:01:21.451438 968 leader_election.cc:341] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: b5c1567e0c9448dca870bd3d8502bf02
I20260620 07:01:21.451550 968 leader_election.cc:302] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.451879 2531 raft_consensus.cc:2726] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.452586 2359 raft_consensus.cc:504] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.453924 2366 raft_consensus.cc:482] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.454058 2366 raft_consensus.cc:504] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.454617 2366 leader_election.cc:288] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.454560 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bc3dd1306af4e49a9fec197b5740374" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:21.455179 681 leader_election.cc:341] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.455164 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76237044ff2f4c8b84c6af43badd164a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:21.455597 830 leader_election.cc:341] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.460665 2450 raft_consensus.cc:686] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:21.461338 2450 consensus_queue.cc:237] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.467506 1166 tablet_replica.cc:330] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.467741 1166 raft_consensus.cc:2229] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:21.467710 2531 raft_consensus.cc:482] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.468055 1166 raft_consensus.cc:2258] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.467868 2531 raft_consensus.cc:504] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.468617 1166 ts_tablet_manager.cc:1905] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.468779 2531 leader_election.cc:288] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:21.472558 2567 raft_consensus.cc:482] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:21.473168 968 leader_election.cc:341] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e5b6c578055d4f95b44c85eba8e92ac8
I20260620 07:01:21.472851 2567 raft_consensus.cc:504] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.476817 1167 tablet_bootstrap.cc:492] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.477079 1167 ts_tablet_manager.cc:1397] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.000s
I20260620 07:01:21.478188 1167 raft_consensus.cc:348] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.478624 1167 raft_consensus.cc:374] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.478765 1167 raft_consensus.cc:729] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.479333 1167 consensus_queue.cc:260] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:21.481249 969 leader_election.cc:341] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e5b6c578055d4f95b44c85eba8e92ac8
I20260620 07:01:21.481364 969 leader_election.cc:302] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.481668 1167 ts_tablet_manager.cc:1428] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:01:21.482218 1167 tablet_bootstrap.cc:492] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.482692 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bc3dd1306af4e49a9fec197b5740374" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:21.482933 889 raft_consensus.cc:3037] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:21.484440 1167 tablet_bootstrap.cc:654] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.485679 889 raft_consensus.cc:2454] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:21.485653 2359 leader_election.cc:288] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.486406 2567 leader_election.cc:288] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.487692 2531 raft_consensus.cc:2726] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.476359 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76237044ff2f4c8b84c6af43badd164a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:21.489133 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:21.491766 681 leader_election.cc:341] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.492996 1170 consensus_queue.cc:260] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.493544 1170 ts_tablet_manager.cc:1428] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.169s user 0.002s sys 0.000s
W20260620 07:01:21.495054 831 leader_election.cc:341] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.495003 891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:21.495165 831 leader_election.cc:302] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:21.495223 891 raft_consensus.cc:2454] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:21.495412 2366 raft_consensus.cc:2726] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.495878 683 leader_election.cc:302] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:21.500166 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 712c252b492141a6a81499d19428cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.501850 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 223a1984728144eda1e2f1873061ffa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.503450 1165 ts_tablet_manager.cc:1918] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:21.503558 1165 log.cc:1196] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/fe79bcf487fc4d118a91f4c62628d8a5
I20260620 07:01:21.503899 1165 ts_tablet_manager.cc:1939] T fe79bcf487fc4d118a91f4c62628d8a5 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:21.504240 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1064) took 2044 ms. Trace:
I20260620 07:01:21.504359 1165 rpcz_store.cc:276] 0620 07:01:19.460124 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.461005 (+ 881us) service_pool.cc:227] Handling call
0620 07:01:20.791429 (+1330424us) ts_tablet_manager.cc:1145] Deleting tablet fe79bcf487fc4d118a91f4c62628d8a5
0620 07:01:20.791440 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.396296 (+604856us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.503356 (+107060us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.504224 (+ 868us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1167471}
I20260620 07:01:21.504796 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 058b05ffae80472c81a82ace8c6b81d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.504776 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]) successfully deleted
I20260620 07:01:21.509979 2566 raft_consensus.cc:482] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.510128 1165 tablet_replica.cc:330] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:21.510349 1165 raft_consensus.cc:2229] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.510315 2566 raft_consensus.cc:504] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.512112 1511 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 07:01:21.512531 2570 raft_consensus.cc:2781] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:21.512650 2570 raft_consensus.cc:686] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:21.512881 2570 consensus_queue.cc:237] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.515519 1170 tablet_bootstrap.cc:492] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.517196 1170 tablet_bootstrap.cc:654] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.520545 1168 tablet_bootstrap.cc:492] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.526703 1165 raft_consensus.cc:2258] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.526758 1168 ts_tablet_manager.cc:1397] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.272s user 0.007s sys 0.007s
I20260620 07:01:21.529036 1168 raft_consensus.cc:348] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.529278 1168 raft_consensus.cc:374] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.529369 1168 raft_consensus.cc:729] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.529603 1168 consensus_queue.cc:260] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.530166 1168 ts_tablet_manager.cc:1428] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:21.530684 1168 tablet_bootstrap.cc:492] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.532294 1168 tablet_bootstrap.cc:654] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.532761 1167 tablet_bootstrap.cc:492] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.532982 1167 ts_tablet_manager.cc:1397] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.000s
I20260620 07:01:21.533663 1167 raft_consensus.cc:348] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.533984 1166 ts_tablet_manager.cc:1918] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:21.534008 1167 raft_consensus.cc:374] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.534220 1167 raft_consensus.cc:729] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.534528 1167 consensus_queue.cc:260] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.535272 1167 ts_tablet_manager.cc:1428] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:21.540405 1167 tablet_bootstrap.cc:492] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.541895 2531 raft_consensus.cc:482] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.542030 2531 raft_consensus.cc:504] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.542199 1167 tablet_bootstrap.cc:654] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.542336 854 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45966 (request call id 227) took 1114 ms. Trace:
I20260620 07:01:21.534104 1166 log.cc:1196] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/fe79bcf487fc4d118a91f4c62628d8a5
I20260620 07:01:21.542440 854 rpcz_store.cc:276] 0620 07:01:20.428049 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.428114 (+ 65us) service_pool.cc:227] Handling call
0620 07:01:20.531547 (+103433us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x6160002d2630. stack: 00007f3d444d566e 00007f3d444d5430 00007f3d4355c5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3d50cbafea 00007f3d535b5a88 00007f3d4e121016 00007f3d4e120d45 00007f3d4b0119be 00007f3d4b01079e 00007f3d4b016b25 00007f3d4b01754f 00007f3d4b017378 00000000009edb7c
0620 07:01:21.542305 (+1010758us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10179328}
I20260620 07:01:21.542644 2531 leader_election.cc:288] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:21.543517 1166 ts_tablet_manager.cc:1939] T fe79bcf487fc4d118a91f4c62628d8a5 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:21.543823 969 leader_election.cc:341] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 95a109e7871241ec9467858dca467bbe
I20260620 07:01:21.545328 1165 ts_tablet_manager.cc:1905] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.526368 683 leader_election.cc:302] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:21.547013 2570 raft_consensus.cc:2781] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 07:01:21.547114 2570 raft_consensus.cc:482] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:21.547189 2570 raft_consensus.cc:3037] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Advancing to term 2
I20260620 07:01:21.548388 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a109e7871241ec9467858dca467bbe" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:21.548607 751 raft_consensus.cc:2454] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:21.549108 968 leader_election.cc:302] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:21.549582 2531 raft_consensus.cc:2781] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:21.549660 2531 raft_consensus.cc:482] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:21.549721 2531 raft_consensus.cc:3037] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:21.549695 2570 raft_consensus.cc:504] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.550272 2570 leader_election.cc:288] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.551191 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1015) took 2091 ms. Trace:
I20260620 07:01:21.551295 1166 rpcz_store.cc:276] 0620 07:01:19.459356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.459526 (+ 170us) service_pool.cc:227] Handling call
0620 07:01:21.467452 (+2007926us) ts_tablet_manager.cc:1145] Deleting tablet fe79bcf487fc4d118a91f4c62628d8a5
0620 07:01:21.467465 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.484785 (+ 17320us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.533892 (+ 49107us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.551172 (+ 17280us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2007713}
I20260620 07:01:21.551760 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]) successfully deleted
I20260620 07:01:21.552103 1166 tablet_replica.cc:330] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.552273 1166 raft_consensus.cc:2229] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.552392 1166 raft_consensus.cc:2258] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.552670 2531 raft_consensus.cc:504] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.552887 1166 ts_tablet_manager.cc:1905] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.554148 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:21.554816 681 leader_election.cc:341] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.555187 2531 leader_election.cc:288] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:21.555439 1169 ts_tablet_manager.cc:1918] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.555547 1169 log.cc:1196] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/4655d289c94c4bce9707be375fc4b850
I20260620 07:01:21.555881 1169 ts_tablet_manager.cc:1939] T 4655d289c94c4bce9707be375fc4b850 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:01:21.556032 969 leader_election.cc:341] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 95a109e7871241ec9467858dca467bbe
I20260620 07:01:21.556289 1168 tablet_bootstrap.cc:492] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.556421 1168 ts_tablet_manager.cc:1397] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20260620 07:01:21.556511 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a109e7871241ec9467858dca467bbe" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:21.556602 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 975) took 3993 ms. Trace:
I20260620 07:01:21.556670 751 raft_consensus.cc:3037] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:21.557093 1168 raft_consensus.cc:348] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.557281 1168 raft_consensus.cc:374] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.557324 1168 raft_consensus.cc:729] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.557497 1168 consensus_queue.cc:260] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.557981 1168 ts_tablet_manager.cc:1428] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260620 07:01:21.558197 1168 tablet_bootstrap.cc:492] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.559451 751 raft_consensus.cc:2454] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:21.560115 968 leader_election.cc:302] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:21.560638 2531 raft_consensus.cc:2781] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:21.560815 2531 raft_consensus.cc:686] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:21.556672 1169 rpcz_store.cc:276] 0620 07:01:17.563403 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.563467 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:21.108943 (+3545476us) ts_tablet_manager.cc:1145] Deleting tablet 4655d289c94c4bce9707be375fc4b850
0620 07:01:21.112598 (+ 3655us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.533691 (+421093us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.555334 (+ 21643us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.556589 (+ 1255us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3533312}
I20260620 07:01:21.561059 2531 consensus_queue.cc:237] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.561369 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 976) took 3942 ms. Trace:
I20260620 07:01:21.561468 1169 rpcz_store.cc:276] 0620 07:01:17.618765 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:17.618842 (+ 77us) service_pool.cc:227] Handling call
0620 07:01:21.561181 (+3942339us) ts_tablet_manager.cc:1145] Deleting tablet a590f553b9e041c4830234897dbbf09f
0620 07:01:21.561193 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.561352 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3942059}
I20260620 07:01:21.561653 1167 tablet_bootstrap.cc:492] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.561820 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 987) took 3463 ms. Trace:
I20260620 07:01:21.561852 1167 ts_tablet_manager.cc:1397] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.004s
I20260620 07:01:21.561899 1169 rpcz_store.cc:276] 0620 07:01:18.098238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.098315 (+ 77us) service_pool.cc:227] Handling call
0620 07:01:21.561711 (+3463396us) ts_tablet_manager.cc:1145] Deleting tablet 29eb0db9b60f413ebce9ce16fe50aea4
0620 07:01:21.561722 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.561805 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3447673}
I20260620 07:01:21.562186 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 988) took 3463 ms. Trace:
I20260620 07:01:21.562264 1169 rpcz_store.cc:276] 0620 07:01:18.099127 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.099202 (+ 75us) service_pool.cc:227] Handling call
0620 07:01:21.562102 (+3462900us) ts_tablet_manager.cc:1145] Deleting tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263
0620 07:01:21.562111 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.562174 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3447870}
I20260620 07:01:21.562566 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 989) took 3461 ms. Trace:
I20260620 07:01:21.562644 1169 rpcz_store.cc:276] 0620 07:01:18.100718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.109139 (+ 8421us) service_pool.cc:227] Handling call
0620 07:01:21.562483 (+3453344us) ts_tablet_manager.cc:1145] Deleting tablet 2e05786efb6341ea85fb3d3c42bd85d7
0620 07:01:21.562492 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.562555 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3448144}
I20260620 07:01:21.562994 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 995) took 3317 ms. Trace:
I20260620 07:01:21.563153 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 633f3666050846dc9fc59a365110406d
I20260620 07:01:21.563117 1169 rpcz_store.cc:276] 0620 07:01:18.245304 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.245350 (+ 46us) service_pool.cc:227] Handling call
0620 07:01:21.562902 (+3317552us) ts_tablet_manager.cc:1145] Deleting tablet c2a1e6f386db42e6ba9e4aa29d9f986f
0620 07:01:21.562911 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.562980 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3317375}
I20260620 07:01:21.563380 1169 tablet_replica.cc:330] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:21.563009 1167 raft_consensus.cc:348] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.563606 1167 raft_consensus.cc:374] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.563617 1169 raft_consensus.cc:2229] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.563724 1167 raft_consensus.cc:729] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.563786 1169 raft_consensus.cc:2258] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.564050 1167 consensus_queue.cc:260] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.564335 420 master_service.cc:946] ReplaceTablet: received request to replace tablet c9ad0680f1da4504b87d9d0d6bcbabcb from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:21.564764 1167 ts_tablet_manager.cc:1428] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:21.564891 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d5ce229059f94b59b8e4c882aba39374" } modify_external_catalogs: true
I20260620 07:01:21.565068 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d5ce229059f94b59b8e4c882aba39374" } modify_external_catalogs: true
I20260620 07:01:21.565140 1167 tablet_bootstrap.cc:492] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.565114 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_76836e03e3af4d5290e79e81eda0ab64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.565743 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76836e03e3af4d5290e79e81eda0ab64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.566501 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5f9fe9ba01454a26b0b7344560204fbe" } modify_external_catalogs: true
I20260620 07:01:21.566655 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_5f9fe9ba01454a26b0b7344560204fbe" } modify_external_catalogs: true
I20260620 07:01:21.567121 1167 tablet_bootstrap.cc:654] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.567389 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_88baf3e114364967936c5fedb74422cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.567879 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88baf3e114364967936c5fedb74422cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.569166 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ff79295ab7e34563b6edae211c496205"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.569584 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff79295ab7e34563b6edae211c496205 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.570151 1169 ts_tablet_manager.cc:1905] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.570590 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b53304f072cb4a00a17de5df6f59168b
I20260620 07:01:21.571201 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8af172cfabc043eca78837a1636bd814"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.571624 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8af172cfabc043eca78837a1636bd814 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.572242 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 633f3666050846dc9fc59a365110406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.572439 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 4655d289c94c4bce9707be375fc4b850 (table default.Table_4b0078a40169404eb33b169cdb5f08df [id=8f652552eba04d87aad349983184c524]) successfully deleted
W20260620 07:01:21.572686 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a590f553b9e041c4830234897dbbf09f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a590f553b9e041c4830234897dbbf09f already in progress: creating tablet
W20260620 07:01:21.572901 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 29eb0db9b60f413ebce9ce16fe50aea4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29eb0db9b60f413ebce9ce16fe50aea4 already in progress: creating tablet
W20260620 07:01:21.573269 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d01ac3dd3844ac6b3b9c9c9f86ad263 already in progress: creating tablet
W20260620 07:01:21.573472 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2e05786efb6341ea85fb3d3c42bd85d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e05786efb6341ea85fb3d3c42bd85d7 already in progress: creating tablet
I20260620 07:01:21.573385 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bcb9bb2d798e4c9981a78796f16cbd71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.573752 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c2a1e6f386db42e6ba9e4aa29d9f986f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2a1e6f386db42e6ba9e4aa29d9f986f already in progress: creating tablet
W20260620 07:01:21.573868 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcb9bb2d798e4c9981a78796f16cbd71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.574723 720 tablet_service.cc:1514] Processing DeleteTablet for tablet b53304f072cb4a00a17de5df6f59168b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.575065 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 633f3666050846dc9fc59a365110406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.575471 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet b53304f072cb4a00a17de5df6f59168b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.577284 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a48735bdc4c54529aa2a8ee62db1c4b0" } new_table_name: "default.Table_603b24ca29d64fd4b03b5386406b25db" modify_external_catalogs: true
I20260620 07:01:21.579283 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 633f3666050846dc9fc59a365110406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:21.579551 867 tablet_service.cc:1514] Processing DeleteTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:21.584517 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:21.584749 889 raft_consensus.cc:3037] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Advancing to term 2
I20260620 07:01:21.585575 863 tablet_service.cc:1514] Processing DeleteTablet for tablet b53304f072cb4a00a17de5df6f59168b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:21.588500 1167 tablet_bootstrap.cc:492] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.588654 1167 ts_tablet_manager.cc:1397] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260620 07:01:21.589430 1167 raft_consensus.cc:348] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.589676 1167 raft_consensus.cc:374] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.589744 1167 raft_consensus.cc:729] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.590317 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bc3dd1306af4e49a9fec197b5740374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.592200 1168 tablet_bootstrap.cc:654] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.592576 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b99781ba1ed44f6895af7da082618616
I20260620 07:01:21.593050 418 catalog_manager.cc:6565] ReplaceTablet: tablet b99781ba1ed44f6895af7da082618616 deleted and replaced by tablet 778bd8bda6b3447eb94154d53e7bfa67
I20260620 07:01:21.593513 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet b99781ba1ed44f6895af7da082618616 with delete_type TABLET_DATA_DELETED (replaced by tablet 778bd8bda6b3447eb94154d53e7bfa67) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.594648 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 14bbd042527e4f55aec6fbd996b132aa
I20260620 07:01:21.594822 1167 consensus_queue.cc:260] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.595218 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0317c7d3f556484385f6af21f10cbc97" } new_table_name: "default.Table_20c884ae94984113bab8149dbfd6b8d0" modify_external_catalogs: true
I20260620 07:01:21.595547 889 raft_consensus.cc:2454] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 2.
I20260620 07:01:21.599115 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e94e3deb764f4de49ed3291a61ee8ab1" } new_table_name: "default.Table_1b4f08866177424f9ef6832b774aee49" modify_external_catalogs: true
I20260620 07:01:21.599292 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 14bbd042527e4f55aec6fbd996b132aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.595736 1167 ts_tablet_manager.cc:1428] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260620 07:01:21.599814 1167 tablet_bootstrap.cc:492] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.599869 1165 ts_tablet_manager.cc:1918] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:21.599973 1165 log.cc:1196] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/3f9d7421b549468e8a7782f467473bdb
I20260620 07:01:21.600328 1165 ts_tablet_manager.cc:1939] T 3f9d7421b549468e8a7782f467473bdb P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:21.602171 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1065) took 2135 ms. Trace:
I20260620 07:01:21.602686 1165 rpcz_store.cc:276] 0620 07:01:19.466615 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.466715 (+ 100us) service_pool.cc:227] Handling call
0620 07:01:21.510080 (+2043365us) ts_tablet_manager.cc:1145] Deleting tablet 3f9d7421b549468e8a7782f467473bdb
0620 07:01:21.510090 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.586946 (+ 76856us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.599764 (+ 12818us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.602154 (+ 2390us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1886073}
I20260620 07:01:21.604071 1170 tablet_bootstrap.cc:492] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.604488 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1066) took 1905 ms. Trace:
I20260620 07:01:21.605116 1165 rpcz_store.cc:276] 0620 07:01:19.699186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.699242 (+ 56us) service_pool.cc:227] Handling call
0620 07:01:21.604357 (+1905115us) ts_tablet_manager.cc:1145] Deleting tablet 728e7997b9e442669f9b5bda602311ce
0620 07:01:21.604369 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.604472 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1904945}
I20260620 07:01:21.605688 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 3f9d7421b549468e8a7782f467473bdb (table default.Table_14c9ff1d977443ba914900cfb627c5e7 [id=471f2077c52c4990a4c8b7eb8879d92e]) successfully deleted
I20260620 07:01:21.605293 683 leader_election.cc:302] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:21.606204 863 tablet_service.cc:1514] Processing DeleteTablet for tablet b99781ba1ed44f6895af7da082618616 with delete_type TABLET_DATA_DELETED (replaced by tablet 778bd8bda6b3447eb94154d53e7bfa67) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:21.606462 2569 raft_consensus.cc:2781] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 07:01:21.613459 1167 tablet_bootstrap.cc:654] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.616127 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 14bbd042527e4f55aec6fbd996b132aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:21.616766 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c01c4e10f345fc84e3e253e8501aff with delete_type TABLET_DATA_DELETED (replaced by tablet 6363d1d9233d4938ba40abff452ed147) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:21.617183 863 tablet_service.cc:1514] Processing DeleteTablet for tablet e37f336c01974ba79caeb25f4781667a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:21.618141 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 728e7997b9e442669f9b5bda602311ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 728e7997b9e442669f9b5bda602311ce already in progress: creating tablet
I20260620 07:01:21.618247 1170 ts_tablet_manager.cc:1397] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.103s user 0.006s sys 0.006s
I20260620 07:01:21.605746 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1067) took 1903 ms. Trace:
I20260620 07:01:21.618985 1165 rpcz_store.cc:276] 0620 07:01:19.701971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.702029 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:21.605634 (+1903605us) ts_tablet_manager.cc:1145] Deleting tablet 71b2d6ea3dab4bb8b544a59a5e433cdc
0620 07:01:21.605644 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.605731 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1903394}
I20260620 07:01:21.620049 1170 raft_consensus.cc:348] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.621017 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1068) took 1909 ms. Trace:
I20260620 07:01:21.621273 1166 ts_tablet_manager.cc:1918] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.621404 1166 log.cc:1196] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ba93e22c4720417c99d471b9c8b49b86
I20260620 07:01:21.621683 1166 ts_tablet_manager.cc:1939] T ba93e22c4720417c99d471b9c8b49b86 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.622175 1165 rpcz_store.cc:276] 0620 07:01:19.711370 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.711430 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:21.620846 (+1909416us) ts_tablet_manager.cc:1145] Deleting tablet 8c0b0969fb784dba96459ea441f88ae9
0620 07:01:21.620864 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.620994 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1909229}
I20260620 07:01:21.622448 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1016) took 2162 ms. Trace:
I20260620 07:01:21.622551 1166 rpcz_store.cc:276] 0620 07:01:19.459477 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.459662 (+ 185us) service_pool.cc:227] Handling call
0620 07:01:21.552032 (+2092370us) ts_tablet_manager.cc:1145] Deleting tablet ba93e22c4720417c99d471b9c8b49b86
0620 07:01:21.552042 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.617974 (+ 65932us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.621163 (+ 3189us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.622429 (+ 1266us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2092097}
I20260620 07:01:21.623036 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ba93e22c4720417c99d471b9c8b49b86 (table default.Table_222fe401283741dfbd8316b30e97e70d [id=f974e84fd3e44839bf7da901087aa984]) successfully deleted
I20260620 07:01:21.623584 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1069) took 1907 ms. Trace:
I20260620 07:01:21.624223 1170 raft_consensus.cc:374] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.624682 1170 raft_consensus.cc:729] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.625028 1165 rpcz_store.cc:276] 0620 07:01:19.716461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.716570 (+ 109us) service_pool.cc:227] Handling call
0620 07:01:21.623432 (+1906862us) ts_tablet_manager.cc:1145] Deleting tablet 01b82aa3a0ba48f7bf61401713aca6bc
0620 07:01:21.623447 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.623563 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1906680}
I20260620 07:01:21.627149 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1070) took 1875 ms. Trace:
I20260620 07:01:21.627357 1165 rpcz_store.cc:276] 0620 07:01:19.752076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.752170 (+ 94us) service_pool.cc:227] Handling call
0620 07:01:21.626999 (+1874829us) ts_tablet_manager.cc:1145] Deleting tablet 2feb83cb7d0b427eaa936f326f83aad0
0620 07:01:21.627014 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.627129 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1861848}
I20260620 07:01:21.627759 1165 tablet_replica.cc:330] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:21.628079 1165 raft_consensus.cc:2229] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.628538 1170 consensus_queue.cc:260] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.629176 1170 ts_tablet_manager.cc:1428] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260620 07:01:21.629539 1170 tablet_bootstrap.cc:492] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.631896 1170 tablet_bootstrap.cc:654] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.625960 2583 tablet.cc:1722] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:21.634023 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9d344f9e4b444e4b6018fdf0cf762fd" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:21.634732 681 leader_election.cc:341] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.636986 1165 raft_consensus.cc:2258] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.637691 1165 ts_tablet_manager.cc:1905] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.639083 1168 tablet_bootstrap.cc:492] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.640329 1168 ts_tablet_manager.cc:1397] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.082s user 0.000s sys 0.004s
I20260620 07:01:21.641130 1168 raft_consensus.cc:348] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.641501 1168 raft_consensus.cc:374] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.641593 1168 raft_consensus.cc:729] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:21.641685 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71b2d6ea3dab4bb8b544a59a5e433cdc already in progress: creating tablet
I20260620 07:01:21.641855 1168 consensus_queue.cc:260] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
W20260620 07:01:21.642081 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8c0b0969fb784dba96459ea441f88ae9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c0b0969fb784dba96459ea441f88ae9 already in progress: creating tablet
W20260620 07:01:21.642421 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 01b82aa3a0ba48f7bf61401713aca6bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01b82aa3a0ba48f7bf61401713aca6bc already in progress: creating tablet
I20260620 07:01:21.642477 1168 ts_tablet_manager.cc:1428] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260620 07:01:21.642719 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2feb83cb7d0b427eaa936f326f83aad0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2feb83cb7d0b427eaa936f326f83aad0 already in progress: creating tablet
I20260620 07:01:21.643857 1168 tablet_bootstrap.cc:492] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.645511 1168 tablet_bootstrap.cc:654] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.649510 1167 tablet_bootstrap.cc:492] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.649581 1165 ts_tablet_manager.cc:1918] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.649631 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f83dc03de5ad407b85daff91e19ff012
I20260620 07:01:21.650171 1167 ts_tablet_manager.cc:1397] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.000s
I20260620 07:01:21.650605 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet f83dc03de5ad407b85daff91e19ff012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.651499 1167 raft_consensus.cc:348] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.652426 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_088b8f1d026f4a638631c284a7c66e42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.652971 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_088b8f1d026f4a638631c284a7c66e42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.654057 1165 log.cc:1196] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/e6bae5090f81417cbcf4b4d598b438da
I20260620 07:01:21.654443 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_20896721839841d2bbf7bedd7d08b2c7" } new_table_name: "default.Table_b0a98e7f341240fc9ea439e7b2464285" modify_external_catalogs: true
I20260620 07:01:21.654858 1165 ts_tablet_manager.cc:1939] T e6bae5090f81417cbcf4b4d598b438da P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:21.655257 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_80767314891a4208af17029afa663aff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:21.655707 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1075) took 1803 ms. Trace:
W20260620 07:01:21.655758 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80767314891a4208af17029afa663aff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.655889 1165 rpcz_store.cc:276] 0620 07:01:19.851862 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.851924 (+ 62us) service_pool.cc:227] Handling call
0620 07:01:21.627709 (+1775785us) ts_tablet_manager.cc:1145] Deleting tablet e6bae5090f81417cbcf4b4d598b438da
0620 07:01:21.627722 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.646532 (+ 18810us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.649483 (+ 2951us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.655689 (+ 6206us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1775590}
I20260620 07:01:21.656524 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ad65565caddf4e878292d1178fbf6037
I20260620 07:01:21.656528 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1076) took 1772 ms. Trace:
I20260620 07:01:21.656710 1165 rpcz_store.cc:276] 0620 07:01:19.884373 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.884511 (+ 138us) service_pool.cc:227] Handling call
0620 07:01:21.656407 (+1771896us) ts_tablet_manager.cc:1145] Deleting tablet ef4e6fda73ba45c6892273b33b37a688
0620 07:01:21.656418 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.656514 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1771628}
I20260620 07:01:21.657214 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1079) took 1735 ms. Trace:
I20260620 07:01:21.657353 1165 rpcz_store.cc:276] 0620 07:01:19.921856 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.927183 (+ 5327us) service_pool.cc:227] Handling call
0620 07:01:21.657120 (+1729937us) ts_tablet_manager.cc:1145] Deleting tablet f96688ac7c91450cb34afd5f40b9826c
0620 07:01:21.657130 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.657201 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1729449}
I20260620 07:01:21.657760 1165 tablet_replica.cc:330] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:21.658027 1165 raft_consensus.cc:2229] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.658226 1165 raft_consensus.cc:2258] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.658838 1165 ts_tablet_manager.cc:1905] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.660576 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet e6bae5090f81417cbcf4b4d598b438da (table default.Table_2887bc68d41444e7a3da02fea7842d8d [id=e872cbca26c7448ea0b1e65fd692f96e]) successfully deleted
W20260620 07:01:21.660862 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ef4e6fda73ba45c6892273b33b37a688 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef4e6fda73ba45c6892273b33b37a688 already in progress: creating tablet
W20260620 07:01:21.661064 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f96688ac7c91450cb34afd5f40b9826c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96688ac7c91450cb34afd5f40b9826c already in progress: creating tablet
I20260620 07:01:21.661271 863 tablet_service.cc:1514] Processing DeleteTablet for tablet f83dc03de5ad407b85daff91e19ff012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:21.661500 867 tablet_service.cc:1514] Processing DeleteTablet for tablet ad65565caddf4e878292d1178fbf6037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:21.662117 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb29ab54c11a4ef98c67fad8e233e3c4 consensus state has no leader
I20260620 07:01:21.665367 1165 ts_tablet_manager.cc:1918] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:21.666510 683 consensus_peers.cc:487] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f9d7421b549468e8a7782f467473bdb. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:21.670347 1165 log.cc:1196] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/2bc3dd1306af4e49a9fec197b5740374
I20260620 07:01:21.670869 1165 ts_tablet_manager.cc:1939] T 2bc3dd1306af4e49a9fec197b5740374 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:21.671684 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1099) took 1483 ms. Trace:
I20260620 07:01:21.671829 1165 rpcz_store.cc:276] 0620 07:01:20.188405 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.189529 (+ 1124us) service_pool.cc:227] Handling call
0620 07:01:21.657722 (+1468193us) ts_tablet_manager.cc:1145] Deleting tablet 2bc3dd1306af4e49a9fec197b5740374
0620 07:01:21.657732 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.662419 (+ 4687us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.665263 (+ 2844us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.671663 (+ 6400us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1467967}
I20260620 07:01:21.672408 1165 tablet_replica.cc:330] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:21.672634 1165 raft_consensus.cc:2229] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.672835 1165 raft_consensus.cc:2258] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.673403 1165 ts_tablet_manager.cc:1905] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.674979 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 2bc3dd1306af4e49a9fec197b5740374 (table default.Table_49d850227cc94454b2919e6c54793f35 [id=501af04cab4f4a0da5d8396e8f629397]) successfully deleted
W20260620 07:01:21.677860 683 leader_election.cc:341] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c9d344f9e4b444e4b6018fdf0cf762fd
I20260620 07:01:21.678092 683 leader_election.cc:302] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.678398 2564 raft_consensus.cc:2726] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.681228 2583 tablet.cc:1722] T a9e70b585def4a4a9081a0938af8ce5b P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:21.682363 1168 tablet_bootstrap.cc:492] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.682533 1168 ts_tablet_manager.cc:1397] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.003s
I20260620 07:01:21.683607 1168 raft_consensus.cc:348] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.683956 1168 raft_consensus.cc:374] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.684026 1168 raft_consensus.cc:729] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.684271 1168 consensus_queue.cc:260] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.685042 1168 ts_tablet_manager.cc:1428] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260620 07:01:21.687546 1167 raft_consensus.cc:374] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.687675 1167 raft_consensus.cc:729] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.687971 1167 consensus_queue.cc:260] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.656256 1166 tablet_replica.cc:330] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.657240 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet ad65565caddf4e878292d1178fbf6037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.680363 2544 raft_consensus.cc:482] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.688689 2569 raft_consensus.cc:686] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [term 2 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:21.688603 2544 raft_consensus.cc:504] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.688946 2569 consensus_queue.cc:237] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.689246 2544 leader_election.cc:288] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:21.688599 1166 raft_consensus.cc:2229] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.689776 1166 raft_consensus.cc:2258] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.690503 1166 ts_tablet_manager.cc:1905] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:21.690828 968 leader_election.cc:341] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 7cf81c5c0d9744f5a8c3f0866a435ae3
I20260620 07:01:21.677834 2566 leader_election.cc:288] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.701699 2590 tablet.cc:1722] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260620 07:01:21.704416 969 leader_election.cc:341] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7cf81c5c0d9744f5a8c3f0866a435ae3
I20260620 07:01:21.704571 969 leader_election.cc:302] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.705163 2544 raft_consensus.cc:2726] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.705896 1168 tablet_bootstrap.cc:492] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.712785 1166 ts_tablet_manager.cc:1918] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:21.713021 1166 log.cc:1196] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/3f9d7421b549468e8a7782f467473bdb
I20260620 07:01:21.713321 1168 tablet_bootstrap.cc:654] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.713869 1166 ts_tablet_manager.cc:1939] T 3f9d7421b549468e8a7782f467473bdb P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.716853 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb with delete_type TABLET_DATA_DELETED (replaced by tablet 9cebdd8c947845528affd32316d9b336) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:21.717391 1167 ts_tablet_manager.cc:1428] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.067s user 0.000s sys 0.003s
I20260620 07:01:21.719031 1167 tablet_bootstrap.cc:492] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.720299 1165 ts_tablet_manager.cc:1918] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.721138 1167 tablet_bootstrap.cc:654] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.721335 1165 log.cc:1196] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/91f8c4955c164e6b9061ac607bbe081c
I20260620 07:01:21.723394 1165 ts_tablet_manager.cc:1939] T 91f8c4955c164e6b9061ac607bbe081c P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:21.723742 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1017) took 2257 ms. Trace:
I20260620 07:01:21.723850 1166 rpcz_store.cc:276] 0620 07:01:19.466175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.466229 (+ 54us) service_pool.cc:227] Handling call
0620 07:01:21.656205 (+2189976us) ts_tablet_manager.cc:1145] Deleting tablet 3f9d7421b549468e8a7782f467473bdb
0620 07:01:21.656218 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.693935 (+ 37717us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.698715 (+ 4780us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.723717 (+ 25002us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2189787}
I20260620 07:01:21.724351 1170 tablet_bootstrap.cc:492] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.724305 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 3f9d7421b549468e8a7782f467473bdb (table default.Table_14c9ff1d977443ba914900cfb627c5e7 [id=471f2077c52c4990a4c8b7eb8879d92e]) successfully deleted
I20260620 07:01:21.724535 1170 ts_tablet_manager.cc:1397] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.095s user 0.006s sys 0.006s
I20260620 07:01:21.725036 1166 tablet_replica.cc:330] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.725188 1170 raft_consensus.cc:348] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.725239 1166 raft_consensus.cc:2229] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.725479 1170 raft_consensus.cc:374] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.725497 1166 raft_consensus.cc:2258] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.725593 1170 raft_consensus.cc:729] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.725806 1170 consensus_queue.cc:260] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.725994 1166 ts_tablet_manager.cc:1905] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.726380 1170 ts_tablet_manager.cc:1428] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:21.726652 1170 tablet_bootstrap.cc:492] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.728096 1170 tablet_bootstrap.cc:654] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.729173 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1100) took 1532 ms. Trace:
I20260620 07:01:21.731519 1165 rpcz_store.cc:276] 0620 07:01:20.196492 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.196569 (+ 77us) service_pool.cc:227] Handling call
0620 07:01:21.672363 (+1475794us) ts_tablet_manager.cc:1145] Deleting tablet 91f8c4955c164e6b9061ac607bbe081c
0620 07:01:21.672373 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.676778 (+ 4405us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.720173 (+ 43395us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.729149 (+ 8976us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1475569}
I20260620 07:01:21.732133 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1101) took 1523 ms. Trace:
I20260620 07:01:21.732115 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 91f8c4955c164e6b9061ac607bbe081c (table default.Table_95bf37d6a97f41a5ba9d681d07d75283 [id=ceb3d35427694e1099764949625fac6f]) successfully deleted
I20260620 07:01:21.732357 1165 rpcz_store.cc:276] 0620 07:01:20.208912 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.209095 (+ 183us) service_pool.cc:227] Handling call
0620 07:01:21.732000 (+1522905us) ts_tablet_manager.cc:1145] Deleting tablet ca86563e5b014bb88ccb74c628670c46
0620 07:01:21.732013 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.732117 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1522668}
I20260620 07:01:21.723694 2584 tablet.cc:1722] T a9e70b585def4a4a9081a0938af8ce5b P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260620 07:01:21.732796 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ca86563e5b014bb88ccb74c628670c46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca86563e5b014bb88ccb74c628670c46 already in progress: creating tablet
I20260620 07:01:21.734398 1165 tablet_replica.cc:330] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:21.734647 1165 raft_consensus.cc:2229] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.734894 1165 raft_consensus.cc:2258] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.735541 1165 ts_tablet_manager.cc:1905] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.738236 1169 ts_tablet_manager.cc:1918] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:21.738381 1169 log.cc:1196] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/704e8aaabe6d40138b6611bdc30abf16
I20260620 07:01:21.746022 418 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:21.747750 1168 tablet_bootstrap.cc:492] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.747689 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 95a109e7871241ec9467858dca467bbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.748027 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 6229a52adf8d4b17bdf89347e01621ed with delete_type TABLET_DATA_DELETED (replaced by tablet 883d1959ed484c58935db467aa2dc50a) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.748208 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e with delete_type TABLET_DATA_DELETED (replaced by tablet 74eaa712962245b4bb14d17e4cdd8485) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.748344 1168 ts_tablet_manager.cc:1397] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20260620 07:01:21.749114 1168 raft_consensus.cc:348] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.749670 1168 raft_consensus.cc:374] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.749785 1168 raft_consensus.cc:729] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:21.750169 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b45d144514134cb6a644087e62c436e3 consensus state has no leader
I20260620 07:01:21.750530 1167 tablet_bootstrap.cc:492] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.751173 1170 tablet_bootstrap.cc:492] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.751322 1170 ts_tablet_manager.cc:1397] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260620 07:01:21.752072 1170 raft_consensus.cc:348] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.752266 1170 raft_consensus.cc:374] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.752323 1170 raft_consensus.cc:729] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.752491 1167 ts_tablet_manager.cc:1397] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.001s
I20260620 07:01:21.752497 1170 consensus_queue.cc:260] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.753044 1170 ts_tablet_manager.cc:1428] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:21.753300 1170 tablet_bootstrap.cc:492] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.754696 1170 tablet_bootstrap.cc:654] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.754935 1168 consensus_queue.cc:260] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.755631 1168 ts_tablet_manager.cc:1428] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260620 07:01:21.755566 1167 raft_consensus.cc:348] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.758324 1167 raft_consensus.cc:374] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.758529 1165 ts_tablet_manager.cc:1918] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.758679 1165 log.cc:1196] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/877a71e8db5f4bf689df39f83735f326
I20260620 07:01:21.758857 1168 tablet_bootstrap.cc:492] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.760300 1167 raft_consensus.cc:729] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.760433 1168 tablet_bootstrap.cc:654] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.756996 2531 raft_consensus.cc:482] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.760775 2531 raft_consensus.cc:504] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.768368 1166 ts_tablet_manager.cc:1918] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.761257 1167 consensus_queue.cc:260] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.768975 1165 ts_tablet_manager.cc:1939] T 877a71e8db5f4bf689df39f83735f326 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:21.769167 1167 ts_tablet_manager.cc:1428] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260620 07:01:21.738735 1169 ts_tablet_manager.cc:1939] T 704e8aaabe6d40138b6611bdc30abf16 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:21.769500 1167 tablet_bootstrap.cc:492] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.770138 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1007) took 3360 ms. Trace:
I20260620 07:01:21.770243 1169 rpcz_store.cc:276] 0620 07:01:18.410139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.410412 (+ 273us) service_pool.cc:227] Handling call
0620 07:01:21.563321 (+3152909us) ts_tablet_manager.cc:1145] Deleting tablet 704e8aaabe6d40138b6611bdc30abf16
0620 07:01:21.563330 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.583165 (+ 19835us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.738132 (+154967us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.770089 (+ 31957us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3152539}
I20260620 07:01:21.770813 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1016) took 3126 ms. Trace:
I20260620 07:01:21.770905 1169 rpcz_store.cc:276] 0620 07:01:18.644088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.644161 (+ 73us) service_pool.cc:227] Handling call
0620 07:01:21.770662 (+3126501us) ts_tablet_manager.cc:1145] Deleting tablet 2d1bad6b34f14270a060ce7245ff0c0f
0620 07:01:21.770673 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.770774 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3126205}
W20260620 07:01:21.771144 968 leader_election.cc:341] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 864c95b908674e4f8425d765444c281b
I20260620 07:01:21.771209 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1102) took 1394 ms. Trace:
I20260620 07:01:21.771219 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1022) took 3120 ms. Trace:
I20260620 07:01:21.771297 1169 rpcz_store.cc:276] 0620 07:01:18.650758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:18.650828 (+ 70us) service_pool.cc:227] Handling call
0620 07:01:21.771122 (+3120294us) ts_tablet_manager.cc:1145] Deleting tablet 8dad7e6437ab4328b9b88d5e6febe8a0
0620 07:01:21.771133 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.771205 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3120138}
I20260620 07:01:21.771538 1169 tablet_replica.cc:330] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:21.771288 1165 rpcz_store.cc:276] 0620 07:01:20.376377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.376658 (+ 281us) service_pool.cc:227] Handling call
0620 07:01:21.732774 (+1356116us) ts_tablet_manager.cc:1145] Deleting tablet 877a71e8db5f4bf689df39f83735f326
0620 07:01:21.732870 (+ 96us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.750669 (+ 17799us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.758429 (+ 7760us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.771187 (+ 12758us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1355906}
I20260620 07:01:21.771749 1169 raft_consensus.cc:2229] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.771759 2531 leader_election.cc:288] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:21.771942 1169 raft_consensus.cc:2258] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.772533 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1103) took 1396 ms. Trace:
I20260620 07:01:21.768501 1166 log.cc:1196] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/a9daee42d5c748ceaed7dc94f551c0d1
I20260620 07:01:21.773180 1166 ts_tablet_manager.cc:1939] T a9daee42d5c748ceaed7dc94f551c0d1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.773499 1165 rpcz_store.cc:276] 0620 07:01:20.376502 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.416322 (+ 39820us) service_pool.cc:227] Handling call
0620 07:01:21.772405 (+1356083us) ts_tablet_manager.cc:1145] Deleting tablet b2f5c0f1c20f46b7b62fccea47f857d9
0620 07:01:21.772417 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.772514 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1355774}
I20260620 07:01:21.774008 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 877a71e8db5f4bf689df39f83735f326 (table default.Table_890aba75c15e4e5990b4c0cae43dd28e [id=a302748f0b1e46209ebe7622280629a5]) successfully deleted
W20260620 07:01:21.774291 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b2f5c0f1c20f46b7b62fccea47f857d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2f5c0f1c20f46b7b62fccea47f857d9 already in progress: creating tablet
I20260620 07:01:21.775187 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1018) took 2109 ms. Trace:
I20260620 07:01:21.775488 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1104) took 1398 ms. Trace:
I20260620 07:01:21.775707 1165 rpcz_store.cc:276] 0620 07:01:20.376613 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.416668 (+ 40055us) service_pool.cc:227] Handling call
0620 07:01:21.774279 (+1357611us) ts_tablet_manager.cc:1145] Deleting tablet 5773d09ad37c45198d62886624c87eea
0620 07:01:21.774291 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.775471 (+ 1180us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1357359}
W20260620 07:01:21.776297 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5773d09ad37c45198d62886624c87eea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5773d09ad37c45198d62886624c87eea already in progress: creating tablet
I20260620 07:01:21.776396 1169 ts_tablet_manager.cc:1905] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.776621 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1109) took 1259 ms. Trace:
I20260620 07:01:21.776909 1168 tablet_bootstrap.cc:492] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.777081 1168 ts_tablet_manager.cc:1397] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260620 07:01:21.776840 1165 rpcz_store.cc:276] 0620 07:01:20.517571 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.528666 (+ 11095us) service_pool.cc:227] Handling call
0620 07:01:21.776321 (+1247655us) ts_tablet_manager.cc:1145] Deleting tablet 31c56e80a73c442aa3cc65126a76c8be
0620 07:01:21.776330 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.776605 (+ 275us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1247367}
W20260620 07:01:21.777436 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 31c56e80a73c442aa3cc65126a76c8be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31c56e80a73c442aa3cc65126a76c8be already in progress: creating tablet
I20260620 07:01:21.777755 1165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1105) took 1260 ms. Trace:
I20260620 07:01:21.777393 1166 rpcz_store.cc:276] 0620 07:01:19.666211 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.666265 (+ 54us) service_pool.cc:227] Handling call
0620 07:01:21.724987 (+2058722us) ts_tablet_manager.cc:1145] Deleting tablet a9daee42d5c748ceaed7dc94f551c0d1
0620 07:01:21.724999 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.729104 (+ 4105us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.768261 (+ 39157us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.775168 (+ 6907us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2058544}
I20260620 07:01:21.778280 1166 tablet_replica.cc:330] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.778110 1168 raft_consensus.cc:348] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.778802 1168 raft_consensus.cc:374] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.778692 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6199c2fbd7fe41bf929440f2927e709a" } modify_external_catalogs: true
I20260620 07:01:21.778924 1168 raft_consensus.cc:729] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.778931 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6199c2fbd7fe41bf929440f2927e709a" } modify_external_catalogs: true
I20260620 07:01:21.779273 1168 consensus_queue.cc:260] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
W20260620 07:01:21.779773 969 leader_election.cc:341] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 864c95b908674e4f8425d765444c281b
I20260620 07:01:21.779996 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet a9daee42d5c748ceaed7dc94f551c0d1 (table default.Table_659d4f17a45b47f5a065e40e30ab00b7 [id=88c48077ab69456c9d5241e3cd750089]) successfully deleted
I20260620 07:01:21.779861 1166 raft_consensus.cc:2229] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.779891 969 leader_election.cc:302] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.780980 2592 raft_consensus.cc:2726] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.778455 1165 rpcz_store.cc:276] 0620 07:01:20.517159 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.543206 (+ 26047us) service_pool.cc:227] Handling call
0620 07:01:21.777664 (+1234458us) ts_tablet_manager.cc:1145] Deleting tablet 1e3d4ea81afe43a2a6101e21cbd08f97
0620 07:01:21.777673 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.777740 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1234118}
I20260620 07:01:21.781723 1170 tablet_bootstrap.cc:492] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.781864 1170 ts_tablet_manager.cc:1397] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
W20260620 07:01:21.782099 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1e3d4ea81afe43a2a6101e21cbd08f97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e3d4ea81afe43a2a6101e21cbd08f97 already in progress: creating tablet
W20260620 07:01:21.782439 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7a024765ed144281a81db3b75cd271bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a024765ed144281a81db3b75cd271bf already in progress: creating tablet
I20260620 07:01:21.782694 1170 raft_consensus.cc:348] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.782950 1170 raft_consensus.cc:374] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.783023 1170 raft_consensus.cc:729] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.783419 720 tablet_service.cc:1514] Processing DeleteTablet for tablet b99781ba1ed44f6895af7da082618616 with delete_type TABLET_DATA_DELETED (replaced by tablet 778bd8bda6b3447eb94154d53e7bfa67) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.783615 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 14bbd042527e4f55aec6fbd996b132aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.783211 1170 consensus_queue.cc:260] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.786098 1170 ts_tablet_manager.cc:1428] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260620 07:01:21.786294 1168 ts_tablet_manager.cc:1428] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260620 07:01:21.786376 1170 tablet_bootstrap.cc:492] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.786556 1168 tablet_bootstrap.cc:492] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.786582 2566 raft_consensus.cc:482] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.780241 1166 raft_consensus.cc:2258] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.786827 2566 raft_consensus.cc:504] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:21.787755 1166 ts_tablet_manager.cc:1905] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.787804 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0bae39e1634710af12de493f7f58d5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:21.788259 681 leader_election.cc:341] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:21.788707 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3ebca13b8fb646778c1e8b9db404904f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ebca13b8fb646778c1e8b9db404904f already in progress: creating tablet
I20260620 07:01:21.791604 2566 leader_election.cc:288] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:21.792850 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 already in progress: creating tablet
I20260620 07:01:21.793947 720 tablet_service.cc:1514] Processing DeleteTablet for tablet f83dc03de5ad407b85daff91e19ff012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:21.794004 683 leader_election.cc:341] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cf0bae39e1634710af12de493f7f58d5
I20260620 07:01:21.794126 683 leader_election.cc:302] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.794405 2581 raft_consensus.cc:2726] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.794916 720 tablet_service.cc:1514] Processing DeleteTablet for tablet ad65565caddf4e878292d1178fbf6037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:21.796396 1170 tablet_bootstrap.cc:654] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.796698 1165 tablet_replica.cc:330] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:21.796913 1165 raft_consensus.cc:2229] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.797080 1165 raft_consensus.cc:2258] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:21.797382 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 633f3666050846dc9fc59a365110406d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 633f3666050846dc9fc59a365110406d already in progress: creating tablet
I20260620 07:01:21.797602 1165 ts_tablet_manager.cc:1905] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.802416 1169 ts_tablet_manager.cc:1918] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:21.802565 1169 log.cc:1196] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f8be5f41f1d64d918b727e3eef18738e
I20260620 07:01:21.803825 1170 tablet_bootstrap.cc:492] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.803982 1170 ts_tablet_manager.cc:1397] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260620 07:01:21.804255 1168 tablet_bootstrap.cc:654] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.804708 1170 raft_consensus.cc:348] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.804895 1170 raft_consensus.cc:374] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.804937 1170 raft_consensus.cc:729] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.805099 1170 consensus_queue.cc:260] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.805608 1170 ts_tablet_manager.cc:1428] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:21.805851 1170 tablet_bootstrap.cc:492] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.807622 1170 tablet_bootstrap.cc:654] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.808553 1169 ts_tablet_manager.cc:1939] T f8be5f41f1d64d918b727e3eef18738e P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:21.809368 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1043) took 2503 ms. Trace:
I20260620 07:01:21.809455 1169 rpcz_store.cc:276] 0620 07:01:19.306405 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.307967 (+ 1562us) service_pool.cc:227] Handling call
0620 07:01:21.771497 (+2463530us) ts_tablet_manager.cc:1145] Deleting tablet f8be5f41f1d64d918b727e3eef18738e
0620 07:01:21.771505 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.798364 (+ 26859us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.802296 (+ 3932us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.809345 (+ 7049us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2463323}
I20260620 07:01:21.809834 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1044) took 2453 ms. Trace:
I20260620 07:01:21.809913 1169 rpcz_store.cc:276] 0620 07:01:19.356308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.356371 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:21.809710 (+2453339us) ts_tablet_manager.cc:1145] Deleting tablet f0876d36e48a4d7fa78a1448fbeee4c2
0620 07:01:21.809722 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.809818 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2453120}
I20260620 07:01:21.810191 1169 tablet_replica.cc:330] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:21.810415 1169 raft_consensus.cc:2229] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.810588 1169 raft_consensus.cc:2258] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.812366 1167 tablet_bootstrap.cc:654] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.815121 1169 ts_tablet_manager.cc:1905] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.818357 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_248c3ae009f44b5cbe214d7139e363ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.819018 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_248c3ae009f44b5cbe214d7139e363ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.820910 1170 tablet_bootstrap.cc:492] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.821051 1170 ts_tablet_manager.cc:1397] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.002s
I20260620 07:01:21.821786 1170 raft_consensus.cc:348] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.822002 1170 raft_consensus.cc:374] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.822060 1170 raft_consensus.cc:729] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.822245 1170 consensus_queue.cc:260] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.822824 1170 ts_tablet_manager.cc:1428] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:21.823110 2584 tablet.cc:1722] T 97e01aa120cc4c189017236ad57de811 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:21.823623 1170 tablet_bootstrap.cc:492] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.823820 1165 ts_tablet_manager.cc:1918] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.821671 1166 ts_tablet_manager.cc:1918] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.824734 1166 log.cc:1196] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/fe3b70b1674e43768b29dea84b09a1a0
I20260620 07:01:21.825169 1170 tablet_bootstrap.cc:654] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.825564 1166 ts_tablet_manager.cc:1939] T fe3b70b1674e43768b29dea84b09a1a0 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.825817 1165 log.cc:1196] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/af743ffd2eb2427caa3779c7fceb8f30
I20260620 07:01:21.826267 2589 tablet.cc:1722] T 97e01aa120cc4c189017236ad57de811 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:21.826745 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1019) took 2140 ms. Trace:
I20260620 07:01:21.826889 1166 rpcz_store.cc:276] 0620 07:01:19.686273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.686324 (+ 51us) service_pool.cc:227] Handling call
0620 07:01:21.778239 (+2091915us) ts_tablet_manager.cc:1145] Deleting tablet fe3b70b1674e43768b29dea84b09a1a0
0620 07:01:21.778250 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.813239 (+ 34989us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.821565 (+ 8326us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.826724 (+ 5159us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2091685}
I20260620 07:01:21.827442 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet fe3b70b1674e43768b29dea84b09a1a0 (table default.Table_ec98cedea527437ebc2237e75dcc45ec [id=55c4c9a5f69b4cf7bb05ce4157f8a5e8]) successfully deleted
I20260620 07:01:21.828372 1165 ts_tablet_manager.cc:1939] T af743ffd2eb2427caa3779c7fceb8f30 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:21.829523 1167 tablet_bootstrap.cc:492] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.829702 1167 ts_tablet_manager.cc:1397] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.005s
I20260620 07:01:21.830441 1167 raft_consensus.cc:348] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.830718 1167 raft_consensus.cc:374] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.830853 1167 raft_consensus.cc:729] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.831154 1167 consensus_queue.cc:260] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.832242 1167 ts_tablet_manager.cc:1428] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:21.832558 1167 tablet_bootstrap.cc:492] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.833132 1168 tablet_bootstrap.cc:492] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.835304 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1020) took 2137 ms. Trace:
I20260620 07:01:21.835402 1166 rpcz_store.cc:276] 0620 07:01:19.697431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.697812 (+ 381us) service_pool.cc:227] Handling call
0620 07:01:21.835174 (+2137362us) ts_tablet_manager.cc:1145] Deleting tablet 728e7997b9e442669f9b5bda602311ce
0620 07:01:21.835186 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.835286 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2137166}
I20260620 07:01:21.835527 1168 ts_tablet_manager.cc:1397] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.002s
W20260620 07:01:21.835867 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 728e7997b9e442669f9b5bda602311ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 728e7997b9e442669f9b5bda602311ce already in progress: creating tablet
I20260620 07:01:21.836220 1168 raft_consensus.cc:348] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.837348 1167 tablet_bootstrap.cc:654] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.837502 1169 ts_tablet_manager.cc:1918] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.837613 1169 log.cc:1196] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/3456cf91d65a4413a35efe94513c723d
I20260620 07:01:21.837883 1169 ts_tablet_manager.cc:1939] T 3456cf91d65a4413a35efe94513c723d P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:21.838101 1165 tablet_replica.cc:330] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:21.838125 1168 raft_consensus.cc:374] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.838194 1168 raft_consensus.cc:729] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.838402 1168 consensus_queue.cc:260] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.838920 1168 ts_tablet_manager.cc:1428] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260620 07:01:21.838285 1165 raft_consensus.cc:2229] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.839612 1165 raft_consensus.cc:2258] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.839932 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet af743ffd2eb2427caa3779c7fceb8f30 (table default.Table_16bc98530ef6482fbf02e2aa78c0ea47 [id=26c4b0db3c984eb8a79d9aa31548a229]) successfully deleted
W20260620 07:01:21.840175 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b53304f072cb4a00a17de5df6f59168b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b53304f072cb4a00a17de5df6f59168b already in progress: creating tablet
W20260620 07:01:21.840314 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b99781ba1ed44f6895af7da082618616 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b99781ba1ed44f6895af7da082618616 already in progress: creating tablet
W20260620 07:01:21.840478 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 14bbd042527e4f55aec6fbd996b132aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14bbd042527e4f55aec6fbd996b132aa already in progress: creating tablet
I20260620 07:01:21.843029 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c8b01cca92cd4368b795c93728945929" } new_table_name: "default.Table_f886739768844a4e9c7ab5e15353f524" modify_external_catalogs: true
I20260620 07:01:21.844723 1170 tablet_bootstrap.cc:492] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.844861 1170 ts_tablet_manager.cc:1397] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20260620 07:01:21.845589 1170 raft_consensus.cc:348] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.845788 1170 raft_consensus.cc:374] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.845842 1170 raft_consensus.cc:729] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.846016 1170 consensus_queue.cc:260] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.846508 1170 ts_tablet_manager.cc:1428] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:21.837455 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1021) took 2137 ms. Trace:
I20260620 07:01:21.847189 1166 rpcz_store.cc:276] 0620 07:01:19.700368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.700422 (+ 54us) service_pool.cc:227] Handling call
0620 07:01:21.837340 (+2136918us) ts_tablet_manager.cc:1145] Deleting tablet 71b2d6ea3dab4bb8b544a59a5e433cdc
0620 07:01:21.837350 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.837438 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2136740}
W20260620 07:01:21.847687 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71b2d6ea3dab4bb8b544a59a5e433cdc already in progress: creating tablet
I20260620 07:01:21.848727 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3d77765908684704b05388a22b1eece9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:21.849171 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1022) took 2137 ms. Trace:
W20260620 07:01:21.849294 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d77765908684704b05388a22b1eece9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.849262 1166 rpcz_store.cc:276] 0620 07:01:19.711035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.711129 (+ 94us) service_pool.cc:227] Handling call
0620 07:01:21.848805 (+2137676us) ts_tablet_manager.cc:1145] Deleting tablet 8c0b0969fb784dba96459ea441f88ae9
0620 07:01:21.848816 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.848913 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2137473}
W20260620 07:01:21.849680 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8c0b0969fb784dba96459ea441f88ae9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c0b0969fb784dba96459ea441f88ae9 already in progress: creating tablet
I20260620 07:01:21.850081 1168 tablet_bootstrap.cc:492] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.851575 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1023) took 2135 ms. Trace:
I20260620 07:01:21.851680 1166 rpcz_store.cc:276] 0620 07:01:19.716494 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.716810 (+ 316us) service_pool.cc:227] Handling call
0620 07:01:21.851447 (+2134637us) ts_tablet_manager.cc:1145] Deleting tablet 01b82aa3a0ba48f7bf61401713aca6bc
0620 07:01:21.851460 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.851555 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2134367}
I20260620 07:01:21.852211 1165 ts_tablet_manager.cc:1905] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:21.852183 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 01b82aa3a0ba48f7bf61401713aca6bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01b82aa3a0ba48f7bf61401713aca6bc already in progress: creating tablet
I20260620 07:01:21.852614 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2c521985be09401e89a3b7a3c3c6bb22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:21.853166 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c521985be09401e89a3b7a3c3c6bb22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:21.854158 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1025) took 2102 ms. Trace:
I20260620 07:01:21.855324 1168 tablet_bootstrap.cc:654] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.854251 1166 rpcz_store.cc:276] 0620 07:01:19.752067 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.752164 (+ 97us) service_pool.cc:227] Handling call
0620 07:01:21.854017 (+2101853us) ts_tablet_manager.cc:1145] Deleting tablet 2feb83cb7d0b427eaa936f326f83aad0
0620 07:01:21.854036 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.854138 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2101635}
W20260620 07:01:21.856565 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2feb83cb7d0b427eaa936f326f83aad0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2feb83cb7d0b427eaa936f326f83aad0 already in progress: creating tablet
I20260620 07:01:21.859122 1166 tablet_replica.cc:330] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.859587 1166 raft_consensus.cc:2229] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.860076 1166 raft_consensus.cc:2258] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.861030 1166 ts_tablet_manager.cc:1905] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.863219 1168 tablet_bootstrap.cc:492] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.863817 1168 ts_tablet_manager.cc:1397] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260620 07:01:21.864705 1168 raft_consensus.cc:348] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.868005 1166 ts_tablet_manager.cc:1918] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.868156 1166 log.cc:1196] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/54bb495eea4c49b7ad7bf2300ad0e60a
I20260620 07:01:21.868568 1166 ts_tablet_manager.cc:1939] T 54bb495eea4c49b7ad7bf2300ad0e60a P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.869030 1168 raft_consensus.cc:374] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.869333 1168 raft_consensus.cc:729] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.869843 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_72d11279e6754a32aadd5966adbb5aaf" } modify_external_catalogs: true
I20260620 07:01:21.869740 1168 consensus_queue.cc:260] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.870095 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_72d11279e6754a32aadd5966adbb5aaf" } modify_external_catalogs: true
I20260620 07:01:21.870957 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_97e6f2abc164418f8571bab6b7db96e3" } modify_external_catalogs: true
I20260620 07:01:21.871225 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_97e6f2abc164418f8571bab6b7db96e3" } modify_external_catalogs: true
I20260620 07:01:21.874336 1168 ts_tablet_manager.cc:1428] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260620 07:01:21.874910 1168 tablet_bootstrap.cc:492] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.876413 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1026) took 2092 ms. Trace:
I20260620 07:01:21.867930 1165 ts_tablet_manager.cc:1918] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.876523 1166 rpcz_store.cc:276] 0620 07:01:19.783813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.783876 (+ 63us) service_pool.cc:227] Handling call
0620 07:01:21.859069 (+2075193us) ts_tablet_manager.cc:1145] Deleting tablet 54bb495eea4c49b7ad7bf2300ad0e60a
0620 07:01:21.859080 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.865124 (+ 6044us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.867927 (+ 2803us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.876379 (+ 8452us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2074963}
I20260620 07:01:21.876785 1165 log.cc:1196] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/88c01c4e10f345fc84e3e253e8501aff
I20260620 07:01:21.877002 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 54bb495eea4c49b7ad7bf2300ad0e60a (table default.Table_9ac3d44fdcc34f1eafc2bae7f184dfd0 [id=2b09808e1cf44c2c8a03ba6f69e8416a]) successfully deleted
I20260620 07:01:21.877198 1165 ts_tablet_manager.cc:1939] T 88c01c4e10f345fc84e3e253e8501aff P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:21.877502 2589 tablet.cc:1722] T 134f76587b6147afaf4e94fde5574efc P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:21.878465 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1031) took 2023 ms. Trace:
I20260620 07:01:21.878551 1166 rpcz_store.cc:276] 0620 07:01:19.855207 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.855291 (+ 84us) service_pool.cc:227] Handling call
0620 07:01:21.878342 (+2023051us) ts_tablet_manager.cc:1145] Deleting tablet e6bae5090f81417cbcf4b4d598b438da
0620 07:01:21.878352 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.878451 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2022858}
W20260620 07:01:21.879004 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet e6bae5090f81417cbcf4b4d598b438da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bae5090f81417cbcf4b4d598b438da already in progress: creating tablet
I20260620 07:01:21.879359 2612 tablet.cc:1722] T 134f76587b6147afaf4e94fde5574efc P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:21.880357 420 catalog_manager.cc:5495] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:21.880889 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 302adda3630e44289d371de591061692 (table default.Table_443cffc65b664caf91066d86837262e1 [id=92e4f74224ab4135982722f846eb9e73]). Expected version 3 got 0
I20260620 07:01:21.881227 420 catalog_manager.cc:5495] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:21.881590 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]). Expected version 1 got 0
I20260620 07:01:21.882146 1165 tablet_replica.cc:330] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:21.882328 1165 raft_consensus.cc:2229] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.882462 1165 raft_consensus.cc:2258] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.882608 1168 tablet_bootstrap.cc:654] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.883862 1165 ts_tablet_manager.cc:1905] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.884640 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 88c01c4e10f345fc84e3e253e8501aff (table default.Table_1e18ab4a35f347abb061df0a7db49226 [id=3234298ef6b649e78f3c7c7c61facd36]) successfully deleted
I20260620 07:01:21.885028 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 20781385be4d4c6aa278554faf9d15df (DEFAULT_TABLE table=default.Table_1ddd2a4884e54fd28958caa1ff0cbee9 [id=774557dc49794170a33b7a96f79cd2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.885470 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20781385be4d4c6aa278554faf9d15df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.887187 1010 tablet_service.cc:1467] Processing CreateTablet for tablet e24e56dfc05d4632a8f54fcfde37ac0f (DEFAULT_TABLE table=default.Table_b77f861dcbb84f6dac56b5be789a7553 [id=670fb7d8dc2a4cd38bb28a024cccc135]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.887588 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e24e56dfc05d4632a8f54fcfde37ac0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.891170 867 tablet_service.cc:1467] Processing CreateTablet for tablet 20781385be4d4c6aa278554faf9d15df (DEFAULT_TABLE table=default.Table_1ddd2a4884e54fd28958caa1ff0cbee9 [id=774557dc49794170a33b7a96f79cd2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.891571 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20781385be4d4c6aa278554faf9d15df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.895062 994 tablet_service.cc:1467] Processing CreateTablet for tablet 0960f88ebd0f46bc806ba313c52fa782 (DEFAULT_TABLE table=default.Table_285bef485f9245a9af76437cdd971673 [id=b83855bc093749d0ba0950b93b325085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.895469 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0960f88ebd0f46bc806ba313c52fa782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.895860 1007 tablet_service.cc:1467] Processing CreateTablet for tablet a31a321d64d04c6d875b5295bbeb9d51 (DEFAULT_TABLE table=default.Table_bb68c71e75fa4c80b07fee25fa7a1578 [id=fbb840a10203442096b95c85a07979dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.896220 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a31a321d64d04c6d875b5295bbeb9d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.898077 2564 raft_consensus.cc:482] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.898223 2564 raft_consensus.cc:504] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.899060 1001 tablet_service.cc:1467] Processing CreateTablet for tablet e28974261e7f4c67afafca0273238d96 (DEFAULT_TABLE table=default.Table_d77be1066b784bc0a04db10d6ddd1483 [id=4894b99d2cc34842be34fa0cfd1184c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.899449 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91f8c4955c164e6b9061ac607bbe081c" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:21.899857 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:21.900117 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 333eef8b98da4a279acceaead9405149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:00:59 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:21.900115 681 leader_election.cc:341] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.900256 2564 leader_election.cc:288] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:21.901064 861 tablet_service.cc:1467] Processing CreateTablet for tablet e24e56dfc05d4632a8f54fcfde37ac0f (DEFAULT_TABLE table=default.Table_b77f861dcbb84f6dac56b5be789a7553 [id=670fb7d8dc2a4cd38bb28a024cccc135]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.901329 863 tablet_service.cc:1467] Processing CreateTablet for tablet e28974261e7f4c67afafca0273238d96 (DEFAULT_TABLE table=default.Table_d77be1066b784bc0a04db10d6ddd1483 [id=4894b99d2cc34842be34fa0cfd1184c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.901453 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e24e56dfc05d4632a8f54fcfde37ac0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.901634 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e28974261e7f4c67afafca0273238d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.904911 2366 raft_consensus.cc:482] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.905030 857 tablet_service.cc:1467] Processing CreateTablet for tablet 0960f88ebd0f46bc806ba313c52fa782 (DEFAULT_TABLE table=default.Table_285bef485f9245a9af76437cdd971673 [id=b83855bc093749d0ba0950b93b325085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.905059 2366 raft_consensus.cc:504] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.905388 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0960f88ebd0f46bc806ba313c52fa782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.905761 2366 leader_election.cc:288] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:21.899430 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e28974261e7f4c67afafca0273238d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.906469 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4b81f2b92f4363829034d3fe290742" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:21.908649 874 tablet_service.cc:1467] Processing CreateTablet for tablet a31a321d64d04c6d875b5295bbeb9d51 (DEFAULT_TABLE table=default.Table_bb68c71e75fa4c80b07fee25fa7a1578 [id=fbb840a10203442096b95c85a07979dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.908974 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a31a321d64d04c6d875b5295bbeb9d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.909180 720 tablet_service.cc:1467] Processing CreateTablet for tablet 996af19ac5fb43baae105988856b6d34 (DEFAULT_TABLE table=default.Table_dea72b45670847ea9b89dd25e200f407 [id=c7eac381b930442abcd3c296aee41d1b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:21.910122 830 leader_election.cc:341] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.910297 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1033) took 1929 ms. Trace:
W20260620 07:01:21.910579 683 leader_election.cc:341] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 91f8c4955c164e6b9061ac607bbe081c
I20260620 07:01:21.910709 683 leader_election.cc:302] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:21.911772 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 996af19ac5fb43baae105988856b6d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.912539 716 tablet_service.cc:1467] Processing CreateTablet for tablet 20781385be4d4c6aa278554faf9d15df (DEFAULT_TABLE table=default.Table_1ddd2a4884e54fd28958caa1ff0cbee9 [id=774557dc49794170a33b7a96f79cd2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.912842 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20781385be4d4c6aa278554faf9d15df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.913823 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4b81f2b92f4363829034d3fe290742" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:21.914173 997 tablet_service.cc:1467] Processing CreateTablet for tablet 996af19ac5fb43baae105988856b6d34 (DEFAULT_TABLE table=default.Table_dea72b45670847ea9b89dd25e200f407 [id=c7eac381b930442abcd3c296aee41d1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.914676 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 996af19ac5fb43baae105988856b6d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.915040 733 tablet_service.cc:1467] Processing CreateTablet for tablet e28974261e7f4c67afafca0273238d96 (DEFAULT_TABLE table=default.Table_d77be1066b784bc0a04db10d6ddd1483 [id=4894b99d2cc34842be34fa0cfd1184c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.915374 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e28974261e7f4c67afafca0273238d96. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:21.919243 831 leader_election.cc:341] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:21.919404 831 leader_election.cc:302] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:21.919916 2366 raft_consensus.cc:2726] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.920372 2569 raft_consensus.cc:2726] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:21.921679 2584 tablet.cc:1722] T 134f76587b6147afaf4e94fde5574efc P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:21.910413 1166 rpcz_store.cc:276] 0620 07:01:19.980645 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.980699 (+ 54us) service_pool.cc:227] Handling call
0620 07:01:21.910176 (+1929477us) ts_tablet_manager.cc:1145] Deleting tablet ef4e6fda73ba45c6892273b33b37a688
0620 07:01:21.910187 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.910278 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1929219}
W20260620 07:01:21.924729 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ef4e6fda73ba45c6892273b33b37a688 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef4e6fda73ba45c6892273b33b37a688 already in progress: creating tablet
I20260620 07:01:21.925519 1166 tablet_replica.cc:330] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:21.925722 1166 raft_consensus.cc:2229] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.925912 1166 raft_consensus.cc:2258] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.926455 1166 ts_tablet_manager.cc:1905] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.935007 869 tablet_service.cc:1467] Processing CreateTablet for tablet 996af19ac5fb43baae105988856b6d34 (DEFAULT_TABLE table=default.Table_dea72b45670847ea9b89dd25e200f407 [id=c7eac381b930442abcd3c296aee41d1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.935688 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 996af19ac5fb43baae105988856b6d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.935688 1166 ts_tablet_manager.cc:1918] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.935808 1166 log.cc:1196] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/eeb082e189304f13909d115f7197c5a1
I20260620 07:01:21.936127 1166 ts_tablet_manager.cc:1939] T eeb082e189304f13909d115f7197c5a1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:21.936869 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1036) took 1861 ms. Trace:
I20260620 07:01:21.936982 1166 rpcz_store.cc:276] 0620 07:01:20.075470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.083777 (+ 8307us) service_pool.cc:227] Handling call
0620 07:01:21.925454 (+1841677us) ts_tablet_manager.cc:1145] Deleting tablet eeb082e189304f13909d115f7197c5a1
0620 07:01:21.925466 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.932944 (+ 7478us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.935580 (+ 2636us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.936837 (+ 1257us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1841459}
I20260620 07:01:21.937449 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet eeb082e189304f13909d115f7197c5a1 (table default.Table_a40bbf24d40c42a693a3c8694f7dac84 [id=6bf90216e3494e01b7d8c51f68a83db0]) successfully deleted
I20260620 07:01:21.938732 2612 tablet.cc:1722] T 1c64df83a18a470c98a9c1fd6bb38918 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260620 07:01:21.939270 2583 tablet.cc:1722] T 1c64df83a18a470c98a9c1fd6bb38918 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260620 07:01:21.939883 1170 tablet_bootstrap.cc:492] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.939963 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1046) took 2581 ms. Trace:
I20260620 07:01:21.940047 1169 rpcz_store.cc:276] 0620 07:01:19.358206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.358899 (+ 693us) service_pool.cc:227] Handling call
0620 07:01:21.810135 (+2451236us) ts_tablet_manager.cc:1145] Deleting tablet 3456cf91d65a4413a35efe94513c723d
0620 07:01:21.810149 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.818298 (+ 8149us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.837399 (+ 19101us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.939949 (+102550us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2451055}
I20260620 07:01:21.940343 1169 tablet_replica.cc:330] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:21.940554 1169 raft_consensus.cc:2229] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.940729 1169 raft_consensus.cc:2258] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.941224 1169 ts_tablet_manager.cc:1905] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.941455 1170 tablet_bootstrap.cc:654] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.944252 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1035) took 1953 ms. Trace:
I20260620 07:01:21.944777 1166 rpcz_store.cc:276] 0620 07:01:19.990449 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.112281 (+121832us) service_pool.cc:227] Handling call
0620 07:01:21.944093 (+1831812us) ts_tablet_manager.cc:1145] Deleting tablet f96688ac7c91450cb34afd5f40b9826c
0620 07:01:21.944105 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.944211 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1831616}
I20260620 07:01:21.945310 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 704e8aaabe6d40138b6611bdc30abf16 (table default.Table_5345217f0b8545a29bddb73746b3d846 [id=6a49cf444e3b409bbf2fc6a73764cfe6]) successfully deleted
W20260620 07:01:21.945583 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2d1bad6b34f14270a060ce7245ff0c0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1bad6b34f14270a060ce7245ff0c0f already in progress: creating tablet
W20260620 07:01:21.945781 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f96688ac7c91450cb34afd5f40b9826c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96688ac7c91450cb34afd5f40b9826c already in progress: creating tablet
W20260620 07:01:21.945899 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8dad7e6437ab4328b9b88d5e6febe8a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dad7e6437ab4328b9b88d5e6febe8a0 already in progress: creating tablet
I20260620 07:01:21.946110 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f8be5f41f1d64d918b727e3eef18738e (table default.Table_3122a50618184dc7bf7cb696dca2a55b [id=d55d6c70a1b34227b4820944e280fde8]) successfully deleted
I20260620 07:01:21.946372 1166 tablet_replica.cc:330] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
W20260620 07:01:21.946349 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f0876d36e48a4d7fa78a1448fbeee4c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0876d36e48a4d7fa78a1448fbeee4c2 already in progress: creating tablet
I20260620 07:01:21.946715 1166 raft_consensus.cc:2229] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.947031 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 3456cf91d65a4413a35efe94513c723d (table default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9 [id=24e00ed0d7994f1cbebd87b708274b55]) successfully deleted
I20260620 07:01:21.947381 1166 raft_consensus.cc:2258] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.947649 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_411089a06f704215ae2532a11925490c" } modify_external_catalogs: true
I20260620 07:01:21.947921 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_411089a06f704215ae2532a11925490c" } modify_external_catalogs: true
I20260620 07:01:21.948557 1166 ts_tablet_manager.cc:1905] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.952929 1170 tablet_bootstrap.cc:492] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.953076 1170 ts_tablet_manager.cc:1397] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260620 07:01:21.955226 1165 ts_tablet_manager.cc:1918] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.956882 1168 tablet_bootstrap.cc:492] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:21.957175 1168 ts_tablet_manager.cc:1397] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.082s user 0.006s sys 0.000s
I20260620 07:01:21.957966 1168 raft_consensus.cc:348] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.958273 1168 raft_consensus.cc:374] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.958381 1168 raft_consensus.cc:729] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.958671 1168 consensus_queue.cc:260] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:21.959455 1168 ts_tablet_manager.cc:1428] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:21.953893 1170 raft_consensus.cc:348] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.959801 1170 raft_consensus.cc:374] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.959831 1168 tablet_bootstrap.cc:492] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:21.959882 1170 raft_consensus.cc:729] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.960103 1170 consensus_queue.cc:260] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.960639 1170 ts_tablet_manager.cc:1428] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 07:01:21.960887 1170 tablet_bootstrap.cc:492] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.961714 1168 tablet_bootstrap.cc:654] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.962357 1170 tablet_bootstrap.cc:654] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.962510 1165 log.cc:1196] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/e37f336c01974ba79caeb25f4781667a
I20260620 07:01:21.962929 1165 ts_tablet_manager.cc:1939] T e37f336c01974ba79caeb25f4781667a P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:21.964195 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet e37f336c01974ba79caeb25f4781667a (table default.Table_fa5e48ba0ba24f30a0212db6021bc618 [id=faf33298650347f1860fd8982c8a242a]) successfully deleted
I20260620 07:01:21.964430 1165 tablet_replica.cc:330] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:21.964501 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet f83dc03de5ad407b85daff91e19ff012 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f83dc03de5ad407b85daff91e19ff012 already in progress: creating tablet
I20260620 07:01:21.964725 1165 raft_consensus.cc:2229] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:21.964964 1165 raft_consensus.cc:2258] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:21.965529 1165 ts_tablet_manager.cc:1905] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:21.968987 2592 raft_consensus.cc:482] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:21.969158 2592 raft_consensus.cc:504] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.970254 2592 leader_election.cc:288] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:21.971261 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "333eef8b98da4a279acceaead9405149" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:21.971374 969 leader_election.cc:341] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 333eef8b98da4a279acceaead9405149
I20260620 07:01:21.971472 751 raft_consensus.cc:2454] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:21.971805 968 leader_election.cc:302] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:21.972422 2592 raft_consensus.cc:2781] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:21.972508 2592 raft_consensus.cc:482] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:21.972581 2592 raft_consensus.cc:3037] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:21.975402 2592 raft_consensus.cc:504] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.976456 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "333eef8b98da4a279acceaead9405149" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:21.976665 2592 leader_election.cc:288] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:21.976842 751 raft_consensus.cc:3037] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:21.979384 969 leader_election.cc:341] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 333eef8b98da4a279acceaead9405149
I20260620 07:01:21.979496 751 raft_consensus.cc:2454] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:21.979843 968 leader_election.cc:302] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:21.980245 2592 raft_consensus.cc:2781] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:21.980369 2592 raft_consensus.cc:686] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:21.980592 2592 consensus_queue.cc:237] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.982151 1167 tablet_bootstrap.cc:492] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:21.982334 1167 ts_tablet_manager.cc:1397] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.150s user 0.008s sys 0.020s
I20260620 07:01:21.982420 1170 tablet_bootstrap.cc:492] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:21.982555 1170 ts_tablet_manager.cc:1397] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20260620 07:01:21.983273 1167 raft_consensus.cc:348] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.983263 1170 raft_consensus.cc:348] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.983533 1170 raft_consensus.cc:374] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.983595 1170 raft_consensus.cc:729] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.983788 1170 consensus_queue.cc:260] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.984149 1167 raft_consensus.cc:374] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:21.984347 1167 raft_consensus.cc:729] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:21.984480 1170 ts_tablet_manager.cc:1428] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:21.984730 1170 tablet_bootstrap.cc:492] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:21.984730 1167 consensus_queue.cc:260] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:21.985189 2584 tablet.cc:1722] T 1c64df83a18a470c98a9c1fd6bb38918 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260620 07:01:21.985744 1167 ts_tablet_manager.cc:1428] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260620 07:01:21.986428 1167 tablet_bootstrap.cc:492] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:21.988083 1167 tablet_bootstrap.cc:654] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.991425 716 tablet_service.cc:1467] Processing CreateTablet for tablet e24e56dfc05d4632a8f54fcfde37ac0f (DEFAULT_TABLE table=default.Table_b77f861dcbb84f6dac56b5be789a7553 [id=670fb7d8dc2a4cd38bb28a024cccc135]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:21.991889 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e24e56dfc05d4632a8f54fcfde37ac0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:21.995532 1170 tablet_bootstrap.cc:654] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:21.998543 1166 ts_tablet_manager.cc:1918] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:21.998679 1166 log.cc:1196] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/d51c7488711b4db697b48025a5ba6e9d
I20260620 07:01:21.999008 1166 ts_tablet_manager.cc:1939] T d51c7488711b4db697b48025a5ba6e9d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.000080 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1056) took 1799 ms. Trace:
I20260620 07:01:22.000222 1166 rpcz_store.cc:276] 0620 07:01:20.200790 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.204914 (+ 4124us) service_pool.cc:227] Handling call
0620 07:01:21.946152 (+1741238us) ts_tablet_manager.cc:1145] Deleting tablet d51c7488711b4db697b48025a5ba6e9d
0620 07:01:21.946163 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:21.955257 (+ 9094us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:21.998434 (+ 43177us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:22.000052 (+ 1618us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1740949}
I20260620 07:01:22.000845 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet d51c7488711b4db697b48025a5ba6e9d (table default.Table_8bb5c7631c6145c49b7b09fcda4e4554 [id=ca832808e4a449deab0a9c100d5ead0b]) successfully deleted
I20260620 07:01:22.001703 1168 tablet_bootstrap.cc:492] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.001673 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1057) took 1310 ms. Trace:
I20260620 07:01:22.001760 1166 rpcz_store.cc:276] 0620 07:01:20.691722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.691926 (+ 204us) service_pool.cc:227] Handling call
0620 07:01:22.001539 (+1309613us) ts_tablet_manager.cc:1145] Deleting tablet ca86563e5b014bb88ccb74c628670c46
0620 07:01:22.001550 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.001655 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1309258}
I20260620 07:01:22.002058 1168 ts_tablet_manager.cc:1397] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.003s
W20260620 07:01:22.002231 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ca86563e5b014bb88ccb74c628670c46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca86563e5b014bb88ccb74c628670c46 already in progress: creating tablet
I20260620 07:01:22.003300 1166 tablet_replica.cc:330] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.003221 1168 raft_consensus.cc:348] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.003647 1168 raft_consensus.cc:374] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.003767 1168 raft_consensus.cc:729] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.003767 1166 raft_consensus.cc:2229] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.003924 1166 raft_consensus.cc:2258] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.004208 1168 consensus_queue.cc:260] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.004544 1166 ts_tablet_manager.cc:1905] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.005097 1168 ts_tablet_manager.cc:1428] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:22.005424 1168 tablet_bootstrap.cc:492] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:22.007984 1170 tablet_bootstrap.cc:492] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.008143 1170 ts_tablet_manager.cc:1397] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260620 07:01:22.009335 1031 raft_consensus.cc:3037] T b6e2c297072741eb927dff9bcf6a573f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.009761 1165 ts_tablet_manager.cc:1918] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.7
I20260620 07:01:22.009865 1165 log.cc:1196] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ad65565caddf4e878292d1178fbf6037
I20260620 07:01:22.009977 733 tablet_service.cc:1467] Processing CreateTablet for tablet a31a321d64d04c6d875b5295bbeb9d51 (DEFAULT_TABLE table=default.Table_bb68c71e75fa4c80b07fee25fa7a1578 [id=fbb840a10203442096b95c85a07979dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.010526 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a31a321d64d04c6d875b5295bbeb9d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.011338 1167 tablet_bootstrap.cc:492] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.011476 1167 ts_tablet_manager.cc:1397] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20260620 07:01:22.011545 2564 raft_consensus.cc:482] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.011659 2564 raft_consensus.cc:504] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.012264 2564 leader_election.cc:288] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.012179 1167 raft_consensus.cc:348] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.012372 1167 raft_consensus.cc:374] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.012434 1167 raft_consensus.cc:729] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.012631 1167 consensus_queue.cc:260] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.013271 1167 ts_tablet_manager.cc:1428] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:22.013455 2564 raft_consensus.cc:482] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.013597 1167 tablet_bootstrap.cc:492] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.013556 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6bae5090f81417cbcf4b4d598b438da" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.013602 2564 raft_consensus.cc:504] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.013751 1170 raft_consensus.cc:348] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.013949 1170 raft_consensus.cc:374] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.014005 1170 raft_consensus.cc:729] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.014117 2564 leader_election.cc:288] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.014195 1170 consensus_queue.cc:260] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.014741 1170 ts_tablet_manager.cc:1428] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.000s sys 0.000s
I20260620 07:01:22.015172 1170 tablet_bootstrap.cc:492] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.015071 891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0f7d4b6fa14811a1f02456418f95a4" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:22.015314 891 raft_consensus.cc:2454] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:22.015486 1167 tablet_bootstrap.cc:654] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:22.016040 681 leader_election.cc:341] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.016537 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0f7d4b6fa14811a1f02456418f95a4" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.016660 683 leader_election.cc:302] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:22.016742 1170 tablet_bootstrap.cc:654] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.017022 2569 raft_consensus.cc:2781] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.017123 2569 raft_consensus.cc:482] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.017200 2569 raft_consensus.cc:3037] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:22.017216 681 leader_election.cc:341] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:22.017921 683 leader_election.cc:341] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e6bae5090f81417cbcf4b4d598b438da
I20260620 07:01:22.018029 683 leader_election.cc:302] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.018335 2564 raft_consensus.cc:2726] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.010195 1165 ts_tablet_manager.cc:1939] T ad65565caddf4e878292d1178fbf6037 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:22.018929 2564 raft_consensus.cc:482] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.019058 2564 raft_consensus.cc:504] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.019598 2564 leader_election.cc:288] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.020285 2592 raft_consensus.cc:482] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.020418 2592 raft_consensus.cc:504] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.020586 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88c01c4e10f345fc84e3e253e8501aff" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.020882 683 leader_election.cc:341] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 88c01c4e10f345fc84e3e253e8501aff
I20260620 07:01:22.020985 2592 leader_election.cc:288] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:22.022051 969 leader_election.cc:341] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d0c41bf6a8a448ad809292d66ebf9c0e
I20260620 07:01:22.022017 2569 raft_consensus.cc:504] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:22.022179 681 leader_election.cc:341] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.022274 681 leader_election.cc:302] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.022694 2452 raft_consensus.cc:2726] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.023057 2569 leader_election.cc:288] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.023432 891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0f7d4b6fa14811a1f02456418f95a4" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:22.023622 891 raft_consensus.cc:3037] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.023620 716 tablet_service.cc:1467] Processing CreateTablet for tablet 0960f88ebd0f46bc806ba313c52fa782 (DEFAULT_TABLE table=default.Table_285bef485f9245a9af76437cdd971673 [id=b83855bc093749d0ba0950b93b325085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.024016 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0960f88ebd0f46bc806ba313c52fa782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.025027 1166 ts_tablet_manager.cc:1918] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.025128 1166 log.cc:1196] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ab60101b34144f85b0afd2e8c4846e48
I20260620 07:01:22.025403 1166 ts_tablet_manager.cc:1939] T ab60101b34144f85b0afd2e8c4846e48 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.026126 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1058) took 1333 ms. Trace:
I20260620 07:01:22.026219 1166 rpcz_store.cc:276] 0620 07:01:20.692650 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.692728 (+ 78us) service_pool.cc:227] Handling call
0620 07:01:22.003247 (+1310519us) ts_tablet_manager.cc:1145] Deleting tablet ab60101b34144f85b0afd2e8c4846e48
0620 07:01:22.003260 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.017142 (+ 13882us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:22.024919 (+ 7777us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:22.026106 (+ 1187us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1310160}
I20260620 07:01:22.026396 891 raft_consensus.cc:2454] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:22.026834 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ab60101b34144f85b0afd2e8c4846e48 (table default.Table_22154b88a133429f981e2e3a4d1fd4aa [id=76b0e45d4d264794a80b3293898b6064]) successfully deleted
I20260620 07:01:22.027133 683 leader_election.cc:302] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:22.027486 2569 raft_consensus.cc:2781] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.027755 2569 raft_consensus.cc:686] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:22.028025 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0f7d4b6fa14811a1f02456418f95a4" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:22.028023 2569 consensus_queue.cc:237] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:22.028590 681 leader_election.cc:341] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.029042 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0c41bf6a8a448ad809292d66ebf9c0e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.029284 751 raft_consensus.cc:2454] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:22.029683 968 leader_election.cc:302] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:22.030035 2592 raft_consensus.cc:2781] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.030095 2592 raft_consensus.cc:482] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.030148 2592 raft_consensus.cc:3037] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.032070 1167 tablet_bootstrap.cc:492] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.032192 1167 ts_tablet_manager.cc:1397] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260620 07:01:22.032846 1167 raft_consensus.cc:348] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.032927 2592 raft_consensus.cc:504] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.033038 1167 raft_consensus.cc:374] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.033083 1167 raft_consensus.cc:729] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.033298 1167 consensus_queue.cc:260] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.033773 2592 leader_election.cc:288] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.034299 419 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_e673aadd5ad94cfd870f850dc0d14201 [id=a876d134592d456ea2e7b8336037020f] alter complete (version 3)
I20260620 07:01:22.034391 1167 ts_tablet_manager.cc:1428] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:22.034721 1167 tablet_bootstrap.cc:492] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.036072 1167 tablet_bootstrap.cc:654] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.036460 424 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:22.037066 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1059) took 1343 ms. Trace:
I20260620 07:01:22.037928 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b1a1e74dc48b4814833821eecf2041f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.038185 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0c41bf6a8a448ad809292d66ebf9c0e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:22.038371 749 raft_consensus.cc:3037] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:22.038476 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1a1e74dc48b4814833821eecf2041f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.040304 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9f401d0b21824b5d8ca50cafcd90ae1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:22.040869 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f401d0b21824b5d8ca50cafcd90ae1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.041062 749 raft_consensus.cc:2454] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:22.041530 968 leader_election.cc:302] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:22.042840 1166 rpcz_store.cc:276] 0620 07:01:20.693327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.693396 (+ 69us) service_pool.cc:227] Handling call
0620 07:01:22.036941 (+1343545us) ts_tablet_manager.cc:1145] Deleting tablet b2f5c0f1c20f46b7b62fccea47f857d9
0620 07:01:22.036950 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.037047 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1343223}
W20260620 07:01:22.043262 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0147ed61f6904914b04433b8db049b7a consensus state has no leader
W20260620 07:01:22.043352 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b2f5c0f1c20f46b7b62fccea47f857d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2f5c0f1c20f46b7b62fccea47f857d9 already in progress: creating tablet
I20260620 07:01:22.043519 2592 raft_consensus.cc:2781] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.043716 2592 raft_consensus.cc:686] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:22.043923 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1060) took 1349 ms. Trace:
I20260620 07:01:22.043818 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cc7e83f45ddb45f5903d2456a6d3ca19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.043982 2592 consensus_queue.cc:237] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.044064 1166 rpcz_store.cc:276] 0620 07:01:20.694090 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.694160 (+ 70us) service_pool.cc:227] Handling call
0620 07:01:22.043739 (+1349579us) ts_tablet_manager.cc:1145] Deleting tablet 5773d09ad37c45198d62886624c87eea
0620 07:01:22.043752 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.043907 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1349245}
W20260620 07:01:22.044622 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc7e83f45ddb45f5903d2456a6d3ca19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:22.044727 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5773d09ad37c45198d62886624c87eea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5773d09ad37c45198d62886624c87eea already in progress: creating tablet
I20260620 07:01:22.045174 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1061) took 1350 ms. Trace:
W20260620 07:01:22.045382 969 leader_election.cc:341] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d0c41bf6a8a448ad809292d66ebf9c0e
I20260620 07:01:22.045774 1166 rpcz_store.cc:276] 0620 07:01:20.694976 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.695340 (+ 364us) service_pool.cc:227] Handling call
0620 07:01:22.045066 (+1349726us) ts_tablet_manager.cc:1145] Deleting tablet 1e3d4ea81afe43a2a6101e21cbd08f97
0620 07:01:22.045077 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.045158 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1349303}
W20260620 07:01:22.046377 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1e3d4ea81afe43a2a6101e21cbd08f97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e3d4ea81afe43a2a6101e21cbd08f97 already in progress: creating tablet
I20260620 07:01:22.046928 1166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41218 (request call id 1064) took 1347 ms. Trace:
I20260620 07:01:22.047233 1166 rpcz_store.cc:276] 0620 07:01:20.699330 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.700137 (+ 807us) service_pool.cc:227] Handling call
0620 07:01:22.046761 (+1346624us) ts_tablet_manager.cc:1145] Deleting tablet 31c56e80a73c442aa3cc65126a76c8be
0620 07:01:22.046777 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.046912 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1340646}
W20260620 07:01:22.047945 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 31c56e80a73c442aa3cc65126a76c8be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31c56e80a73c442aa3cc65126a76c8be already in progress: creating tablet
W20260620 07:01:22.048713 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7a024765ed144281a81db3b75cd271bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a024765ed144281a81db3b75cd271bf already in progress: creating tablet
I20260620 07:01:22.049338 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e]) successfully deleted
I20260620 07:01:22.049703 2564 raft_consensus.cc:482] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:22.049913 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3ebca13b8fb646778c1e8b9db404904f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ebca13b8fb646778c1e8b9db404904f already in progress: creating tablet
I20260620 07:01:22.049851 2564 raft_consensus.cc:504] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.050496 2564 leader_election.cc:288] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:22.050616 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 already in progress: creating tablet
I20260620 07:01:22.051098 1166 tablet_replica.cc:330] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.051510 1166 raft_consensus.cc:2229] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.051970 1166 raft_consensus.cc:2258] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.052384 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4260b0c953c14a198dbf9b64a30e7e05" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.053092 681 leader_election.cc:341] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.053524 1166 ts_tablet_manager.cc:1905] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:22.053912 683 leader_election.cc:341] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4260b0c953c14a198dbf9b64a30e7e05
I20260620 07:01:22.054025 683 leader_election.cc:302] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.054417 2564 raft_consensus.cc:2726] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.055048 1165 tablet_replica.cc:330] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:22.055303 1165 raft_consensus.cc:2229] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.055481 1165 raft_consensus.cc:2258] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.056391 1165 ts_tablet_manager.cc:1905] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.063514 2564 raft_consensus.cc:482] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.063742 1170 tablet_bootstrap.cc:492] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.063967 1170 ts_tablet_manager.cc:1397] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.003s
I20260620 07:01:22.063740 2564 raft_consensus.cc:504] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.065135 1170 raft_consensus.cc:348] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.065371 1170 raft_consensus.cc:374] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.065436 1170 raft_consensus.cc:729] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.065650 1170 consensus_queue.cc:260] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.065997 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd75e318982a4fb9bf28cb35b030642f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.066237 1170 ts_tablet_manager.cc:1428] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:22.066529 1170 tablet_bootstrap.cc:492] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:22.066737 681 leader_election.cc:341] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.067961 2564 leader_election.cc:288] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:22.068557 683 leader_election.cc:341] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cd75e318982a4fb9bf28cb35b030642f
I20260620 07:01:22.068655 683 leader_election.cc:302] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.068696 1170 tablet_bootstrap.cc:654] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.068899 2452 raft_consensus.cc:2726] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.074338 2544 raft_consensus.cc:482] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.074501 2544 raft_consensus.cc:504] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.075285 1166 ts_tablet_manager.cc:1918] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.075335 2544 leader_election.cc:288] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.075418 1166 log.cc:1196] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/864c95b908674e4f8425d765444c281b
I20260620 07:01:22.075716 1166 ts_tablet_manager.cc:1939] T 864c95b908674e4f8425d765444c281b P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:22.076761 968 leader_election.cc:341] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 7d3ebdb3ef844adf82b99a6d3b6c61c2
I20260620 07:01:22.076745 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 864c95b908674e4f8425d765444c281b (table default.Table_3af42fa4c4614dab89c7853707b243cb [id=f3a3145cdeb841329b0b4af9d9aa4235]) successfully deleted
W20260620 07:01:22.077486 969 leader_election.cc:341] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7d3ebdb3ef844adf82b99a6d3b6c61c2
I20260620 07:01:22.077610 969 leader_election.cc:302] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.077981 2544 raft_consensus.cc:2726] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.062780 1165 ts_tablet_manager.cc:1918] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.079174 1167 tablet_bootstrap.cc:492] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.079418 1167 ts_tablet_manager.cc:1397] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.005s
I20260620 07:01:22.080302 1167 raft_consensus.cc:348] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.080693 1167 raft_consensus.cc:374] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.080818 1167 raft_consensus.cc:729] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.081115 1167 consensus_queue.cc:260] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.081838 1167 ts_tablet_manager.cc:1428] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:22.082144 1167 tablet_bootstrap.cc:492] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.078387 1165 log.cc:1196] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/0e30fb1d050c4439bb72a21a0f2b13eb
I20260620 07:01:22.082603 1165 ts_tablet_manager.cc:1939] T 0e30fb1d050c4439bb72a21a0f2b13eb P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:22.084509 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 0e30fb1d050c4439bb72a21a0f2b13eb (table default.Table_debb21e4366f4317ae8f74130390b8d3 [id=37e74ef650534d1c90d6669ca2b43d19]) successfully deleted
I20260620 07:01:22.085340 1167 tablet_bootstrap.cc:654] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.086280 1166 tablet_replica.cc:330] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.086545 1166 raft_consensus.cc:2229] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.086745 1166 raft_consensus.cc:2258] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.087330 1166 ts_tablet_manager.cc:1905] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.088127 2592 raft_consensus.cc:482] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.088243 2592 raft_consensus.cc:504] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.088795 2592 leader_election.cc:288] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.089447 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "967cc8f19ad64278910c86ffc4cb3ed2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:22.089670 888 raft_consensus.cc:2454] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:22.090329 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "967cc8f19ad64278910c86ffc4cb3ed2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.090551 751 raft_consensus.cc:2454] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:22.091147 968 leader_election.cc:302] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:22.091775 2592 raft_consensus.cc:2781] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.091847 2592 raft_consensus.cc:482] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.091912 2592 raft_consensus.cc:3037] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.093479 1166 ts_tablet_manager.cc:1918] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.093586 1166 log.cc:1196] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/7cf81c5c0d9744f5a8c3f0866a435ae3
I20260620 07:01:22.093850 1166 ts_tablet_manager.cc:1939] T 7cf81c5c0d9744f5a8c3f0866a435ae3 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.094496 2592 raft_consensus.cc:504] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.096179 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_982eb8abebd34542b51573e542ad6085" } new_table_name: "default.Table_e85e7f993b574dd1bf681863cdd76b40" modify_external_catalogs: true
I20260620 07:01:22.096699 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "967cc8f19ad64278910c86ffc4cb3ed2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:22.096979 751 raft_consensus.cc:3037] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.097504 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5d394816a1114bf688692a825a176c92
I20260620 07:01:22.098147 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ce9c6307fb7e4e148efdc12609b110b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.098256 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d394816a1114bf688692a825a176c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.098387 1167 tablet_bootstrap.cc:492] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.098508 1167 ts_tablet_manager.cc:1397] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
W20260620 07:01:22.098683 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce9c6307fb7e4e148efdc12609b110b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.098635 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "967cc8f19ad64278910c86ffc4cb3ed2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:22.098865 888 raft_consensus.cc:3037] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.099294 1167 raft_consensus.cc:348] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.099493 1167 raft_consensus.cc:374] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.099550 1167 raft_consensus.cc:729] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.099764 1167 consensus_queue.cc:260] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.100364 1167 ts_tablet_manager.cc:1428] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:22.100605 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d394816a1114bf688692a825a176c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.100682 1167 tablet_bootstrap.cc:492] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.101259 2592 leader_election.cc:288] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.102038 1167 tablet_bootstrap.cc:654] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.103077 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2f1be61424224fa6a2e14985266defbb
I20260620 07:01:22.103223 888 raft_consensus.cc:2454] T 967cc8f19ad64278910c86ffc4cb3ed2 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:22.103581 969 leader_election.cc:302] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:22.103892 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8d07844409574a23bfbc41cbf9c95168" } modify_external_catalogs: true
I20260620 07:01:22.104036 2592 raft_consensus.cc:2781] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.104040 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f1be61424224fa6a2e14985266defbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.104151 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8d07844409574a23bfbc41cbf9c95168" } modify_external_catalogs: true
I20260620 07:01:22.104274 2592 raft_consensus.cc:686] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:22.104720 1166 tablet_replica.cc:330] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.104861 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 7cf81c5c0d9744f5a8c3f0866a435ae3 (table default.Table_9dd2793fba0e423ab605fac4be9fc8c9 [id=441ab9871f3141a28fb5f7c8c26e41bb]) successfully deleted
I20260620 07:01:22.104919 1166 raft_consensus.cc:2229] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.105042 1166 raft_consensus.cc:2258] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.104482 2592 consensus_queue.cc:237] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.105576 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4444360e8ade484f958816c5b80dca7e
I20260620 07:01:22.105582 1166 ts_tablet_manager.cc:1905] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.106133 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d8ddf3cd80a941f1adc86a978bb18f6b" } new_table_name: "default.Table_3a5957219154466b90bac067b632c52d" modify_external_catalogs: true
I20260620 07:01:22.106288 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 4444360e8ade484f958816c5b80dca7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.107757 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c9afec791fba43e4b8aaff2500fea9d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:22.108268 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9afec791fba43e4b8aaff2500fea9d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.109512 1168 tablet_bootstrap.cc:654] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.111722 419 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_6065a383cd53439fb9ad92441a4d3c8f [id=d7198485f2104c2092955ef5305900cf] alter complete (version 2)
I20260620 07:01:22.112627 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8eb6ccb773d14188b66a1af0fd3252e1" } new_table_name: "default.Table_123ca49fa9c445e29f90fc0c4222a5a1" modify_external_catalogs: true
W20260620 07:01:22.114398 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5d394816a1114bf688692a825a176c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d394816a1114bf688692a825a176c92 already in progress: creating tablet
I20260620 07:01:22.114527 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 4444360e8ade484f958816c5b80dca7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.114729 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb with delete_type TABLET_DATA_DELETED (replaced by tablet 9cebdd8c947845528affd32316d9b336) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.114759 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f1be61424224fa6a2e14985266defbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.115054 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c0bb50405d0446488272384523c2deb with delete_type TABLET_DATA_DELETED (replaced by tablet 98544574a8cd4a86a443284a421fa030) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.115386 1165 tablet_replica.cc:330] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:22.115407 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b6b64853a1aa44f8bc8f65b3354fd2e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.115582 1165 raft_consensus.cc:2229] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.115722 1165 raft_consensus.cc:2258] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:22.115959 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6b64853a1aa44f8bc8f65b3354fd2e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.116411 1167 tablet_bootstrap.cc:492] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.116519 1165 ts_tablet_manager.cc:1905] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.116539 1167 ts_tablet_manager.cc:1397] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s
I20260620 07:01:22.117175 1167 raft_consensus.cc:348] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.117401 1167 raft_consensus.cc:374] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.117475 1167 raft_consensus.cc:729] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.117722 1167 consensus_queue.cc:260] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.118336 1167 ts_tablet_manager.cc:1428] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:22.118525 424 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_603b24ca29d64fd4b03b5386406b25db [id=5c8493166f2448dea6f711457ba8c1bc] alter complete (version 4)
I20260620 07:01:22.118719 1167 tablet_bootstrap.cc:492] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.119257 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6c1b78c4f39f4e09abafd1d51690766a" } new_table_name: "default.Table_835e5822e64d4231bffd011bf691fab2" modify_external_catalogs: true
I20260620 07:01:22.119416 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 3456cf91d65a4413a35efe94513c723d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:22.120450 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 4444360e8ade484f958816c5b80dca7e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4444360e8ade484f958816c5b80dca7e already in progress: creating tablet
W20260620 07:01:22.120697 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0e30fb1d050c4439bb72a21a0f2b13eb because the tablet was not found. No further retry: Not found: Tablet not found: 0e30fb1d050c4439bb72a21a0f2b13eb
W20260620 07:01:22.120909 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2f1be61424224fa6a2e14985266defbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f1be61424224fa6a2e14985266defbb already in progress: creating tablet
I20260620 07:01:22.121704 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 393521cca6b44618bbfb71423f36c6a1
I20260620 07:01:22.121830 1167 tablet_bootstrap.cc:654] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.122478 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 393521cca6b44618bbfb71423f36c6a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.122367 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b0633505641342949a8dcca4b833d27d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.123176 1166 ts_tablet_manager.cc:1918] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.123458 1166 log.cc:1196] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/e5b6c578055d4f95b44c85eba8e92ac8
I20260620 07:01:22.123641 1165 ts_tablet_manager.cc:1918] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.123806 1165 log.cc:1196] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/2c0bb50405d0446488272384523c2deb
I20260620 07:01:22.123826 1166 ts_tablet_manager.cc:1939] T e5b6c578055d4f95b44c85eba8e92ac8 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.124220 1165 ts_tablet_manager.cc:1939] T 2c0bb50405d0446488272384523c2deb P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:22.124742 1166 tablet_replica.cc:330] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.124940 1166 raft_consensus.cc:2229] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.124928 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet e5b6c578055d4f95b44c85eba8e92ac8 (table default.Table_ca33b9aa48c84b99bdf69c17be8e9d4a [id=b64b98af489b40d3a363f9101d971f53]) successfully deleted
I20260620 07:01:22.125072 1166 raft_consensus.cc:2258] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.125545 1166 ts_tablet_manager.cc:1905] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.126551 1168 tablet_bootstrap.cc:492] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.127254 1168 ts_tablet_manager.cc:1397] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.122s user 0.022s sys 0.000s
I20260620 07:01:22.128088 1168 raft_consensus.cc:348] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.129141 1168 raft_consensus.cc:374] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.129341 1168 raft_consensus.cc:729] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.129766 1168 consensus_queue.cc:260] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
W20260620 07:01:22.131191 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0633505641342949a8dcca4b833d27d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.131399 1168 ts_tablet_manager.cc:1428] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260620 07:01:22.131896 1168 tablet_bootstrap.cc:492] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:22.133036 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 2c0bb50405d0446488272384523c2deb (table default.Table_429cabf4e04f4125b89d28e55eca678b [id=f31a91ff5fe241a1832414544e7a1e4f]) successfully deleted
I20260620 07:01:22.133318 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 393521cca6b44618bbfb71423f36c6a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:22.135151 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 393521cca6b44618bbfb71423f36c6a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 393521cca6b44618bbfb71423f36c6a1 already in progress: creating tablet
I20260620 07:01:22.135401 1167 tablet_bootstrap.cc:492] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.135618 1167 ts_tablet_manager.cc:1397] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.006s
I20260620 07:01:22.136238 1168 tablet_bootstrap.cc:654] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.136389 1167 raft_consensus.cc:348] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.136699 1167 raft_consensus.cc:374] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.136798 1167 raft_consensus.cc:729] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.137100 1167 consensus_queue.cc:260] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.137678 1167 ts_tablet_manager.cc:1428] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:22.138027 1167 tablet_bootstrap.cc:492] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.139834 1167 tablet_bootstrap.cc:654] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.141741 1166 ts_tablet_manager.cc:1918] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.142620 1166 log.cc:1196] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/b5c1567e0c9448dca870bd3d8502bf02
I20260620 07:01:22.143083 1166 ts_tablet_manager.cc:1939] T b5c1567e0c9448dca870bd3d8502bf02 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.144464 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet b5c1567e0c9448dca870bd3d8502bf02 (table default.Table_064fe848c6a04392901aeeb0168f99b4 [id=4315970d1a304e3d8d41ff5b0e452ebd]) successfully deleted
I20260620 07:01:22.145001 1166 tablet_replica.cc:330] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
W20260620 07:01:22.145153 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 633f3666050846dc9fc59a365110406d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 633f3666050846dc9fc59a365110406d already in progress: creating tablet
I20260620 07:01:22.145206 1166 raft_consensus.cc:2229] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
W20260620 07:01:22.145376 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b53304f072cb4a00a17de5df6f59168b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b53304f072cb4a00a17de5df6f59168b already in progress: creating tablet
I20260620 07:01:22.145479 1166 raft_consensus.cc:2258] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:22.145586 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b99781ba1ed44f6895af7da082618616 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b99781ba1ed44f6895af7da082618616 already in progress: creating tablet
W20260620 07:01:22.145777 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 14bbd042527e4f55aec6fbd996b132aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14bbd042527e4f55aec6fbd996b132aa already in progress: creating tablet
W20260620 07:01:22.145991 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f83dc03de5ad407b85daff91e19ff012 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f83dc03de5ad407b85daff91e19ff012 already in progress: creating tablet
I20260620 07:01:22.146018 1166 ts_tablet_manager.cc:1905] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.147933 2452 raft_consensus.cc:482] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.148070 2452 raft_consensus.cc:504] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.148618 1168 tablet_bootstrap.cc:492] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.148744 1168 ts_tablet_manager.cc:1397] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
I20260620 07:01:22.148754 2452 leader_election.cc:288] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:22.150238 683 leader_election.cc:341] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 25b878def9344cbdae65b209cac4067f
I20260620 07:01:22.150208 1168 raft_consensus.cc:348] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.150417 1168 raft_consensus.cc:374] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.150964 1168 raft_consensus.cc:729] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.151418 1168 consensus_queue.cc:260] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
W20260620 07:01:22.151651 413 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.61:33455, user_credentials={real_user=slave}} blocked reactor thread for 58704.6us
I20260620 07:01:22.152402 1168 ts_tablet_manager.cc:1428] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:22.152604 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d394816a1114bf688692a825a176c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.150731 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25b878def9344cbdae65b209cac4067f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.153263 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f1be61424224fa6a2e14985266defbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.153548 1168 tablet_bootstrap.cc:492] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:22.154453 681 leader_election.cc:341] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.156612 1168 tablet_bootstrap.cc:654] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.154573 681 leader_election.cc:302] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.160281 2569 raft_consensus.cc:2726] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.161512 2366 raft_consensus.cc:482] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.161602 1170 tablet_bootstrap.cc:492] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.161725 1170 ts_tablet_manager.cc:1397] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.095s user 0.013s sys 0.009s
I20260620 07:01:22.161648 2366 raft_consensus.cc:504] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.162223 2366 leader_election.cc:288] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:22.167132 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ad723586ff545049dad658221e6455b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.167793 830 leader_election.cc:341] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.168821 1168 tablet_bootstrap.cc:492] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.169663 1168 ts_tablet_manager.cc:1397] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20260620 07:01:22.169688 1167 tablet_bootstrap.cc:492] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.169888 1167 ts_tablet_manager.cc:1397] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.001s
I20260620 07:01:22.170588 1167 raft_consensus.cc:348] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.170571 1168 raft_consensus.cc:348] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.170817 1168 raft_consensus.cc:374] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.171016 1167 raft_consensus.cc:374] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.171152 1167 raft_consensus.cc:729] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.171482 1167 consensus_queue.cc:260] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.171838 1168 raft_consensus.cc:729] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.172212 1167 ts_tablet_manager.cc:1428] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:22.172528 1167 tablet_bootstrap.cc:492] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.172461 1168 consensus_queue.cc:260] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.174113 1167 tablet_bootstrap.cc:654] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.162860 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ad723586ff545049dad658221e6455b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.175854 751 raft_consensus.cc:2454] T 967cc8f19ad64278910c86ffc4cb3ed2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:22.175772 1168 ts_tablet_manager.cc:1428] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:22.176438 1168 tablet_bootstrap.cc:492] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:22.177959 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 393521cca6b44618bbfb71423f36c6a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:22.178166 831 leader_election.cc:341] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.178306 831 leader_election.cc:302] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.178550 2366 raft_consensus.cc:2726] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.179880 1168 tablet_bootstrap.cc:654] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.177897 2544 raft_consensus.cc:482] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.179976 2544 raft_consensus.cc:504] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.180603 2544 leader_election.cc:288] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.181365 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1c683a2169e4938b6941f83308cd392" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:22.181591 1170 raft_consensus.cc:348] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.181792 1170 raft_consensus.cc:374] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.181847 1170 raft_consensus.cc:729] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.182088 1170 consensus_queue.cc:260] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.182600 1170 ts_tablet_manager.cc:1428] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260620 07:01:22.183301 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1c683a2169e4938b6941f83308cd392" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.184566 1031 raft_consensus.cc:3037] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.187964 1168 tablet_bootstrap.cc:492] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.188570 1170 tablet_bootstrap.cc:492] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.188668 968 leader_election.cc:302] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.189163 1168 ts_tablet_manager.cc:1397] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.002s
I20260620 07:01:22.189244 2544 raft_consensus.cc:2726] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.190078 1168 raft_consensus.cc:348] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.190271 1170 tablet_bootstrap.cc:654] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.191190 1168 raft_consensus.cc:374] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.191386 1168 raft_consensus.cc:729] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.191716 1168 consensus_queue.cc:260] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.192816 1168 ts_tablet_manager.cc:1428] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:22.193627 1168 tablet_bootstrap.cc:492] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:22.195374 1168 tablet_bootstrap.cc:654] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.202560 1169 ts_tablet_manager.cc:1918] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.202701 1169 log.cc:1196] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/95a109e7871241ec9467858dca467bbe
I20260620 07:01:22.203094 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 4128a4e9a228456cb5cd08eef2bf73d4 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:22.204615 2569 raft_consensus.cc:482] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.204739 1168 tablet_bootstrap.cc:492] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.204846 2569 raft_consensus.cc:504] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.205287 1168 ts_tablet_manager.cc:1397] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.001s
I20260620 07:01:22.205547 2569 leader_election.cc:288] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:22.206382 683 leader_election.cc:341] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8b8659e903084f15ac3d9ea8c4c0dc0f
I20260620 07:01:22.207199 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8659e903084f15ac3d9ea8c4c0dc0f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.206391 1168 raft_consensus.cc:348] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.207360 1168 raft_consensus.cc:374] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.207427 1168 raft_consensus.cc:729] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.207612 1168 consensus_queue.cc:260] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:22.208061 681 leader_election.cc:341] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.208206 681 leader_election.cc:302] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.208824 2564 raft_consensus.cc:2726] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.208917 1169 ts_tablet_manager.cc:1939] T 95a109e7871241ec9467858dca467bbe P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:22.209633 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1047) took 2851 ms. Trace:
W20260620 07:01:22.209744 681 consensus_peers.cc:487] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:22.209916 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 4444360e8ade484f958816c5b80dca7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.209740 1169 rpcz_store.cc:276] 0620 07:01:19.358404 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.359123 (+ 719us) service_pool.cc:227] Handling call
0620 07:01:21.940304 (+2581181us) ts_tablet_manager.cc:1145] Deleting tablet 95a109e7871241ec9467858dca467bbe
0620 07:01:21.940314 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.000896 (+ 60582us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:22.202439 (+201543us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:22.209614 (+ 7175us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2581049}
I20260620 07:01:22.211236 1168 ts_tablet_manager.cc:1428] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260620 07:01:22.211931 1168 tablet_bootstrap.cc:492] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:22.214578 1168 tablet_bootstrap.cc:654] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.217759 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 95a109e7871241ec9467858dca467bbe (table default.Table_61fb27a9ecc44d718bdfa4051514a36a [id=2f50ee8c71f8435aad169b0637348a30]) successfully deleted
I20260620 07:01:22.218989 1169 tablet_replica.cc:330] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:22.219251 1169 raft_consensus.cc:2229] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.219416 1169 raft_consensus.cc:2258] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.219929 1169 ts_tablet_manager.cc:1905] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.223011 2366 raft_consensus.cc:482] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.223174 2366 raft_consensus.cc:504] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.223915 2366 leader_election.cc:288] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:22.226542 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9a7fab4d1684604be1b81d4d4bbe560 consensus state has no leader
I20260620 07:01:22.228284 2569 raft_consensus.cc:482] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.228513 2569 raft_consensus.cc:504] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.230142 2569 leader_election.cc:288] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:22.232016 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb4d9534187f44af9dfe0134cf0f1620 consensus state has no leader
I20260620 07:01:22.232064 1166 ts_tablet_manager.cc:1918] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.7
W20260620 07:01:22.232321 414 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0147ed61f6904914b04433b8db049b7a (table default.Table_f886739768844a4e9c7ab5e15353f524 [id=98050f19dcab4925843c69174cc94af7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0147ed61f6904914b04433b8db049b7a consensus state has no leader
W20260620 07:01:22.232931 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b81bd1cb0e2498a8cec55e7ca761d72 consensus state has no leader
I20260620 07:01:22.233598 1170 tablet_bootstrap.cc:492] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.233724 1170 ts_tablet_manager.cc:1397] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.006s
W20260620 07:01:22.234472 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6a69679d033433cb541bba7ebda282c consensus state has no leader
I20260620 07:01:22.234449 1170 raft_consensus.cc:348] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.234655 1170 raft_consensus.cc:374] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.234711 1170 raft_consensus.cc:729] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.229944 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125e8a5e20bf484cade408f0358489a1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.234923 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5926946427294a5ca6fbc72d3e1b612d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.234933 1170 consensus_queue.cc:260] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:22.235324 681 leader_election.cc:341] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.235443 1170 ts_tablet_manager.cc:1428] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260620 07:01:22.235706 830 leader_election.cc:341] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.236131 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c0f594983a7540db9c245c64a87a3edd
I20260620 07:01:22.236946 997 tablet_service.cc:1514] Processing DeleteTablet for tablet c0f594983a7540db9c245c64a87a3edd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.237434 863 tablet_service.cc:1514] Processing DeleteTablet for tablet c0f594983a7540db9c245c64a87a3edd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.237977 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5926946427294a5ca6fbc72d3e1b612d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:22.238142 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c0f594983a7540db9c245c64a87a3edd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0f594983a7540db9c245c64a87a3edd already in progress: creating tablet
W20260620 07:01:22.238158 683 leader_election.cc:341] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 125e8a5e20bf484cade408f0358489a1
I20260620 07:01:22.238247 683 leader_election.cc:302] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.238468 2569 raft_consensus.cc:2726] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:22.238817 831 leader_election.cc:341] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.238946 831 leader_election.cc:302] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.239320 2366 raft_consensus.cc:2726] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.242579 1166 log.cc:1196] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/ad65565caddf4e878292d1178fbf6037
I20260620 07:01:22.243028 1166 ts_tablet_manager.cc:1939] T ad65565caddf4e878292d1178fbf6037 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.244814 1168 tablet_bootstrap.cc:492] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.245494 1168 ts_tablet_manager.cc:1397] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20260620 07:01:22.245523 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e]) successfully deleted
I20260620 07:01:22.246416 1168 raft_consensus.cc:348] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.246619 1168 raft_consensus.cc:374] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.246670 1168 raft_consensus.cc:729] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.247504 1166 tablet_replica.cc:330] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.247946 1168 consensus_queue.cc:260] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.248399 1170 tablet_bootstrap.cc:492] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.248713 1166 raft_consensus.cc:2229] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:22.248458 1167 tablet_bootstrap.cc:492] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.249648 2544 raft_consensus.cc:482] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.249784 2544 raft_consensus.cc:504] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.250365 2544 leader_election.cc:288] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.250500 1170 tablet_bootstrap.cc:654] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.251113 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97e01aa120cc4c189017236ad57de811" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.251260 1168 ts_tablet_manager.cc:1428] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 07:01:22.251886 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97e01aa120cc4c189017236ad57de811" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:22.252457 969 leader_election.cc:302] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.252669 2531 raft_consensus.cc:482] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.252774 2531 raft_consensus.cc:504] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.252883 2544 raft_consensus.cc:2726] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.253296 2531 leader_election.cc:288] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:22.254196 968 leader_election.cc:341] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: f8be5f41f1d64d918b727e3eef18738e
I20260620 07:01:22.249181 1167 ts_tablet_manager.cc:1397] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.077s user 0.001s sys 0.005s
I20260620 07:01:22.255069 1168 tablet_bootstrap.cc:492] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:22.255067 969 leader_election.cc:341] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f8be5f41f1d64d918b727e3eef18738e
I20260620 07:01:22.255182 969 leader_election.cc:302] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.255388 2531 raft_consensus.cc:2726] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.255417 716 tablet_service.cc:1514] Processing DeleteTablet for tablet c0f594983a7540db9c245c64a87a3edd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.255926 1167 raft_consensus.cc:348] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.256206 1167 raft_consensus.cc:374] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.256315 1167 raft_consensus.cc:729] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.256587 1167 consensus_queue.cc:260] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.257154 1168 tablet_bootstrap.cc:654] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.257530 1031 raft_consensus.cc:3037] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.257742 1167 ts_tablet_manager.cc:1428] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:22.262991 1167 tablet_bootstrap.cc:492] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.263280 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_865d4dac0d6a4d69b85fa2190d19d81d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.264564 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_db9af592557440a38ede430f2606a807"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.248939 1166 pending_rounds.cc:62] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:22.265478 1166 pending_rounds.cc:68] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821658879057920 op_type: NO_OP noop_request { }
I20260620 07:01:22.265630 1166 raft_consensus.cc:2866] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:22.265628 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_31d0405bb6474308a84704c3e98bb9fa" } new_table_name: "default.Table_7156ae6b8b524116ae5517637382e5ee" modify_external_catalogs: true
I20260620 07:01:22.265748 1166 raft_consensus.cc:2258] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.267160 2531 raft_consensus.cc:482] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.267284 2531 raft_consensus.cc:504] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.267881 2531 leader_election.cc:288] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:22.268667 969 leader_election.cc:341] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c8f81fa4e88945f1a392fbacfd031392
W20260620 07:01:22.269029 968 leader_election.cc:341] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: c8f81fa4e88945f1a392fbacfd031392
I20260620 07:01:22.269130 968 leader_election.cc:302] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.269409 1166 ts_tablet_manager.cc:1905] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.269611 2531 raft_consensus.cc:2726] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.272544 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ba2e85fd379f4437946d4bb6af649094"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.279322 1170 tablet_bootstrap.cc:492] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.279487 1170 ts_tablet_manager.cc:1397] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.003s
I20260620 07:01:22.280267 1170 raft_consensus.cc:348] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.280589 1170 raft_consensus.cc:374] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.280687 1170 raft_consensus.cc:729] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.281025 1170 consensus_queue.cc:260] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.281769 1167 tablet_bootstrap.cc:654] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.281838 1170 ts_tablet_manager.cc:1428] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:22.282356 1170 tablet_bootstrap.cc:492] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.285504 1170 tablet_bootstrap.cc:654] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.290153 2366 raft_consensus.cc:482] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.290338 2366 raft_consensus.cc:504] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.291069 2366 leader_election.cc:288] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.291693 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c7b3977b604cb69df671318fae1212" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.291651 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c7b3977b604cb69df671318fae1212" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:22.292176 830 leader_election.cc:341] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:22.292304 831 leader_election.cc:341] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.292490 831 leader_election.cc:302] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.292856 2366 raft_consensus.cc:2726] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.296985 2612 tablet.cc:1722] T 97e01aa120cc4c189017236ad57de811 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:22.298779 1166 ts_tablet_manager.cc:1918] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:22.302958 2569 raft_consensus.cc:482] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.303107 2569 raft_consensus.cc:504] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.303684 2569 leader_election.cc:288] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:22.304872 683 leader_election.cc:341] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 877a71e8db5f4bf689df39f83735f326
I20260620 07:01:22.309823 1166 log.cc:1196] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/95a109e7871241ec9467858dca467bbe
I20260620 07:01:22.310586 1166 ts_tablet_manager.cc:1939] T 95a109e7871241ec9467858dca467bbe P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.305744 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877a71e8db5f4bf689df39f83735f326" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.315178 681 leader_election.cc:341] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.315352 681 leader_election.cc:302] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.315828 2569 raft_consensus.cc:2726] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.313531 1167 tablet_bootstrap.cc:492] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:01:22.316286 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0ca4bb86788c4ba1ac48ca5a57a3a85d consensus state has no leader
I20260620 07:01:22.316359 1167 ts_tablet_manager.cc:1397] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.053s user 0.007s sys 0.001s
I20260620 07:01:22.317286 1167 raft_consensus.cc:348] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.317592 1167 raft_consensus.cc:374] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.317663 1167 raft_consensus.cc:729] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.317843 1167 consensus_queue.cc:260] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.318567 1167 ts_tablet_manager.cc:1428] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:22.319031 1167 tablet_bootstrap.cc:492] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.319779 1166 tablet_replica.cc:330] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.320164 1166 raft_consensus.cc:2229] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.320398 1166 raft_consensus.cc:2258] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.321043 1167 tablet_bootstrap.cc:654] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.321197 2592 raft_consensus.cc:482] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.321311 2592 raft_consensus.cc:504] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.321887 2592 leader_election.cc:288] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:22.323340 969 leader_election.cc:341] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3456cf91d65a4413a35efe94513c723d
I20260620 07:01:22.323441 1170 tablet_bootstrap.cc:492] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.323581 1170 ts_tablet_manager.cc:1397] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260620 07:01:22.323583 2569 raft_consensus.cc:482] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.323823 2569 raft_consensus.cc:504] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.324419 1170 raft_consensus.cc:348] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.324601 2569 leader_election.cc:288] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.324623 1170 raft_consensus.cc:374] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.325408 1170 raft_consensus.cc:729] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.325613 1170 consensus_queue.cc:260] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.326208 1170 ts_tablet_manager.cc:1428] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260620 07:01:22.326604 1170 tablet_bootstrap.cc:492] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:22.326681 683 leader_election.cc:341] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 1d9d4b5a69484176a7b0f4fded010867
W20260620 07:01:22.327039 968 leader_election.cc:341] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 3456cf91d65a4413a35efe94513c723d
I20260620 07:01:22.327167 968 leader_election.cc:302] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.327899 2592 raft_consensus.cc:2726] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.328262 1170 tablet_bootstrap.cc:654] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.330474 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d9d4b5a69484176a7b0f4fded010867" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.331444 681 leader_election.cc:341] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.331589 681 leader_election.cc:302] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.332298 2452 raft_consensus.cc:2726] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.329926 2581 consensus_queue.cc:1035] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:22.334438 2581 consensus_queue.cc:1035] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:22.319497 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 95a109e7871241ec9467858dca467bbe (table default.Table_61fb27a9ecc44d718bdfa4051514a36a [id=2f50ee8c71f8435aad169b0637348a30]) successfully deleted
W20260620 07:01:22.338476 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_865d4dac0d6a4d69b85fa2190d19d81d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:22.340237 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db9af592557440a38ede430f2606a807 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.341231 1166 ts_tablet_manager.cc:1905] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:22.341274 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba2e85fd379f4437946d4bb6af649094 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.350656 1170 tablet_bootstrap.cc:492] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.350845 1170 ts_tablet_manager.cc:1397] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260620 07:01:22.351579 1170 raft_consensus.cc:348] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.351820 1170 raft_consensus.cc:374] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.351882 1170 raft_consensus.cc:729] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.357944 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0ab928899b3146b7b2a5ca13688518bd" } modify_external_catalogs: true
I20260620 07:01:22.358261 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0ab928899b3146b7b2a5ca13688518bd" } modify_external_catalogs: true
I20260620 07:01:22.352088 1170 consensus_queue.cc:260] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:22.365146 681 consensus_peers.cc:487] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:22.365582 2592 raft_consensus.cc:482] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.365715 2592 raft_consensus.cc:504] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.366261 2592 leader_election.cc:288] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.366281 1170 ts_tablet_manager.cc:1428] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260620 07:01:22.366873 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.367365 1170 tablet_bootstrap.cc:492] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.368211 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a4f3b5450948768c8db382d200cc19" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:22.368448 888 raft_consensus.cc:2354] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06a32ef63b2b495a9ade1de48c024ae9 for earlier term 1. Current term is 2.
I20260620 07:01:22.368836 969 leader_election.cc:398] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) with higher term. Message: Invalid argument: T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06a32ef63b2b495a9ade1de48c024ae9 for earlier term 1. Current term is 2.
I20260620 07:01:22.368904 969 leader_election.cc:401] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260620 07:01:22.369189 2592 raft_consensus.cc:3037] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 2
I20260620 07:01:22.370940 2366 raft_consensus.cc:482] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.371078 2366 raft_consensus.cc:504] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.371623 2366 leader_election.cc:288] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:22.372113 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba189cfcef094a7bb45bc7d5f4ee5b71" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:22.372605 831 leader_election.cc:341] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.373028 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba189cfcef094a7bb45bc7d5f4ee5b71" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.373447 830 leader_election.cc:341] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.373569 830 leader_election.cc:302] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.373992 2366 raft_consensus.cc:2726] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.374248 1170 tablet_bootstrap.cc:654] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.374601 2592 raft_consensus.cc:2726] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) with higher term. Message: Invalid argument: T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06a32ef63b2b495a9ade1de48c024ae9 for earlier term 1. Current term is 2.
I20260620 07:01:22.378544 1166 ts_tablet_manager.cc:1918] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.380447 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6f07addf070c41ca99d660f88ffd8c7c" } modify_external_catalogs: true
I20260620 07:01:22.380671 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6f07addf070c41ca99d660f88ffd8c7c" } modify_external_catalogs: true
I20260620 07:01:22.381599 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8af172cfabc043eca78837a1636bd814" } modify_external_catalogs: true
I20260620 07:01:22.381834 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8af172cfabc043eca78837a1636bd814" } modify_external_catalogs: true
I20260620 07:01:22.382761 1170 tablet_bootstrap.cc:492] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.382719 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1600b2622d554f059342111df409c44d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.381278 1031 raft_consensus.cc:3037] T a1c683a2169e4938b6941f83308cd392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.388720 1170 ts_tablet_manager.cc:1397] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260620 07:01:22.389974 1170 raft_consensus.cc:348] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.391543 1166 log.cc:1196] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/6229a52adf8d4b17bdf89347e01621ed
I20260620 07:01:22.392045 1166 ts_tablet_manager.cc:1939] T 6229a52adf8d4b17bdf89347e01621ed P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.396617 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 6229a52adf8d4b17bdf89347e01621ed (table default.Table_7eafc8e838624e3e9873bc01998b5daa [id=e4ea9f9e77f74312a2ead7c22390b268]) successfully deleted
I20260620 07:01:22.397419 1166 tablet_replica.cc:330] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.397701 1170 raft_consensus.cc:374] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.398036 1170 raft_consensus.cc:729] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.398432 1170 consensus_queue.cc:260] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.398583 1166 raft_consensus.cc:2229] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:22.399643 1170 ts_tablet_manager.cc:1428] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260620 07:01:22.401026 1166 pending_rounds.cc:62] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:22.401095 1166 pending_rounds.cc:68] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821660848676864 op_type: NO_OP noop_request { }
I20260620 07:01:22.401217 1166 raft_consensus.cc:2866] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:22.401319 1166 raft_consensus.cc:2258] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.401682 1170 tablet_bootstrap.cc:492] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.402271 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7b70534507514814b1c557a5432f221b" } modify_external_catalogs: true
I20260620 07:01:22.402355 2366 raft_consensus.cc:482] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.402516 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7b70534507514814b1c557a5432f221b" } modify_external_catalogs: true
I20260620 07:01:22.402482 2366 raft_consensus.cc:504] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.403478 2366 leader_election.cc:288] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:22.403486 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d6e28c641ffd480ca6a0ee1baa4f5998"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.404440 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4128a4e9a228456cb5cd08eef2bf73d4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.404426 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4128a4e9a228456cb5cd08eef2bf73d4" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:22.405121 830 leader_election.cc:341] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:22.405427 831 leader_election.cc:341] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.405570 831 leader_election.cc:302] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.406057 2366 raft_consensus.cc:2726] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.407317 1166 ts_tablet_manager.cc:1905] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:22.408243 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6e28c641ffd480ca6a0ee1baa4f5998 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.408695 1168 tablet_bootstrap.cc:492] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
W20260620 07:01:22.408787 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1600b2622d554f059342111df409c44d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.408938 1168 ts_tablet_manager.cc:1397] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.157s user 0.019s sys 0.035s
I20260620 07:01:22.409682 1168 raft_consensus.cc:348] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.409947 1168 raft_consensus.cc:374] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.410043 1168 raft_consensus.cc:729] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.410298 1168 consensus_queue.cc:260] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.411180 1168 ts_tablet_manager.cc:1428] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:22.412557 1167 tablet_bootstrap.cc:492] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.412767 1167 ts_tablet_manager.cc:1397] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.094s user 0.011s sys 0.003s
I20260620 07:01:22.414390 2366 raft_consensus.cc:482] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.414513 2366 raft_consensus.cc:504] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.414999 1168 tablet_bootstrap.cc:492] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:22.415117 2366 leader_election.cc:288] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.415647 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8aa75356fb54672a0ada533fc634613" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.415948 1167 raft_consensus.cc:348] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.416139 1167 raft_consensus.cc:374] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.416256 1167 raft_consensus.cc:729] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
W20260620 07:01:22.416323 831 leader_election.cc:341] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:22.417273 681 consensus_peers.cc:487] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:22.416965 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8aa75356fb54672a0ada533fc634613" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.417765 830 leader_election.cc:341] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.417887 830 leader_election.cc:302] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.418272 2366 raft_consensus.cc:2726] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.419162 1168 tablet_bootstrap.cc:654] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.416508 1167 consensus_queue.cc:260] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.425873 1167 ts_tablet_manager.cc:1428] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260620 07:01:22.426317 1167 tablet_bootstrap.cc:492] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.428047 1167 tablet_bootstrap.cc:654] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.428773 2366 raft_consensus.cc:482] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.428921 2366 raft_consensus.cc:504] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.429562 2366 leader_election.cc:288] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.431130 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777a6b981b7f43a4ba8978ba6f3971e1" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:22.431946 831 leader_election.cc:341] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.432922 1170 tablet_bootstrap.cc:654] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.428063 1166 ts_tablet_manager.cc:1918] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:22.430356 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777a6b981b7f43a4ba8978ba6f3971e1" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.434688 830 leader_election.cc:341] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.434731 1166 log.cc:1196] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/d0c41bf6a8a448ad809292d66ebf9c0e
I20260620 07:01:22.434824 830 leader_election.cc:302] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.435194 2366 raft_consensus.cc:2726] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.435585 1166 ts_tablet_manager.cc:1939] T d0c41bf6a8a448ad809292d66ebf9c0e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:22.441975 683 consensus_peers.cc:487] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2bc3dd1306af4e49a9fec197b5740374. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:22.443452 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet d0c41bf6a8a448ad809292d66ebf9c0e (table default.Table_d980ceff63f447adbc0aaf600b24f40e [id=ea3947fe0a794502a317ef69c47c0444]) successfully deleted
I20260620 07:01:22.444705 1166 tablet_replica.cc:330] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.448426 1166 raft_consensus.cc:2229] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.449222 1166 raft_consensus.cc:2258] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.450039 1166 ts_tablet_manager.cc:1905] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.455762 2569 raft_consensus.cc:482] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.455957 1170 tablet_bootstrap.cc:492] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.456209 1170 ts_tablet_manager.cc:1397] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.003s
I20260620 07:01:22.455960 2569 raft_consensus.cc:504] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.456966 2569 leader_election.cc:288] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.457369 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a6c684d6032a46a38cb35d8770b1ce44" } new_table_name: "default.Table_323817970d4545d2af7eb571b43768eb" modify_external_catalogs: true
I20260620 07:01:22.458630 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb81ac0ebd4865b9d53259ed5787d1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.458877 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_21b426dcc72f41c0ac24a61fe70581a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.458887 1170 raft_consensus.cc:348] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.459115 1170 raft_consensus.cc:374] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.459164 1170 raft_consensus.cc:729] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
W20260620 07:01:22.459353 681 leader_election.cc:341] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:22.459484 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21b426dcc72f41c0ac24a61fe70581a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.459625 1170 consensus_queue.cc:260] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
W20260620 07:01:22.459826 683 leader_election.cc:341] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 35cb81ac0ebd4865b9d53259ed5787d1
I20260620 07:01:22.459954 683 leader_election.cc:302] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.460191 1170 ts_tablet_manager.cc:1428] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:22.460461 1170 tablet_bootstrap.cc:492] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.460492 2581 raft_consensus.cc:2726] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.460752 2581 raft_consensus.cc:482] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.460891 2581 raft_consensus.cc:504] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.461637 2581 leader_election.cc:288] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.462158 1170 tablet_bootstrap.cc:654] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.462378 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f793a91ab247408bbe4a9f7cb370fffe" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.467139 427 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 6c4b81f2b92f4363829034d3fe290742 (table default.Table_84dadb1417974806a37c5fc6f5347d2d [id=6fcbcf995f28481ea31b3a41340a978b]). Expected version 2 got 0
I20260620 07:01:22.467406 427 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:22.467650 427 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:22.467905 1167 tablet_bootstrap.cc:492] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.467906 427 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (table default.Table_35a0e30f853640ff94b025abf4fe9d66 [id=bd3649f95ee640eeaeb1d585ac20e4e4]). Expected version 4 got 0
I20260620 07:01:22.468137 1167 ts_tablet_manager.cc:1397] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.000s
I20260620 07:01:22.468964 1167 raft_consensus.cc:348] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.469285 1167 raft_consensus.cc:374] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.469398 1167 raft_consensus.cc:729] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.469684 1167 consensus_queue.cc:260] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.470038 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:22.470702 425 catalog_manager.cc:5495] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3). New cstate: current_term: 1 leader_uuid: "06a32ef63b2b495a9ade1de48c024ae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:22.471153 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:22.471457 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 97e01aa120cc4c189017236ad57de811 (table default.Table_b19a46e2d20e4f75a3d170cbb543ca71 [id=19dd20742533400980193075baec1956]). Expected version 1 got 0
I20260620 07:01:22.471591 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 2 got 0
I20260620 07:01:22.474730 1167 ts_tablet_manager.cc:1428] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260620 07:01:22.475071 1167 tablet_bootstrap.cc:492] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.475371 997 tablet_service.cc:1467] Processing CreateTablet for tablet d17f18bd4b9743d1af48e3fee45bf525 (DEFAULT_TABLE table=default.Table_80767314891a4208af17029afa663aff [id=fb49979e6e0e43d7a10a712a1b6e5ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.475939 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d17f18bd4b9743d1af48e3fee45bf525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.476703 1167 tablet_bootstrap.cc:654] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.478984 2366 raft_consensus.cc:482] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.479144 2366 raft_consensus.cc:504] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.479827 2366 leader_election.cc:288] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:22.480649 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4bebaa8ed1431d8c775f4856a3d808" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.481534 830 leader_election.cc:341] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.484217 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2d262a232e884ed9be976b6b7a8e7a9c
I20260620 07:01:22.485038 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7477c1a1742f44dea7a1b3a4ae40287f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:22.485680 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7477c1a1742f44dea7a1b3a4ae40287f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:22.463143 681 leader_election.cc:341] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:22.488251 683 leader_election.cc:341] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f793a91ab247408bbe4a9f7cb370fffe
I20260620 07:01:22.488801 683 leader_election.cc:302] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.489634 2569 raft_consensus.cc:2726] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.490327 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d262a232e884ed9be976b6b7a8e7a9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.490641 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d262a232e884ed9be976b6b7a8e7a9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.491232 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d262a232e884ed9be976b6b7a8e7a9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.490696 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4bebaa8ed1431d8c775f4856a3d808" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:22.492606 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2d262a232e884ed9be976b6b7a8e7a9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d262a232e884ed9be976b6b7a8e7a9c already in progress: creating tablet
W20260620 07:01:22.492892 831 leader_election.cc:341] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.493057 831 leader_election.cc:302] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.493320 2366 raft_consensus.cc:2726] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.494350 1167 tablet_bootstrap.cc:492] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.494494 1167 ts_tablet_manager.cc:1397] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260620 07:01:22.495282 2366 raft_consensus.cc:482] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.495219 1167 raft_consensus.cc:348] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.495464 1167 raft_consensus.cc:374] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.495431 2366 raft_consensus.cc:504] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.495545 1167 raft_consensus.cc:729] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.495718 1167 consensus_queue.cc:260] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.496014 2366 leader_election.cc:288] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.496189 1167 ts_tablet_manager.cc:1428] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:22.496455 1167 tablet_bootstrap.cc:492] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.496367 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a96030064de046e5873bdaab6f3dff60" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.496563 751 raft_consensus.cc:2454] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:22.496961 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a96030064de046e5873bdaab6f3dff60" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.497561 831 leader_election.cc:302] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:22.497784 2366 raft_consensus.cc:2781] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.497880 2366 raft_consensus.cc:482] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.497946 2366 raft_consensus.cc:3037] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.498147 1167 tablet_bootstrap.cc:654] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.498672 1166 ts_tablet_manager.cc:1918] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.498773 1166 log.cc:1196] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/7d3ebdb3ef844adf82b99a6d3b6c61c2
I20260620 07:01:22.499200 1166 ts_tablet_manager.cc:1939] T 7d3ebdb3ef844adf82b99a6d3b6c61c2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.500567 2366 raft_consensus.cc:504] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.501171 2366 leader_election.cc:288] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:22.501521 830 leader_election.cc:341] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.501796 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a96030064de046e5873bdaab6f3dff60" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:22.502413 830 leader_election.cc:341] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.503135 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a96030064de046e5873bdaab6f3dff60" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:22.503368 751 raft_consensus.cc:3037] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.507364 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4128a4e9a228456cb5cd08eef2bf73d4
I20260620 07:01:22.507642 751 raft_consensus.cc:2454] T a96030064de046e5873bdaab6f3dff60 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:22.507848 418 catalog_manager.cc:6565] ReplaceTablet: tablet 4128a4e9a228456cb5cd08eef2bf73d4 deleted and replaced by tablet c292d437da9741af8ed8d05d8932d870
I20260620 07:01:22.508205 831 leader_election.cc:302] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:22.508252 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6e410dfb5ade4fdfb314561d54f4b069"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.508508 2366 raft_consensus.cc:2781] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 07:01:22.508934 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e410dfb5ade4fdfb314561d54f4b069 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.510471 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5855497e5b22493bb60024d30cc23e03
I20260620 07:01:22.511087 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b1f648ab301c4e3c83bd33230653f395
I20260620 07:01:22.511274 1170 tablet_bootstrap.cc:492] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.511402 1170 ts_tablet_manager.cc:1397] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.002s
I20260620 07:01:22.511670 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ce9c6307fb7e4e148efdc12609b110b0" } new_table_name: "default.Table_73748ee3c61e4f02960f56befc9c9c6e" modify_external_catalogs: true
I20260620 07:01:22.512177 1170 raft_consensus.cc:348] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.512365 1170 raft_consensus.cc:374] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.512418 1170 raft_consensus.cc:729] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.513633 863 tablet_service.cc:1514] Processing DeleteTablet for tablet 4128a4e9a228456cb5cd08eef2bf73d4 with delete_type TABLET_DATA_DELETED (replaced by tablet c292d437da9741af8ed8d05d8932d870) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.513651 861 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f648ab301c4e3c83bd33230653f395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.513892 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 5855497e5b22493bb60024d30cc23e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.514143 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f648ab301c4e3c83bd33230653f395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.514400 1165 tablet_replica.cc:330] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:22.514254 1170 consensus_queue.cc:260] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.514462 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4e4e652fd8784743812eb669bc82fce2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.514655 1165 raft_consensus.cc:2229] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.514816 1165 raft_consensus.cc:2258] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.514837 1170 ts_tablet_manager.cc:1428] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260620 07:01:22.515002 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e4e652fd8784743812eb669bc82fce2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.515096 1170 tablet_bootstrap.cc:492] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.516577 1165 ts_tablet_manager.cc:1905] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:22.516609 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b678a77d34f34718836fba62b81412c9 consensus state has no leader
I20260620 07:01:22.516722 1170 tablet_bootstrap.cc:654] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.517016 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_44d2bbefe6b14ed29a35f1c1b6a3a9d9" } new_table_name: "default.Table_711286df2623480caf1ade7272c70f0d" modify_external_catalogs: true
I20260620 07:01:22.520902 420 catalog_manager.cc:5495] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 2 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:22.521865 420 catalog_manager.cc:5495] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:22.522241 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet eb0f7d4b6fa14811a1f02456418f95a4 (table default.Table_a7132339336c4cde8e1bf9740c940062 [id=ea9135e430a142ab992288c43fe54bf7]). Expected version 1 got 0
I20260620 07:01:22.522505 420 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:22.523006 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 5855497e5b22493bb60024d30cc23e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.523211 427 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_b19a46e2d20e4f75a3d170cbb543ca71 [id=19dd20742533400980193075baec1956] alter complete (version 1)
I20260620 07:01:22.524523 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_275b8e1034684302afacf36ef1aa7c57" } modify_external_catalogs: true
I20260620 07:01:22.524724 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_275b8e1034684302afacf36ef1aa7c57" } modify_external_catalogs: true
I20260620 07:01:22.527609 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ded117a6342e473e992c6a9d192462f1
I20260620 07:01:22.527657 2366 raft_consensus.cc:686] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:22.527904 2366 consensus_queue.cc:237] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.528252 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_361fa70850d54eb291b21f9da97fbdb0" } new_table_name: "default.Table_043ce56467524870ad8c66601c8eb719" modify_external_catalogs: true
I20260620 07:01:22.529924 869 tablet_service.cc:1514] Processing DeleteTablet for tablet ded117a6342e473e992c6a9d192462f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.530861 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet ded117a6342e473e992c6a9d192462f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.533079 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 5855497e5b22493bb60024d30cc23e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.533304 720 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f648ab301c4e3c83bd33230653f395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.533926 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 4128a4e9a228456cb5cd08eef2bf73d4 with delete_type TABLET_DATA_DELETED (replaced by tablet c292d437da9741af8ed8d05d8932d870) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.534125 727 tablet_service.cc:1514] Processing DeleteTablet for tablet ded117a6342e473e992c6a9d192462f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.535724 869 tablet_service.cc:1467] Processing CreateTablet for tablet d17f18bd4b9743d1af48e3fee45bf525 (DEFAULT_TABLE table=default.Table_80767314891a4208af17029afa663aff [id=fb49979e6e0e43d7a10a712a1b6e5ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.537111 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 40c431492b654903a44b3a6db3dba363 (DEFAULT_TABLE table=default.Table_bcb9bb2d798e4c9981a78796f16cbd71 [id=c79fb17796444aaa9d77f657dbfcaa4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.537556 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c431492b654903a44b3a6db3dba363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.537629 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 778bd8bda6b3447eb94154d53e7bfa67 (DEFAULT_TABLE table=default.Table_ecac1f12f41f42609220ff60055c6e50 [id=b22bf01348b04d348a7d6fea3cf21496]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.537890 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 778bd8bda6b3447eb94154d53e7bfa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.543206 994 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb5246eb5c04c898d88efb17ca65051 (DEFAULT_TABLE table=default.Table_88baf3e114364967936c5fedb74422cb [id=122dc2d012f84694a7957952e1ab53bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.543612 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb5246eb5c04c898d88efb17ca65051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.547201 1001 tablet_service.cc:1467] Processing CreateTablet for tablet b1f648ab301c4e3c83bd33230653f395 (DEFAULT_TABLE table=default.Table_8af172cfabc043eca78837a1636bd814 [id=3dde8edabd934d6e955bff80065e297e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.547658 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1f648ab301c4e3c83bd33230653f395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.553715 727 tablet_service.cc:1467] Processing CreateTablet for tablet d17f18bd4b9743d1af48e3fee45bf525 (DEFAULT_TABLE table=default.Table_80767314891a4208af17029afa663aff [id=fb49979e6e0e43d7a10a712a1b6e5ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.554160 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d17f18bd4b9743d1af48e3fee45bf525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.554214 720 tablet_service.cc:1467] Processing CreateTablet for tablet 40c431492b654903a44b3a6db3dba363 (DEFAULT_TABLE table=default.Table_bcb9bb2d798e4c9981a78796f16cbd71 [id=c79fb17796444aaa9d77f657dbfcaa4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.554526 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c431492b654903a44b3a6db3dba363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.556061 1003 tablet_service.cc:1467] Processing CreateTablet for tablet a75be0eee2454e0fad995e0f74a82a80 (DEFAULT_TABLE table=default.Table_d5d5e550e63747639ad05d1e42f47abe [id=de1b84b0f48341b1baf432fb02840a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.556500 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a75be0eee2454e0fad995e0f74a82a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.557358 716 tablet_service.cc:1467] Processing CreateTablet for tablet a75be0eee2454e0fad995e0f74a82a80 (DEFAULT_TABLE table=default.Table_d5d5e550e63747639ad05d1e42f47abe [id=de1b84b0f48341b1baf432fb02840a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.557688 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a75be0eee2454e0fad995e0f74a82a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.559453 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d17f18bd4b9743d1af48e3fee45bf525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.561591 720 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb5246eb5c04c898d88efb17ca65051 (DEFAULT_TABLE table=default.Table_88baf3e114364967936c5fedb74422cb [id=122dc2d012f84694a7957952e1ab53bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.561968 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb5246eb5c04c898d88efb17ca65051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.565330 888 raft_consensus.cc:1261] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 2 FOLLOWER]: Refusing update from remote peer 2b84cae646b24bc7bd424eb8434ad425: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260620 07:01:22.565476 861 tablet_service.cc:1467] Processing CreateTablet for tablet a75be0eee2454e0fad995e0f74a82a80 (DEFAULT_TABLE table=default.Table_d5d5e550e63747639ad05d1e42f47abe [id=de1b84b0f48341b1baf432fb02840a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.565846 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a75be0eee2454e0fad995e0f74a82a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.566540 874 tablet_service.cc:1467] Processing CreateTablet for tablet b1f648ab301c4e3c83bd33230653f395 (DEFAULT_TABLE table=default.Table_8af172cfabc043eca78837a1636bd814 [id=3dde8edabd934d6e955bff80065e297e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.567087 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1f648ab301c4e3c83bd33230653f395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.569726 857 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb5246eb5c04c898d88efb17ca65051 (DEFAULT_TABLE table=default.Table_88baf3e114364967936c5fedb74422cb [id=122dc2d012f84694a7957952e1ab53bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.570055 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb5246eb5c04c898d88efb17ca65051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.571169 867 tablet_service.cc:1467] Processing CreateTablet for tablet 778bd8bda6b3447eb94154d53e7bfa67 (DEFAULT_TABLE table=default.Table_ecac1f12f41f42609220ff60055c6e50 [id=b22bf01348b04d348a7d6fea3cf21496]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.571576 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 778bd8bda6b3447eb94154d53e7bfa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.575450 863 tablet_service.cc:1467] Processing CreateTablet for tablet 40c431492b654903a44b3a6db3dba363 (DEFAULT_TABLE table=default.Table_bcb9bb2d798e4c9981a78796f16cbd71 [id=c79fb17796444aaa9d77f657dbfcaa4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.575889 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c431492b654903a44b3a6db3dba363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.580406 2581 raft_consensus.cc:482] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.482748 1169 ts_tablet_manager.cc:1918] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.580715 1169 log.cc:1196] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/333eef8b98da4a279acceaead9405149
I20260620 07:01:22.580587 2581 raft_consensus.cc:504] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.581102 1169 ts_tablet_manager.cc:1939] T 333eef8b98da4a279acceaead9405149 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:22.581342 2581 leader_election.cc:288] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.581883 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1048) took 3223 ms. Trace:
I20260620 07:01:22.581976 1169 rpcz_store.cc:276] 0620 07:01:19.358528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.359292 (+ 764us) service_pool.cc:227] Handling call
0620 07:01:22.218905 (+2859613us) ts_tablet_manager.cc:1145] Deleting tablet 333eef8b98da4a279acceaead9405149
0620 07:01:22.218924 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.397231 (+178307us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:22.482651 (+ 85420us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:22.581864 (+ 99213us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2859474}
I20260620 07:01:22.582377 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1049) took 3223 ms. Trace:
I20260620 07:01:22.582471 1169 rpcz_store.cc:276] 0620 07:01:19.358636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.359441 (+ 805us) service_pool.cc:227] Handling call
0620 07:01:22.582280 (+3222839us) ts_tablet_manager.cc:1145] Deleting tablet a9d4ef3ba51e432f889fb927a6af8b49
0620 07:01:22.582290 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.582362 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3222741}
I20260620 07:01:22.582741 1169 tablet_replica.cc:330] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:22.582959 1169 raft_consensus.cc:2229] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.583166 1169 raft_consensus.cc:2258] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.583560 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3651ef9790d342ec96f554134ae714dc" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.583737 1169 ts_tablet_manager.cc:1905] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.583841 1031 raft_consensus.cc:2454] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:22.584540 681 leader_election.cc:302] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:22.585088 716 tablet_service.cc:1467] Processing CreateTablet for tablet b1f648ab301c4e3c83bd33230653f395 (DEFAULT_TABLE table=default.Table_8af172cfabc043eca78837a1636bd814 [id=3dde8edabd934d6e955bff80065e297e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.585457 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 333eef8b98da4a279acceaead9405149 (table default.Table_e032d39a4bb74ed18c922fb3ba622d07 [id=1135222d9b5f4d14bb527056194a68cd]) successfully deleted
W20260620 07:01:22.585762 413 catalog_manager.cc:4808] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet a9d4ef3ba51e432f889fb927a6af8b49 because the tablet was not found. No further retry: Not found: Tablet not found: a9d4ef3ba51e432f889fb927a6af8b49
I20260620 07:01:22.585808 727 tablet_service.cc:1467] Processing CreateTablet for tablet 778bd8bda6b3447eb94154d53e7bfa67 (DEFAULT_TABLE table=default.Table_ecac1f12f41f42609220ff60055c6e50 [id=b22bf01348b04d348a7d6fea3cf21496]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.592525 2581 raft_consensus.cc:2781] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.592684 2581 raft_consensus.cc:482] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.592762 2581 raft_consensus.cc:3037] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.594529 2592 raft_consensus.cc:482] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.594691 2592 raft_consensus.cc:504] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.595427 2592 leader_election.cc:288] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:22.596489 969 leader_election.cc:341] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cf0bae39e1634710af12de493f7f58d5
I20260620 07:01:22.598875 2452 consensus_queue.cc:1035] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:22.602157 1010 tablet_service.cc:1467] Processing CreateTablet for tablet dcb01b8ab6f2440b8612af790a86c858 (DEFAULT_TABLE table=default.Table_76836e03e3af4d5290e79e81eda0ab64 [id=1c996351ba724b0a962fbe69ad2a3bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.602314 2663 raft_consensus.cc:482] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.602445 2663 raft_consensus.cc:504] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.602599 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcb01b8ab6f2440b8612af790a86c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.602939 2569 raft_consensus.cc:482] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.603072 2569 raft_consensus.cc:504] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:22.603251 683 leader_election.cc:341] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3651ef9790d342ec96f554134ae714dc
I20260620 07:01:22.603665 2569 leader_election.cc:288] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.603734 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 30ea95affc1a4657afd13a01e2cc304d (DEFAULT_TABLE table=default.Table_088b8f1d026f4a638631c284a7c66e42 [id=35e3837f1efd48a2939551c8c0366c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.604059 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30ea95affc1a4657afd13a01e2cc304d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.604198 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a3ccec08ee4c8480a808b1402eb4a9" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.604687 681 leader_election.cc:341] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.605269 2663 leader_election.cc:288] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.605409 996 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2b7ebe35b342059e08152dac56761f (DEFAULT_TABLE table=default.Table_ff79295ab7e34563b6edae211c496205 [id=90fb53465d37456792e82cfe3ce3d6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.605811 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2b7ebe35b342059e08152dac56761f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.607020 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 91a83a8128fd405a856e692a4bdab8f3 (DEFAULT_TABLE table=default.Table_4c9adf5632e1496ba74dab0d3973432d [id=76224d8e7484463dafa57e083f3adb0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.607316 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a83a8128fd405a856e692a4bdab8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.611263 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "113dd3d57c144088ae7204dc5229f883" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.611783 830 leader_election.cc:341] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.611611 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0bae39e1634710af12de493f7f58d5" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:22.612766 968 leader_election.cc:341] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: Tablet not RUNNING: STOPPED
I20260620 07:01:22.612898 968 leader_election.cc:302] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.613299 2592 raft_consensus.cc:2726] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.614423 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a3ccec08ee4c8480a808b1402eb4a9" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:22.614555 733 tablet_service.cc:1467] Processing CreateTablet for tablet 30ea95affc1a4657afd13a01e2cc304d (DEFAULT_TABLE table=default.Table_088b8f1d026f4a638631c284a7c66e42 [id=35e3837f1efd48a2939551c8c0366c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.614677 888 raft_consensus.cc:2454] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:22.615062 730 tablet_service.cc:1467] Processing CreateTablet for tablet 91a83a8128fd405a856e692a4bdab8f3 (DEFAULT_TABLE table=default.Table_4c9adf5632e1496ba74dab0d3973432d [id=76224d8e7484463dafa57e083f3adb0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.615518 683 leader_election.cc:302] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:22.615975 2569 raft_consensus.cc:2781] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.616056 2569 raft_consensus.cc:482] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.616130 2569 raft_consensus.cc:3037] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.616084 857 tablet_service.cc:1467] Processing CreateTablet for tablet 30ea95affc1a4657afd13a01e2cc304d (DEFAULT_TABLE table=default.Table_088b8f1d026f4a638631c284a7c66e42 [id=35e3837f1efd48a2939551c8c0366c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.616473 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30ea95affc1a4657afd13a01e2cc304d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.619189 861 tablet_service.cc:1467] Processing CreateTablet for tablet 91a83a8128fd405a856e692a4bdab8f3 (DEFAULT_TABLE table=default.Table_4c9adf5632e1496ba74dab0d3973432d [id=76224d8e7484463dafa57e083f3adb0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.619601 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a83a8128fd405a856e692a4bdab8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.619730 2569 raft_consensus.cc:504] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.620534 2569 leader_election.cc:288] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.621125 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a3ccec08ee4c8480a808b1402eb4a9" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:22.621763 681 leader_election.cc:341] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.624567 720 tablet_service.cc:1467] Processing CreateTablet for tablet dcb01b8ab6f2440b8612af790a86c858 (DEFAULT_TABLE table=default.Table_76836e03e3af4d5290e79e81eda0ab64 [id=1c996351ba724b0a962fbe69ad2a3bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.624814 1168 tablet_bootstrap.cc:492] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.625002 1168 ts_tablet_manager.cc:1397] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.210s user 0.043s sys 0.089s
I20260620 07:01:22.625084 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1f648ab301c4e3c83bd33230653f395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.625245 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30ea95affc1a4657afd13a01e2cc304d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.625828 1168 raft_consensus.cc:348] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.626001 1168 raft_consensus.cc:374] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.626050 1168 raft_consensus.cc:729] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.626458 1168 consensus_queue.cc:260] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.627008 1168 ts_tablet_manager.cc:1428] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:22.627231 1168 tablet_bootstrap.cc:492] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:22.628731 1168 tablet_bootstrap.cc:654] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.629945 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a83a8128fd405a856e692a4bdab8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.630555 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcb01b8ab6f2440b8612af790a86c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.630606 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "113dd3d57c144088ae7204dc5229f883" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.635392 2452 raft_consensus.cc:482] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.635576 2452 raft_consensus.cc:504] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.636348 2452 leader_election.cc:288] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.636656 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 778bd8bda6b3447eb94154d53e7bfa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.638818 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76237044ff2f4c8b84c6af43badd164a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.638998 1029 raft_consensus.cc:1261] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 2 FOLLOWER]: Refusing update from remote peer 2b84cae646b24bc7bd424eb8434ad425: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260620 07:01:22.639331 2592 raft_consensus.cc:482] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.639465 2592 raft_consensus.cc:504] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.639719 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633 (DEFAULT_TABLE table=default.Table_e3bac62777904f028c5af42ef8b750cc [id=2025f5a56642416da72d0dbe222fa1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.640005 2592 leader_election.cc:288] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.640090 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:22.641368 969 leader_election.cc:341] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cd75e318982a4fb9bf28cb35b030642f
W20260620 07:01:22.642374 681 leader_election.cc:341] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.642689 2569 consensus_queue.cc:1035] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:22.642984 2452 raft_consensus.cc:482] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.643097 2452 raft_consensus.cc:504] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.643743 2452 leader_election.cc:288] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.644392 733 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2b7ebe35b342059e08152dac56761f (DEFAULT_TABLE table=default.Table_ff79295ab7e34563b6edae211c496205 [id=90fb53465d37456792e82cfe3ce3d6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.644537 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37f336c01974ba79caeb25f4781667a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.645938 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2b7ebe35b342059e08152dac56761f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:22.646131 681 leader_election.cc:341] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.646570 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd75e318982a4fb9bf28cb35b030642f" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:22.647388 831 leader_election.cc:341] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.647621 2366 raft_consensus.cc:482] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.647794 2366 raft_consensus.cc:504] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.648492 2366 leader_election.cc:288] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:22.649415 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73bcb81a0c84cdfb4dea0561647828a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.650118 830 leader_election.cc:341] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.650346 831 leader_election.cc:302] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.651075 2366 raft_consensus.cc:2726] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.657711 730 tablet_service.cc:1467] Processing CreateTablet for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633 (DEFAULT_TABLE table=default.Table_e3bac62777904f028c5af42ef8b750cc [id=2025f5a56642416da72d0dbe222fa1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.658234 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.657629 751 raft_consensus.cc:2454] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:22.661881 968 leader_election.cc:302] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:22.662380 2592 raft_consensus.cc:2781] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.662452 2592 raft_consensus.cc:482] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.662506 2592 raft_consensus.cc:3037] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.663067 997 tablet_service.cc:1514] Processing DeleteTablet for tablet 4128a4e9a228456cb5cd08eef2bf73d4 with delete_type TABLET_DATA_DELETED (replaced by tablet c292d437da9741af8ed8d05d8932d870) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.665722 2592 raft_consensus.cc:504] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.666307 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a3ccec08ee4c8480a808b1402eb4a9" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:22.666496 2592 leader_election.cc:288] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.666570 888 raft_consensus.cc:3037] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.667197 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd75e318982a4fb9bf28cb35b030642f" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:22.667380 751 raft_consensus.cc:3037] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.669847 751 raft_consensus.cc:2454] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:22.670293 968 leader_election.cc:302] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:22.670655 2592 raft_consensus.cc:2781] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.670873 2592 raft_consensus.cc:686] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:22.671067 888 raft_consensus.cc:2454] T 00a3ccec08ee4c8480a808b1402eb4a9 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:22.671106 2592 consensus_queue.cc:237] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:22.671603 969 leader_election.cc:341] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: cd75e318982a4fb9bf28cb35b030642f
I20260620 07:01:22.673301 683 leader_election.cc:302] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:22.673990 2452 raft_consensus.cc:2781] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.674130 2452 raft_consensus.cc:686] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:22.674578 2452 consensus_queue.cc:237] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:22.677331 681 consensus_peers.cc:487] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f9d7421b549468e8a7782f467473bdb. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:22.677562 427 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_20c884ae94984113bab8149dbfd6b8d0 [id=4896f23e711941b988db4ea9f22ce625] alter complete (version 5)
I20260620 07:01:22.678803 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76237044ff2f4c8b84c6af43badd164a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:22.679178 888 raft_consensus.cc:2454] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:22.679606 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_bc6f45b50d5647928a19eb8b0b789fd8" } new_table_name: "default.Table_81ba0bc77e1248e3a02688cf1ef9bfea" modify_external_catalogs: true
I20260620 07:01:22.684466 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b878def9344cbdae65b209cac4067f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.684474 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d46ba54811d64a4bbb102c24b7e98245"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.684928 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 877a71e8db5f4bf689df39f83735f326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:22.685119 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d46ba54811d64a4bbb102c24b7e98245 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.685389 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.685418 996 tablet_service.cc:1514] Processing DeleteTablet for tablet cd75e318982a4fb9bf28cb35b030642f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.685791 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 4260b0c953c14a198dbf9b64a30e7e05 with delete_type TABLET_DATA_DELETED (replaced by tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.686163 997 tablet_service.cc:1514] Processing DeleteTablet for tablet d0c41bf6a8a448ad809292d66ebf9c0e with delete_type TABLET_DATA_DELETED (replaced by tablet 74eaa712962245b4bb14d17e4cdd8485) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.686195 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f8c4955c164e6b9061ac607bbe081c with delete_type TABLET_DATA_DELETED (replaced by tablet 0e864cac7431439b9eb18d0cd98a7755) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.687964 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 125e8a5e20bf484cade408f0358489a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 48726d9a3aa745fca3bcd9b6e8807c49) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.688237 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c01c4e10f345fc84e3e253e8501aff with delete_type TABLET_DATA_DELETED (replaced by tablet 6363d1d9233d4938ba40abff452ed147) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:22.689736 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet c8f81fa4e88945f1a392fbacfd031392 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:22.689734 683 leader_election.cc:341] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e37f336c01974ba79caeb25f4781667a
I20260620 07:01:22.689841 683 leader_election.cc:302] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.682741 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c704b8cf734a4d74b04175f7d4e41dcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:22.691480 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4bebaa8ed1431d8c775f4856a3d808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.691620 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 485ce059be9b4900adb1dbc3268efb55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.691686 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 5926946427294a5ca6fbc72d3e1b612d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:22.691807 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c704b8cf734a4d74b04175f7d4e41dcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:22.691843 861 tablet_service.cc:1514] Processing DeleteTablet for tablet c73bcb81a0c84cdfb4dea0561647828a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:22.691995 683 leader_election.cc:302] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:22.692229 2564 raft_consensus.cc:2726] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.692366 2564 raft_consensus.cc:2781] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.692418 2564 raft_consensus.cc:482] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.692474 2564 raft_consensus.cc:3037] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.694941 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet f8be5f41f1d64d918b727e3eef18738e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:18 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.695647 2564 raft_consensus.cc:504] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.696336 2564 leader_election.cc:288] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.696656 1165 ts_tablet_manager.cc:1918] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.696856 1165 log.cc:1196] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/4128a4e9a228456cb5cd08eef2bf73d4
I20260620 07:01:22.697252 1165 ts_tablet_manager.cc:1939] T 4128a4e9a228456cb5cd08eef2bf73d4 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:22.697163 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76237044ff2f4c8b84c6af43badd164a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:22.697705 681 leader_election.cc:341] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.698462 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 4302edba0ec04d7abc2789bc7be1beca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:22.657274 2581 raft_consensus.cc:504] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.698964 1165 tablet_replica.cc:330] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:22.699154 1165 raft_consensus.cc:2229] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.699304 1165 raft_consensus.cc:2258] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.699723 2581 leader_election.cc:288] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.699857 1165 ts_tablet_manager.cc:1905] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.700285 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3651ef9790d342ec96f554134ae714dc" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:22.700479 1031 raft_consensus.cc:3037] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.703229 1166 tablet_replica.cc:330] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.703269 1031 raft_consensus.cc:2454] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:22.703460 1166 raft_consensus.cc:2229] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:22.703730 1166 pending_rounds.cc:62] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:22.703855 1166 pending_rounds.cc:68] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821660588797952 op_type: NO_OP noop_request { }
I20260620 07:01:22.703898 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 7d3ebdb3ef844adf82b99a6d3b6c61c2 (table default.Table_642c62b94c31483480661843e4bcbe5c [id=aec61ada90ac43b6b4ca3d6c297c8bd3]) successfully deleted
I20260620 07:01:22.704083 1166 raft_consensus.cc:2866] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:22.704474 681 leader_election.cc:302] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:22.704213 1166 raft_consensus.cc:2258] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.709439 867 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2b7ebe35b342059e08152dac56761f (DEFAULT_TABLE table=default.Table_ff79295ab7e34563b6edae211c496205 [id=90fb53465d37456792e82cfe3ce3d6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.710016 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2b7ebe35b342059e08152dac56761f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.715600 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 4128a4e9a228456cb5cd08eef2bf73d4 (table default.Table_837dfe71dadf41468194692d0c1e1ed0 [id=c263c37cb6584037bd9fbd704dd61f5f]) successfully deleted
I20260620 07:01:22.715734 2366 raft_consensus.cc:482] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:22.715957 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet b1f648ab301c4e3c83bd33230653f395 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1f648ab301c4e3c83bd33230653f395 already in progress: creating tablet
I20260620 07:01:22.715925 2366 raft_consensus.cc:504] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
W20260620 07:01:22.716159 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 5855497e5b22493bb60024d30cc23e03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5855497e5b22493bb60024d30cc23e03 already in progress: creating tablet
W20260620 07:01:22.716355 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ded117a6342e473e992c6a9d192462f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ded117a6342e473e992c6a9d192462f1 already in progress: creating tablet
I20260620 07:01:22.716722 2366 leader_election.cc:288] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:22.719302 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485ce059be9b4900adb1dbc3268efb55" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.719847 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76237044ff2f4c8b84c6af43badd164a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:22.720075 888 raft_consensus.cc:3037] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.723073 888 raft_consensus.cc:2454] T 76237044ff2f4c8b84c6af43badd164a P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:22.723556 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485ce059be9b4900adb1dbc3268efb55" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.724457 830 leader_election.cc:341] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.725597 1167 tablet_bootstrap.cc:492] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.725776 1167 ts_tablet_manager.cc:1397] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.229s user 0.039s sys 0.044s
I20260620 07:01:22.725855 2581 raft_consensus.cc:2781] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.726037 2581 raft_consensus.cc:686] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:22.726300 2581 consensus_queue.cc:237] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.726545 1167 raft_consensus.cc:348] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.726773 1167 raft_consensus.cc:374] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.726904 1167 raft_consensus.cc:729] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.727900 1167 consensus_queue.cc:260] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.728706 1167 ts_tablet_manager.cc:1428] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 07:01:22.730934 874 tablet_service.cc:1467] Processing CreateTablet for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633 (DEFAULT_TABLE table=default.Table_e3bac62777904f028c5af42ef8b750cc [id=2025f5a56642416da72d0dbe222fa1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.731398 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.732088 1167 tablet_bootstrap.cc:492] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.732414 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73bcb81a0c84cdfb4dea0561647828a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:22.733232 683 leader_election.cc:341] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3651ef9790d342ec96f554134ae714dc
W20260620 07:01:22.733753 831 leader_election.cc:341] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.733826 1167 tablet_bootstrap.cc:654] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.734037 683 leader_election.cc:302] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:22.734472 2569 raft_consensus.cc:2781] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.734584 2569 raft_consensus.cc:686] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:22.734894 2569 consensus_queue.cc:237] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.740131 831 leader_election.cc:302] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.740413 2664 raft_consensus.cc:2726] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:22.740654 831 leader_election.cc:341] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.740815 831 leader_election.cc:302] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.741096 2664 raft_consensus.cc:2726] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.735947 1165 ts_tablet_manager.cc:1918] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.741672 1165 log.cc:1196] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/0a4bebaa8ed1431d8c775f4856a3d808
I20260620 07:01:22.737983 863 tablet_service.cc:1467] Processing CreateTablet for tablet dcb01b8ab6f2440b8612af790a86c858 (DEFAULT_TABLE table=default.Table_76836e03e3af4d5290e79e81eda0ab64 [id=1c996351ba724b0a962fbe69ad2a3bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:22.742233 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcb01b8ab6f2440b8612af790a86c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:22.743358 1167 tablet_bootstrap.cc:492] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.743518 1167 ts_tablet_manager.cc:1397] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260620 07:01:22.742190 1165 ts_tablet_manager.cc:1939] T 0a4bebaa8ed1431d8c775f4856a3d808 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:22.745545 1165 tablet_replica.cc:330] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:22.749101 1165 raft_consensus.cc:2229] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.751583 1165 raft_consensus.cc:2258] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.751924 1167 raft_consensus.cc:348] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.752753 1165 ts_tablet_manager.cc:1905] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.753225 1167 raft_consensus.cc:374] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.753561 1167 raft_consensus.cc:729] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.754528 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 0a4bebaa8ed1431d8c775f4856a3d808 (table default.Table_ed11da599e5c4b44b63531233e52da80 [id=5129c45c780d450ea02914b5e4c1754f]) successfully deleted
I20260620 07:01:22.755218 1166 ts_tablet_manager.cc:1905] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.753999 1167 consensus_queue.cc:260] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.756409 1167 ts_tablet_manager.cc:1428] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260620 07:01:22.757121 1167 tablet_bootstrap.cc:492] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.764654 1167 tablet_bootstrap.cc:654] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.762741 1165 ts_tablet_manager.cc:1918] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.784039 1165 log.cc:1196] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/485ce059be9b4900adb1dbc3268efb55
I20260620 07:01:22.784695 1165 ts_tablet_manager.cc:1939] T 485ce059be9b4900adb1dbc3268efb55 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:22.785265 2592 raft_consensus.cc:482] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.785475 2592 raft_consensus.cc:504] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.786314 2592 leader_election.cc:288] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:22.787197 969 leader_election.cc:341] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 6a36a5319a044e9da7dc7b666484e257
I20260620 07:01:22.787547 1165 tablet_replica.cc:330] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:22.787675 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 485ce059be9b4900adb1dbc3268efb55 (table default.Table_3ab345e4abbc4b6c9cf08c26e1a95287 [id=96b547ecb1de4ab3838dab042caeac95]) successfully deleted
I20260620 07:01:22.787801 1165 raft_consensus.cc:2229] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.788012 1165 raft_consensus.cc:2258] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.788590 1165 ts_tablet_manager.cc:1905] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.791355 2564 raft_consensus.cc:482] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.791532 2564 raft_consensus.cc:504] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.792253 2564 leader_election.cc:288] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.793129 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ad723586ff545049dad658221e6455b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.793943 681 leader_election.cc:341] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.794595 891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ad723586ff545049dad658221e6455b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:22.794871 891 raft_consensus.cc:2454] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:22.795258 683 leader_election.cc:302] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:22.795730 2564 raft_consensus.cc:2781] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.795815 2564 raft_consensus.cc:482] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.795909 2564 raft_consensus.cc:3037] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.799075 2592 raft_consensus.cc:482] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.799281 2592 raft_consensus.cc:504] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.800405 2592 leader_election.cc:288] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.798779 2564 raft_consensus.cc:504] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.787081 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a36a5319a044e9da7dc7b666484e257" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.801759 751 raft_consensus.cc:2454] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
W20260620 07:01:22.801836 968 leader_election.cc:341] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 88c6aeea7c504f36964e8bf41b0fc4f9
I20260620 07:01:22.802212 968 leader_election.cc:302] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
W20260620 07:01:22.802505 969 leader_election.cc:341] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 88c6aeea7c504f36964e8bf41b0fc4f9
I20260620 07:01:22.802634 969 leader_election.cc:302] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.803002 2531 raft_consensus.cc:2781] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.803119 2531 raft_consensus.cc:482] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.803210 2531 raft_consensus.cc:3037] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.803243 2664 raft_consensus.cc:482] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.803476 1168 tablet_bootstrap.cc:492] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.803356 2664 raft_consensus.cc:504] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.803586 1168 ts_tablet_manager.cc:1397] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.176s user 0.018s sys 0.023s
I20260620 07:01:22.803905 2664 leader_election.cc:288] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:22.804328 1168 raft_consensus.cc:348] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.804591 1168 raft_consensus.cc:374] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.804652 1168 raft_consensus.cc:729] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.804003 2564 leader_election.cc:288] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.804870 1168 consensus_queue.cc:260] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.805537 1168 ts_tablet_manager.cc:1428] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:22.805804 1168 tablet_bootstrap.cc:492] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:22.806102 2531 raft_consensus.cc:504] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.807412 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ad723586ff545049dad658221e6455b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:22.807529 1168 tablet_bootstrap.cc:654] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.808024 888 raft_consensus.cc:3037] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.808189 2592 raft_consensus.cc:2726] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:22.808509 969 leader_election.cc:341] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 6a36a5319a044e9da7dc7b666484e257
I20260620 07:01:22.808876 1166 ts_tablet_manager.cc:1918] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:22.809715 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a36a5319a044e9da7dc7b666484e257" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:22.809988 751 raft_consensus.cc:3037] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.810638 888 raft_consensus.cc:2454] T 9ad723586ff545049dad658221e6455b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:22.811041 683 leader_election.cc:302] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
W20260620 07:01:22.812099 388 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4u_93S/build/asan/bin/kudu pid 1194: Timed out: CheckLeaks RPC to 127.0.97.60:46775 timed out after 1.000s (SENT)
I20260620 07:01:22.812284 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4u_93S/build/asan/bin/kudu with pid 1194
I20260620 07:01:22.812830 1170 tablet_bootstrap.cc:492] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.812960 1170 ts_tablet_manager.cc:1397] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.298s user 0.006s sys 0.002s
I20260620 07:01:22.814190 2452 raft_consensus.cc:2781] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.814486 2452 raft_consensus.cc:686] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:22.814761 2452 consensus_queue.cc:237] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.808939 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a064674792b42d49e9ff20a7496f820" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:22.809499 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ad723586ff545049dad658221e6455b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:22.816143 1166 log.cc:1196] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/333eef8b98da4a279acceaead9405149
W20260620 07:01:22.816619 681 leader_election.cc:341] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.806737 2531 leader_election.cc:288] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.811954 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a064674792b42d49e9ff20a7496f820" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.818548 749 raft_consensus.cc:2454] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
W20260620 07:01:22.816395 830 leader_election.cc:341] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.819062 831 leader_election.cc:302] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:22.820283 2664 raft_consensus.cc:2781] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:22.820375 2664 raft_consensus.cc:482] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:22.820441 2664 raft_consensus.cc:3037] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.823050 2664 raft_consensus.cc:504] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.823779 2664 leader_election.cc:288] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:22.824503 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a064674792b42d49e9ff20a7496f820" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:22.824653 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a064674792b42d49e9ff20a7496f820" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:22.824872 749 raft_consensus.cc:3037] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:22.825515 1165 ts_tablet_manager.cc:1918] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.825625 1165 log.cc:1196] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/5926946427294a5ca6fbc72d3e1b612d
I20260620 07:01:22.825894 1165 ts_tablet_manager.cc:1939] T 5926946427294a5ca6fbc72d3e1b612d P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:22.826498 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 5926946427294a5ca6fbc72d3e1b612d (table default.Table_0948b3a7b876431dafb498c00e40cc2e [id=fe4914615d844910998e00900b81fe05]) successfully deleted
W20260620 07:01:22.826984 830 leader_election.cc:341] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.828387 749 raft_consensus.cc:2454] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:22.828889 831 leader_election.cc:302] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:22.829319 1165 tablet_replica.cc:330] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:22.829888 1165 raft_consensus.cc:2229] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.830528 2664 raft_consensus.cc:2781] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.830750 2664 raft_consensus.cc:686] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:22.830840 1165 raft_consensus.cc:2258] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.831068 2664 consensus_queue.cc:237] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.832284 1165 ts_tablet_manager.cc:1905] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.835755 1166 ts_tablet_manager.cc:1939] T 333eef8b98da4a279acceaead9405149 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.836690 1170 raft_consensus.cc:348] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.836925 1170 raft_consensus.cc:374] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.836969 1170 raft_consensus.cc:729] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.837159 1170 consensus_queue.cc:260] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.837441 751 raft_consensus.cc:2454] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:22.837760 1170 ts_tablet_manager.cc:1428] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260620 07:01:22.838256 1170 tablet_bootstrap.cc:492] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.838263 968 leader_election.cc:302] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:22.838699 2531 raft_consensus.cc:2781] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:22.838976 2531 raft_consensus.cc:686] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:22.839229 2531 consensus_queue.cc:237] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.844362 2592 raft_consensus.cc:482] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.844587 2592 raft_consensus.cc:504] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
I20260620 07:01:22.845323 2592 leader_election.cc:288] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:22.849179 1168 tablet_bootstrap.cc:492] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:22.849423 1168 ts_tablet_manager.cc:1397] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.044s user 0.006s sys 0.002s
I20260620 07:01:22.850281 1168 raft_consensus.cc:348] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.850981 1168 raft_consensus.cc:374] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.851178 1168 raft_consensus.cc:729] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.851553 1168 consensus_queue.cc:260] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.853185 1168 ts_tablet_manager.cc:1428] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:22.853938 1168 tablet_bootstrap.cc:492] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:22.855062 969 leader_election.cc:341] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4302edba0ec04d7abc2789bc7be1beca
W20260620 07:01:22.855379 968 leader_election.cc:341] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 4302edba0ec04d7abc2789bc7be1beca
I20260620 07:01:22.856652 968 leader_election.cc:302] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:22.857225 1170 tablet_bootstrap.cc:654] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.857523 2592 raft_consensus.cc:2726] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:22.870699 1166 tablet_replica.cc:330] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.870725 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 333eef8b98da4a279acceaead9405149 (table default.Table_e032d39a4bb74ed18c922fb3ba622d07 [id=1135222d9b5f4d14bb527056194a68cd]) successfully deleted
I20260620 07:01:22.871102 1166 raft_consensus.cc:2229] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:22.871124 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5d394816a1114bf688692a825a176c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d394816a1114bf688692a825a176c92 already in progress: creating tablet
I20260620 07:01:22.871335 1166 raft_consensus.cc:2258] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:22.871613 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2f1be61424224fa6a2e14985266defbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f1be61424224fa6a2e14985266defbb already in progress: creating tablet
W20260620 07:01:22.871878 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4444360e8ade484f958816c5b80dca7e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4444360e8ade484f958816c5b80dca7e already in progress: creating tablet
I20260620 07:01:22.871932 1166 ts_tablet_manager.cc:1905] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.874162 1168 tablet_bootstrap.cc:654] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.876382 1165 ts_tablet_manager.cc:1918] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.880952 1165 log.cc:1196] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/c73bcb81a0c84cdfb4dea0561647828a
I20260620 07:01:22.881753 1165 ts_tablet_manager.cc:1939] T c73bcb81a0c84cdfb4dea0561647828a P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:22.887266 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet c73bcb81a0c84cdfb4dea0561647828a (table default.Table_5ddbd67fa9074a4b817bbe12a7725343 [id=166782c539214a359fa49796e3643504]) successfully deleted
I20260620 07:01:22.895357 1166 ts_tablet_manager.cc:1918] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.903553 2688 tablet.cc:1722] T 2e0891d6911d4bf8887f7e88a605aed5 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:22.907156 2686 tablet.cc:1722] T 2e0891d6911d4bf8887f7e88a605aed5 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:22.911785 1170 tablet_bootstrap.cc:492] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.912072 1170 ts_tablet_manager.cc:1397] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.074s user 0.008s sys 0.001s
I20260620 07:01:22.913089 1170 raft_consensus.cc:348] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.913467 1170 raft_consensus.cc:374] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.913586 1170 raft_consensus.cc:729] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.913890 1170 consensus_queue.cc:260] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.926576 2687 tablet.cc:1722] T 2e0891d6911d4bf8887f7e88a605aed5 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:22.927824 1166 log.cc:1196] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/3456cf91d65a4413a35efe94513c723d
I20260620 07:01:22.928313 1166 ts_tablet_manager.cc:1939] T 3456cf91d65a4413a35efe94513c723d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.929392 1170 ts_tablet_manager.cc:1428] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260620 07:01:22.929559 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 3456cf91d65a4413a35efe94513c723d (table default.Table_e0b5f5ba1fe24a7fbe1e9fdbb9da6bc9 [id=24e00ed0d7994f1cbebd87b708274b55]) successfully deleted
I20260620 07:01:22.929809 1170 tablet_bootstrap.cc:492] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:22.930398 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 393521cca6b44618bbfb71423f36c6a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 393521cca6b44618bbfb71423f36c6a1 already in progress: creating tablet
W20260620 07:01:22.931228 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c0f594983a7540db9c245c64a87a3edd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0f594983a7540db9c245c64a87a3edd already in progress: creating tablet
W20260620 07:01:22.932142 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2d262a232e884ed9be976b6b7a8e7a9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d262a232e884ed9be976b6b7a8e7a9c already in progress: creating tablet
W20260620 07:01:22.933086 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet b1f648ab301c4e3c83bd33230653f395 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1f648ab301c4e3c83bd33230653f395 already in progress: creating tablet
W20260620 07:01:22.933846 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5855497e5b22493bb60024d30cc23e03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5855497e5b22493bb60024d30cc23e03 already in progress: creating tablet
W20260620 07:01:22.934461 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ded117a6342e473e992c6a9d192462f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ded117a6342e473e992c6a9d192462f1 already in progress: creating tablet
W20260620 07:01:22.935075 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4128a4e9a228456cb5cd08eef2bf73d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4128a4e9a228456cb5cd08eef2bf73d4 already in progress: creating tablet
I20260620 07:01:22.935411 1166 tablet_replica.cc:330] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.935680 1166 raft_consensus.cc:2229] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:22.935997 1166 pending_rounds.cc:62] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:22.936094 1166 pending_rounds.cc:68] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821663423442944 op_type: NO_OP noop_request { }
I20260620 07:01:22.936288 1166 raft_consensus.cc:2866] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:22.936447 1166 raft_consensus.cc:2258] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.937403 1166 ts_tablet_manager.cc:1905] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.944159 1166 ts_tablet_manager.cc:1918] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:22.944383 1166 log.cc:1196] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/cd75e318982a4fb9bf28cb35b030642f
I20260620 07:01:22.944811 1166 ts_tablet_manager.cc:1939] T cd75e318982a4fb9bf28cb35b030642f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.945966 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet cd75e318982a4fb9bf28cb35b030642f (table default.Table_7d53dfa17a784fa08192e52f450ee287 [id=5af5baece18749bdbccb48b3a793fbe9]) successfully deleted
W20260620 07:01:22.946615 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d0c41bf6a8a448ad809292d66ebf9c0e because the tablet was not found. No further retry: Not found: Tablet not found: d0c41bf6a8a448ad809292d66ebf9c0e
I20260620 07:01:22.947009 1166 tablet_replica.cc:330] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.947252 1166 raft_consensus.cc:2229] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.947453 1166 raft_consensus.cc:2258] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.948112 1166 ts_tablet_manager.cc:1905] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.949231 1167 tablet_bootstrap.cc:492] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.949399 1167 ts_tablet_manager.cc:1397] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.192s user 0.002s sys 0.045s
I20260620 07:01:22.950419 1167 raft_consensus.cc:348] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.950680 1167 raft_consensus.cc:374] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.950763 1167 raft_consensus.cc:729] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.951066 1167 consensus_queue.cc:260] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.951689 1167 ts_tablet_manager.cc:1428] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:22.951972 1167 tablet_bootstrap.cc:492] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.953596 1167 tablet_bootstrap.cc:654] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.955677 1166 ts_tablet_manager.cc:1918] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.956029 1166 log.cc:1196] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/c8f81fa4e88945f1a392fbacfd031392
I20260620 07:01:22.956388 1166 ts_tablet_manager.cc:1939] T c8f81fa4e88945f1a392fbacfd031392 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.957556 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet c8f81fa4e88945f1a392fbacfd031392 (table default.Table_a3dece319ace4b3c8341417bad1846e4 [id=0828a7e1651a4a46926570ca443cf647]) successfully deleted
I20260620 07:01:22.957966 1166 tablet_replica.cc:330] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:22.958292 1166 raft_consensus.cc:2229] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:22.958518 1166 raft_consensus.cc:2258] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:22.959167 1166 ts_tablet_manager.cc:1905] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:22.960897 1170 tablet_bootstrap.cc:654] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.981021 1167 tablet_bootstrap.cc:492] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:22.982095 1167 ts_tablet_manager.cc:1397] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.007s
I20260620 07:01:22.984299 1167 raft_consensus.cc:348] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.986904 1167 raft_consensus.cc:374] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.987112 1167 raft_consensus.cc:729] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.987528 1167 consensus_queue.cc:260] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.988472 1167 ts_tablet_manager.cc:1428] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260620 07:01:22.988654 2664 raft_consensus.cc:482] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:22.988857 2664 raft_consensus.cc:504] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:22.989319 1167 tablet_bootstrap.cc:492] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:22.990046 2664 leader_election.cc:288] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:22.991037 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0f7e6245c074c82a5a72be79ab1987f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:22.991276 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0f7e6245c074c82a5a72be79ab1987f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:22.992436 831 leader_election.cc:341] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:22.992815 830 leader_election.cc:341] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:22.993422 1170 tablet_bootstrap.cc:492] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:22.993587 1170 ts_tablet_manager.cc:1397] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.004s
I20260620 07:01:22.994436 1170 raft_consensus.cc:348] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.994686 1170 raft_consensus.cc:374] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:22.994925 1167 tablet_bootstrap.cc:654] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:22.994890 1170 raft_consensus.cc:729] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:22.995188 1170 consensus_queue.cc:260] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:22.996249 1170 ts_tablet_manager.cc:1428] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:22.996554 1170 tablet_bootstrap.cc:492] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:22.996589 1166 ts_tablet_manager.cc:1918] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:22.996745 1166 log.cc:1196] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f8be5f41f1d64d918b727e3eef18738e
I20260620 07:01:22.997112 1166 ts_tablet_manager.cc:1939] T f8be5f41f1d64d918b727e3eef18738e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:22.997952 830 leader_election.cc:302] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:22.998756 1170 tablet_bootstrap.cc:654] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.000530 2664 raft_consensus.cc:2726] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.001447 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f8be5f41f1d64d918b727e3eef18738e (table default.Table_3122a50618184dc7bf7cb696dca2a55b [id=d55d6c70a1b34227b4820944e280fde8]) successfully deleted
I20260620 07:01:23.007225 1168 tablet_bootstrap.cc:492] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.007464 1168 ts_tablet_manager.cc:1397] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.154s user 0.021s sys 0.018s
I20260620 07:01:23.008222 1168 raft_consensus.cc:348] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.008541 1168 raft_consensus.cc:374] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.008671 1168 raft_consensus.cc:729] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.008960 1168 consensus_queue.cc:260] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.009578 1168 ts_tablet_manager.cc:1428] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:23.009908 1168 tablet_bootstrap.cc:492] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.011716 1168 tablet_bootstrap.cc:654] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.013450 1167 tablet_bootstrap.cc:492] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:23.013656 1167 ts_tablet_manager.cc:1397] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.004s
I20260620 07:01:23.014437 1167 raft_consensus.cc:348] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.014724 1167 raft_consensus.cc:374] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.014851 1167 raft_consensus.cc:729] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.015110 1167 consensus_queue.cc:260] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.015766 1167 ts_tablet_manager.cc:1428] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:23.016050 1167 tablet_bootstrap.cc:492] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.017377 1167 tablet_bootstrap.cc:654] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.017746 1166 tablet_replica.cc:330] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:23.018971 1166 raft_consensus.cc:2229] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.019164 1168 tablet_bootstrap.cc:492] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.019203 1166 raft_consensus.cc:2258] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.019405 1168 ts_tablet_manager.cc:1397] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.003s
I20260620 07:01:23.020174 1168 raft_consensus.cc:348] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.020467 1168 raft_consensus.cc:374] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.020596 1168 raft_consensus.cc:729] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.020937 1170 tablet_bootstrap.cc:492] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.020875 1168 consensus_queue.cc:260] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.021108 1170 ts_tablet_manager.cc:1397] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.003s
I20260620 07:01:23.021456 1166 ts_tablet_manager.cc:1905] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.021549 1168 ts_tablet_manager.cc:1428] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:23.021938 1170 raft_consensus.cc:348] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.022219 1168 tablet_bootstrap.cc:492] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.022210 1170 raft_consensus.cc:374] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.022277 1170 raft_consensus.cc:729] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.022507 1170 consensus_queue.cc:260] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.023216 1170 ts_tablet_manager.cc:1428] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:23.023530 1170 tablet_bootstrap.cc:492] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.024096 1168 tablet_bootstrap.cc:654] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.029714 2531 raft_consensus.cc:482] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.029874 2531 raft_consensus.cc:504] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.030509 2531 leader_election.cc:288] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.032505 1167 tablet_bootstrap.cc:492] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:23.032625 1167 ts_tablet_manager.cc:1397] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.002s
I20260620 07:01:23.033032 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da80903ac124d1aae937c2329f9b13e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.033233 751 raft_consensus.cc:2454] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:23.033382 1167 raft_consensus.cc:348] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.033578 1167 raft_consensus.cc:374] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.033631 1167 raft_consensus.cc:729] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.033749 968 leader_election.cc:302] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.033819 1167 consensus_queue.cc:260] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.034152 2592 raft_consensus.cc:2781] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.034220 2592 raft_consensus.cc:482] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.034291 2592 raft_consensus.cc:3037] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:23.034468 969 leader_election.cc:341] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 9da80903ac124d1aae937c2329f9b13e
I20260620 07:01:23.034772 1170 tablet_bootstrap.cc:654] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.036911 2592 raft_consensus.cc:504] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.037514 2592 leader_election.cc:288] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.038209 2592 consensus_queue.cc:1035] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:23.038301 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da80903ac124d1aae937c2329f9b13e" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:23.038515 751 raft_consensus.cc:3037] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:23.038553 969 leader_election.cc:341] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 9da80903ac124d1aae937c2329f9b13e
I20260620 07:01:23.039372 1167 ts_tablet_manager.cc:1428] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 07:01:23.039687 1167 tablet_bootstrap.cc:492] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.041168 1167 tablet_bootstrap.cc:654] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.043242 1168 tablet_bootstrap.cc:492] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.043531 1168 ts_tablet_manager.cc:1397] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260620 07:01:23.044651 1168 raft_consensus.cc:348] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.045339 1168 raft_consensus.cc:374] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.045512 1168 raft_consensus.cc:729] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.045892 1168 consensus_queue.cc:260] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.046986 1168 ts_tablet_manager.cc:1428] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:23.047425 1168 tablet_bootstrap.cc:492] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.047384 751 raft_consensus.cc:2454] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:23.047947 968 leader_election.cc:302] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:23.048492 2592 raft_consensus.cc:2781] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.048621 2592 raft_consensus.cc:686] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:23.048873 2592 consensus_queue.cc:237] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.049178 1167 tablet_bootstrap.cc:492] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:23.049396 1167 ts_tablet_manager.cc:1397] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.002s
I20260620 07:01:23.050173 1167 raft_consensus.cc:348] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.050426 1167 raft_consensus.cc:374] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.050509 1167 raft_consensus.cc:729] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.050710 1167 consensus_queue.cc:260] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.051441 1167 ts_tablet_manager.cc:1428] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:23.051716 1167 tablet_bootstrap.cc:492] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.053920 1170 tablet_bootstrap.cc:492] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.054029 2531 raft_consensus.cc:482] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.054113 1170 ts_tablet_manager.cc:1397] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.001s
I20260620 07:01:23.054160 2531 raft_consensus.cc:504] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.054798 2531 leader_election.cc:288] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.055217 1167 tablet_bootstrap.cc:654] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.055361 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c083ebc2e054e09a531a8768802dcb1" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:23.055608 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c083ebc2e054e09a531a8768802dcb1" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.056242 1168 tablet_bootstrap.cc:654] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.056195 968 leader_election.cc:302] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.057991 2452 consensus_queue.cc:1035] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:23.058867 2531 raft_consensus.cc:2726] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.058998 1170 raft_consensus.cc:348] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.059614 1170 raft_consensus.cc:374] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.059844 2452 raft_consensus.cc:482] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.059860 1170 raft_consensus.cc:729] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.059984 2452 raft_consensus.cc:504] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.060166 1170 consensus_queue.cc:260] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.060551 2452 leader_election.cc:288] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.060853 1170 ts_tablet_manager.cc:1428] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260620 07:01:23.061159 1170 tablet_bootstrap.cc:492] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:23.061869 683 leader_election.cc:341] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0e30fb1d050c4439bb72a21a0f2b13eb
I20260620 07:01:23.062460 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e30fb1d050c4439bb72a21a0f2b13eb" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:23.063087 681 leader_election.cc:341] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.063194 681 leader_election.cc:302] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.063700 2452 raft_consensus.cc:2726] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:23.071615 681 consensus_peers.cc:487] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:23.075172 1167 tablet_bootstrap.cc:492] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:23.075330 1167 ts_tablet_manager.cc:1397] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.002s
I20260620 07:01:23.075628 2452 raft_consensus.cc:482] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.076066 1167 raft_consensus.cc:348] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.075796 2452 raft_consensus.cc:504] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.076257 1167 raft_consensus.cc:374] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.076300 1167 raft_consensus.cc:729] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.076493 1167 consensus_queue.cc:260] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.076736 2452 leader_election.cc:288] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:23.077841 683 leader_election.cc:341] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7b781d0578834708ae64b24419959cca
I20260620 07:01:23.077975 1168 tablet_bootstrap.cc:492] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.078114 1168 ts_tablet_manager.cc:1397] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.001s
I20260620 07:01:23.078869 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b781d0578834708ae64b24419959cca" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.078917 1168 raft_consensus.cc:348] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.079100 1029 raft_consensus.cc:2454] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:23.079145 1168 raft_consensus.cc:374] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.079226 1168 raft_consensus.cc:729] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.079459 1168 consensus_queue.cc:260] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.080049 1168 ts_tablet_manager.cc:1428] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:23.080061 681 leader_election.cc:302] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:23.080353 1168 tablet_bootstrap.cc:492] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.080574 2452 raft_consensus.cc:2781] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.080651 2452 raft_consensus.cc:482] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.080729 2452 raft_consensus.cc:3037] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.081763 426 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 2 got 0
I20260620 07:01:23.081946 1168 tablet_bootstrap.cc:654] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.081996 426 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet a9e70b585def4a4a9081a0938af8ce5b (table default.Table_e673aadd5ad94cfd870f850dc0d14201 [id=a876d134592d456ea2e7b8336037020f]). Expected version 3 got 0
I20260620 07:01:23.082188 426 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]). Expected version 1 got 0
I20260620 07:01:23.084091 1170 tablet_bootstrap.cc:654] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.085119 2452 raft_consensus.cc:504] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.086216 418 catalog_manager.cc:5495] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
W20260620 07:01:23.087030 683 leader_election.cc:341] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7b781d0578834708ae64b24419959cca
I20260620 07:01:23.088171 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b781d0578834708ae64b24419959cca" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:23.088366 1029 raft_consensus.cc:3037] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.091013 2581 raft_consensus.cc:482] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.091143 2581 raft_consensus.cc:504] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.091698 2581 leader_election.cc:288] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:23.092767 683 leader_election.cc:341] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: af743ffd2eb2427caa3779c7fceb8f30
I20260620 07:01:23.093425 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af743ffd2eb2427caa3779c7fceb8f30" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:23.094020 681 leader_election.cc:341] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.094139 681 leader_election.cc:302] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.094527 2581 raft_consensus.cc:2726] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.095044 1029 raft_consensus.cc:2454] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:23.095590 1170 tablet_bootstrap.cc:492] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.095764 1170 ts_tablet_manager.cc:1397] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260620 07:01:23.095829 681 leader_election.cc:302] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:23.096204 2581 raft_consensus.cc:2781] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.096318 2581 raft_consensus.cc:686] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:23.096520 1170 raft_consensus.cc:348] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.096715 1170 raft_consensus.cc:374] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.096763 1170 raft_consensus.cc:729] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.096529 2581 consensus_queue.cc:237] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.096913 1170 consensus_queue.cc:260] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.097242 1169 ts_tablet_manager.cc:1918] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.097338 1169 log.cc:1196] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/cf0bae39e1634710af12de493f7f58d5
I20260620 07:01:23.097378 1170 ts_tablet_manager.cc:1428] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:23.097605 1170 tablet_bootstrap.cc:492] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.097692 1169 ts_tablet_manager.cc:1939] T cf0bae39e1634710af12de493f7f58d5 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:23.098384 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1050) took 3739 ms. Trace:
I20260620 07:01:23.098483 1169 rpcz_store.cc:276] 0620 07:01:19.358736 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.359549 (+ 813us) service_pool.cc:227] Handling call
0620 07:01:22.582700 (+3223151us) ts_tablet_manager.cc:1145] Deleting tablet cf0bae39e1634710af12de493f7f58d5
0620 07:01:22.582708 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:22.641181 (+ 58473us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:23.097143 (+455962us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:23.098368 (+ 1225us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3223052}
I20260620 07:01:23.086691 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:23.099164 1170 tablet_bootstrap.cc:654] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.099126 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet c8aa75356fb54672a0ada533fc634613 (table default.Table_830d1bf5012e446b871ec75b647e73b5 [id=9872a758911d490c98d27afe035475b2]). Expected version 2 got 0
I20260620 07:01:23.099308 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet cf0bae39e1634710af12de493f7f58d5 (table default.Table_dd975c3c465e439db363c170ba3e4147 [id=c5d6638ed0bf48e1b8339e21c50f9a0a]) successfully deleted
I20260620 07:01:23.099366 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]). Expected version 1 got 0
I20260620 07:01:23.099555 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 302adda3630e44289d371de591061692 (table default.Table_443cffc65b664caf91066d86837262e1 [id=92e4f74224ab4135982722f846eb9e73]). Expected version 3 got 0
W20260620 07:01:23.087087 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c24fe8318b4743df886d210fc94318fe consensus state has no leader
I20260620 07:01:23.100485 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_475300ca7abe461b994d885db1818066"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.101384 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_475300ca7abe461b994d885db1818066 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.087282 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fbc8c484e491431bbd1c2713662fd22b
I20260620 07:01:23.104995 863 tablet_service.cc:1514] Processing DeleteTablet for tablet fbc8c484e491431bbd1c2713662fd22b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.105154 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3f4cdac47f2e45ff9d2e525919091c7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:23.105618 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet fbc8c484e491431bbd1c2713662fd22b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:23.105702 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f4cdac47f2e45ff9d2e525919091c7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:23.106096 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fbc8c484e491431bbd1c2713662fd22b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbc8c484e491431bbd1c2713662fd22b already in progress: creating tablet
I20260620 07:01:23.106974 1168 tablet_bootstrap.cc:492] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.107175 1168 ts_tablet_manager.cc:1397] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.003s
W20260620 07:01:23.087513 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1776f6361710465ba5036c3bb84740a8 consensus state has no leader
I20260620 07:01:23.107895 1168 raft_consensus.cc:348] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.108110 1168 raft_consensus.cc:374] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.108474 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_683b374c978a473e97801fc65fa16183"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.109091 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_683b374c978a473e97801fc65fa16183 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:23.090266 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 681743b78f834f1193ff23a249e69c89 has no consensus state
I20260620 07:01:23.111886 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_af208c36d70d42ad9d2f065e7f73f388"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:23.112550 2452 leader_election.cc:288] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:23.112581 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af208c36d70d42ad9d2f065e7f73f388 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.116247 720 tablet_service.cc:1514] Processing DeleteTablet for tablet fbc8c484e491431bbd1c2713662fd22b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:22 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.116735 1031 raft_consensus.cc:3037] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.120378 1170 tablet_bootstrap.cc:492] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.124382 1170 ts_tablet_manager.cc:1397] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.002s
I20260620 07:01:23.125983 1170 raft_consensus.cc:348] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.129006 1166 ts_tablet_manager.cc:1918] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.129125 1166 log.cc:1196] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/4302edba0ec04d7abc2789bc7be1beca
I20260620 07:01:23.129161 1170 raft_consensus.cc:374] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.129297 1170 raft_consensus.cc:729] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.129420 1166 ts_tablet_manager.cc:1939] T 4302edba0ec04d7abc2789bc7be1beca P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:23.129539 1170 consensus_queue.cc:260] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.129839 2569 raft_consensus.cc:482] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.129980 2569 raft_consensus.cc:504] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.130091 1170 ts_tablet_manager.cc:1428] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 07:01:23.130335 1170 tablet_bootstrap.cc:492] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.130543 2569 leader_election.cc:288] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.131006 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 4302edba0ec04d7abc2789bc7be1beca (table default.Table_4d3d2172df004ee39d7e56f81179364f [id=d553eceadb64462ba38a1e7026cb0a83]) successfully deleted
W20260620 07:01:23.132179 683 leader_election.cc:341] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 08ec769f903c4438bc1186d5fc1c5108
I20260620 07:01:23.133327 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ec769f903c4438bc1186d5fc1c5108" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.133634 1169 tablet_replica.cc:330] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:23.133842 1169 raft_consensus.cc:2229] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.134009 1169 raft_consensus.cc:2258] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:23.134411 681 leader_election.cc:341] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.134532 681 leader_election.cc:302] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.134912 2569 raft_consensus.cc:2726] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.135407 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet cd75e318982a4fb9bf28cb35b030642f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.135632 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b781d0578834708ae64b24419959cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.136348 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a36a5319a044e9da7dc7b666484e257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.137163 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0bae39e1634710af12de493f7f58d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 394a20b5d4814305b347c5718731d551) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.137727 1168 raft_consensus.cc:729] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.138103 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 3651ef9790d342ec96f554134ae714dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.140777 2592 consensus_queue.cc:1035] T 967cc8f19ad64278910c86ffc4cb3ed2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:23.141142 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9781a7cd64e242389d7bab889fe0781d" } modify_external_catalogs: true
I20260620 07:01:23.142060 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9781a7cd64e242389d7bab889fe0781d" } modify_external_catalogs: true
I20260620 07:01:23.134531 1169 ts_tablet_manager.cc:1905] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.143499 1168 consensus_queue.cc:260] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.144634 1168 ts_tablet_manager.cc:1428] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.037s user 0.018s sys 0.000s
I20260620 07:01:23.144698 1170 tablet_bootstrap.cc:654] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.145941 1168 tablet_bootstrap.cc:492] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.147697 1168 tablet_bootstrap.cc:654] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.156993 1168 tablet_bootstrap.cc:492] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.157665 1168 ts_tablet_manager.cc:1397] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260620 07:01:23.158483 1168 raft_consensus.cc:348] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.159824 1170 tablet_bootstrap.cc:492] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.160045 1170 ts_tablet_manager.cc:1397] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260620 07:01:23.160881 1170 raft_consensus.cc:348] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.161196 1170 raft_consensus.cc:374] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.161299 1170 raft_consensus.cc:729] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.161734 1170 consensus_queue.cc:260] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.162367 1170 ts_tablet_manager.cc:1428] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:23.162688 1170 tablet_bootstrap.cc:492] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.164539 1170 tablet_bootstrap.cc:654] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.169070 1168 raft_consensus.cc:374] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.169515 1168 raft_consensus.cc:729] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.169983 1168 consensus_queue.cc:260] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.171249 1168 ts_tablet_manager.cc:1428] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260620 07:01:23.172442 1168 tablet_bootstrap.cc:492] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.174356 1168 tablet_bootstrap.cc:654] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.177429 420 master_service.cc:946] ReplaceTablet: received request to replace tablet b6dca84adc5940e5a5505378e7276731 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:23.180529 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a420ddfbb1164494a7e0d123dc734366"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.181181 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a420ddfbb1164494a7e0d123dc734366 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.183697 1170 tablet_bootstrap.cc:492] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.183853 1170 ts_tablet_manager.cc:1397] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.002s
W20260620 07:01:23.184007 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 028ca38aefdc40f29b1413bbed7ed0ae consensus state has no leader
I20260620 07:01:23.184402 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_000758a78ff9431d9aec460d05262232" } modify_external_catalogs: true
I20260620 07:01:23.184593 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_000758a78ff9431d9aec460d05262232" } modify_external_catalogs: true
I20260620 07:01:23.185606 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8f93b40f12a1469283e48666d1dd1899" } modify_external_catalogs: true
I20260620 07:01:23.185799 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8f93b40f12a1469283e48666d1dd1899" } modify_external_catalogs: true
I20260620 07:01:23.188848 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c9afec791fba43e4b8aaff2500fea9d3" } new_table_name: "default.Table_3fb071f3e68d4501963071409c49a16b" modify_external_catalogs: true
I20260620 07:01:23.190625 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e9c55413664544dc92da5198f9de26be" } modify_external_catalogs: true
I20260620 07:01:23.190811 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e9c55413664544dc92da5198f9de26be" } modify_external_catalogs: true
I20260620 07:01:23.195634 1170 raft_consensus.cc:348] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.195935 1170 raft_consensus.cc:374] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.195995 1170 raft_consensus.cc:729] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.197045 1170 consensus_queue.cc:260] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.197391 1168 tablet_bootstrap.cc:492] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.197486 1170 ts_tablet_manager.cc:1428] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260620 07:01:23.197513 1168 ts_tablet_manager.cc:1397] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.006s
I20260620 07:01:23.197741 1170 tablet_bootstrap.cc:492] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.198113 1168 raft_consensus.cc:348] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.198302 1168 raft_consensus.cc:374] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.198359 1168 raft_consensus.cc:729] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.198634 1168 consensus_queue.cc:260] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.199631 1168 ts_tablet_manager.cc:1428] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:23.200012 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 4f41781c106e4a9bbbda32dc84b08797 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:23.200333 1168 tablet_bootstrap.cc:492] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.201881 1168 tablet_bootstrap.cc:654] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.205365 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 777a6b981b7f43a4ba8978ba6f3971e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.205731 863 tablet_service.cc:1514] Processing DeleteTablet for tablet a6c7b3977b604cb69df671318fae1212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.205862 1165 tablet_replica.cc:330] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:23.205919 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 113dd3d57c144088ae7204dc5229f883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.206049 1165 raft_consensus.cc:2229] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.206099 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 816218c726a9473e9849b7a97c820678 with delete_type TABLET_DATA_DELETED (replaced by tablet 494a2bc5b3b843c6b29f019974fa0a92) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.206189 1165 raft_consensus.cc:2258] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.206679 1165 ts_tablet_manager.cc:1905] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.207937 1170 tablet_bootstrap.cc:654] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.212976 1165 ts_tablet_manager.cc:1918] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.213155 1165 log.cc:1196] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/777a6b981b7f43a4ba8978ba6f3971e1
W20260620 07:01:23.213186 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fbc8c484e491431bbd1c2713662fd22b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbc8c484e491431bbd1c2713662fd22b already in progress: creating tablet
I20260620 07:01:23.213532 1165 ts_tablet_manager.cc:1939] T 777a6b981b7f43a4ba8978ba6f3971e1 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:23.214742 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 777a6b981b7f43a4ba8978ba6f3971e1 (table default.Table_514f5506c81a4038ad87979a2e476fd0 [id=480d35deefed493692a6b99af40b1f9d]) successfully deleted
I20260620 07:01:23.214824 1165 tablet_replica.cc:330] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:23.215003 1165 raft_consensus.cc:2229] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.215198 1165 raft_consensus.cc:2258] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.215678 1165 ts_tablet_manager.cc:1905] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:23.216372 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet cd75e318982a4fb9bf28cb35b030642f because the tablet was not found. No further retry: Not found: Tablet not found: cd75e318982a4fb9bf28cb35b030642f
I20260620 07:01:23.216740 1166 tablet_replica.cc:330] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:23.217962 1166 raft_consensus.cc:2229] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.218181 1166 raft_consensus.cc:2258] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.218736 1166 ts_tablet_manager.cc:1905] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.219724 2710 raft_consensus.cc:482] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.224788 2710 raft_consensus.cc:504] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.225997 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06fd96feb4a74b9f8d3243b7d774f388" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.226259 751 raft_consensus.cc:2454] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:23.226665 968 leader_election.cc:302] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.227228 2710 leader_election.cc:288] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.227406 2710 raft_consensus.cc:2781] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.227514 2710 raft_consensus.cc:482] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 07:01:23.227701 969 leader_election.cc:341] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 06fd96feb4a74b9f8d3243b7d774f388
I20260620 07:01:23.227967 2710 raft_consensus.cc:3037] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.223007 2531 raft_consensus.cc:482] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.230129 2531 raft_consensus.cc:504] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.231086 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3eda988492234d6aaeaee87f84f99d06" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.231223 2686 tablet.cc:1722] T eb0f7d4b6fa14811a1f02456418f95a4 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:23.231490 751 raft_consensus.cc:2454] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:23.232389 2687 tablet.cc:1722] T eb0f7d4b6fa14811a1f02456418f95a4 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:23.236564 2452 raft_consensus.cc:482] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06a32ef63b2b495a9ade1de48c024ae9)
I20260620 07:01:23.236831 2452 raft_consensus.cc:504] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:23.238515 683 leader_election.cc:341] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: fe79bcf487fc4d118a91f4c62628d8a5
W20260620 07:01:23.239524 681 leader_election.cc:341] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: fe79bcf487fc4d118a91f4c62628d8a5
I20260620 07:01:23.239645 681 leader_election.cc:302] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.239893 2581 raft_consensus.cc:2726] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:23.238735 2452 leader_election.cc:288] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.240666 1167 ts_tablet_manager.cc:1428] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.165s user 0.029s sys 0.021s
I20260620 07:01:23.241040 1167 tablet_bootstrap.cc:492] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.242681 1167 tablet_bootstrap.cc:654] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.244050 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet b6dca84adc5940e5a5505378e7276731
I20260620 07:01:23.244491 420 catalog_manager.cc:6565] ReplaceTablet: tablet b6dca84adc5940e5a5505378e7276731 deleted and replaced by tablet 85937bdc2f724d2daa73a02ac81c1a1d
I20260620 07:01:23.245366 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7c761bb09032495c9a2f5d00e1b90902
I20260620 07:01:23.245537 869 tablet_service.cc:1514] Processing DeleteTablet for tablet b6dca84adc5940e5a5505378e7276731 with delete_type TABLET_DATA_DELETED (replaced by tablet 85937bdc2f724d2daa73a02ac81c1a1d) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.246389 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet b6dca84adc5940e5a5505378e7276731 with delete_type TABLET_DATA_DELETED (replaced by tablet 85937bdc2f724d2daa73a02ac81c1a1d) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.246390 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c761bb09032495c9a2f5d00e1b90902 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:23.246840 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6f910e246b34b5cba01d953df2a9a77 has no consensus state
I20260620 07:01:23.247567 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8fcb1830334a4bb082283d56247a551e
I20260620 07:01:23.247656 1165 ts_tablet_manager.cc:1918] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.247750 1165 log.cc:1196] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/a6c7b3977b604cb69df671318fae1212
I20260620 07:01:23.247953 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c761bb09032495c9a2f5d00e1b90902 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.248024 1165 ts_tablet_manager.cc:1939] T a6c7b3977b604cb69df671318fae1212 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:23.248603 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fcb1830334a4bb082283d56247a551e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.248627 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fcb1830334a4bb082283d56247a551e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.249627 730 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fcb1830334a4bb082283d56247a551e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.249701 720 tablet_service.cc:1514] Processing DeleteTablet for tablet b6dca84adc5940e5a5505378e7276731 with delete_type TABLET_DATA_DELETED (replaced by tablet 85937bdc2f724d2daa73a02ac81c1a1d) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.249848 733 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c761bb09032495c9a2f5d00e1b90902 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.253347 1169 ts_tablet_manager.cc:1918] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.256256 968 leader_election.cc:302] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.256700 2704 raft_consensus.cc:2781] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.256840 2704 raft_consensus.cc:482] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.256986 2704 raft_consensus.cc:3037] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.256049 1170 tablet_bootstrap.cc:492] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.257742 1169 log.cc:1196] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/cd75e318982a4fb9bf28cb35b030642f
I20260620 07:01:23.257933 1170 ts_tablet_manager.cc:1397] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.006s
I20260620 07:01:23.258687 1168 tablet_bootstrap.cc:492] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.258894 1168 ts_tablet_manager.cc:1397] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.003s
I20260620 07:01:23.258746 1170 raft_consensus.cc:348] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.258984 1170 raft_consensus.cc:374] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.259080 1170 raft_consensus.cc:729] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.259343 1170 consensus_queue.cc:260] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.259600 1168 raft_consensus.cc:348] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.259876 2704 raft_consensus.cc:504] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.260046 1170 ts_tablet_manager.cc:1428] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:23.260064 1168 raft_consensus.cc:374] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.260125 1168 raft_consensus.cc:729] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.260460 1170 tablet_bootstrap.cc:492] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.260406 1168 consensus_queue.cc:260] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.260926 1169 ts_tablet_manager.cc:1939] T cd75e318982a4fb9bf28cb35b030642f P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:23.261615 1168 ts_tablet_manager.cc:1428] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260620 07:01:23.262058 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet a6c7b3977b604cb69df671318fae1212 (table default.Table_5c2cb157c156453ab32c75abc2ab6a09 [id=fb404678cbde40e4bd8996bb2d228e28]) successfully deleted
I20260620 07:01:23.261901 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1051) took 3903 ms. Trace:
I20260620 07:01:23.266145 1169 rpcz_store.cc:276] 0620 07:01:19.358848 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.359660 (+ 812us) service_pool.cc:227] Handling call
0620 07:01:23.098749 (+3739089us) ts_tablet_manager.cc:1145] Deleting tablet cd75e318982a4fb9bf28cb35b030642f
0620 07:01:23.098758 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:23.154244 (+ 55486us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:23.253251 (+ 99007us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:23.261884 (+ 8633us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3738999}
I20260620 07:01:23.266767 1169 tablet_replica.cc:330] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:23.266912 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet cd75e318982a4fb9bf28cb35b030642f (table default.Table_7d53dfa17a784fa08192e52f450ee287 [id=5af5baece18749bdbccb48b3a793fbe9]) successfully deleted
I20260620 07:01:23.267302 1165 tablet_replica.cc:330] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:23.267319 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 028ca38aefdc40f29b1413bbed7ed0ae (table default.Table_81ba0bc77e1248e3a02688cf1ef9bfea [id=d66c9d3d39c9401fbb8007dc460dd23f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 028ca38aefdc40f29b1413bbed7ed0ae consensus state has no leader
I20260620 07:01:23.267138 1169 raft_consensus.cc:2229] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.267463 1168 tablet_bootstrap.cc:492] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.267580 1169 raft_consensus.cc:2258] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.267711 1165 raft_consensus.cc:2229] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.267907 1165 raft_consensus.cc:2258] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.268102 1169 ts_tablet_manager.cc:1905] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.268507 1165 ts_tablet_manager.cc:1905] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.268782 1168 tablet_bootstrap.cc:654] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.268146 1170 tablet_bootstrap.cc:654] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.279455 1165 ts_tablet_manager.cc:1918] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.280915 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fcf5bef884174f4485ff7399a415bd12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.281523 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcf5bef884174f4485ff7399a415bd12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.283491 1165 log.cc:1196] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/113dd3d57c144088ae7204dc5229f883
I20260620 07:01:23.283933 1165 ts_tablet_manager.cc:1939] T 113dd3d57c144088ae7204dc5229f883 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:23.285722 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9ab3ba7c9f544843b5261225d687b7a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.286312 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ab3ba7c9f544843b5261225d687b7a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.287204 1165 tablet_replica.cc:330] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:23.287396 1165 raft_consensus.cc:2229] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.287501 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 113dd3d57c144088ae7204dc5229f883 (table default.Table_0936aaf00bfd443a9fb64da285fd6a89 [id=16e82920837948a798536c72832e30ae]) successfully deleted
I20260620 07:01:23.287613 1170 tablet_bootstrap.cc:492] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.287607 1165 raft_consensus.cc:2258] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.287730 1170 ts_tablet_manager.cc:1397] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260620 07:01:23.288117 1165 ts_tablet_manager.cc:1905] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.288486 1170 raft_consensus.cc:348] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.288897 1170 raft_consensus.cc:374] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.289075 1170 raft_consensus.cc:729] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.289286 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d14ce1b233284a41aeb1279664775975"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:23.289347 1170 consensus_queue.cc:260] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:23.289858 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d14ce1b233284a41aeb1279664775975 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.290233 1170 ts_tablet_manager.cc:1428] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:23.290477 1170 tablet_bootstrap.cc:492] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.290910 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 2a850b95532446ea9007478fce7c23ea from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:23.292084 1170 tablet_bootstrap.cc:654] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.260409 2531 leader_election.cc:288] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:23.261240 969 leader_election.cc:341] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3eda988492234d6aaeaee87f84f99d06
I20260620 07:01:23.263123 1167 tablet_bootstrap.cc:492] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:23.296027 1167 ts_tablet_manager.cc:1397] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.004s
I20260620 07:01:23.296794 1167 raft_consensus.cc:348] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.296999 1167 raft_consensus.cc:374] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.297052 1167 raft_consensus.cc:729] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.297240 1167 consensus_queue.cc:260] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.297737 1167 ts_tablet_manager.cc:1428] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:23.298000 1167 tablet_bootstrap.cc:492] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.300138 1167 tablet_bootstrap.cc:654] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.267021 2710 raft_consensus.cc:504] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.301561 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_183340ef4f634865953699cc2800f48a" } new_table_name: "default.Table_476c4cfd370b4dd1928aa203715f5a4a" modify_external_catalogs: true
I20260620 07:01:23.270017 2688 tablet.cc:1722] T a9e70b585def4a4a9081a0938af8ce5b P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:23.305033 2704 leader_election.cc:288] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.296869 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3eda988492234d6aaeaee87f84f99d06" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:23.300421 2452 raft_consensus.cc:482] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.306860 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06fd96feb4a74b9f8d3243b7d774f388" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:23.306741 2452 raft_consensus.cc:504] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.307140 749 raft_consensus.cc:3037] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.307646 2452 leader_election.cc:288] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.308904 751 raft_consensus.cc:3037] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.309008 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba189cfcef094a7bb45bc7d5f4ee5b71" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.310819 2710 leader_election.cc:288] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:23.311841 681 leader_election.cc:341] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.312268 423 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d93e7060309143e88364bc7045d58c42" } new_table_name: "default.Table_1384cf6eb6394077bb5243c114ba48c1" modify_external_catalogs: true
I20260620 07:01:23.313988 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9f401d0b21824b5d8ca50cafcd90ae1e" } modify_external_catalogs: true
I20260620 07:01:23.314231 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9f401d0b21824b5d8ca50cafcd90ae1e" } modify_external_catalogs: true
I20260620 07:01:23.318933 2664 raft_consensus.cc:482] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.319139 2664 raft_consensus.cc:504] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.320046 2664 leader_election.cc:288] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.320612 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee90d961729b4088b0a312ec770d3cd0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.321022 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee90d961729b4088b0a312ec770d3cd0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:23.321211 830 leader_election.cc:341] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.321712 1167 tablet_bootstrap.cc:492] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:01:23.321699 831 leader_election.cc:341] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.321892 1167 ts_tablet_manager.cc:1397] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.005s
I20260620 07:01:23.321835 831 leader_election.cc:302] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:23.322741 751 raft_consensus.cc:2454] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:23.322659 1167 raft_consensus.cc:348] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.282023 1166 ts_tablet_manager.cc:1918] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.322934 1167 raft_consensus.cc:374] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.322995 1167 raft_consensus.cc:729] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.323033 1166 log.cc:1196] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/7b781d0578834708ae64b24419959cca
I20260620 07:01:23.323220 968 leader_election.cc:302] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.323220 1167 consensus_queue.cc:260] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.323797 2664 raft_consensus.cc:2726] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.323891 1166 ts_tablet_manager.cc:1939] T 7b781d0578834708ae64b24419959cca P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:23.323940 1167 ts_tablet_manager.cc:1428] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:23.324458 2704 raft_consensus.cc:2781] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.324625 2704 raft_consensus.cc:686] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:23.324916 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 7b781d0578834708ae64b24419959cca (table default.Table_6d1419cac1c54567a909e7a7b5bc2ff0 [id=84ff58148b4f4e10b31009115fe83352]) successfully deleted
I20260620 07:01:23.325133 2704 consensus_queue.cc:237] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.325448 1166 tablet_replica.cc:330] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:23.325660 1166 raft_consensus.cc:2229] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:23.325904 1166 pending_rounds.cc:62] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:23.326061 1170 tablet_bootstrap.cc:492] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.326001 1166 pending_rounds.cc:68] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821664111910912 op_type: NO_OP noop_request { }
I20260620 07:01:23.326018 749 raft_consensus.cc:2454] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:23.326117 1166 raft_consensus.cc:2866] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:23.326367 1166 raft_consensus.cc:2258] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.326444 1167 tablet_bootstrap.cc:492] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.326525 968 leader_election.cc:302] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.326810 1170 ts_tablet_manager.cc:1397] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.004s
I20260620 07:01:23.328083 1167 tablet_bootstrap.cc:654] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.327975 1170 raft_consensus.cc:348] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.328341 1170 raft_consensus.cc:374] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.328472 1170 raft_consensus.cc:729] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.329058 2710 raft_consensus.cc:2781] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.329299 2710 raft_consensus.cc:686] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:23.329514 1031 raft_consensus.cc:3037] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.329547 2710 consensus_queue.cc:237] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:23.331197 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 069b271c96ab49d8802ba3ae31c324d0 consensus state has no leader
I20260620 07:01:23.331653 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7089aa2571e44d8aaa70cadb5e74d87e" } new_table_name: "default.Table_98f9090e31994e9baea182f30b1b809b" modify_external_catalogs: true
W20260620 07:01:23.332024 423 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1be799b684ec46c9878a3555f7133e09 consensus state has no leader
I20260620 07:01:23.332665 1165 ts_tablet_manager.cc:1918] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.333513 1170 consensus_queue.cc:260] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.334250 1170 ts_tablet_manager.cc:1428] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260620 07:01:23.334587 1170 tablet_bootstrap.cc:492] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.336201 1170 tablet_bootstrap.cc:654] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:23.336681 969 leader_election.cc:341] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 3eda988492234d6aaeaee87f84f99d06
W20260620 07:01:23.337013 969 leader_election.cc:341] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 06fd96feb4a74b9f8d3243b7d774f388
I20260620 07:01:23.336195 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba189cfcef094a7bb45bc7d5f4ee5b71" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:23.338617 1165 log.cc:1196] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/816218c726a9473e9849b7a97c820678
I20260620 07:01:23.338692 888 raft_consensus.cc:2454] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:23.339887 1165 ts_tablet_manager.cc:1939] T 816218c726a9473e9849b7a97c820678 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:23.340093 2687 tablet.cc:1722] T 302adda3630e44289d371de591061692 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:23.338218 2686 tablet.cc:1722] T 302adda3630e44289d371de591061692 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:23.349538 2710 raft_consensus.cc:482] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.349736 2710 raft_consensus.cc:504] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.350490 1029 raft_consensus.cc:3037] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.350981 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d53c90eff33044479838ff67dea93057" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.351228 749 raft_consensus.cc:2454] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:23.340412 683 leader_election.cc:302] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
W20260620 07:01:23.351527 969 leader_election.cc:341] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d53c90eff33044479838ff67dea93057
I20260620 07:01:23.351780 2581 raft_consensus.cc:2781] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.351868 2581 raft_consensus.cc:482] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.351955 2581 raft_consensus.cc:3037] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.351960 968 leader_election.cc:302] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:23.352201 2531 raft_consensus.cc:2781] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.352263 2531 raft_consensus.cc:482] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.352319 2531 raft_consensus.cc:3037] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.354423 2581 raft_consensus.cc:504] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.355036 2531 raft_consensus.cc:504] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.355405 2581 leader_election.cc:288] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.355822 2531 leader_election.cc:288] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.355902 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba189cfcef094a7bb45bc7d5f4ee5b71" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:23.356112 2710 leader_election.cc:288] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.356323 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba189cfcef094a7bb45bc7d5f4ee5b71" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:23.356518 888 raft_consensus.cc:3037] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:23.356506 681 leader_election.cc:341] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.357317 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d53c90eff33044479838ff67dea93057" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:23.357554 749 raft_consensus.cc:3037] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.360407 749 raft_consensus.cc:2454] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
W20260620 07:01:23.360661 969 leader_election.cc:341] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: d53c90eff33044479838ff67dea93057
I20260620 07:01:23.361089 968 leader_election.cc:302] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:23.361541 2531 raft_consensus.cc:2781] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.361608 888 raft_consensus.cc:2454] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:23.361691 2531 raft_consensus.cc:686] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:23.361994 2531 consensus_queue.cc:237] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.362321 683 leader_election.cc:302] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:23.363248 2569 raft_consensus.cc:2781] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.363443 2569 raft_consensus.cc:686] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:23.363713 2569 consensus_queue.cc:237] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.365635 1167 tablet_bootstrap.cc:492] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:23.366421 1165 tablet_replica.cc:330] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:23.366473 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 816218c726a9473e9849b7a97c820678 (table default.Table_7883c1fc8c5b4c998ab3e869467a79b4 [id=28eabd7db6d149c594279815f0ab8f81]) successfully deleted
I20260620 07:01:23.365837 2688 tablet.cc:1722] T 302adda3630e44289d371de591061692 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:23.367206 1167 ts_tablet_manager.cc:1397] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.001s
I20260620 07:01:23.367403 1165 raft_consensus.cc:2229] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.368312 1167 raft_consensus.cc:348] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.368738 1165 raft_consensus.cc:2258] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.374439 1165 ts_tablet_manager.cc:1905] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.375272 1167 raft_consensus.cc:374] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.378180 1169 ts_tablet_manager.cc:1918] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.378384 1169 log.cc:1196] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f793a91ab247408bbe4a9f7cb370fffe
I20260620 07:01:23.379573 1166 ts_tablet_manager.cc:1905] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.376407 2710 raft_consensus.cc:482] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.379781 2710 raft_consensus.cc:504] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.380446 2710 leader_election.cc:288] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:23.381837 969 leader_election.cc:341] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f793a91ab247408bbe4a9f7cb370fffe
I20260620 07:01:23.382087 1167 raft_consensus.cc:729] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.382416 1167 consensus_queue.cc:260] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.383395 1167 ts_tablet_manager.cc:1428] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260620 07:01:23.383857 1167 tablet_bootstrap.cc:492] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.384246 1168 tablet_bootstrap.cc:492] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.384485 1168 ts_tablet_manager.cc:1397] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.015s
W20260620 07:01:23.385496 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39e9f8eb03a74bb5ab4c9cc1c7b109c2 consensus state has no leader
I20260620 07:01:23.385603 1167 tablet_bootstrap.cc:654] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.385201 1168 raft_consensus.cc:348] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.386662 1168 raft_consensus.cc:374] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.386999 1168 raft_consensus.cc:729] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.387290 1168 consensus_queue.cc:260] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.391319 2710 raft_consensus.cc:482] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.391518 2710 raft_consensus.cc:504] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.392302 2710 leader_election.cc:288] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.392925 1168 ts_tablet_manager.cc:1428] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260620 07:01:23.393723 1168 tablet_bootstrap.cc:492] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.396504 1165 ts_tablet_manager.cc:1918] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:23.403692 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b0633505641342949a8dcca4b833d27d" } new_table_name: "default.Table_ae222c2995ad430cb1a5a49b05a754dd" modify_external_catalogs: true
I20260620 07:01:23.407123 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0d4f78078f134da08fa9407a9d062a50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.407981 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d4f78078f134da08fa9407a9d062a50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.398094 1168 tablet_bootstrap.cc:654] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.414942 1165 log.cc:1196] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/b6dca84adc5940e5a5505378e7276731
I20260620 07:01:23.415369 1165 ts_tablet_manager.cc:1939] T b6dca84adc5940e5a5505378e7276731 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
W20260620 07:01:23.416036 969 leader_election.cc:341] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0435678022914e6991c974e116d1a9f7
I20260620 07:01:23.423004 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]) successfully deleted
W20260620 07:01:23.423336 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 7c761bb09032495c9a2f5d00e1b90902 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c761bb09032495c9a2f5d00e1b90902 already in progress: creating tablet
W20260620 07:01:23.424329 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8fcb1830334a4bb082283d56247a551e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fcb1830334a4bb082283d56247a551e already in progress: creating tablet
I20260620 07:01:23.426246 1167 tablet_bootstrap.cc:492] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:23.426426 1167 ts_tablet_manager.cc:1397] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.001s
I20260620 07:01:23.427642 2710 raft_consensus.cc:482] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.427785 2710 raft_consensus.cc:504] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.428381 2710 leader_election.cc:288] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.428933 1167 raft_consensus.cc:348] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:23.429422 969 leader_election.cc:341] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 6fbd069552314f2c9ee010c054386644
I20260620 07:01:23.431758 1167 raft_consensus.cc:374] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.432065 1167 raft_consensus.cc:729] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.432478 1167 consensus_queue.cc:260] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.433398 1167 ts_tablet_manager.cc:1428] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260620 07:01:23.433732 1167 tablet_bootstrap.cc:492] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.435366 1167 tablet_bootstrap.cc:654] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:23.440975 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f121db3125a74df09b7f9ae3741b7f0d has no consensus state
I20260620 07:01:23.441480 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d0bb87eb87c54b9bb88d286bfee259df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:23.442844 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_896dfaa410f147e5a979725bd3164c3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:23.444927 1168 tablet_bootstrap.cc:492] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.445413 1168 ts_tablet_manager.cc:1397] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.002s
I20260620 07:01:23.446429 1168 raft_consensus.cc:348] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.446803 1168 raft_consensus.cc:374] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.446935 1168 raft_consensus.cc:729] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.447296 1168 consensus_queue.cc:260] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.448333 1168 ts_tablet_manager.cc:1428] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:23.449813 1168 tablet_bootstrap.cc:492] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.451452 1168 tablet_bootstrap.cc:654] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.459748 1168 tablet_bootstrap.cc:492] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:23.460085 1168 ts_tablet_manager.cc:1397] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.002s
I20260620 07:01:23.463176 1168 raft_consensus.cc:348] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.464531 1168 raft_consensus.cc:374] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.465205 1168 raft_consensus.cc:729] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.466179 1168 consensus_queue.cc:260] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.468942 1168 ts_tablet_manager.cc:1428] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260620 07:01:23.470216 1168 tablet_bootstrap.cc:492] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.477596 1167 tablet_bootstrap.cc:492] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:23.477924 1167 ts_tablet_manager.cc:1397] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.044s user 0.012s sys 0.007s
I20260620 07:01:23.479704 1167 raft_consensus.cc:348] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.480237 1167 raft_consensus.cc:374] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.480439 1167 raft_consensus.cc:729] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.481474 1168 tablet_bootstrap.cc:654] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.481122 1167 consensus_queue.cc:260] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.484491 1167 ts_tablet_manager.cc:1428] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 07:01:23.485642 1167 tablet_bootstrap.cc:492] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.488659 1167 tablet_bootstrap.cc:654] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.502628 2570 raft_consensus.cc:482] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.502949 2570 raft_consensus.cc:504] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.503754 2570 leader_election.cc:288] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.506095 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4b81f2b92f4363829034d3fe290742" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.521129 2664 consensus_queue.cc:1035] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:23.522037 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4b81f2b92f4363829034d3fe290742" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:23.522284 888 raft_consensus.cc:2454] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:23.535051 2664 raft_consensus.cc:482] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.535219 2664 raft_consensus.cc:504] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.535787 2664 leader_election.cc:288] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.536649 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2426d52b8ff40f39887545e0341a91a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:23.537454 830 leader_election.cc:341] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.514211 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f793a91ab247408bbe4a9f7cb370fffe" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.514223 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0435678022914e6991c974e116d1a9f7" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.543704 751 raft_consensus.cc:2454] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:23.514235 2581 raft_consensus.cc:482] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.544122 2581 raft_consensus.cc:504] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.544678 2581 leader_election.cc:288] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.514628 2564 raft_consensus.cc:482] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.545022 2564 raft_consensus.cc:504] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.545531 2564 leader_election.cc:288] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.519734 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fbd069552314f2c9ee010c054386644" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.545812 752 raft_consensus.cc:2454] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
W20260620 07:01:23.519860 681 leader_election.cc:341] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.547600 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485ce059be9b4900adb1dbc3268efb55" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:23.547904 681 consensus_peers.cc:487] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:23.548013 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fbd069552314f2c9ee010c054386644" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.548197 1032 raft_consensus.cc:2454] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:23.526098 1170 tablet_bootstrap.cc:492] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.548770 1170 ts_tablet_manager.cc:1397] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.214s user 0.021s sys 0.023s
W20260620 07:01:23.548924 681 leader_election.cc:341] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.549136 681 leader_election.cc:302] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.549633 2581 raft_consensus.cc:2781] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.549723 2581 raft_consensus.cc:482] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.549855 2581 raft_consensus.cc:3037] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.549824 1170 raft_consensus.cc:348] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.550074 1170 raft_consensus.cc:374] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.550175 1170 raft_consensus.cc:729] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.550405 1170 consensus_queue.cc:260] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.551139 1170 ts_tablet_manager.cc:1428] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:23.551486 1170 tablet_bootstrap.cc:492] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.552552 2581 raft_consensus.cc:504] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.553983 2581 leader_election.cc:288] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.554199 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fbd069552314f2c9ee010c054386644" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:23.554440 1028 raft_consensus.cc:3037] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.556489 2569 raft_consensus.cc:482] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.556627 2569 raft_consensus.cc:504] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.557121 1028 raft_consensus.cc:2454] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:23.557709 681 leader_election.cc:302] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.558036 2564 raft_consensus.cc:2781] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.558200 2564 raft_consensus.cc:686] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:23.558427 2564 consensus_queue.cc:237] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:23.559700 968 leader_election.cc:341] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: Tablet not RUNNING: STOPPED
I20260620 07:01:23.559811 968 leader_election.cc:302] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.560124 968 leader_election.cc:302] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:23.560310 2710 raft_consensus.cc:2726] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.560439 2710 raft_consensus.cc:2781] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.560518 2710 raft_consensus.cc:482] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.560578 2710 raft_consensus.cc:3037] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.560981 2739 raft_consensus.cc:482] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.561103 2739 raft_consensus.cc:504] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.561612 2739 leader_election.cc:288] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.561740 2739 consensus_queue.cc:1035] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:23.560449 968 leader_election.cc:302] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:23.563614 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca86563e5b014bb88ccb74c628670c46" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.563683 2704 raft_consensus.cc:2741] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260620 07:01:23.564409 1170 tablet_bootstrap.cc:654] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:23.565116 681 leader_election.cc:341] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.565455 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c51ecf0f006400597f0e7f776698854" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.565682 1028 raft_consensus.cc:2454] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:23.565636 2710 raft_consensus.cc:504] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.566043 683 leader_election.cc:302] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:23.566655 2710 leader_election.cc:288] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.566859 2569 leader_election.cc:288] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.567028 2569 raft_consensus.cc:2781] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.567150 2569 raft_consensus.cc:482] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.567278 2569 raft_consensus.cc:3037] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.567428 681 leader_election.cc:302] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.567546 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0435678022914e6991c974e116d1a9f7" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:23.567770 751 raft_consensus.cc:3037] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.568660 2740 raft_consensus.cc:2781] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.568992 2740 raft_consensus.cc:482] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.569644 2740 raft_consensus.cc:3037] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.571161 751 raft_consensus.cc:2454] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:23.571521 2569 raft_consensus.cc:504] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.571772 968 leader_election.cc:302] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.572062 2710 raft_consensus.cc:2781] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.572255 2710 raft_consensus.cc:686] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:23.572497 2710 consensus_queue.cc:237] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.575600 2569 leader_election.cc:288] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.575806 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4b81f2b92f4363829034d3fe290742" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:23.576439 681 leader_election.cc:341] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.576385 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2426d52b8ff40f39887545e0341a91a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:23.578408 969 leader_election.cc:341] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0435678022914e6991c974e116d1a9f7
I20260620 07:01:23.580206 1170 tablet_bootstrap.cc:492] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.580242 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4b81f2b92f4363829034d3fe290742" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:23.580489 1170 ts_tablet_manager.cc:1397] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260620 07:01:23.580487 895 raft_consensus.cc:3037] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.581212 1170 raft_consensus.cc:348] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.581447 1170 raft_consensus.cc:374] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.581525 1170 raft_consensus.cc:729] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.581789 1170 consensus_queue.cc:260] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.582396 1170 ts_tablet_manager.cc:1428] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:23.582701 1170 tablet_bootstrap.cc:492] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.583636 895 raft_consensus.cc:2454] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:23.585121 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca86563e5b014bb88ccb74c628670c46" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:23.585999 888 raft_consensus.cc:2454] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
W20260620 07:01:23.588945 683 consensus_peers.cc:487] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6dca84adc5940e5a5505378e7276731. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:23.590737 1170 tablet_bootstrap.cc:654] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:23.591455 683 leader_election.cc:341] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 485ce059be9b4900adb1dbc3268efb55
I20260620 07:01:23.591516 2569 raft_consensus.cc:482] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.591691 2569 raft_consensus.cc:504] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.592370 2569 leader_election.cc:288] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.593109 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777a6b981b7f43a4ba8978ba6f3971e1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:23.593811 681 leader_election.cc:341] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.591696 683 leader_election.cc:302] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.594579 2569 raft_consensus.cc:2726] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:23.595067 683 leader_election.cc:341] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 6fbd069552314f2c9ee010c054386644
W20260620 07:01:23.595465 683 leader_election.cc:341] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 6fbd069552314f2c9ee010c054386644
W20260620 07:01:23.596197 683 leader_election.cc:341] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0c51ecf0f006400597f0e7f776698854
I20260620 07:01:23.596508 683 leader_election.cc:302] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:23.596825 2569 raft_consensus.cc:2781] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.596966 2569 raft_consensus.cc:686] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:23.597221 2569 consensus_queue.cc:237] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.509951 1169 ts_tablet_manager.cc:1939] T f793a91ab247408bbe4a9f7cb370fffe P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:23.600708 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1045) took 4243 ms. Trace:
I20260620 07:01:23.600857 1169 rpcz_store.cc:276] 0620 07:01:19.357058 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.359810 (+ 2752us) service_pool.cc:227] Handling call
0620 07:01:23.266713 (+3906903us) ts_tablet_manager.cc:1145] Deleting tablet f793a91ab247408bbe4a9f7cb370fffe
0620 07:01:23.266728 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:23.374179 (+107451us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:23.378055 (+ 3876us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:23.600634 (+222579us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3906785}
I20260620 07:01:23.601352 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1052) took 4229 ms. Trace:
I20260620 07:01:23.601434 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f793a91ab247408bbe4a9f7cb370fffe (table default.Table_6f694d1dc105473b93ba18dc487d0d55 [id=4a2d8361d2404c1eb6710cc8f5190708]) successfully deleted
I20260620 07:01:23.601469 1169 rpcz_store.cc:276] 0620 07:01:19.371619 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.371683 (+ 64us) service_pool.cc:227] Handling call
0620 07:01:23.601164 (+4229481us) ts_tablet_manager.cc:1145] Deleting tablet 7d067448ff3c4faea9579eaaf29cd29f
0620 07:01:23.601177 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:23.601286 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4229245}
I20260620 07:01:23.601801 1169 tablet_replica.cc:330] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:23.602048 1169 raft_consensus.cc:2229] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:23.602100 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7d067448ff3c4faea9579eaaf29cd29f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d067448ff3c4faea9579eaaf29cd29f already in progress: creating tablet
I20260620 07:01:23.599462 2740 raft_consensus.cc:504] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.603790 683 leader_election.cc:302] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
W20260620 07:01:23.604431 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0bb87eb87c54b9bb88d286bfee259df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:23.605473 831 leader_election.cc:341] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.605605 831 leader_election.cc:302] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:23.605845 2664 raft_consensus.cc:2726] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.607465 2740 leader_election.cc:288] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.607659 2740 raft_consensus.cc:2781] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.608533 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c51ecf0f006400597f0e7f776698854" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:23.608821 683 leader_election.cc:341] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0c51ecf0f006400597f0e7f776698854
I20260620 07:01:23.609184 1028 raft_consensus.cc:3037] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.612481 1028 raft_consensus.cc:2454] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:23.615309 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_896dfaa410f147e5a979725bd3164c3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.607775 2740 raft_consensus.cc:482] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.616930 681 leader_election.cc:302] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:23.617512 2569 raft_consensus.cc:2781] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.617729 2569 raft_consensus.cc:686] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:23.618088 2569 consensus_queue.cc:237] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.618963 2581 raft_consensus.cc:482] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.619151 2581 raft_consensus.cc:504] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.620158 2581 leader_election.cc:288] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.620041 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3af86396ccfe41619735799d3a4b7058"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.621106 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3af86396ccfe41619735799d3a4b7058 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.622342 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5926946427294a5ca6fbc72d3e1b612d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.622843 2740 raft_consensus.cc:3037] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:23.622974 681 leader_election.cc:341] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:23.624643 830 consensus_peers.cc:487] T a96030064de046e5873bdaab6f3dff60 P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:23.626583 683 leader_election.cc:341] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 777a6b981b7f43a4ba8978ba6f3971e1
I20260620 07:01:23.626828 683 leader_election.cc:302] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.627138 2741 raft_consensus.cc:2726] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.629959 1166 ts_tablet_manager.cc:1918] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:23.630080 1166 log.cc:1196] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/6a36a5319a044e9da7dc7b666484e257
I20260620 07:01:23.634135 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_54df90bb27e3499c9be26f19e09b05ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.634869 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54df90bb27e3499c9be26f19e09b05ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.643445 2569 raft_consensus.cc:482] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.643735 2569 raft_consensus.cc:504] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.644598 2569 leader_election.cc:288] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.645090 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4128a4e9a228456cb5cd08eef2bf73d4" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:23.645671 681 leader_election.cc:341] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:23.650605 683 consensus_peers.cc:487] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3651ef9790d342ec96f554134ae714dc. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:23.651839 683 leader_election.cc:341] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 5926946427294a5ca6fbc72d3e1b612d
I20260620 07:01:23.652784 2664 raft_consensus.cc:482] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.652923 2664 raft_consensus.cc:504] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.653631 2664 leader_election.cc:288] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.653578 1170 tablet_bootstrap.cc:492] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.654937 683 leader_election.cc:302] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.654919 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a34f01ce5d4d5696248dc88802dafd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.655071 1170 ts_tablet_manager.cc:1397] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.072s user 0.011s sys 0.006s
W20260620 07:01:23.655431 830 leader_election.cc:341] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.655944 2569 raft_consensus.cc:2726] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:23.656421 683 leader_election.cc:341] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4128a4e9a228456cb5cd08eef2bf73d4
I20260620 07:01:23.656301 1170 raft_consensus.cc:348] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.657617 683 leader_election.cc:302] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.656746 2740 raft_consensus.cc:504] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.657744 1170 raft_consensus.cc:374] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.658325 1170 raft_consensus.cc:729] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.658669 1170 consensus_queue.cc:260] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.659336 2569 raft_consensus.cc:2726] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.659678 1170 ts_tablet_manager.cc:1428] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:01:23.659807 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca86563e5b014bb88ccb74c628670c46" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:23.660064 1170 tablet_bootstrap.cc:492] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:23.660425 681 leader_election.cc:341] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.660687 2740 leader_election.cc:288] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.661250 1169 raft_consensus.cc:2258] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.661178 2569 consensus_queue.cc:1035] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:23.661856 1169 ts_tablet_manager.cc:1905] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.664804 2569 raft_consensus.cc:482] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.665189 2569 raft_consensus.cc:504] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.666863 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4bebaa8ed1431d8c775f4856a3d808" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.667616 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1a02055c018e459296bb93027fd71599"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.668277 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a02055c018e459296bb93027fd71599 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.668756 1166 ts_tablet_manager.cc:1939] T 6a36a5319a044e9da7dc7b666484e257 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:23.668880 681 leader_election.cc:341] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.671622 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 6a36a5319a044e9da7dc7b666484e257 (table default.Table_690ab28d5a40472ebf9dfa50126f6c42 [id=0b2270efe0844d8aa33eac8150145bad]) successfully deleted
I20260620 07:01:23.672040 1166 tablet_replica.cc:330] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:23.672312 1166 raft_consensus.cc:2229] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.672811 1166 raft_consensus.cc:2258] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.673269 2710 raft_consensus.cc:482] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.673506 2710 raft_consensus.cc:504] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.674643 2710 leader_election.cc:288] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:23.675140 1168 tablet_bootstrap.cc:492] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
W20260620 07:01:23.675246 969 leader_election.cc:341] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f6bdcd8cd2574acf867b7ec487559db2
I20260620 07:01:23.676122 1167 tablet_bootstrap.cc:492] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:23.682991 423 master_service.cc:946] ReplaceTablet: received request to replace tablet b37f2c150b314b7298f32c3d414ff43d from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:23.685818 681 consensus_peers.cc:487] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:23.685859 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6bdcd8cd2574acf867b7ec487559db2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.686157 752 raft_consensus.cc:2454] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:23.686203 2569 leader_election.cc:288] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.686383 1170 tablet_bootstrap.cc:654] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.686640 968 leader_election.cc:302] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:23.691941 2710 raft_consensus.cc:2781] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.692101 2710 raft_consensus.cc:482] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.692229 2710 raft_consensus.cc:3037] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.693913 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_16f776af75174366b8650fdeb7578ebf" } modify_external_catalogs: true
I20260620 07:01:23.694334 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_16f776af75174366b8650fdeb7578ebf" } modify_external_catalogs: true
I20260620 07:01:23.694972 2710 raft_consensus.cc:504] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.696044 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e931da372abe49fe8893c6abb65fe7dc" } new_table_name: "default.Table_988d1407bfb142609d3a813379b53b0e" modify_external_catalogs: true
I20260620 07:01:23.698302 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6bdcd8cd2574acf867b7ec487559db2" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:23.698540 751 raft_consensus.cc:3037] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.698590 1166 ts_tablet_manager.cc:1905] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:23.701429 751 raft_consensus.cc:2454] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:23.702150 968 leader_election.cc:302] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:23.702443 2704 raft_consensus.cc:2781] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.702561 2704 raft_consensus.cc:686] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:23.702819 2704 consensus_queue.cc:237] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:23.713838 969 leader_election.cc:341] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f6bdcd8cd2574acf867b7ec487559db2
I20260620 07:01:23.714970 1168 ts_tablet_manager.cc:1397] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.245s user 0.018s sys 0.013s
I20260620 07:01:23.715384 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a34f01ce5d4d5696248dc88802dafd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.715572 1170 tablet_bootstrap.cc:492] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.716686 1170 ts_tablet_manager.cc:1397] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.009s
I20260620 07:01:23.717679 1170 raft_consensus.cc:348] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.717998 1170 raft_consensus.cc:374] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.718128 1170 raft_consensus.cc:729] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.718463 1170 consensus_queue.cc:260] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.715703 752 raft_consensus.cc:2454] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:23.725589 1167 ts_tablet_manager.cc:1397] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.240s user 0.010s sys 0.017s
I20260620 07:01:23.727380 1170 ts_tablet_manager.cc:1428] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260620 07:01:23.677526 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca86563e5b014bb88ccb74c628670c46" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:23.727699 888 raft_consensus.cc:3037] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.730580 888 raft_consensus.cc:2454] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:23.716459 2754 raft_consensus.cc:482] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.726866 2710 leader_election.cc:288] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:23.733994 683 leader_election.cc:341] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0a4bebaa8ed1431d8c775f4856a3d808
I20260620 07:01:23.734721 683 leader_election.cc:302] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:23.735193 1170 tablet_bootstrap.cc:492] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.733127 831 leader_election.cc:302] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:23.732465 2664 raft_consensus.cc:482] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.736382 2664 raft_consensus.cc:504] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.737843 1170 tablet_bootstrap.cc:654] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.735493 1168 raft_consensus.cc:348] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.734932 2754 raft_consensus.cc:504] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.739063 1168 raft_consensus.cc:374] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.739228 1168 raft_consensus.cc:729] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.739464 2754 leader_election.cc:288] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:23.739590 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b5c83ccfccc4bf1be5a31f21bb3faa2 consensus state has no leader
I20260620 07:01:23.739617 2754 raft_consensus.cc:2781] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.739677 2754 raft_consensus.cc:482] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.739750 2754 raft_consensus.cc:3037] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.740490 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9ab3ba7c9f544843b5261225d687b7a3" } modify_external_catalogs: true
I20260620 07:01:23.740480 1167 raft_consensus.cc:348] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.740731 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9ab3ba7c9f544843b5261225d687b7a3" } modify_external_catalogs: true
I20260620 07:01:23.740811 1167 raft_consensus.cc:374] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.740964 1167 raft_consensus.cc:729] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.741240 1167 consensus_queue.cc:260] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.741853 1167 ts_tablet_manager.cc:1428] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260620 07:01:23.742581 2754 raft_consensus.cc:504] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.743221 2754 leader_election.cc:288] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.743615 2664 leader_election.cc:288] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.744915 1168 consensus_queue.cc:260] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.745728 1168 ts_tablet_manager.cc:1428] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260620 07:01:23.746063 1168 tablet_bootstrap.cc:492] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:23.742324 2569 raft_consensus.cc:2726] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.748247 1168 tablet_bootstrap.cc:654] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.742738 683 leader_election.cc:302] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:23.750542 2569 raft_consensus.cc:2781] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.750736 2569 raft_consensus.cc:686] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:23.751065 2569 consensus_queue.cc:237] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.752696 425 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 9e0f866eb93247d0ba9d62f4238c3dcd
I20260620 07:01:23.753685 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c9840562383e49ccaff65b9accc7f78b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.754698 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9840562383e49ccaff65b9accc7f78b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.759725 1170 tablet_bootstrap.cc:492] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.759896 1170 ts_tablet_manager.cc:1397] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.003s
I20260620 07:01:23.760753 1170 raft_consensus.cc:348] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.760999 1170 raft_consensus.cc:374] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.761144 1170 raft_consensus.cc:729] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.761452 1170 consensus_queue.cc:260] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.762322 1170 ts_tablet_manager.cc:1428] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:23.762830 1170 tablet_bootstrap.cc:492] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.765074 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet a9e70b585def4a4a9081a0938af8ce5b (table default.Table_e673aadd5ad94cfd870f850dc0d14201 [id=a876d134592d456ea2e7b8336037020f]). Expected version 3 got 0
I20260620 07:01:23.768514 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:23.768754 421 catalog_manager.cc:5495] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:23.769227 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:23.769433 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (table default.Table_35a0e30f853640ff94b025abf4fe9d66 [id=bd3649f95ee640eeaeb1d585ac20e4e4]). Expected version 4 got 0
I20260620 07:01:23.769785 1170 tablet_bootstrap.cc:654] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.749522 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d2a46f972e45f5aeadb09101a68149" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.771898 1167 tablet_bootstrap.cc:492] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:23.750033 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a34f01ce5d4d5696248dc88802dafd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:23.750324 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0a5967c84434000a51fe7d819fac439" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.774749 421 catalog_manager.cc:5495] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:23.775580 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 302adda3630e44289d371de591061692 (table default.Table_443cffc65b664caf91066d86837262e1 [id=92e4f74224ab4135982722f846eb9e73]). Expected version 3 got 0
I20260620 07:01:23.775880 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]). Expected version 1 got 0
I20260620 07:01:23.776096 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:23.780553 1167 tablet_bootstrap.cc:654] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:23.756624 830 consensus_peers.cc:487] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:23.781278 830 leader_election.cc:341] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:23.781481 830 leader_election.cc:341] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:23.781632 830 leader_election.cc:341] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.776901 2752 raft_consensus.cc:482] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.781818 2752 raft_consensus.cc:504] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.784428 2752 leader_election.cc:288] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:23.787642 681 connection.cc:535] client connection to 127.0.97.60:46775 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 07:01:23.787729 967 connection.cc:535] client connection to 127.0.97.60:46775 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 07:01:23.788035 412 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.97.60:46775 (error 108) [suppressed 1 similar messages]
W20260620 07:01:23.788089 830 connection.cc:535] client connection to 127.0.97.60:46775 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 07:01:23.785182 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960fca9c94764f3d8d2daae20a0f8388" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:23.797698 1169 ts_tablet_manager.cc:1918] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:23.802203 1166 ts_tablet_manager.cc:1918] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:23.802364 1166 log.cc:1196] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/cf0bae39e1634710af12de493f7f58d5
I20260620 07:01:23.805570 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3fe199dbdfb246a58b0bf5839c4ef15c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.806329 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fe199dbdfb246a58b0bf5839c4ef15c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.809054 869 tablet_service.cc:1467] Processing CreateTablet for tablet 0bf5256682ca4642b3b7f0afbf479968 (DEFAULT_TABLE table=default.Table_21b426dcc72f41c0ac24a61fe70581a6 [id=0ea0678a50ad412cacb557847941c32e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.809523 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bf5256682ca4642b3b7f0afbf479968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.814426 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1ce25c8fd7334d1c9d35e33122d58a19
I20260620 07:01:23.814993 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0f4af5f22c1348998cf08fb52a8f02cb
I20260620 07:01:23.815361 426 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42866 (request call id 1434) took 1123 ms. Trace:
I20260620 07:01:23.815637 867 tablet_service.cc:1467] Processing CreateTablet for tablet 405551895e3342deaa56cf96cf136a3b (DEFAULT_TABLE table=default.Table_865d4dac0d6a4d69b85fa2190d19d81d [id=83d47bfe6b1a42c29d6656be08c0d868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.815452 426 rpcz_store.cc:276] 0620 07:01:22.692123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:23.138505 (+446382us) service_pool.cc:227] Handling call
0620 07:01:23.142205 (+ 3700us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 07:01:23.155850 (+ 13645us) catalog_manager.cc:2752] Modifying in-memory table state
0620 07:01:23.155939 (+ 89us) catalog_manager.cc:2761] Locking tablets
0620 07:01:23.757554 (+601615us) catalog_manager.cc:2775] Removing table and tablets from system table
0620 07:01:23.814857 (+ 57303us) catalog_manager.cc:2793] Removing table from by-name map
0620 07:01:23.814920 (+ 63us) catalog_manager.cc:2809] Committing in-memory state
0620 07:01:23.814956 (+ 36us) catalog_manager.cc:2813] Aborting table tasks
0620 07:01:23.815308 (+ 352us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:23.784941 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:23.785032 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:23.785038 (+ 6us) write_op.cc:435] Acquired schema lock
0620 07:01:23.785040 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:23.785134 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:23.785142 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:23.785146 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:23.785240 (+ 94us) tablet.cc:699] Row locks acquired
0620 07:01:23.785242 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:23.785290 (+ 48us) write_op.cc:270] Start()
0620 07:01:23.785336 (+ 46us) write_op.cc:276] Timestamp: P: 1781938883785257 usec, L: 0
0620 07:01:23.785341 (+ 5us) op_driver.cc:331] REPLICATION: starting
0620 07:01:23.785488 (+ 147us) log.cc:842] Serialized 722 byte log entry
0620 07:01:23.812645 (+ 27157us) op_driver.cc:444] REPLICATION: finished
0620 07:01:23.813460 (+ 815us) write_op.cc:301] APPLY: starting
0620 07:01:23.813470 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:23.813499 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:23.813532 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:23.813588 (+ 56us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:23.813614 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0620 07:01:23.813620 (+ 6us) write_op.cc:312] APPLY: finished
0620 07:01:23.813674 (+ 54us) log.cc:842] Serialized 29 byte log entry
0620 07:01:23.813709 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:23.813722 (+ 13us) write_op.cc:454] Released schema lock
0620 07:01:23.813727 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:23.813772 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:23.813775 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":784,"apply.run_cpu_time_us":356,"apply.run_wall_time_us":355,"mutex_wait_us":25767,"num_ops":2,"prepare.queue_time_us":26768,"prepare.run_cpu_time_us":599,"prepare.run_wall_time_us":599,"replication_time_us":27286}]]}
I20260620 07:01:23.816054 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 405551895e3342deaa56cf96cf136a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.816435 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 031a348ca98a4f179cb7a7001fe74154
I20260620 07:01:23.817332 427 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42866 (request call id 1437) took 1077 ms. Trace:
I20260620 07:01:23.817440 427 rpcz_store.cc:276] 0620 07:01:22.739812 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:23.184244 (+444432us) service_pool.cc:227] Handling call
0620 07:01:23.184708 (+ 464us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 07:01:23.184860 (+ 152us) catalog_manager.cc:2752] Modifying in-memory table state
0620 07:01:23.184937 (+ 77us) catalog_manager.cc:2761] Locking tablets
0620 07:01:23.758558 (+573621us) catalog_manager.cc:2775] Removing table and tablets from system table
0620 07:01:23.814219 (+ 55661us) catalog_manager.cc:2793] Removing table from by-name map
0620 07:01:23.814309 (+ 90us) catalog_manager.cc:2809] Committing in-memory state
0620 07:01:23.814353 (+ 44us) catalog_manager.cc:2813] Aborting table tasks
0620 07:01:23.817297 (+ 2944us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:23.785582 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:23.785659 (+ 77us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:23.785664 (+ 5us) write_op.cc:435] Acquired schema lock
0620 07:01:23.785666 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:23.785740 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:23.785748 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:23.785752 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:23.785854 (+ 102us) tablet.cc:699] Row locks acquired
0620 07:01:23.785858 (+ 4us) write_op.cc:260] PREPARE: finished
0620 07:01:23.785886 (+ 28us) write_op.cc:270] Start()
0620 07:01:23.785918 (+ 32us) write_op.cc:276] Timestamp: P: 1781938883785855 usec, L: 0
0620 07:01:23.785923 (+ 5us) op_driver.cc:331] REPLICATION: starting
0620 07:01:23.786097 (+ 174us) log.cc:842] Serialized 753 byte log entry
0620 07:01:23.812687 (+ 26590us) op_driver.cc:444] REPLICATION: finished
0620 07:01:23.813841 (+ 1154us) write_op.cc:301] APPLY: starting
0620 07:01:23.813849 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:23.813874 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:23.813893 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:23.813938 (+ 45us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:23.813960 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0620 07:01:23.813966 (+ 6us) write_op.cc:312] APPLY: finished
0620 07:01:23.814023 (+ 57us) log.cc:842] Serialized 29 byte log entry
0620 07:01:23.814056 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:23.814067 (+ 11us) write_op.cc:454] Released schema lock
0620 07:01:23.814071 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:23.814119 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:23.814123 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1129,"apply.run_cpu_time_us":316,"apply.run_wall_time_us":315,"mutex_wait_us":24910,"num_ops":2,"prepare.queue_time_us":26450,"prepare.run_cpu_time_us":572,"prepare.run_wall_time_us":571,"replication_time_us":26750,"threads_started":1}]]}
I20260620 07:01:23.802772 1166 ts_tablet_manager.cc:1939] T cf0bae39e1634710af12de493f7f58d5 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:23.819119 863 tablet_service.cc:1467] Processing CreateTablet for tablet 5534b0b4966e4358ac24260c60e5c74e (DEFAULT_TABLE table=default.Table_b6b64853a1aa44f8bc8f65b3354fd2e2 [id=a1e0f1fa09b648cb96e37a64d6b68864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.819535 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5534b0b4966e4358ac24260c60e5c74e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.824487 874 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ce25c8fd7334d1c9d35e33122d58a19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.824616 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4af5f22c1348998cf08fb52a8f02cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.824901 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 031a348ca98a4f179cb7a7001fe74154 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.825327 861 tablet_service.cc:1467] Processing CreateTablet for tablet 180feb3d97ab4bde80c7fd23fa4e41a6 (DEFAULT_TABLE table=default.Table_2c521985be09401e89a3b7a3c3c6bb22 [id=beea57ffe1ba46ad9ce13145d95b3e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.825543 874 tablet_service.cc:1467] Processing CreateTablet for tablet 681743b78f834f1193ff23a249e69c89 (DEFAULT_TABLE table=default.Table_73748ee3c61e4f02960f56befc9c9c6e [id=252096a8acb64c0e94ac2f23b9115c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.825786 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 180feb3d97ab4bde80c7fd23fa4e41a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.825973 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 681743b78f834f1193ff23a249e69c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.825973 864 tablet_service.cc:1467] Processing CreateTablet for tablet be42d6d56d0d458fa6320078de8bb235 (DEFAULT_TABLE table=default.Table_b1a1e74dc48b4814833821eecf2041f5 [id=9e9768ed4d1842a6883c1ab6f91c4f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.826318 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be42d6d56d0d458fa6320078de8bb235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.826282 865 tablet_service.cc:1467] Processing CreateTablet for tablet b57c3a7769904b478f33b6682a03c6c8 (DEFAULT_TABLE table=default.Table_248c3ae009f44b5cbe214d7139e363ba [id=58a104b82685433cbf9fc87ce23c8376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.826601 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b57c3a7769904b478f33b6682a03c6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.826749 875 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd2323e6f6b4b9ea1e232ea904472fb (DEFAULT_TABLE table=default.Table_d6e28c641ffd480ca6a0ee1baa4f5998 [id=84cf0899dee34e349b394aa330d78180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.827088 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd2323e6f6b4b9ea1e232ea904472fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.831195 857 tablet_service.cc:1467] Processing CreateTablet for tablet c4c37f901a99492f810c55b6182fec7c (DEFAULT_TABLE table=default.Table_3d77765908684704b05388a22b1eece9 [id=465dae31c81846208e56c9628cf029bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.831307 866 tablet_service.cc:1467] Processing CreateTablet for tablet a6f910e246b34b5cba01d953df2a9a77 (DEFAULT_TABLE table=default.Table_3fb071f3e68d4501963071409c49a16b [id=4697c84f363244038c64db4caf677fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.831562 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c37f901a99492f810c55b6182fec7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.832036 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6f910e246b34b5cba01d953df2a9a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.833829 1166 tablet_replica.cc:330] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:23.834246 1166 raft_consensus.cc:2229] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.834568 1166 raft_consensus.cc:2258] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.836838 1166 ts_tablet_manager.cc:1905] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:23.853446 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1ce25c8fd7334d1c9d35e33122d58a19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ce25c8fd7334d1c9d35e33122d58a19 already in progress: creating tablet
W20260620 07:01:23.855134 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0f4af5f22c1348998cf08fb52a8f02cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f4af5f22c1348998cf08fb52a8f02cb already in progress: creating tablet
W20260620 07:01:23.855458 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 031a348ca98a4f179cb7a7001fe74154 because the tablet was not found. No further retry: Not found: Tablet not found: 031a348ca98a4f179cb7a7001fe74154
I20260620 07:01:23.857138 864 tablet_service.cc:1467] Processing CreateTablet for tablet 7cca039a6f9e4d1d93fa4b0ac824b90f (DEFAULT_TABLE table=default.Table_cc7e83f45ddb45f5903d2456a6d3ca19 [id=6e2249e777e74e78a05c1c3f08c7fffa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.857688 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cca039a6f9e4d1d93fa4b0ac824b90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.860146 2704 consensus_queue.cc:1035] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:23.860469 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2a850b95532446ea9007478fce7c23ea
I20260620 07:01:23.860837 420 catalog_manager.cc:6565] ReplaceTablet: tablet 2a850b95532446ea9007478fce7c23ea deleted and replaced by tablet af64c05a0f034a94b5e253834f5e3483
I20260620 07:01:23.861075 875 tablet_service.cc:1467] Processing CreateTablet for tablet c292d437da9741af8ed8d05d8932d870 (DEFAULT_TABLE table=default.Table_837dfe71dadf41468194692d0c1e1ed0 [id=c263c37cb6584037bd9fbd704dd61f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.861495 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4f41781c106e4a9bbbda32dc84b08797
I20260620 07:01:23.861698 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c292d437da9741af8ed8d05d8932d870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.861920 424 catalog_manager.cc:6565] ReplaceTablet: tablet 4f41781c106e4a9bbbda32dc84b08797 deleted and replaced by tablet 6470f04c28964e63ba7296b2fe74d3d3
I20260620 07:01:23.864248 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a850b95532446ea9007478fce7c23ea with delete_type TABLET_DATA_DELETED (replaced by tablet af64c05a0f034a94b5e253834f5e3483) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.864833 869 tablet_service.cc:1467] Processing CreateTablet for tablet 4c145c6ea6e744c6a405c6050e85b2b4 (DEFAULT_TABLE table=default.Table_1600b2622d554f059342111df409c44d [id=b96d281381074c25b3a0437639a52be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.865382 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f41781c106e4a9bbbda32dc84b08797 with delete_type TABLET_DATA_DELETED (replaced by tablet 6470f04c28964e63ba7296b2fe74d3d3) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:23.865681 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c145c6ea6e744c6a405c6050e85b2b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:23.865854 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 2a850b95532446ea9007478fce7c23ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a850b95532446ea9007478fce7c23ea already in progress: creating tablet
I20260620 07:01:23.866677 857 tablet_service.cc:1467] Processing CreateTablet for tablet f121db3125a74df09b7f9ae3741b7f0d (DEFAULT_TABLE table=default.Table_ae222c2995ad430cb1a5a49b05a754dd [id=aa9a5b3aded14859ad3858c2396e0bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.868515 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f121db3125a74df09b7f9ae3741b7f0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:23.869112 421 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.1:52621 (request call id 127) took 949 ms (client timeout 1000 ms). Trace:
W20260620 07:01:23.869215 421 rpcz_store.cc:269] 0620 07:01:22.919647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:23.087869 (+168222us) service_pool.cc:227] Handling call
0620 07:01:23.869044 (+781175us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:23.792344 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:23.792469 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:23.792476 (+ 7us) write_op.cc:435] Acquired schema lock
0620 07:01:23.792481 (+ 5us) tablet.cc:660] Decoding operations
0620 07:01:23.794063 (+ 1582us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:23.794077 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:23.794083 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:23.794193 (+ 110us) tablet.cc:699] Row locks acquired
0620 07:01:23.794196 (+ 3us) write_op.cc:260] PREPARE: finished
0620 07:01:23.794244 (+ 48us) write_op.cc:270] Start()
0620 07:01:23.794279 (+ 35us) write_op.cc:276] Timestamp: P: 1781938883794209 usec, L: 0
0620 07:01:23.794283 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:23.794447 (+ 164us) log.cc:842] Serialized 895 byte log entry
0620 07:01:23.866232 (+ 71785us) op_driver.cc:444] REPLICATION: finished
0620 07:01:23.866318 (+ 86us) write_op.cc:301] APPLY: starting
0620 07:01:23.866332 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:23.866374 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:23.866397 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:23.866488 (+ 91us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:23.866520 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0620 07:01:23.866529 (+ 9us) write_op.cc:312] APPLY: finished
0620 07:01:23.866599 (+ 70us) log.cc:842] Serialized 29 byte log entry
0620 07:01:23.866674 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:23.866691 (+ 17us) write_op.cc:454] Released schema lock
0620 07:01:23.866699 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:23.866761 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:23.866767 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":43,"apply.run_cpu_time_us":509,"apply.run_wall_time_us":509,"mutex_wait_us":11467,"num_ops":2,"prepare.queue_time_us":15426,"prepare.run_cpu_time_us":775,"prepare.run_wall_time_us":2175,"replication_time_us":71921}]]}
I20260620 07:01:23.871495 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:23.871677 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet eb0f7d4b6fa14811a1f02456418f95a4 (table default.Table_a7132339336c4cde8e1bf9740c940062 [id=ea9135e430a142ab992288c43fe54bf7]). Expected version 1 got 0
I20260620 07:01:23.871867 418 catalog_manager.cc:5495] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:23.872331 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:23.872735 418 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 52d2a46f972e45f5aeadb09101a68149 (table default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447]). Expected version 2 got 0
I20260620 07:01:23.874286 422 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_8d4d5a67761c41e79e46f9bab18cb0e5 [id=e8f54af0bb3645dfbf1f7032451ec119] alter complete (version 1)
W20260620 07:01:23.875886 830 leader_election.cc:341] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:23.879750 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 4f41781c106e4a9bbbda32dc84b08797 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f41781c106e4a9bbbda32dc84b08797 already in progress: creating tablet
I20260620 07:01:23.880555 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_ac24bada4af041fcb27885c714fca800"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:23.881124 1166 ts_tablet_manager.cc:1918] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:23.881309 1166 log.cc:1196] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/3651ef9790d342ec96f554134ae714dc
I20260620 07:01:23.881784 1166 ts_tablet_manager.cc:1939] T 3651ef9790d342ec96f554134ae714dc P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:23.882280 2757 raft_consensus.cc:482] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.882441 2757 raft_consensus.cc:504] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.883013 2757 leader_election.cc:288] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.883124 2757 raft_consensus.cc:482] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.883257 2757 raft_consensus.cc:504] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.883733 2757 leader_election.cc:288] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.883737 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_1ddd2a4884e54fd28958caa1ff0cbee9" } new_table_name: "default.Table_14baa04b07a64624a28aebd22a467526" modify_external_catalogs: true
I20260620 07:01:23.884203 861 tablet_service.cc:1467] Processing CreateTablet for tablet 51d13068f0864e7f90eaa2021e3972b4 (DEFAULT_TABLE table=default.Table_db9af592557440a38ede430f2606a807 [id=266600e0d34d4f1e90919eae829420aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.884652 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d13068f0864e7f90eaa2021e3972b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.885646 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fd8e215a66e649fd92d7f993a4d78300"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.886144 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd8e215a66e649fd92d7f993a4d78300 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.886610 863 tablet_service.cc:1467] Processing CreateTablet for tablet 031a348ca98a4f179cb7a7001fe74154 (DEFAULT_TABLE table=default.Table_9f401d0b21824b5d8ca50cafcd90ae1e [id=b5fb991ed19943b7af87d30cfdc3a1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.887272 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 031a348ca98a4f179cb7a7001fe74154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.888731 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ff9d8e8291954a39b6ab22986f4c59dd" } new_table_name: "default.Table_864cfaf13e504b518041bd7962ae7d63" modify_external_catalogs: true
I20260620 07:01:23.891562 866 tablet_service.cc:1467] Processing CreateTablet for tablet d1bdd04f565d45e6848717ed18d92996 (DEFAULT_TABLE table=default.Table_ba2e85fd379f4437946d4bb6af649094 [id=e4236c0a4d5a43b4bda759e3635c3d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.893077 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6065a383cd53439fb9ad92441a4d3c8f" } new_table_name: "default.Table_3afdf58081b24bb3b6aa051008f4efdc" modify_external_catalogs: true
I20260620 07:01:23.893615 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1bdd04f565d45e6848717ed18d92996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.894505 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_c6fd6bc54d634406b10b4a1467ba1850"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:23.900141 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6fd6bc54d634406b10b4a1467ba1850 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.900519 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d93d57c99d6f419f9d0a86faafba8f3a" } new_table_name: "default.Table_08637f494b694e018e7279da34449841" modify_external_catalogs: true
I20260620 07:01:23.905542 746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c7f0513df34ddb8104b06e5733fb62" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.905710 1169 log.cc:1196] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/fe79bcf487fc4d118a91f4c62628d8a5
I20260620 07:01:23.798521 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d2a46f972e45f5aeadb09101a68149" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.798682 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0a5967c84434000a51fe7d819fac439" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.906039 751 raft_consensus.cc:2454] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:23.801477 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a34f01ce5d4d5696248dc88802dafd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:23.906186 749 raft_consensus.cc:3037] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.906195 1166 tablet_replica.cc:330] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:23.801735 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960fca9c94764f3d8d2daae20a0f8388" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.906472 753 raft_consensus.cc:2454] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:23.809341 733 tablet_service.cc:1467] Processing CreateTablet for tablet 0bf5256682ca4642b3b7f0afbf479968 (DEFAULT_TABLE table=default.Table_21b426dcc72f41c0ac24a61fe70581a6 [id=0ea0678a50ad412cacb557847941c32e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.906877 733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bf5256682ca4642b3b7f0afbf479968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.906847 1166 raft_consensus.cc:2229] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:23.907104 1166 raft_consensus.cc:2258] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:23.907763 1166 ts_tablet_manager.cc:1905] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:23.907835 831 leader_election.cc:341] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:23.908046 831 leader_election.cc:341] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.908133 831 leader_election.cc:302] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:23.908504 831 leader_election.cc:302] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:23.908726 749 raft_consensus.cc:2454] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:23.908784 831 leader_election.cc:302] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:23.909013 2752 raft_consensus.cc:2726] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:23.909196 2752 raft_consensus.cc:2781] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.909245 2752 raft_consensus.cc:482] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.909317 2752 raft_consensus.cc:3037] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.909597 2757 raft_consensus.cc:2781] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:23.909677 2757 raft_consensus.cc:482] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:23.909744 2757 raft_consensus.cc:3037] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:23.809875 720 tablet_service.cc:1467] Processing CreateTablet for tablet 405551895e3342deaa56cf96cf136a3b (DEFAULT_TABLE table=default.Table_865d4dac0d6a4d69b85fa2190d19d81d [id=83d47bfe6b1a42c29d6656be08c0d868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.910579 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 405551895e3342deaa56cf96cf136a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.810333 730 tablet_service.cc:1467] Processing CreateTablet for tablet 5534b0b4966e4358ac24260c60e5c74e (DEFAULT_TABLE table=default.Table_b6b64853a1aa44f8bc8f65b3354fd2e2 [id=a1e0f1fa09b648cb96e37a64d6b68864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.911550 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5534b0b4966e4358ac24260c60e5c74e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.821238 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ce25c8fd7334d1c9d35e33122d58a19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.915217 716 tablet_service.cc:1467] Processing CreateTablet for tablet 51d13068f0864e7f90eaa2021e3972b4 (DEFAULT_TABLE table=default.Table_db9af592557440a38ede430f2606a807 [id=266600e0d34d4f1e90919eae829420aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.915566 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d13068f0864e7f90eaa2021e3972b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.821390 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4af5f22c1348998cf08fb52a8f02cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.918383 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d9d4b5a69484176a7b0f4fded010867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.918541 727 tablet_service.cc:1514] Processing DeleteTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.918663 727 tablet_service.cc:1514] Processing DeleteTablet for tablet e37f336c01974ba79caeb25f4781667a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.918972 727 tablet_service.cc:1467] Processing CreateTablet for tablet d1bdd04f565d45e6848717ed18d92996 (DEFAULT_TABLE table=default.Table_ba2e85fd379f4437946d4bb6af649094 [id=e4236c0a4d5a43b4bda759e3635c3d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.919305 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1bdd04f565d45e6848717ed18d92996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.919305 831 leader_election.cc:302] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:23.919768 2751 raft_consensus.cc:2781] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:23.919912 2751 raft_consensus.cc:686] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:23.920135 2751 consensus_queue.cc:237] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.821504 721 tablet_service.cc:1514] Processing DeleteTablet for tablet 031a348ca98a4f179cb7a7001fe74154 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.923123 721 tablet_service.cc:1467] Processing CreateTablet for tablet 031a348ca98a4f179cb7a7001fe74154 (DEFAULT_TABLE table=default.Table_9f401d0b21824b5d8ca50cafcd90ae1e [id=b5fb991ed19943b7af87d30cfdc3a1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.923058 2740 consensus_queue.cc:1035] T 00a3ccec08ee4c8480a808b1402eb4a9 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:23.923454 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 031a348ca98a4f179cb7a7001fe74154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.822371 729 tablet_service.cc:1467] Processing CreateTablet for tablet 681743b78f834f1193ff23a249e69c89 (DEFAULT_TABLE table=default.Table_73748ee3c61e4f02960f56befc9c9c6e [id=252096a8acb64c0e94ac2f23b9115c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.927060 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 681743b78f834f1193ff23a249e69c89. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:23.928153 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac24bada4af041fcb27885c714fca800 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:23.928422 1166 ts_tablet_manager.cc:1918] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:23.928555 1166 log.cc:1196] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/b6dca84adc5940e5a5505378e7276731
I20260620 07:01:23.928999 1166 ts_tablet_manager.cc:1939] T b6dca84adc5940e5a5505378e7276731 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:23.929231 412 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.60:46775, user_credentials={real_user=slave}} blocked reactor thread for 141216us
I20260620 07:01:23.930228 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 0bf5256682ca4642b3b7f0afbf479968 (DEFAULT_TABLE table=default.Table_21b426dcc72f41c0ac24a61fe70581a6 [id=0ea0678a50ad412cacb557847941c32e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.930627 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bf5256682ca4642b3b7f0afbf479968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.822571 723 tablet_service.cc:1467] Processing CreateTablet for tablet 180feb3d97ab4bde80c7fd23fa4e41a6 (DEFAULT_TABLE table=default.Table_2c521985be09401e89a3b7a3c3c6bb22 [id=beea57ffe1ba46ad9ce13145d95b3e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.931052 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 180feb3d97ab4bde80c7fd23fa4e41a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.931028 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 405551895e3342deaa56cf96cf136a3b (DEFAULT_TABLE table=default.Table_865d4dac0d6a4d69b85fa2190d19d81d [id=83d47bfe6b1a42c29d6656be08c0d868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.931383 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 405551895e3342deaa56cf96cf136a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.822643 726 tablet_service.cc:1467] Processing CreateTablet for tablet be42d6d56d0d458fa6320078de8bb235 (DEFAULT_TABLE table=default.Table_b1a1e74dc48b4814833821eecf2041f5 [id=9e9768ed4d1842a6883c1ab6f91c4f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.935139 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be42d6d56d0d458fa6320078de8bb235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.935105 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 5534b0b4966e4358ac24260c60e5c74e (DEFAULT_TABLE table=default.Table_b6b64853a1aa44f8bc8f65b3354fd2e2 [id=a1e0f1fa09b648cb96e37a64d6b68864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.935426 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5534b0b4966e4358ac24260c60e5c74e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.938910 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ce25c8fd7334d1c9d35e33122d58a19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.939150 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4af5f22c1348998cf08fb52a8f02cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.940039 997 tablet_service.cc:1467] Processing CreateTablet for tablet 180feb3d97ab4bde80c7fd23fa4e41a6 (DEFAULT_TABLE table=default.Table_2c521985be09401e89a3b7a3c3c6bb22 [id=beea57ffe1ba46ad9ce13145d95b3e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.940471 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 180feb3d97ab4bde80c7fd23fa4e41a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.940928 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f41781c106e4a9bbbda32dc84b08797 with delete_type TABLET_DATA_DELETED (replaced by tablet 6470f04c28964e63ba7296b2fe74d3d3) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.941179 1012 tablet_service.cc:1514] Processing DeleteTablet for tablet 0435678022914e6991c974e116d1a9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.822947 722 tablet_service.cc:1467] Processing CreateTablet for tablet c4c37f901a99492f810c55b6182fec7c (DEFAULT_TABLE table=default.Table_3d77765908684704b05388a22b1eece9 [id=465dae31c81846208e56c9628cf029bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.941427 996 tablet_service.cc:1467] Processing CreateTablet for tablet c4c37f901a99492f810c55b6182fec7c (DEFAULT_TABLE table=default.Table_3d77765908684704b05388a22b1eece9 [id=465dae31c81846208e56c9628cf029bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.941761 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c37f901a99492f810c55b6182fec7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.941828 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4c37f901a99492f810c55b6182fec7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.946955 1010 tablet_service.cc:1467] Processing CreateTablet for tablet b57c3a7769904b478f33b6682a03c6c8 (DEFAULT_TABLE table=default.Table_248c3ae009f44b5cbe214d7139e363ba [id=58a104b82685433cbf9fc87ce23c8376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.947129 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 7cca039a6f9e4d1d93fa4b0ac824b90f (DEFAULT_TABLE table=default.Table_cc7e83f45ddb45f5903d2456a6d3ca19 [id=6e2249e777e74e78a05c1c3f08c7fffa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.947299 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b57c3a7769904b478f33b6682a03c6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.947523 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cca039a6f9e4d1d93fa4b0ac824b90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.947762 999 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd2323e6f6b4b9ea1e232ea904472fb (DEFAULT_TABLE table=default.Table_d6e28c641ffd480ca6a0ee1baa4f5998 [id=84cf0899dee34e349b394aa330d78180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.948055 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd2323e6f6b4b9ea1e232ea904472fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.951172 995 tablet_service.cc:1467] Processing CreateTablet for tablet a6f910e246b34b5cba01d953df2a9a77 (DEFAULT_TABLE table=default.Table_3fb071f3e68d4501963071409c49a16b [id=4697c84f363244038c64db4caf677fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.951639 1006 tablet_service.cc:1467] Processing CreateTablet for tablet c292d437da9741af8ed8d05d8932d870 (DEFAULT_TABLE table=default.Table_837dfe71dadf41468194692d0c1e1ed0 [id=c263c37cb6584037bd9fbd704dd61f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.951709 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 4c145c6ea6e744c6a405c6050e85b2b4 (DEFAULT_TABLE table=default.Table_1600b2622d554f059342111df409c44d [id=b96d281381074c25b3a0437639a52be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.952026 1013 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a850b95532446ea9007478fce7c23ea with delete_type TABLET_DATA_DELETED (replaced by tablet af64c05a0f034a94b5e253834f5e3483) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.952239 1008 tablet_service.cc:1467] Processing CreateTablet for tablet f121db3125a74df09b7f9ae3741b7f0d (DEFAULT_TABLE table=default.Table_ae222c2995ad430cb1a5a49b05a754dd [id=aa9a5b3aded14859ad3858c2396e0bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.823786 732 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd2323e6f6b4b9ea1e232ea904472fb (DEFAULT_TABLE table=default.Table_d6e28c641ffd480ca6a0ee1baa4f5998 [id=84cf0899dee34e349b394aa330d78180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.823909 734 tablet_service.cc:1467] Processing CreateTablet for tablet b57c3a7769904b478f33b6682a03c6c8 (DEFAULT_TABLE table=default.Table_248c3ae009f44b5cbe214d7139e363ba [id=58a104b82685433cbf9fc87ce23c8376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.952427 998 tablet_service.cc:1467] Processing CreateTablet for tablet 51d13068f0864e7f90eaa2021e3972b4 (DEFAULT_TABLE table=default.Table_db9af592557440a38ede430f2606a807 [id=266600e0d34d4f1e90919eae829420aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.952647 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a36a5319a044e9da7dc7b666484e257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.952811 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b57c3a7769904b478f33b6682a03c6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.952889 994 tablet_service.cc:1514] Processing DeleteTablet for tablet 031a348ca98a4f179cb7a7001fe74154 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.953087 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd2323e6f6b4b9ea1e232ea904472fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.953094 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet f793a91ab247408bbe4a9f7cb370fffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.953583 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 681743b78f834f1193ff23a249e69c89 (DEFAULT_TABLE table=default.Table_73748ee3c61e4f02960f56befc9c9c6e [id=252096a8acb64c0e94ac2f23b9115c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.953938 1001 tablet_service.cc:1467] Processing CreateTablet for tablet be42d6d56d0d458fa6320078de8bb235 (DEFAULT_TABLE table=default.Table_b1a1e74dc48b4814833821eecf2041f5 [id=9e9768ed4d1842a6883c1ab6f91c4f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.954183 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.954610 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da80903ac124d1aae937c2329f9b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 95ba8444d70342f781bd84edefbca71f) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.954854 994 tablet_service.cc:1514] Processing DeleteTablet for tablet d53c90eff33044479838ff67dea93057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.955171 994 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c51ecf0f006400597f0e7f776698854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.955525 994 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eda988492234d6aaeaee87f84f99d06 with delete_type TABLET_DATA_DELETED (replaced by tablet a590f553b9e041c4830234897dbbf09f) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.956373 994 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c6aeea7c504f36964e8bf41b0fc4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:23.959232 2664 raft_consensus.cc:482] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.959182 994 tablet_service.cc:1467] Processing CreateTablet for tablet d1bdd04f565d45e6848717ed18d92996 (DEFAULT_TABLE table=default.Table_ba2e85fd379f4437946d4bb6af649094 [id=e4236c0a4d5a43b4bda759e3635c3d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.959385 2664 raft_consensus.cc:504] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.959836 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 031a348ca98a4f179cb7a7001fe74154 (DEFAULT_TABLE table=default.Table_9f401d0b21824b5d8ca50cafcd90ae1e [id=b5fb991ed19943b7af87d30cfdc3a1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.959934 2664 leader_election.cc:288] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.854372 725 tablet_service.cc:1467] Processing CreateTablet for tablet a6f910e246b34b5cba01d953df2a9a77 (DEFAULT_TABLE table=default.Table_3fb071f3e68d4501963071409c49a16b [id=4697c84f363244038c64db4caf677fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.960620 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6f910e246b34b5cba01d953df2a9a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.961347 1170 tablet_bootstrap.cc:492] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:23.961472 1170 ts_tablet_manager.cc:1397] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.199s user 0.007s sys 0.011s
I20260620 07:01:23.962146 1170 raft_consensus.cc:348] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.962368 1170 raft_consensus.cc:374] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:23.962419 1170 raft_consensus.cc:729] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:23.962590 1170 consensus_queue.cc:260] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.855278 715 tablet_service.cc:1467] Processing CreateTablet for tablet 7cca039a6f9e4d1d93fa4b0ac824b90f (DEFAULT_TABLE table=default.Table_cc7e83f45ddb45f5903d2456a6d3ca19 [id=6e2249e777e74e78a05c1c3f08c7fffa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.963112 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cca039a6f9e4d1d93fa4b0ac824b90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.964604 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d13068f0864e7f90eaa2021e3972b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.965080 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f121db3125a74df09b7f9ae3741b7f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.965440 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 681743b78f834f1193ff23a249e69c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.965793 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be42d6d56d0d458fa6320078de8bb235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.966138 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6f910e246b34b5cba01d953df2a9a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.966523 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c292d437da9741af8ed8d05d8932d870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.966928 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 031a348ca98a4f179cb7a7001fe74154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.857651 731 tablet_service.cc:1467] Processing CreateTablet for tablet 4c145c6ea6e744c6a405c6050e85b2b4 (DEFAULT_TABLE table=default.Table_1600b2622d554f059342111df409c44d [id=b96d281381074c25b3a0437639a52be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.967253 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c145c6ea6e744c6a405c6050e85b2b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.968492 1170 ts_tablet_manager.cc:1428] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260620 07:01:23.969257 1170 tablet_bootstrap.cc:492] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:23.970649 1170 tablet_bootstrap.cc:654] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:23.858047 719 tablet_service.cc:1467] Processing CreateTablet for tablet c292d437da9741af8ed8d05d8932d870 (DEFAULT_TABLE table=default.Table_837dfe71dadf41468194692d0c1e1ed0 [id=c263c37cb6584037bd9fbd704dd61f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.863581 724 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a850b95532446ea9007478fce7c23ea with delete_type TABLET_DATA_DELETED (replaced by tablet af64c05a0f034a94b5e253834f5e3483) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.863758 717 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f41781c106e4a9bbbda32dc84b08797 with delete_type TABLET_DATA_DELETED (replaced by tablet 6470f04c28964e63ba7296b2fe74d3d3) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.864473 728 tablet_service.cc:1467] Processing CreateTablet for tablet f121db3125a74df09b7f9ae3741b7f0d (DEFAULT_TABLE table=default.Table_ae222c2995ad430cb1a5a49b05a754dd [id=aa9a5b3aded14859ad3858c2396e0bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:23.970947 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1bdd04f565d45e6848717ed18d92996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.971056 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c292d437da9741af8ed8d05d8932d870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.878688 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ec769f903c4438bc1186d5fc1c5108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:23.889865 2570 raft_consensus.cc:482] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.904063 2736 raft_consensus.cc:482] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.971231 2570 raft_consensus.cc:504] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.971329 2736 raft_consensus.cc:504] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.971853 2570 leader_election.cc:288] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.971897 2736 leader_election.cc:288] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.905025 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9647383a4f1b46278348bc25aae2d621" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.972028 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f121db3125a74df09b7f9ae3741b7f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.975073 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c145c6ea6e744c6a405c6050e85b2b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:23.979031 2736 raft_consensus.cc:482] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.979153 2736 raft_consensus.cc:504] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:23.979929 2736 leader_election.cc:288] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:23.985481 2736 raft_consensus.cc:482] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:23.985641 2736 raft_consensus.cc:504] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:23.986344 2736 leader_election.cc:288] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:23.989039 831 leader_election.cc:341] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:23.990667 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fa3702db6004ecba6fff98c09623fe0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:23.990919 748 raft_consensus.cc:2454] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:24.034956 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "113dd3d57c144088ae7204dc5229f883" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.036087 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c0bb50405d0446488272384523c2deb" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.037864 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73bcb81a0c84cdfb4dea0561647828a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.039448 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0f7e6245c074c82a5a72be79ab1987f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:24.050040 681 leader_election.cc:341] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:24.050379 681 leader_election.cc:341] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:24.051704 681 leader_election.cc:341] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:24.053388 681 leader_election.cc:341] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:24.054180 681 consensus_peers.cc:487] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6dca84adc5940e5a5505378e7276731. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:24.054483 681 consensus_peers.cc:487] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:24.058477 2757 raft_consensus.cc:504] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.059312 2757 leader_election.cc:288] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.061460 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c7f0513df34ddb8104b06e5733fb62" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.061565 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9647383a4f1b46278348bc25aae2d621" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.061868 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fa3702db6004ecba6fff98c09623fe0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:24.062343 969 consensus_peers.cc:487] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9da80903ac124d1aae937c2329f9b13e. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:24.062448 830 leader_election.cc:341] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.062598 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960fca9c94764f3d8d2daae20a0f8388" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:24.074683 683 leader_election.cc:341] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 113dd3d57c144088ae7204dc5229f883
I20260620 07:01:24.074848 683 leader_election.cc:302] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:24.074697 2570 consensus_queue.cc:1035] T 9ad723586ff545049dad658221e6455b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:24.075187 683 leader_election.cc:341] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 2c0bb50405d0446488272384523c2deb
I20260620 07:01:24.075264 683 leader_election.cc:302] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:24.075510 2570 raft_consensus.cc:2726] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:24.075532 683 leader_election.cc:341] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c73bcb81a0c84cdfb4dea0561647828a
I20260620 07:01:24.075620 683 leader_election.cc:302] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:24.075662 2570 raft_consensus.cc:2726] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:24.075778 2570 raft_consensus.cc:2726] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:24.078423 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960fca9c94764f3d8d2daae20a0f8388" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:24.078845 754 raft_consensus.cc:3037] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.079310 1169 ts_tablet_manager.cc:1939] T fe79bcf487fc4d118a91f4c62628d8a5 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:24.080058 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1053) took 4625 ms. Trace:
I20260620 07:01:24.080152 1169 rpcz_store.cc:276] 0620 07:01:19.454114 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.454179 (+ 65us) service_pool.cc:227] Handling call
0620 07:01:23.601711 (+4147532us) ts_tablet_manager.cc:1145] Deleting tablet fe79bcf487fc4d118a91f4c62628d8a5
0620 07:01:23.601720 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:23.710911 (+109191us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:23.797541 (+ 86630us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.080033 (+282492us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4133681}
I20260620 07:01:24.080478 1169 tablet_replica.cc:330] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:24.080689 1169 raft_consensus.cc:2229] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.080952 1169 raft_consensus.cc:2258] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.081594 1169 ts_tablet_manager.cc:1905] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.081908 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet fe79bcf487fc4d118a91f4c62628d8a5 (table default.Table_676ef4f879c44d9a94d209ec74b4da67 [id=132709e4a04f4996bb516b5a6a09adb6]) successfully deleted
I20260620 07:01:24.082927 2704 raft_consensus.cc:482] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:24.083142 2763 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 07:01:23.789432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.60:46775 (local address 127.0.97.1:54265)
0620 07:01:23.823488 (+ 34056us) negotiation.cc:107] Waiting for socket to connect
0620 07:01:23.823509 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0620 07:01:23.881778 (+ 58269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 07:01:24.082894 (+201116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":33934,"thread_start_us":34459,"threads_started":1}
I20260620 07:01:24.083086 2704 raft_consensus.cc:504] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.084079 2704 leader_election.cc:288] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:24.084221 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390a327225344afda3076c341202cc1d" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:24.088090 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 07:01:23.790239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.60:46775 (local address 127.0.97.3:52935)
0620 07:01:23.880996 (+ 90757us) negotiation.cc:107] Waiting for socket to connect
0620 07:01:23.881019 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0620 07:01:23.881138 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 07:01:24.087865 (+206727us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":90596,"thread_start_us":36054,"threads_started":1}
I20260620 07:01:24.090647 1166 tablet_replica.cc:330] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.090869 1166 raft_consensus.cc:2229] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.091094 1166 pending_rounds.cc:62] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:24.091143 1166 pending_rounds.cc:68] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821667117854720 op_type: NO_OP noop_request { }
I20260620 07:01:24.091259 1166 raft_consensus.cc:2866] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.091353 1166 raft_consensus.cc:2258] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.100663 1166 ts_tablet_manager.cc:1905] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.074993 831 leader_election.cc:302] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:24.106928 2664 raft_consensus.cc:2781] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:24.107038 2664 raft_consensus.cc:482] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:24.107096 2664 raft_consensus.cc:3037] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.109683 2664 raft_consensus.cc:504] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.110322 2664 leader_election.cc:288] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.110468 2664 consensus_queue.cc:1035] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:24.111734 1167 tablet_bootstrap.cc:492] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:24.111941 1167 ts_tablet_manager.cc:1397] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.340s user 0.001s sys 0.002s
I20260620 07:01:24.073767 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0f7e6245c074c82a5a72be79ab1987f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:24.112941 889 raft_consensus.cc:2454] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:24.112872 1167 raft_consensus.cc:348] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.113070 1167 raft_consensus.cc:374] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.113123 1167 raft_consensus.cc:729] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.113494 1167 consensus_queue.cc:260] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.114830 683 leader_election.cc:302] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:24.115424 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fa3702db6004ecba6fff98c09623fe0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:24.115590 748 raft_consensus.cc:3037] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.118237 748 raft_consensus.cc:2454] T 0fa3702db6004ecba6fff98c09623fe0 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:24.118585 2564 raft_consensus.cc:2781] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:24.118659 2564 raft_consensus.cc:482] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:24.118717 2564 raft_consensus.cc:3037] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.118930 1167 ts_tablet_manager.cc:1428] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260620 07:01:24.121069 2564 raft_consensus.cc:504] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.121626 2564 leader_election.cc:288] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.085201 2757 raft_consensus.cc:482] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.122013 2757 raft_consensus.cc:504] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.122587 2757 leader_election.cc:288] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.087258 1168 tablet_bootstrap.cc:492] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:24.089264 2752 raft_consensus.cc:504] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.123684 2752 leader_election.cc:288] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.123857 831 leader_election.cc:302] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:24.124083 2752 raft_consensus.cc:2781] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:24.124207 2752 raft_consensus.cc:686] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:24.124536 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0f7e6245c074c82a5a72be79ab1987f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:24.124507 2752 consensus_queue.cc:237] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.124689 889 raft_consensus.cc:3037] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.125418 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d2a46f972e45f5aeadb09101a68149" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:24.125481 1166 ts_tablet_manager.cc:1918] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.125592 1166 log.cc:1196] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/0435678022914e6991c974e116d1a9f7
I20260620 07:01:24.125595 749 raft_consensus.cc:3037] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.125908 1166 ts_tablet_manager.cc:1939] T 0435678022914e6991c974e116d1a9f7 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.127249 1166 tablet_replica.cc:330] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.127441 1166 raft_consensus.cc:2229] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.127578 1166 raft_consensus.cc:2258] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.128156 1166 ts_tablet_manager.cc:1905] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.128738 889 raft_consensus.cc:2454] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:24.129015 1168 ts_tablet_manager.cc:1397] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.378s user 0.003s sys 0.001s
I20260620 07:01:24.129421 749 raft_consensus.cc:2454] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:24.129921 831 leader_election.cc:302] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:24.130146 2757 raft_consensus.cc:2781] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:24.130249 2757 raft_consensus.cc:686] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:24.130232 683 leader_election.cc:302] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:24.130564 2452 raft_consensus.cc:2781] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:24.130478 2757 consensus_queue.cc:237] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.130664 2452 raft_consensus.cc:686] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:24.130883 2452 consensus_queue.cc:237] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.136993 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d48f0f9dd4911876ec8f812688439" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:24.137647 831 leader_election.cc:341] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.145596 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fdcfe152ff9a4436b344d662fcdcb671
I20260620 07:01:24.151443 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:24.151980 875 tablet_service.cc:1514] Processing DeleteTablet for tablet fdcfe152ff9a4436b344d662fcdcb671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:24.151723 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20781385be4d4c6aa278554faf9d15df consensus state has no leader
I20260620 07:01:24.152791 875 tablet_service.cc:1514] Processing DeleteTablet for tablet ca86563e5b014bb88ccb74c628670c46 with delete_type TABLET_DATA_DELETED (replaced by tablet ceb16b2060f34a32870bcf6fb143efe7) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.152987 1165 tablet_replica.cc:330] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:24.153148 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fdcfe152ff9a4436b344d662fcdcb671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdcfe152ff9a4436b344d662fcdcb671 already in progress: creating tablet
I20260620 07:01:24.153182 1165 raft_consensus.cc:2229] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.153357 1165 raft_consensus.cc:2258] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.151731 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 390a327225344afda3076c341202cc1d (table default.Table_6065a383cd53439fb9ad92441a4d3c8f [id=d7198485f2104c2092955ef5305900cf]). Expected version 2 got 0
I20260620 07:01:24.153807 425 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]). Expected version 1 got 0
I20260620 07:01:24.153950 1165 ts_tablet_manager.cc:1905] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.155139 875 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f7e6245c074c82a5a72be79ab1987f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.152630 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 0f8ddfba5500406eba8f184bd5039170 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:24.159477 418 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.2:45945 (request call id 149) took 951 ms (client timeout 1000 ms). Trace:
W20260620 07:01:24.159580 418 rpcz_store.cc:269] 0620 07:01:23.207582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:23.207634 (+ 52us) service_pool.cc:227] Handling call
0620 07:01:24.159426 (+951792us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:23.895302 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:23.895393 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:23.895399 (+ 6us) write_op.cc:435] Acquired schema lock
0620 07:01:23.895401 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:23.895524 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:23.895537 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:23.895541 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:23.895614 (+ 73us) tablet.cc:699] Row locks acquired
0620 07:01:23.895616 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:23.895653 (+ 37us) write_op.cc:270] Start()
0620 07:01:23.895688 (+ 35us) write_op.cc:276] Timestamp: P: 1781938883895609 usec, L: 0
0620 07:01:23.895692 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:23.895829 (+ 137us) log.cc:842] Serialized 524 byte log entry
0620 07:01:24.142756 (+246927us) op_driver.cc:444] REPLICATION: finished
0620 07:01:24.143989 (+ 1233us) write_op.cc:301] APPLY: starting
0620 07:01:24.144002 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:24.144038 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:24.144072 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:24.144119 (+ 47us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:24.144162 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:24.144172 (+ 10us) write_op.cc:312] APPLY: finished
0620 07:01:24.144239 (+ 67us) log.cc:842] Serialized 23 byte log entry
0620 07:01:24.144285 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:24.144300 (+ 15us) write_op.cc:454] Released schema lock
0620 07:01:24.144307 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:24.144374 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:24.144379 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":1178,"apply.run_cpu_time_us":455,"apply.run_wall_time_us":455,"num_ops":1,"prepare.queue_time_us":21822,"prepare.run_cpu_time_us":581,"prepare.run_wall_time_us":579,"replication_time_us":247049}]]}
I20260620 07:01:24.161664 1165 ts_tablet_manager.cc:1918] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:24.164713 731 tablet_service.cc:1514] Processing DeleteTablet for tablet fdcfe152ff9a4436b344d662fcdcb671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:24.162324 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.162676 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a34f01ce5d4d5696248dc88802dafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.162981 869 tablet_service.cc:1514] Processing DeleteTablet for tablet a0a5967c84434000a51fe7d819fac439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.163345 863 tablet_service.cc:1514] Processing DeleteTablet for tablet f2426d52b8ff40f39887545e0341a91a with delete_type TABLET_DATA_DELETED (replaced by tablet b9736d57fe0e4edea762508fe0a8d2a5) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.129896 1168 raft_consensus.cc:348] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.171908 1168 raft_consensus.cc:374] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.172024 1168 raft_consensus.cc:729] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.172209 1165 log.cc:1196] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ca86563e5b014bb88ccb74c628670c46
I20260620 07:01:24.172273 1168 consensus_queue.cc:260] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.172794 1165 ts_tablet_manager.cc:1939] T ca86563e5b014bb88ccb74c628670c46 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:24.173031 1168 ts_tablet_manager.cc:1428] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.044s user 0.000s sys 0.001s
I20260620 07:01:24.173293 1168 tablet_bootstrap.cc:492] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:24.173507 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ca86563e5b014bb88ccb74c628670c46 (table default.Table_078c21840d2f416da60744754f4b25b2 [id=81b33eb4aa244515a1fa2baf7d11124e]) successfully deleted
I20260620 07:01:24.182451 1028 raft_consensus.cc:3037] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.102583 754 raft_consensus.cc:2454] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:24.188019 1166 ts_tablet_manager.cc:1918] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:24.188191 1166 log.cc:1196] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f793a91ab247408bbe4a9f7cb370fffe
I20260620 07:01:24.188566 1166 ts_tablet_manager.cc:1939] T f793a91ab247408bbe4a9f7cb370fffe P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.195044 1166 tablet_replica.cc:330] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.173571 1165 tablet_replica.cc:330] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:24.101042 2765 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 07:01:23.806520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.60:46775 (local address 127.0.97.2:55093)
0620 07:01:23.852479 (+ 45959us) negotiation.cc:107] Waiting for socket to connect
0620 07:01:23.852510 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0620 07:01:23.852684 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 07:01:24.100592 (+247908us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":45715,"thread_start_us":68276,"threads_started":1}
I20260620 07:01:24.195645 1166 raft_consensus.cc:2229] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.195957 1166 pending_rounds.cc:62] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:24.196045 1166 pending_rounds.cc:68] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821666120241152 op_type: NO_OP noop_request { }
I20260620 07:01:24.196223 1166 raft_consensus.cc:2866] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.196346 1166 raft_consensus.cc:2258] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.180640 830 leader_election.cc:302] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:24.183024 831 leader_election.cc:302] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:24.197661 1165 raft_consensus.cc:2229] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.197872 1165 raft_consensus.cc:2258] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.199131 2664 raft_consensus.cc:2781] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:24.199205 1165 ts_tablet_manager.cc:1905] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.199260 2664 raft_consensus.cc:686] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:24.199493 2664 consensus_queue.cc:237] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.200554 2754 raft_consensus.cc:2726] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:24.201215 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 138767us
W20260620 07:01:24.201568 830 leader_election.cc:341] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.201790 830 leader_election.cc:302] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:24.202168 2664 raft_consensus.cc:2726] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:24.202950 830 leader_election.cc:341] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:24.203369 830 leader_election.cc:341] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.203505 1167 tablet_bootstrap.cc:492] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:24.203938 1166 ts_tablet_manager.cc:1905] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.204406 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fa3702db6004ecba6fff98c09623fe0" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:24.204953 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d48f0f9dd4911876ec8f812688439" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.205816 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d2a46f972e45f5aeadb09101a68149" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:24.206741 2664 raft_consensus.cc:482] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.206914 2664 raft_consensus.cc:504] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.207069 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0f7e6245c074c82a5a72be79ab1987f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:24.207523 2664 leader_election.cc:288] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.208209 2736 raft_consensus.cc:482] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.208388 2736 raft_consensus.cc:504] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.209072 2736 leader_election.cc:288] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.209862 2704 raft_consensus.cc:482] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.210032 2704 raft_consensus.cc:504] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.210745 2704 leader_election.cc:288] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:24.212023 968 leader_election.cc:341] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: 4655d289c94c4bce9707be375fc4b850
W20260620 07:01:24.213624 683 consensus_peers.cc:487] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b781d0578834708ae64b24419959cca. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:24.213824 683 leader_election.cc:341] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 816218c726a9473e9849b7a97c820678
I20260620 07:01:24.214717 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "294f8a632f9d4191b925d1da605bd80e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:24.215574 831 leader_election.cc:341] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.217455 2704 consensus_queue.cc:1035] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:24.219933 1168 tablet_bootstrap.cc:654] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.232688 1167 tablet_bootstrap.cc:654] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:24.235013 2773 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 07:01:23.932761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.60:46775 (local address 127.0.0.1:48966)
0620 07:01:24.234593 (+301832us) negotiation.cc:107] Waiting for socket to connect
0620 07:01:24.234745 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":301651,"threads_started":1}
I20260620 07:01:24.235107 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390a327225344afda3076c341202cc1d" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:24.235670 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet cf0bae39e1634710af12de493f7f58d5 (table default.Table_dd975c3c465e439db363c170ba3e4147 [id=c5d6638ed0bf48e1b8339e21c50f9a0a]) successfully deleted
I20260620 07:01:24.235970 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 3651ef9790d342ec96f554134ae714dc (table default.Table_5f1815876abd4a8282d506949e5adcda [id=e6ffdd91974a44eabefbcf60974613cb]) successfully deleted
I20260620 07:01:24.236243 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]) successfully deleted
W20260620 07:01:24.236557 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7c761bb09032495c9a2f5d00e1b90902 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c761bb09032495c9a2f5d00e1b90902 already in progress: creating tablet
W20260620 07:01:24.238325 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8fcb1830334a4bb082283d56247a551e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fcb1830334a4bb082283d56247a551e already in progress: creating tablet
W20260620 07:01:24.238618 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1ce25c8fd7334d1c9d35e33122d58a19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ce25c8fd7334d1c9d35e33122d58a19 already in progress: creating tablet
W20260620 07:01:24.242503 681 leader_election.cc:341] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.245631 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "294f8a632f9d4191b925d1da605bd80e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.246459 969 leader_election.cc:302] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:24.247354 969 leader_election.cc:341] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4655d289c94c4bce9707be375fc4b850
I20260620 07:01:24.247470 969 leader_election.cc:302] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:24.247823 2710 raft_consensus.cc:2726] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:24.248399 969 consensus_peers.cc:487] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3eda988492234d6aaeaee87f84f99d06. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:24.248790 969 consensus_peers.cc:487] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d53c90eff33044479838ff67dea93057. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:24.249159 830 leader_election.cc:341] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.263149 2792 tablet.cc:1722] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:24.263517 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "816218c726a9473e9849b7a97c820678" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.264035 1170 tablet_bootstrap.cc:492] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:24.264200 1170 ts_tablet_manager.cc:1397] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.295s user 0.059s sys 0.081s
I20260620 07:01:24.265228 1166 ts_tablet_manager.cc:1918] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.265147 1170 raft_consensus.cc:348] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.265355 1166 log.cc:1196] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/06fd96feb4a74b9f8d3243b7d774f388
I20260620 07:01:24.265384 1170 raft_consensus.cc:374] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.265446 1170 raft_consensus.cc:729] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.265692 1166 ts_tablet_manager.cc:1939] T 06fd96feb4a74b9f8d3243b7d774f388 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.265777 1170 consensus_queue.cc:260] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.266304 1170 ts_tablet_manager.cc:1428] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:24.266619 1170 tablet_bootstrap.cc:492] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:24.266633 1166 tablet_replica.cc:330] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.266844 1166 raft_consensus.cc:2229] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.267180 1166 raft_consensus.cc:2258] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:24.268188 830 leader_election.cc:341] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.268357 830 leader_election.cc:302] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
W20260620 07:01:24.268764 830 leader_election.cc:341] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:24.269047 830 leader_election.cc:341] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.269181 830 leader_election.cc:302] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:24.270572 1166 ts_tablet_manager.cc:1905] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:24.271754 681 leader_election.cc:341] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.279036 681 leader_election.cc:302] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:24.279603 681 consensus_peers.cc:487] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b781d0578834708ae64b24419959cca. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:24.279857 2564 raft_consensus.cc:2726] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:24.281648 2752 raft_consensus.cc:2726] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:24.282030 2752 raft_consensus.cc:2726] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:24.271135 2531 raft_consensus.cc:2726] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:24.286443 1167 tablet_bootstrap.cc:492] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:24.296618 1168 tablet_bootstrap.cc:492] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:24.297094 1168 ts_tablet_manager.cc:1397] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.124s user 0.004s sys 0.000s
I20260620 07:01:24.299149 1168 raft_consensus.cc:348] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.299769 1167 ts_tablet_manager.cc:1397] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.001s
I20260620 07:01:24.300676 1167 raft_consensus.cc:348] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.304176 1168 raft_consensus.cc:374] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.304587 1168 raft_consensus.cc:729] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.304435 1167 raft_consensus.cc:374] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.305685 1167 raft_consensus.cc:729] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.306121 1168 consensus_queue.cc:260] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.306877 1167 consensus_queue.cc:260] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.309049 1168 ts_tablet_manager.cc:1428] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260620 07:01:24.311371 1167 ts_tablet_manager.cc:1428] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260620 07:01:24.316720 1168 tablet_bootstrap.cc:492] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:24.324479 725 tablet_service.cc:1467] Processing CreateTablet for tablet 0dcd4723da554dc3a7aefc75aad836ea (DEFAULT_TABLE table=default.Table_c9840562383e49ccaff65b9accc7f78b [id=ad56ebb5de554e88b7b35c8a6d3213fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.324970 732 tablet_service.cc:1467] Processing CreateTablet for tablet 7b132644404d4d529fa8139928ff337f (DEFAULT_TABLE table=default.Table_1a02055c018e459296bb93027fd71599 [id=50978fe5941049199125e4139ae8b4bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.325393 727 tablet_service.cc:1467] Processing CreateTablet for tablet 225344e71a134bdeafaf456bc05e3a1c (DEFAULT_TABLE table=default.Table_0d4f78078f134da08fa9407a9d062a50 [id=510b5aa112ec4d6babfdf7aa08e53f61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.325863 721 tablet_service.cc:1467] Processing CreateTablet for tablet c1b491e6bb8a4022a61f437ab851769f (DEFAULT_TABLE table=default.Table_d14ce1b233284a41aeb1279664775975 [id=8fd58687b8e24d56a0f1a04c2e1270b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.326282 722 tablet_service.cc:1467] Processing CreateTablet for tablet 64032c51b90043f2a2c1fa452ba6e531 (DEFAULT_TABLE table=default.Table_3f4cdac47f2e45ff9d2e525919091c7d [id=c01f4d70674341a0ad14d590fc386ded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.326445 1167 tablet_bootstrap.cc:492] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:24.327024 719 tablet_service.cc:1467] Processing CreateTablet for tablet ad3478d1b85c46b8843a3aa610254ae4 (DEFAULT_TABLE table=default.Table_6e410dfb5ade4fdfb314561d54f4b069 [id=42b66ce2f34848ab88e0f6aef7164550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.327358 728 tablet_service.cc:1467] Processing CreateTablet for tablet 50fe2d97e204419baabd05652181da9d (DEFAULT_TABLE table=default.Table_4e4e652fd8784743812eb669bc82fce2 [id=128ca8f6e06540b3a4c008e862e323d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.327422 723 tablet_service.cc:1467] Processing CreateTablet for tablet c2e59a8a771b46a1baef2aae069c81e8 (DEFAULT_TABLE table=default.Table_475300ca7abe461b994d885db1818066 [id=99bc45141cd841b5adeaf6af5c8ceedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.327821 1167 tablet_bootstrap.cc:654] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.327802 729 tablet_service.cc:1467] Processing CreateTablet for tablet c7974b34152648549a4856ca037ee3cd (DEFAULT_TABLE table=default.Table_54df90bb27e3499c9be26f19e09b05ba [id=10484612a31b4317be0722245449bf06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.327996 718 tablet_service.cc:1467] Processing CreateTablet for tablet d7aa79769a5245e893872824e932045d (DEFAULT_TABLE table=default.Table_d0bb87eb87c54b9bb88d286bfee259df [id=d09e1697be6d45179820b1e0cc836b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.328183 726 tablet_service.cc:1467] Processing CreateTablet for tablet 6470f04c28964e63ba7296b2fe74d3d3 (DEFAULT_TABLE table=default.Table_f1984579a670481b9fbcc82593055fa3 [id=a1aab549cb7349a6a8ab8cd4a1880619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.328553 730 tablet_service.cc:1467] Processing CreateTablet for tablet 486245c13edd4d0baf0a7aa7da5c9250 (DEFAULT_TABLE table=default.Table_896dfaa410f147e5a979725bd3164c3e [id=7eb67c54de4b42dfbdc6108f0e5980da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.328950 716 tablet_service.cc:1467] Processing CreateTablet for tablet af64c05a0f034a94b5e253834f5e3483 (DEFAULT_TABLE table=default.Table_1fe9925a618f4f8bbfc3f27e7bd9b52e [id=6daa3b6259fa46b2bf7d186a83455944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.326683 715 tablet_service.cc:1467] Processing CreateTablet for tablet cebf74d4e6d04918986fdc6e23a7fc54 (DEFAULT_TABLE table=default.Table_d46ba54811d64a4bbb102c24b7e98245 [id=d2568a98a83c45e88153787a55a30289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.330272 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 225344e71a134bdeafaf456bc05e3a1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:24.270759 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (table default.Table_35a0e30f853640ff94b025abf4fe9d66 [id=bd3649f95ee640eeaeb1d585ac20e4e4], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet ba189cfcef094a7bb45bc7d5f4ee5b71 consensus state has no leader
W20260620 07:01:24.301723 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f0c037506384ea1afd233a53091c6b0 consensus state has no leader
W20260620 07:01:24.331008 412 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 92386.6us
W20260620 07:01:24.331244 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0f4af5f22c1348998cf08fb52a8f02cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f4af5f22c1348998cf08fb52a8f02cb already in progress: creating tablet
W20260620 07:01:24.331434 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4f41781c106e4a9bbbda32dc84b08797 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f41781c106e4a9bbbda32dc84b08797 already in progress: creating tablet
I20260620 07:01:24.331398 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_837dfe71dadf41468194692d0c1e1ed0" } new_table_name: "default.Table_84d6206e72c44b3aa76c398a1b6fee91" modify_external_catalogs: true
I20260620 07:01:24.331566 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 0435678022914e6991c974e116d1a9f7 (table default.Table_9f21f8c0c60642fd97b87ce5e1befcaf [id=3497d9fc568f4979baf33dfdd30ce222]) successfully deleted
W20260620 07:01:24.331787 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 2a850b95532446ea9007478fce7c23ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a850b95532446ea9007478fce7c23ea already in progress: creating tablet
W20260620 07:01:24.331943 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6a36a5319a044e9da7dc7b666484e257 because the tablet was not found. No further retry: Not found: Tablet not found: 6a36a5319a044e9da7dc7b666484e257
I20260620 07:01:24.303669 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_93199bfdf1ec4d6a8091ba5096846e9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:24.332089 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 031a348ca98a4f179cb7a7001fe74154 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 031a348ca98a4f179cb7a7001fe74154 already in progress: creating tablet
I20260620 07:01:24.332231 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f793a91ab247408bbe4a9f7cb370fffe (table default.Table_6f694d1dc105473b93ba18dc487d0d55 [id=4a2d8361d2404c1eb6710cc8f5190708]) successfully deleted
I20260620 07:01:24.306430 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_85e143b73bf848c99ad2a5568f7eeeac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:24.332358 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 06fd96feb4a74b9f8d3243b7d774f388 (table default.Table_55a40d12ea5d42b8b6b51b6b11ae4f7b [id=d2b994c9f22b4fa7a068b180dc980bbd]) successfully deleted
W20260620 07:01:24.332612 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85e143b73bf848c99ad2a5568f7eeeac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:24.332695 412 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc -> Peer f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775): Couldn't send request to peer f32c3995c70946c38ce1a3094aaaffb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:24.332967 996 tablet_service.cc:1514] Processing DeleteTablet for tablet fdcfe152ff9a4436b344d662fcdcb671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:23 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:24.332369 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93199bfdf1ec4d6a8091ba5096846e9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:24.333824 999 tablet_service.cc:1467] Processing CreateTablet for tablet 7b132644404d4d529fa8139928ff337f (DEFAULT_TABLE table=default.Table_1a02055c018e459296bb93027fd71599 [id=50978fe5941049199125e4139ae8b4bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.334198 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b132644404d4d529fa8139928ff337f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.310011 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_261cfafacec24351ad15b54adafc3c8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:24.334968 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_261cfafacec24351ad15b54adafc3c8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:24.335071 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 225344e71a134bdeafaf456bc05e3a1c (DEFAULT_TABLE table=default.Table_0d4f78078f134da08fa9407a9d062a50 [id=510b5aa112ec4d6babfdf7aa08e53f61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.335171 1000 tablet_service.cc:1467] Processing CreateTablet for tablet c2e59a8a771b46a1baef2aae069c81e8 (DEFAULT_TABLE table=default.Table_475300ca7abe461b994d885db1818066 [id=99bc45141cd841b5adeaf6af5c8ceedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.335376 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 225344e71a134bdeafaf456bc05e3a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.335652 995 tablet_service.cc:1467] Processing CreateTablet for tablet 486245c13edd4d0baf0a7aa7da5c9250 (DEFAULT_TABLE table=default.Table_896dfaa410f147e5a979725bd3164c3e [id=7eb67c54de4b42dfbdc6108f0e5980da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.310945 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e403391c444144cda9f7e7d6ca92f65c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:24.335990 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 486245c13edd4d0baf0a7aa7da5c9250. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:24.336095 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e403391c444144cda9f7e7d6ca92f65c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:24.337328 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50fe2d97e204419baabd05652181da9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.339035 1001 tablet_service.cc:1467] Processing CreateTablet for tablet c1b491e6bb8a4022a61f437ab851769f (DEFAULT_TABLE table=default.Table_d14ce1b233284a41aeb1279664775975 [id=8fd58687b8e24d56a0f1a04c2e1270b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.339398 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1b491e6bb8a4022a61f437ab851769f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.341024 996 tablet_service.cc:1467] Processing CreateTablet for tablet 0dcd4723da554dc3a7aefc75aad836ea (DEFAULT_TABLE table=default.Table_c9840562383e49ccaff65b9accc7f78b [id=ad56ebb5de554e88b7b35c8a6d3213fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.341331 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dcd4723da554dc3a7aefc75aad836ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.339031 1002 tablet_service.cc:1467] Processing CreateTablet for tablet fbf4be69c7bd4fd0a0fb60c39881fdf5 (DEFAULT_TABLE table=default.Table_7477c1a1742f44dea7a1b3a4ae40287f [id=2de5b8f2d44649edaf16d4db168cd882]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.343099 1004 tablet_service.cc:1467] Processing CreateTablet for tablet 64032c51b90043f2a2c1fa452ba6e531 (DEFAULT_TABLE table=default.Table_3f4cdac47f2e45ff9d2e525919091c7d [id=c01f4d70674341a0ad14d590fc386ded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.343252 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbf4be69c7bd4fd0a0fb60c39881fdf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.343521 1008 tablet_service.cc:1467] Processing CreateTablet for tablet cebf74d4e6d04918986fdc6e23a7fc54 (DEFAULT_TABLE table=default.Table_d46ba54811d64a4bbb102c24b7e98245 [id=d2568a98a83c45e88153787a55a30289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.343590 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1b491e6bb8a4022a61f437ab851769f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.343780 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cebf74d4e6d04918986fdc6e23a7fc54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.346529 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7aa79769a5245e893872824e932045d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.347020 998 tablet_service.cc:1467] Processing CreateTablet for tablet ad3478d1b85c46b8843a3aa610254ae4 (DEFAULT_TABLE table=default.Table_6e410dfb5ade4fdfb314561d54f4b069 [id=42b66ce2f34848ab88e0f6aef7164550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.347291 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad3478d1b85c46b8843a3aa610254ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.348614 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6470f04c28964e63ba7296b2fe74d3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.351120 723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2e59a8a771b46a1baef2aae069c81e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.351045 1007 tablet_service.cc:1467] Processing CreateTablet for tablet c7974b34152648549a4856ca037ee3cd (DEFAULT_TABLE table=default.Table_54df90bb27e3499c9be26f19e09b05ba [id=10484612a31b4317be0722245449bf06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.351336 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7974b34152648549a4856ca037ee3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.311898 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e1cad206b4964e4da33b9e26800196f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:24.354466 1011 tablet_service.cc:1467] Processing CreateTablet for tablet 6470f04c28964e63ba7296b2fe74d3d3 (DEFAULT_TABLE table=default.Table_f1984579a670481b9fbcc82593055fa3 [id=a1aab549cb7349a6a8ab8cd4a1880619]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:24.354832 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1cad206b4964e4da33b9e26800196f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:24.354996 1005 tablet_service.cc:1467] Processing CreateTablet for tablet af64c05a0f034a94b5e253834f5e3483 (DEFAULT_TABLE table=default.Table_1fe9925a618f4f8bbfc3f27e7bd9b52e [id=6daa3b6259fa46b2bf7d186a83455944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.355404 994 tablet_service.cc:1467] Processing CreateTablet for tablet 50fe2d97e204419baabd05652181da9d (DEFAULT_TABLE table=default.Table_4e4e652fd8784743812eb669bc82fce2 [id=128ca8f6e06540b3a4c008e862e323d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.355775 1006 tablet_service.cc:1467] Processing CreateTablet for tablet d7aa79769a5245e893872824e932045d (DEFAULT_TABLE table=default.Table_d0bb87eb87c54b9bb88d286bfee259df [id=d09e1697be6d45179820b1e0cc836b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.314251 425 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_443cffc65b664caf91066d86837262e1 [id=92e4f74224ab4135982722f846eb9e73] alter complete (version 3)
I20260620 07:01:24.355932 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 486245c13edd4d0baf0a7aa7da5c9250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.357079 1011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6470f04c28964e63ba7296b2fe74d3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.357568 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2887bc68d41444e7a3da02fea7842d8d" } modify_external_catalogs: true
I20260620 07:01:24.357753 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2887bc68d41444e7a3da02fea7842d8d" } modify_external_catalogs: true
I20260620 07:01:24.359136 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64032c51b90043f2a2c1fa452ba6e531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.362908 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7aa79769a5245e893872824e932045d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.367295 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af64c05a0f034a94b5e253834f5e3483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.321573 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
W20260620 07:01:24.329167 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5fb89be110b744408d6730a251a832ef consensus state has no leader
I20260620 07:01:24.370572 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet dac4a1434751433488eb2913b1ddfd23 (table default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1]). Expected version 2 got 0
I20260620 07:01:24.370940 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af64c05a0f034a94b5e253834f5e3483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.371515 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50fe2d97e204419baabd05652181da9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.371546 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 390a327225344afda3076c341202cc1d (table default.Table_3afdf58081b24bb3b6aa051008f4efdc [id=d7198485f2104c2092955ef5305900cf]). Expected version 3 got 2
W20260620 07:01:24.371567 681 consensus_peers.cc:487] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:24.372064 719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad3478d1b85c46b8843a3aa610254ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.371865 423 catalog_manager.cc:5495] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:24.372246 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (table default.Table_35a0e30f853640ff94b025abf4fe9d66 [id=bd3649f95ee640eeaeb1d585ac20e4e4]). Expected version 4 got 0
I20260620 07:01:24.372385 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64032c51b90043f2a2c1fa452ba6e531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.372471 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:24.372637 423 catalog_manager.cc:5495] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } }
I20260620 07:01:24.372961 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 6c4b81f2b92f4363829034d3fe290742 (table default.Table_84dadb1417974806a37c5fc6f5347d2d [id=6fcbcf995f28481ea31b3a41340a978b]). Expected version 2 got 0
I20260620 07:01:24.373154 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 52d2a46f972e45f5aeadb09101a68149 (table default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447]). Expected version 2 got 0
I20260620 07:01:24.373543 423 catalog_manager.cc:5495] T 76237044ff2f4c8b84c6af43badd164a P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:24.374037 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:24.374449 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:24.374590 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]). Expected version 1 got 0
I20260620 07:01:24.375185 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7974b34152648549a4856ca037ee3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.375864 1169 ts_tablet_manager.cc:1918] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.375957 1169 log.cc:1196] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/3f9d7421b549468e8a7782f467473bdb
I20260620 07:01:24.376266 1169 ts_tablet_manager.cc:1939] T 3f9d7421b549468e8a7782f467473bdb P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:24.292629 1166 ts_tablet_manager.cc:1918] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.376515 1166 log.cc:1196] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/9da80903ac124d1aae937c2329f9b13e
I20260620 07:01:24.379261 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b132644404d4d529fa8139928ff337f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.382769 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cebf74d4e6d04918986fdc6e23a7fc54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.383428 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1054) took 4918 ms. Trace:
I20260620 07:01:24.383515 1169 rpcz_store.cc:276] 0620 07:01:19.465483 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.465551 (+ 68us) service_pool.cc:227] Handling call
0620 07:01:24.080439 (+4614888us) ts_tablet_manager.cc:1145] Deleting tablet 3f9d7421b549468e8a7782f467473bdb
0620 07:01:24.080449 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.095814 (+ 15365us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.375768 (+279954us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.383406 (+ 7638us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4612387}
I20260620 07:01:24.383929 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1056) took 4686 ms. Trace:
I20260620 07:01:24.384029 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 3f9d7421b549468e8a7782f467473bdb (table default.Table_14c9ff1d977443ba914900cfb627c5e7 [id=471f2077c52c4990a4c8b7eb8879d92e]) successfully deleted
I20260620 07:01:24.384016 1169 rpcz_store.cc:276] 0620 07:01:19.697314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.697404 (+ 90us) service_pool.cc:227] Handling call
0620 07:01:24.383810 (+4686406us) ts_tablet_manager.cc:1145] Deleting tablet 728e7997b9e442669f9b5bda602311ce
0620 07:01:24.383820 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.383915 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4685736}
I20260620 07:01:24.384291 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1057) took 4684 ms. Trace:
I20260620 07:01:24.384351 1169 rpcz_store.cc:276] 0620 07:01:19.699894 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.699941 (+ 47us) service_pool.cc:227] Handling call
0620 07:01:24.384208 (+4684267us) ts_tablet_manager.cc:1145] Deleting tablet 71b2d6ea3dab4bb8b544a59a5e433cdc
0620 07:01:24.384217 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.384279 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4684066}
W20260620 07:01:24.384472 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 728e7997b9e442669f9b5bda602311ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 728e7997b9e442669f9b5bda602311ce already in progress: creating tablet
I20260620 07:01:24.384605 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1058) took 4674 ms. Trace:
I20260620 07:01:24.384663 1169 rpcz_store.cc:276] 0620 07:01:19.710482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.710549 (+ 67us) service_pool.cc:227] Handling call
0620 07:01:24.384529 (+4673980us) ts_tablet_manager.cc:1145] Deleting tablet 8c0b0969fb784dba96459ea441f88ae9
0620 07:01:24.384537 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.384594 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4673712}
I20260620 07:01:24.384908 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1059) took 4668 ms. Trace:
I20260620 07:01:24.384966 1169 rpcz_store.cc:276] 0620 07:01:19.716737 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.716814 (+ 77us) service_pool.cc:227] Handling call
0620 07:01:24.384821 (+4668007us) ts_tablet_manager.cc:1145] Deleting tablet 01b82aa3a0ba48f7bf61401713aca6bc
0620 07:01:24.384840 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.384897 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4667772}
I20260620 07:01:24.385207 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1060) took 4633 ms. Trace:
W20260620 07:01:24.385285 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 71b2d6ea3dab4bb8b544a59a5e433cdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71b2d6ea3dab4bb8b544a59a5e433cdc already in progress: creating tablet
I20260620 07:01:24.385268 1169 rpcz_store.cc:276] 0620 07:01:19.751592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.751653 (+ 61us) service_pool.cc:227] Handling call
0620 07:01:24.385128 (+4633475us) ts_tablet_manager.cc:1145] Deleting tablet 2feb83cb7d0b427eaa936f326f83aad0
0620 07:01:24.385136 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.385193 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4633252}
I20260620 07:01:24.385473 1169 tablet_replica.cc:330] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:01:24.385475 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8c0b0969fb784dba96459ea441f88ae9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c0b0969fb784dba96459ea441f88ae9 already in progress: creating tablet
I20260620 07:01:24.385638 1169 raft_consensus.cc:2229] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:24.385658 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 01b82aa3a0ba48f7bf61401713aca6bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01b82aa3a0ba48f7bf61401713aca6bc already in progress: creating tablet
I20260620 07:01:24.385761 1169 raft_consensus.cc:2258] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:24.385985 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2feb83cb7d0b427eaa936f326f83aad0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2feb83cb7d0b427eaa936f326f83aad0 already in progress: creating tablet
I20260620 07:01:24.386236 1169 ts_tablet_manager.cc:1905] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.387012 2531 raft_consensus.cc:482] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.387401 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2e59a8a771b46a1baef2aae069c81e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.388861 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dcd4723da554dc3a7aefc75aad836ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.387154 2531 raft_consensus.cc:504] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.393318 1166 ts_tablet_manager.cc:1939] T 9da80903ac124d1aae937c2329f9b13e P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.393364 2531 leader_election.cc:288] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:24.393290 731 tablet_service.cc:1467] Processing CreateTablet for tablet 272659ed6b6d4bcb98847a430679568c (DEFAULT_TABLE table=default.Table_683b374c978a473e97801fc65fa16183 [id=9947c416ebd54052ad60c77c2646b3c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.393843 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 272659ed6b6d4bcb98847a430679568c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.394225 1166 tablet_replica.cc:330] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.394625 1166 raft_consensus.cc:2229] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.395038 1166 pending_rounds.cc:62] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:24.395088 1166 pending_rounds.cc:68] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821666253430784 op_type: NO_OP noop_request { }
I20260620 07:01:24.395195 1166 raft_consensus.cc:2866] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.395272 1166 raft_consensus.cc:2258] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.396044 1166 ts_tablet_manager.cc:1905] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.397379 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 9da80903ac124d1aae937c2329f9b13e (table default.Table_4248c917b1ab466086f9ae5cf25bbe7b [id=2943ebfc86e54b75a06a5727fdcc6190]) successfully deleted
I20260620 07:01:24.399789 2570 raft_consensus.cc:482] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.399926 2570 raft_consensus.cc:504] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.400477 2570 leader_election.cc:288] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.401026 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d2c706414684bb1bacc6f9b870fc9c1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.401217 1029 raft_consensus.cc:2454] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:24.401588 681 leader_election.cc:302] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:24.401832 2570 raft_consensus.cc:2781] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:24.401904 2570 raft_consensus.cc:482] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:24.401961 2570 raft_consensus.cc:3037] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.405640 717 tablet_service.cc:1467] Processing CreateTablet for tablet 4b8c7fd8376c4e7998acc9a2d64808c7 (DEFAULT_TABLE table=default.Table_fcf5bef884174f4485ff7399a415bd12 [id=f2b8b7e4f74043fb967ad5e67cc923b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.406348 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b8c7fd8376c4e7998acc9a2d64808c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.414412 724 tablet_service.cc:1467] Processing CreateTablet for tablet 1d74d33b97dc4750b69f1ab114d4183f (DEFAULT_TABLE table=default.Table_c704b8cf734a4d74b04175f7d4e41dcf [id=74fff351c95d4ff39503d16152da0d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.414948 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d74d33b97dc4750b69f1ab114d4183f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.417747 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb81ac0ebd4865b9d53259ed5787d1" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:24.417977 748 raft_consensus.cc:2454] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:24.418401 968 leader_election.cc:302] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:24.418757 2531 raft_consensus.cc:2781] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:24.418877 2531 raft_consensus.cc:482] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:24.418942 2531 raft_consensus.cc:3037] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.423084 734 tablet_service.cc:1467] Processing CreateTablet for tablet c29f0a5b011642c383fffa8549dde67f (DEFAULT_TABLE table=default.Table_af208c36d70d42ad9d2f065e7f73f388 [id=92872d6c1d2c43d280859c2c7cc93922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.423486 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c29f0a5b011642c383fffa8549dde67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.426091 2741 consensus_queue.cc:1035] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:24.430440 683 leader_election.cc:341] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8d2c706414684bb1bacc6f9b870fc9c1
I20260620 07:01:24.431383 2564 consensus_queue.cc:1035] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:24.432122 1169 ts_tablet_manager.cc:1918] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:24.432232 1169 log.cc:1196] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/e6bae5090f81417cbcf4b4d598b438da
I20260620 07:01:24.432505 1169 ts_tablet_manager.cc:1939] T e6bae5090f81417cbcf4b4d598b438da P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:24.434759 718 tablet_service.cc:1467] Processing CreateTablet for tablet 85937bdc2f724d2daa73a02ac81c1a1d (DEFAULT_TABLE table=default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.435797 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85937bdc2f724d2daa73a02ac81c1a1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.435819 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet 0435678022914e6991c974e116d1a9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.438552 720 tablet_service.cc:1467] Processing CreateTablet for tablet 968d79b9182e49b4b5e87d6c54a6e8fe (DEFAULT_TABLE table=default.Table_3af86396ccfe41619735799d3a4b7058 [id=91e36629adaf4bacb5b6f804bfd57dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.442229 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 968d79b9182e49b4b5e87d6c54a6e8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.443902 1011 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.444164 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fbd069552314f2c9ee010c054386644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.444499 1003 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d2c706414684bb1bacc6f9b870fc9c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.439162 728 tablet_service.cc:1467] Processing CreateTablet for tablet fbf4be69c7bd4fd0a0fb60c39881fdf5 (DEFAULT_TABLE table=default.Table_7477c1a1742f44dea7a1b3a4ae40287f [id=2de5b8f2d44649edaf16d4db168cd882]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.453004 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbf4be69c7bd4fd0a0fb60c39881fdf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.454288 721 tablet_service.cc:1467] Processing CreateTablet for tablet 37d4b16e43624e4abb5bed87304c615e (DEFAULT_TABLE table=default.Table_a420ddfbb1164494a7e0d123dc734366 [id=115df9d39b76417ca58db364dc840ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.454645 721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d4b16e43624e4abb5bed87304c615e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.457643 1166 ts_tablet_manager.cc:1918] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.457751 1166 log.cc:1196] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/d53c90eff33044479838ff67dea93057
I20260620 07:01:24.458108 1166 ts_tablet_manager.cc:1939] T d53c90eff33044479838ff67dea93057 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.460160 1166 tablet_replica.cc:330] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.460531 1166 raft_consensus.cc:2229] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.460777 1166 raft_consensus.cc:2258] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.461416 1166 ts_tablet_manager.cc:1905] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.468858 1166 ts_tablet_manager.cc:1918] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:24.469069 1166 log.cc:1196] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/0c51ecf0f006400597f0e7f776698854
I20260620 07:01:24.469394 1166 ts_tablet_manager.cc:1939] T 0c51ecf0f006400597f0e7f776698854 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.470391 1166 tablet_replica.cc:330] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.470669 1166 raft_consensus.cc:2229] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.471031 1166 raft_consensus.cc:2258] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.474551 1166 ts_tablet_manager.cc:1905] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.477166 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb81ac0ebd4865b9d53259ed5787d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.477492 1001 tablet_service.cc:1514] Processing DeleteTablet for tablet 3651ef9790d342ec96f554134ae714dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.477721 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 06fd96feb4a74b9f8d3243b7d774f388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.477859 1170 tablet_bootstrap.cc:654] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.480950 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 272659ed6b6d4bcb98847a430679568c (DEFAULT_TABLE table=default.Table_683b374c978a473e97801fc65fa16183 [id=9947c416ebd54052ad60c77c2646b3c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.481449 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 37d4b16e43624e4abb5bed87304c615e (DEFAULT_TABLE table=default.Table_a420ddfbb1164494a7e0d123dc734366 [id=115df9d39b76417ca58db364dc840ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.481937 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d4b16e43624e4abb5bed87304c615e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.485344 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 4b8c7fd8376c4e7998acc9a2d64808c7 (DEFAULT_TABLE table=default.Table_fcf5bef884174f4485ff7399a415bd12 [id=f2b8b7e4f74043fb967ad5e67cc923b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.480645 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 85937bdc2f724d2daa73a02ac81c1a1d (DEFAULT_TABLE table=default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.486142 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85937bdc2f724d2daa73a02ac81c1a1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.487236 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 272659ed6b6d4bcb98847a430679568c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.490491 2452 consensus_queue.cc:1035] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:24.501657 2531 raft_consensus.cc:504] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.502316 2531 leader_election.cc:288] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:24.505427 1003 tablet_service.cc:1467] Processing CreateTablet for tablet 968d79b9182e49b4b5e87d6c54a6e8fe (DEFAULT_TABLE table=default.Table_3af86396ccfe41619735799d3a4b7058 [id=91e36629adaf4bacb5b6f804bfd57dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.505587 1006 tablet_service.cc:1467] Processing CreateTablet for tablet c29f0a5b011642c383fffa8549dde67f (DEFAULT_TABLE table=default.Table_af208c36d70d42ad9d2f065e7f73f388 [id=92872d6c1d2c43d280859c2c7cc93922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.506259 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b8c7fd8376c4e7998acc9a2d64808c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.506516 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 968d79b9182e49b4b5e87d6c54a6e8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.506829 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c29f0a5b011642c383fffa8549dde67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.507783 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb81ac0ebd4865b9d53259ed5787d1" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:24.508044 748 raft_consensus.cc:3037] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.509020 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet d53c90eff33044479838ff67dea93057 (table default.Table_7a520f90f9534374822183a6768a4d99 [id=22da0fcad0664913b2d2c6f80e9f1801]) successfully deleted
I20260620 07:01:24.509372 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 0c51ecf0f006400597f0e7f776698854 (table default.Table_48b14443dddd46969ee0299cee27e93e [id=3a5017c5c8104328b9446a42bf0354a6]) successfully deleted
I20260620 07:01:24.514684 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d77be1066b784bc0a04db10d6ddd1483" } modify_external_catalogs: true
I20260620 07:01:24.514942 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d77be1066b784bc0a04db10d6ddd1483" } modify_external_catalogs: true
I20260620 07:01:24.516455 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cd6c42421a00468cac15da0c491e82d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:24.517030 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd6c42421a00468cac15da0c491e82d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:24.518640 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_47d31a0327544bb19e95144d24753b08" } modify_external_catalogs: true
I20260620 07:01:24.518980 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_47d31a0327544bb19e95144d24753b08" } modify_external_catalogs: true
W20260620 07:01:24.521746 681 consensus_peers.cc:487] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3651ef9790d342ec96f554134ae714dc. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:24.523692 1170 tablet_bootstrap.cc:492] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:24.524333 1170 ts_tablet_manager.cc:1397] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.258s user 0.003s sys 0.000s
W20260620 07:01:24.525748 681 consensus_peers.cc:487] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c51ecf0f006400597f0e7f776698854. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:24.525306 1170 raft_consensus.cc:348] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.526073 1170 raft_consensus.cc:374] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.526178 1170 raft_consensus.cc:729] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.526460 1170 consensus_queue.cc:260] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.530627 1166 ts_tablet_manager.cc:1918] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.530743 1166 log.cc:1196] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/3eda988492234d6aaeaee87f84f99d06
I20260620 07:01:24.531181 1166 ts_tablet_manager.cc:1939] T 3eda988492234d6aaeaee87f84f99d06 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.531100 998 tablet_service.cc:1467] Processing CreateTablet for tablet 1d74d33b97dc4750b69f1ab114d4183f (DEFAULT_TABLE table=default.Table_c704b8cf734a4d74b04175f7d4e41dcf [id=74fff351c95d4ff39503d16152da0d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.531622 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d74d33b97dc4750b69f1ab114d4183f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.540051 1166 tablet_replica.cc:330] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.540359 1166 raft_consensus.cc:2229] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.540596 1166 raft_consensus.cc:2258] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.541275 1166 ts_tablet_manager.cc:1905] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:24.542016 393 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 56587.8us
I20260620 07:01:24.550012 2741 raft_consensus.cc:482] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.550297 2741 raft_consensus.cc:504] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.551273 2741 leader_election.cc:288] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.554176 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 3eda988492234d6aaeaee87f84f99d06 (table default.Table_06bc01b8cb5d447ea25fd376cc255a6d [id=188e640d71fa4d34ba29242cb1198020]) successfully deleted
I20260620 07:01:24.556062 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7294e5678ad44622a3249c1113b5e297" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:24.557754 681 leader_election.cc:341] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.560811 1166 ts_tablet_manager.cc:1918] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:24.560969 1166 log.cc:1196] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/88c6aeea7c504f36964e8bf41b0fc4f9
I20260620 07:01:24.561347 1166 ts_tablet_manager.cc:1939] T 88c6aeea7c504f36964e8bf41b0fc4f9 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.562870 1166 tablet_replica.cc:330] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.563143 1166 raft_consensus.cc:2229] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.563452 1166 pending_rounds.cc:62] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:24.563520 1166 pending_rounds.cc:68] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821667649249280 op_type: NO_OP noop_request { }
I20260620 07:01:24.563683 1166 raft_consensus.cc:2866] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.567351 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 88c6aeea7c504f36964e8bf41b0fc4f9 (table default.Table_b0ba90ad7d404eefaffdd72e2bbd6645 [id=b6dc41e1ec4b4b8c9aa8583c725fa886]) successfully deleted
W20260620 07:01:24.567802 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fdcfe152ff9a4436b344d662fcdcb671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdcfe152ff9a4436b344d662fcdcb671 already in progress: creating tablet
W20260620 07:01:24.568215 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0435678022914e6991c974e116d1a9f7 because the tablet was not found. No further retry: Not found: Tablet not found: 0435678022914e6991c974e116d1a9f7
I20260620 07:01:24.563799 1166 raft_consensus.cc:2258] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.575774 1166 ts_tablet_manager.cc:1905] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.581022 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f886739768844a4e9c7ab5e15353f524" } modify_external_catalogs: true
I20260620 07:01:24.581267 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f886739768844a4e9c7ab5e15353f524" } modify_external_catalogs: true
I20260620 07:01:24.584895 1166 ts_tablet_manager.cc:1918] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.585076 1166 log.cc:1196] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/f6bdcd8cd2574acf867b7ec487559db2
I20260620 07:01:24.585538 1166 ts_tablet_manager.cc:1939] T f6bdcd8cd2574acf867b7ec487559db2 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.586603 1166 tablet_replica.cc:330] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.587414 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet f6bdcd8cd2574acf867b7ec487559db2 (table default.Table_a1392579a049482496f7035d9dacbb76 [id=017e06014ef0443086ed5034c5dc1a37]) successfully deleted
I20260620 07:01:24.527237 1170 ts_tablet_manager.cc:1428] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260620 07:01:24.600749 683 leader_election.cc:341] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7294e5678ad44622a3249c1113b5e297
I20260620 07:01:24.600967 683 leader_election.cc:302] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:24.601651 2736 raft_consensus.cc:2726] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:24.602856 1166 raft_consensus.cc:2229] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.603127 1166 raft_consensus.cc:2258] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.603883 1166 ts_tablet_manager.cc:1905] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.612197 1166 ts_tablet_manager.cc:1918] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:24.612388 1166 log.cc:1196] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/8d2c706414684bb1bacc6f9b870fc9c1
I20260620 07:01:24.612787 1166 ts_tablet_manager.cc:1939] T 8d2c706414684bb1bacc6f9b870fc9c1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.613972 1166 tablet_replica.cc:330] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
W20260620 07:01:24.613997 681 consensus_peers.cc:487] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:24.614100 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 8d2c706414684bb1bacc6f9b870fc9c1 (table default.Table_27b3605ce0ed4b8a8c04f4f83227b678 [id=7cff577663c14bf997e9091e37d1c832]) successfully deleted
I20260620 07:01:24.615901 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e43e2f34f5d84283922c1db46aa91fb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:24.616683 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e43e2f34f5d84283922c1db46aa91fb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:24.618893 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c292d437da9741af8ed8d05d8932d870 consensus state has no leader
W20260620 07:01:24.619170 969 leader_election.cc:341] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 35cb81ac0ebd4865b9d53259ed5787d1
I20260620 07:01:24.620401 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_711286df2623480caf1ade7272c70f0d" } modify_external_catalogs: true
I20260620 07:01:24.620644 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_711286df2623480caf1ade7272c70f0d" } modify_external_catalogs: true
I20260620 07:01:24.630281 1170 tablet_bootstrap.cc:492] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:24.323125 866 tablet_service.cc:1467] Processing CreateTablet for tablet cebf74d4e6d04918986fdc6e23a7fc54 (DEFAULT_TABLE table=default.Table_d46ba54811d64a4bbb102c24b7e98245 [id=d2568a98a83c45e88153787a55a30289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.323125 875 tablet_service.cc:1467] Processing CreateTablet for tablet 64032c51b90043f2a2c1fa452ba6e531 (DEFAULT_TABLE table=default.Table_3f4cdac47f2e45ff9d2e525919091c7d [id=c01f4d70674341a0ad14d590fc386ded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.323524 864 tablet_service.cc:1467] Processing CreateTablet for tablet c1b491e6bb8a4022a61f437ab851769f (DEFAULT_TABLE table=default.Table_d14ce1b233284a41aeb1279664775975 [id=8fd58687b8e24d56a0f1a04c2e1270b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.323719 867 tablet_service.cc:1467] Processing CreateTablet for tablet c2e59a8a771b46a1baef2aae069c81e8 (DEFAULT_TABLE table=default.Table_475300ca7abe461b994d885db1818066 [id=99bc45141cd841b5adeaf6af5c8ceedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.323879 869 tablet_service.cc:1467] Processing CreateTablet for tablet 225344e71a134bdeafaf456bc05e3a1c (DEFAULT_TABLE table=default.Table_0d4f78078f134da08fa9407a9d062a50 [id=510b5aa112ec4d6babfdf7aa08e53f61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.324095 865 tablet_service.cc:1467] Processing CreateTablet for tablet c7974b34152648549a4856ca037ee3cd (DEFAULT_TABLE table=default.Table_54df90bb27e3499c9be26f19e09b05ba [id=10484612a31b4317be0722245449bf06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.324105 871 tablet_service.cc:1467] Processing CreateTablet for tablet af64c05a0f034a94b5e253834f5e3483 (DEFAULT_TABLE table=default.Table_1fe9925a618f4f8bbfc3f27e7bd9b52e [id=6daa3b6259fa46b2bf7d186a83455944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.324216 863 tablet_service.cc:1467] Processing CreateTablet for tablet 7b132644404d4d529fa8139928ff337f (DEFAULT_TABLE table=default.Table_1a02055c018e459296bb93027fd71599 [id=50978fe5941049199125e4139ae8b4bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.323524 858 tablet_service.cc:1467] Processing CreateTablet for tablet 486245c13edd4d0baf0a7aa7da5c9250 (DEFAULT_TABLE table=default.Table_896dfaa410f147e5a979725bd3164c3e [id=7eb67c54de4b42dfbdc6108f0e5980da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.324477 874 tablet_service.cc:1467] Processing CreateTablet for tablet 6470f04c28964e63ba7296b2fe74d3d3 (DEFAULT_TABLE table=default.Table_f1984579a670481b9fbcc82593055fa3 [id=a1aab549cb7349a6a8ab8cd4a1880619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.329638 857 tablet_service.cc:1467] Processing CreateTablet for tablet 0dcd4723da554dc3a7aefc75aad836ea (DEFAULT_TABLE table=default.Table_c9840562383e49ccaff65b9accc7f78b [id=ad56ebb5de554e88b7b35c8a6d3213fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.315302 1165 ts_tablet_manager.cc:1918] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:24.632628 1165 log.cc:1196] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/d0f7e6245c074c82a5a72be79ab1987f
I20260620 07:01:24.633123 1165 ts_tablet_manager.cc:1939] T d0f7e6245c074c82a5a72be79ab1987f P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:24.633747 1165 tablet_replica.cc:330] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:24.633885 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet d0f7e6245c074c82a5a72be79ab1987f (table default.Table_8397d634bfa34d018ebbafc7803a6963 [id=71cc7324d22343d994423250a5716606]) successfully deleted
I20260620 07:01:24.634039 1165 raft_consensus.cc:2229] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.634380 1165 pending_rounds.cc:62] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:24.634454 1165 pending_rounds.cc:68] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821669683101696 op_type: NO_OP noop_request { }
I20260620 07:01:24.634650 1165 raft_consensus.cc:2866] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.394893 861 tablet_service.cc:1467] Processing CreateTablet for tablet ad3478d1b85c46b8843a3aa610254ae4 (DEFAULT_TABLE table=default.Table_6e410dfb5ade4fdfb314561d54f4b069 [id=42b66ce2f34848ab88e0f6aef7164550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.399179 862 tablet_service.cc:1467] Processing CreateTablet for tablet 50fe2d97e204419baabd05652181da9d (DEFAULT_TABLE table=default.Table_4e4e652fd8784743812eb669bc82fce2 [id=128ca8f6e06540b3a4c008e862e323d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.399529 859 tablet_service.cc:1467] Processing CreateTablet for tablet d7aa79769a5245e893872824e932045d (DEFAULT_TABLE table=default.Table_d0bb87eb87c54b9bb88d286bfee259df [id=d09e1697be6d45179820b1e0cc836b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.405095 873 tablet_service.cc:1467] Processing CreateTablet for tablet fbf4be69c7bd4fd0a0fb60c39881fdf5 (DEFAULT_TABLE table=default.Table_7477c1a1742f44dea7a1b3a4ae40287f [id=2de5b8f2d44649edaf16d4db168cd882]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.405488 870 tablet_service.cc:1467] Processing CreateTablet for tablet 85937bdc2f724d2daa73a02ac81c1a1d (DEFAULT_TABLE table=default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.405777 872 tablet_service.cc:1467] Processing CreateTablet for tablet 37d4b16e43624e4abb5bed87304c615e (DEFAULT_TABLE table=default.Table_a420ddfbb1164494a7e0d123dc734366 [id=115df9d39b76417ca58db364dc840ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.406123 868 tablet_service.cc:1467] Processing CreateTablet for tablet 272659ed6b6d4bcb98847a430679568c (DEFAULT_TABLE table=default.Table_683b374c978a473e97801fc65fa16183 [id=9947c416ebd54052ad60c77c2646b3c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.406672 860 tablet_service.cc:1467] Processing CreateTablet for tablet 4b8c7fd8376c4e7998acc9a2d64808c7 (DEFAULT_TABLE table=default.Table_fcf5bef884174f4485ff7399a415bd12 [id=f2b8b7e4f74043fb967ad5e67cc923b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.406729 876 tablet_service.cc:1467] Processing CreateTablet for tablet 1d74d33b97dc4750b69f1ab114d4183f (DEFAULT_TABLE table=default.Table_c704b8cf734a4d74b04175f7d4e41dcf [id=74fff351c95d4ff39503d16152da0d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.636011 1165 raft_consensus.cc:2258] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.637267 1165 ts_tablet_manager.cc:1905] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.430751 2757 raft_consensus.cc:482] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.637619 2757 raft_consensus.cc:504] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.638310 2757 leader_election.cc:288] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.646512 2741 raft_consensus.cc:482] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.646831 2741 raft_consensus.cc:504] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.648252 2741 leader_election.cc:288] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.649168 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c7b3977b604cb69df671318fae1212" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:24.650152 681 leader_election.cc:341] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.651782 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ffb66de2e72b4d13ad4c58bec2720b5a
I20260620 07:01:24.653894 733 tablet_service.cc:1514] Processing DeleteTablet for tablet ffb66de2e72b4d13ad4c58bec2720b5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:24.656085 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0416b6a241aa4455868e1ef3823352e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:24.656780 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0416b6a241aa4455868e1ef3823352e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:24.659847 1170 tablet_bootstrap.cc:654] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.679492 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4u_93S/build/asan/bin/kudu
/tmp/dist-test-task4u_93S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:46775
--webserver_interface=127.0.97.60
--webserver_port=44063
--builtin_ntp_servers=127.0.97.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 07:01:24.689776 419 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:24.690261 419 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 390a327225344afda3076c341202cc1d (table default.Table_3afdf58081b24bb3b6aa051008f4efdc [id=d7198485f2104c2092955ef5305900cf]). Expected version 3 got 2
I20260620 07:01:24.700541 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3f4ce8cf64704cde86845513a33699a4" } new_table_name: "default.Table_b88f1e4e88394eacbd71b73f05c0b070" modify_external_catalogs: true
I20260620 07:01:24.702945 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b8c7fd8376c4e7998acc9a2d64808c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.703238 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7aa79769a5245e893872824e932045d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.703550 858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 486245c13edd4d0baf0a7aa7da5c9250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.703771 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d4b16e43624e4abb5bed87304c615e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.706928 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af64c05a0f034a94b5e253834f5e3483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.707154 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50fe2d97e204419baabd05652181da9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.707396 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64032c51b90043f2a2c1fa452ba6e531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.707588 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2e59a8a771b46a1baef2aae069c81e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.707782 863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b132644404d4d529fa8139928ff337f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.707991 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7974b34152648549a4856ca037ee3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.708210 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad3478d1b85c46b8843a3aa610254ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.708415 870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85937bdc2f724d2daa73a02ac81c1a1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.710912 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d74d33b97dc4750b69f1ab114d4183f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.714368 871 tablet_service.cc:1467] Processing CreateTablet for tablet 968d79b9182e49b4b5e87d6c54a6e8fe (DEFAULT_TABLE table=default.Table_3af86396ccfe41619735799d3a4b7058 [id=91e36629adaf4bacb5b6f804bfd57dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.714584 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dcd4723da554dc3a7aefc75aad836ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.716952 860 tablet_service.cc:1467] Processing CreateTablet for tablet c29f0a5b011642c383fffa8549dde67f (DEFAULT_TABLE table=default.Table_af208c36d70d42ad9d2f065e7f73f388 [id=92872d6c1d2c43d280859c2c7cc93922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:24.714768 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 968d79b9182e49b4b5e87d6c54a6e8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.719063 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6470f04c28964e63ba7296b2fe74d3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.721824 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbf4be69c7bd4fd0a0fb60c39881fdf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.722735 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1b491e6bb8a4022a61f437ab851769f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.727052 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e28974261e7f4c67afafca0273238d96
I20260620 07:01:24.728871 733 tablet_service.cc:1514] Processing DeleteTablet for tablet e28974261e7f4c67afafca0273238d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:24.729586 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c29f0a5b011642c383fffa8549dde67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.730162 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ace112cdfa4542c688a64271d6530be8" } new_table_name: "default.Table_de78f6f1d44c439e80a2c83edf4e5076" modify_external_catalogs: true
I20260620 07:01:24.733418 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8ed68b221b4215812934844447d60e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:24.734212 2757 raft_consensus.cc:482] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.739279 2757 raft_consensus.cc:504] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.740005 2757 leader_election.cc:288] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:24.740021 683 consensus_peers.cc:487] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca86563e5b014bb88ccb74c628670c46. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:24.740686 683 consensus_peers.cc:487] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c51ecf0f006400597f0e7f776698854. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:24.750947 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cebf74d4e6d04918986fdc6e23a7fc54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.752154 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1028eae925e7471382514b1425be0d87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:24.752715 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1028eae925e7471382514b1425be0d87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:24.756182 1165 ts_tablet_manager.cc:1918] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.756313 1165 log.cc:1196] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/960fca9c94764f3d8d2daae20a0f8388
I20260620 07:01:24.756888 1165 ts_tablet_manager.cc:1939] T 960fca9c94764f3d8d2daae20a0f8388 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:24.757499 874 tablet_service.cc:1514] Processing DeleteTablet for tablet ffb66de2e72b4d13ad4c58bec2720b5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.757953 858 tablet_service.cc:1514] Processing DeleteTablet for tablet e28974261e7f4c67afafca0273238d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.757768 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 272659ed6b6d4bcb98847a430679568c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:24.767396 1165 tablet_replica.cc:330] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:24.770124 1170 tablet_bootstrap.cc:492] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:24.769949 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1d305578ac2743299339f0493f87c17c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:24.770517 1170 ts_tablet_manager.cc:1397] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.141s user 0.007s sys 0.000s
I20260620 07:01:24.767704 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 225344e71a134bdeafaf456bc05e3a1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:24.770598 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d305578ac2743299339f0493f87c17c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:24.770969 1165 raft_consensus.cc:2229] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.771793 1170 raft_consensus.cc:348] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.772289 1165 pending_rounds.cc:62] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: Trying to abort 1 pending ops.
I20260620 07:01:24.772384 1165 pending_rounds.cc:68] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821668539248640 op_type: NO_OP noop_request { }
I20260620 07:01:24.772552 1165 raft_consensus.cc:2866] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.772677 1165 raft_consensus.cc:2258] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.772892 1170 raft_consensus.cc:374] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.773015 1170 raft_consensus.cc:729] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.773300 1170 consensus_queue.cc:260] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.778451 1165 ts_tablet_manager.cc:1905] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.780668 1168 tablet_bootstrap.cc:654] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.782124 1170 ts_tablet_manager.cc:1428] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260620 07:01:24.782727 1170 tablet_bootstrap.cc:492] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:24.795194 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 5883a8466d0c4e45aba3b4095ced91a4 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:24.795863 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d8dadf1def774fa98f22aca6faf3dc46" } new_table_name: "default.Table_34bc2fad7f8448b59803744f14064d16" modify_external_catalogs: true
I20260620 07:01:24.796444 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bdcd8cd2574acf867b7ec487559db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.796793 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eda988492234d6aaeaee87f84f99d06 with delete_type TABLET_DATA_DELETED (replaced by tablet a590f553b9e041c4830234897dbbf09f) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.797436 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet c24fe8318b4743df886d210fc94318fe
I20260620 07:01:24.797744 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet ffb66de2e72b4d13ad4c58bec2720b5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.798045 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_466db1e9c696430ca1b2fb643bdb5611" } new_table_name: "default.Table_c80a2cb231634ee4b5861f7b5c351d6c" modify_external_catalogs: true
I20260620 07:01:24.802101 1170 tablet_bootstrap.cc:654] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.803757 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1064) took 4951 ms. Trace:
I20260620 07:01:24.803857 1169 rpcz_store.cc:276] 0620 07:01:19.852327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.852415 (+ 88us) service_pool.cc:227] Handling call
0620 07:01:24.385441 (+4533026us) ts_tablet_manager.cc:1145] Deleting tablet e6bae5090f81417cbcf4b4d598b438da
0620 07:01:24.385449 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.413961 (+ 28512us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.432031 (+ 18070us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.803729 (+371698us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4532842}
I20260620 07:01:24.804394 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1066) took 4919 ms. Trace:
I20260620 07:01:24.804476 1169 rpcz_store.cc:276] 0620 07:01:19.884680 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.887248 (+ 2568us) service_pool.cc:227] Handling call
0620 07:01:24.804264 (+4917016us) ts_tablet_manager.cc:1145] Deleting tablet ef4e6fda73ba45c6892273b33b37a688
0620 07:01:24.804275 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.804376 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4916696}
I20260620 07:01:24.804770 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1069) took 4900 ms. Trace:
I20260620 07:01:24.804836 1169 rpcz_store.cc:276] 0620 07:01:19.904667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.904737 (+ 70us) service_pool.cc:227] Handling call
0620 07:01:24.804677 (+4899940us) ts_tablet_manager.cc:1145] Deleting tablet f96688ac7c91450cb34afd5f40b9826c
0620 07:01:24.804686 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.804757 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4899723}
I20260620 07:01:24.805066 1169 tablet_replica.cc:330] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:24.805280 1169 raft_consensus.cc:2229] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.805546 1169 pending_rounds.cc:62] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:24.805600 1169 pending_rounds.cc:68] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821665167048704 op_type: NO_OP noop_request { }
I20260620 07:01:24.805758 1169 raft_consensus.cc:2866] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.805863 1169 raft_consensus.cc:2258] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.805881 2519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fe29008ed9b430ea13d40e54e3ddfcc" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 36007 } } peers { permanent_uuid: "2395d394cd84440ebae89d1ecfa13fb5" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 33455 } } peers { permanent_uuid: "f32c3995c70946c38ce1a3094aaaffb1" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 46775 } } }
I20260620 07:01:24.806107 2519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc [sys.catalog]: This master's current role is: LEADER
I20260620 07:01:24.806564 1169 ts_tablet_manager.cc:1905] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.807621 2570 raft_consensus.cc:504] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.809230 2570 leader_election.cc:288] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:24.811365 681 leader_election.cc:341] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 8d2c706414684bb1bacc6f9b870fc9c1
W20260620 07:01:24.818403 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ef4e6fda73ba45c6892273b33b37a688 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef4e6fda73ba45c6892273b33b37a688 already in progress: creating tablet
W20260620 07:01:24.819190 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f96688ac7c91450cb34afd5f40b9826c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96688ac7c91450cb34afd5f40b9826c already in progress: creating tablet
I20260620 07:01:24.824637 727 tablet_service.cc:1514] Processing DeleteTablet for tablet c24fe8318b4743df886d210fc94318fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:24.829854 1169 ts_tablet_manager.cc:1918] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.830039 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da80903ac124d1aae937c2329f9b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 95ba8444d70342f781bd84edefbca71f) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.830379 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 4655d289c94c4bce9707be375fc4b850 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:02 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.835492 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet c9d344f9e4b444e4b6018fdf0cf762fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.835819 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet d53c90eff33044479838ff67dea93057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:24.843421 831 leader_election.cc:341] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.844736 875 tablet_service.cc:1514] Processing DeleteTablet for tablet c24fe8318b4743df886d210fc94318fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.844838 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 960fca9c94764f3d8d2daae20a0f8388 (table default.Table_9016cc3335c9474492924d45cbc4dcea [id=ffd94fcc85484772af776d4ccbe875af]) successfully deleted
I20260620 07:01:24.848817 1166 raft_consensus.cc:2229] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.849220 1166 pending_rounds.cc:62] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:24.849269 1166 pending_rounds.cc:68] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821667057434624 op_type: NO_OP noop_request { }
I20260620 07:01:24.849416 1166 raft_consensus.cc:2866] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.849522 1166 raft_consensus.cc:2258] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.854300 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet c24fe8318b4743df886d210fc94318fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.854640 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet e28974261e7f4c67afafca0273238d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.856225 1168 tablet_bootstrap.cc:492] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:24.856419 1168 ts_tablet_manager.cc:1397] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.540s user 0.003s sys 0.000s
I20260620 07:01:24.856776 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf912f51bfd4df0afe7aa28815a897e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.857256 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5c083ebc2e054e09a531a8768802dcb1
I20260620 07:01:24.857364 1165 ts_tablet_manager.cc:1918] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.857286 1168 raft_consensus.cc:348] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.857452 1165 log.cc:1196] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/00a34f01ce5d4d5696248dc88802dafd
I20260620 07:01:24.857494 1168 raft_consensus.cc:374] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.857558 1168 raft_consensus.cc:729] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.857861 1165 ts_tablet_manager.cc:1939] T 00a34f01ce5d4d5696248dc88802dafd P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:24.857892 1168 consensus_queue.cc:260] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.858032 1169 log.cc:1196] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/7b781d0578834708ae64b24419959cca
W20260620 07:01:24.857945 2800 consensus_queue.cc:1159] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "06a32ef63b2b495a9ade1de48c024ae9" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260620 07:01:24.830230 748 raft_consensus.cc:2454] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:24.858407 1169 ts_tablet_manager.cc:1939] T 7b781d0578834708ae64b24419959cca P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:24.858641 1166 ts_tablet_manager.cc:1905] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.856906 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8ed68b221b4215812934844447d60e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.858773 1168 ts_tablet_manager.cc:1428] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:24.859087 1168 tablet_bootstrap.cc:492] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:24.847136 683 leader_election.cc:341] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a6c7b3977b604cb69df671318fae1212
I20260620 07:01:24.859493 683 leader_election.cc:302] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:24.859783 2736 raft_consensus.cc:2726] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:24.860250 683 consensus_peers.cc:487] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fbd069552314f2c9ee010c054386644. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:24.860494 683 leader_election.cc:341] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8d2c706414684bb1bacc6f9b870fc9c1
I20260620 07:01:24.860625 683 leader_election.cc:302] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:24.860656 1168 tablet_bootstrap.cc:654] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.860867 2736 raft_consensus.cc:2726] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 07:01:24.862294 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf912f51bfd4df0afe7aa28815a897e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:24.858646 968 leader_election.cc:302] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:24.863269 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1071) took 4932 ms. Trace:
I20260620 07:01:24.863289 2531 raft_consensus.cc:2781] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:24.863374 1169 rpcz_store.cc:276] 0620 07:01:19.930441 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.930893 (+ 452us) service_pool.cc:227] Handling call
0620 07:01:24.805030 (+4874137us) ts_tablet_manager.cc:1145] Deleting tablet 7b781d0578834708ae64b24419959cca
0620 07:01:24.805039 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.822052 (+ 17013us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.829722 (+ 7670us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.863251 (+ 33529us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4851255}
I20260620 07:01:24.863685 1169 tablet_replica.cc:330] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:24.863903 1169 raft_consensus.cc:2229] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.864044 1169 raft_consensus.cc:2258] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.864461 2531 raft_consensus.cc:686] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:24.864533 1169 ts_tablet_manager.cc:1905] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.864533 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0db8d65e3d3c4f9fb6a8a55800d15171"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:24.864784 2531 consensus_queue.cc:237] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:24.865082 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0db8d65e3d3c4f9fb6a8a55800d15171 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:24.867161 831 leader_election.cc:341] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.867584 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c083ebc2e054e09a531a8768802dcb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:24.868618 1170 tablet_bootstrap.cc:492] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:24.868769 1170 ts_tablet_manager.cc:1397] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.000s
I20260620 07:01:24.868762 1166 ts_tablet_manager.cc:1918] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.868872 1166 log.cc:1196] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/6fbd069552314f2c9ee010c054386644
I20260620 07:01:24.869256 1166 ts_tablet_manager.cc:1939] T 6fbd069552314f2c9ee010c054386644 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:24.869721 1166 tablet_replica.cc:330] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:24.869510 1170 raft_consensus.cc:348] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.869798 1170 raft_consensus.cc:374] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.869874 1170 raft_consensus.cc:729] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.870096 1170 consensus_queue.cc:260] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.870639 1170 ts_tablet_manager.cc:1428] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:24.871119 1168 tablet_bootstrap.cc:492] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:24.871245 1168 ts_tablet_manager.cc:1397] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20260620 07:01:24.871660 1170 tablet_bootstrap.cc:492] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:24.871888 2736 consensus_queue.cc:1035] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:24.873386 1168 raft_consensus.cc:348] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.874382 1168 raft_consensus.cc:374] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.874547 1168 raft_consensus.cc:729] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.874840 1168 consensus_queue.cc:260] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.876256 1168 ts_tablet_manager.cc:1428] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:24.877375 1168 tablet_bootstrap.cc:492] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:24.879005 969 leader_election.cc:341] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 35cb81ac0ebd4865b9d53259ed5787d1
I20260620 07:01:24.879746 1170 tablet_bootstrap.cc:654] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.879825 2736 raft_consensus.cc:482] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.879964 2736 raft_consensus.cc:504] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.880614 2736 leader_election.cc:288] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.881891 1168 tablet_bootstrap.cc:654] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.884039 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8aa75356fb54672a0ada533fc634613" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:24.884338 895 raft_consensus.cc:2454] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
W20260620 07:01:24.885648 830 leader_election.cc:341] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.885895 830 leader_election.cc:302] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:24.886224 2757 raft_consensus.cc:2726] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:24.886637 830 leader_election.cc:341] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.886890 830 leader_election.cc:302] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:24.887032 683 leader_election.cc:302] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:24.887158 2757 raft_consensus.cc:2726] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:24.890662 1168 tablet_bootstrap.cc:492] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:24.891330 1168 ts_tablet_manager.cc:1397] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260620 07:01:24.892520 1168 raft_consensus.cc:348] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.894039 1168 raft_consensus.cc:374] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.894271 1168 raft_consensus.cc:729] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.894649 1168 consensus_queue.cc:260] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.897514 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 00a34f01ce5d4d5696248dc88802dafd (table default.Table_aa50efd3e2c24b94ae1de367ad45588e [id=e61a54c0965a44489938c39ebae31a30]) successfully deleted
I20260620 07:01:24.897176 1165 tablet_replica.cc:330] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:24.899369 1165 raft_consensus.cc:2229] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.899719 1165 raft_consensus.cc:2258] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.900054 1170 tablet_bootstrap.cc:492] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:24.900203 1170 ts_tablet_manager.cc:1397] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260620 07:01:24.900493 1165 ts_tablet_manager.cc:1905] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.900861 1170 raft_consensus.cc:348] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.901095 1170 raft_consensus.cc:374] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.901160 1170 raft_consensus.cc:729] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.901414 1170 consensus_queue.cc:260] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.902115 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c083ebc2e054e09a531a8768802dcb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:24.903659 1169 ts_tablet_manager.cc:1918] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:24.903779 1169 log.cc:1196] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/35cb81ac0ebd4865b9d53259ed5787d1
I20260620 07:01:24.904088 1169 ts_tablet_manager.cc:1939] T 35cb81ac0ebd4865b9d53259ed5787d1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:24.904915 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1072) took 4974 ms. Trace:
I20260620 07:01:24.905021 1169 rpcz_store.cc:276] 0620 07:01:19.930558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.930975 (+ 417us) service_pool.cc:227] Handling call
0620 07:01:24.863641 (+4932666us) ts_tablet_manager.cc:1145] Deleting tablet 35cb81ac0ebd4865b9d53259ed5787d1
0620 07:01:24.863653 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.884946 (+ 21293us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.903558 (+ 18612us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.904894 (+ 1336us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4909738}
I20260620 07:01:24.905872 1170 ts_tablet_manager.cc:1428] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:24.906157 1170 tablet_bootstrap.cc:492] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:24.907615 1170 tablet_bootstrap.cc:654] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.908390 1168 ts_tablet_manager.cc:1428] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260620 07:01:24.910256 1168 tablet_bootstrap.cc:492] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:24.911387 1169 tablet_replica.cc:330] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:24.911653 1169 raft_consensus.cc:2229] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.912122 1169 pending_rounds.cc:62] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:24.912199 1169 pending_rounds.cc:68] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821667303399424 op_type: NO_OP noop_request { }
I20260620 07:01:24.912338 1169 raft_consensus.cc:2866] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.912447 1169 raft_consensus.cc:2258] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.913075 1169 ts_tablet_manager.cc:1905] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.914213 1165 ts_tablet_manager.cc:1918] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:24.916090 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 7b781d0578834708ae64b24419959cca (table default.Table_6d1419cac1c54567a909e7a7b5bc2ff0 [id=84ff58148b4f4e10b31009115fe83352]) successfully deleted
I20260620 07:01:24.916559 1165 log.cc:1196] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/a0a5967c84434000a51fe7d819fac439
I20260620 07:01:24.917229 1165 ts_tablet_manager.cc:1939] T a0a5967c84434000a51fe7d819fac439 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:24.918291 1165 tablet_replica.cc:330] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:24.918560 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e0c27f9ca93741919eb4cbe8a8e6443d consensus state has no leader
I20260620 07:01:24.919284 1166 raft_consensus.cc:2229] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:24.919548 1165 raft_consensus.cc:2229] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.919929 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet a0a5967c84434000a51fe7d819fac439 (table default.Table_01ee97109ccf4626922b6e3ec22f9423 [id=75aa959a850d49e8af3dc9d607aa19bf]) successfully deleted
I20260620 07:01:24.920135 2826 raft_consensus.cc:2781] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:24.920508 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f8716b3d4c6b4a0ea6e96829cb10b456"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:24.921104 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8716b3d4c6b4a0ea6e96829cb10b456 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:24.921451 1166 pending_rounds.cc:62] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:24.921504 1166 pending_rounds.cc:68] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821672409051136 op_type: NO_OP noop_request { }
I20260620 07:01:24.921627 1166 raft_consensus.cc:2866] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:24.921726 1166 raft_consensus.cc:2258] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.855222 2741 raft_consensus.cc:482] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.922773 2741 raft_consensus.cc:504] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.920205 2829 raft_consensus.cc:482] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.923063 2829 raft_consensus.cc:504] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.923367 2741 leader_election.cc:288] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.923458 2829 leader_election.cc:288] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.923892 2826 raft_consensus.cc:482] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:24.924012 2826 raft_consensus.cc:3037] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.924292 1170 tablet_bootstrap.cc:492] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:24.924412 1170 ts_tablet_manager.cc:1397] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260620 07:01:24.925036 1170 raft_consensus.cc:348] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.925220 1170 raft_consensus.cc:374] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.925269 1170 raft_consensus.cc:729] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.925426 1170 consensus_queue.cc:260] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.925915 1170 ts_tablet_manager.cc:1428] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260620 07:01:24.926154 1170 tablet_bootstrap.cc:492] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:24.927152 1165 raft_consensus.cc:2258] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.927757 1170 tablet_bootstrap.cc:654] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.915004 1168 tablet_bootstrap.cc:654] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.931149 1165 ts_tablet_manager.cc:1905] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:24.926440 2826 raft_consensus.cc:504] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.939332 1166 ts_tablet_manager.cc:1905] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:24.848600 2532 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s user 0.005s sys 0.006s
W20260620 07:01:24.943233 2532 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s user 0.005s sys 0.006s
I20260620 07:01:24.954505 2826 leader_election.cc:288] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.955971 1170 tablet_bootstrap.cc:492] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:24.956125 1170 ts_tablet_manager.cc:1397] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260620 07:01:24.956832 1170 raft_consensus.cc:348] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.957042 1170 raft_consensus.cc:374] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.957095 1170 raft_consensus.cc:729] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.957255 1170 consensus_queue.cc:260] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.957741 1170 ts_tablet_manager.cc:1428] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:24.959033 2836 tablet.cc:1722] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:24.960278 1170 tablet_bootstrap.cc:492] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:24.965621 1170 tablet_bootstrap.cc:654] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:24.967777 2820 tablet.cc:1722] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:24.967758 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8aa75356fb54672a0ada533fc634613" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:24.968005 889 raft_consensus.cc:3037] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:24.968194 2757 raft_consensus.cc:482] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:24.968850 2757 raft_consensus.cc:504] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.969514 2757 leader_election.cc:288] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:24.971217 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 35cb81ac0ebd4865b9d53259ed5787d1 (table default.Table_1aeab74931f24831bafc5e0ba0dd2a6e [id=1217f9b44b2f484d86191921e496bd0b]) successfully deleted
I20260620 07:01:24.971004 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c083ebc2e054e09a531a8768802dcb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:24.974926 1169 ts_tablet_manager.cc:1918] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:24.975303 1169 log.cc:1196] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/0c51ecf0f006400597f0e7f776698854
I20260620 07:01:24.975721 1169 ts_tablet_manager.cc:1939] T 0c51ecf0f006400597f0e7f776698854 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:24.975759 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c06bf6c4d1af40479c81bd1d85e2848f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.976533 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1073) took 5045 ms. Trace:
I20260620 07:01:24.976629 1169 rpcz_store.cc:276] 0620 07:01:19.930639 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.931033 (+ 394us) service_pool.cc:227] Handling call
0620 07:01:24.911327 (+4980294us) ts_tablet_manager.cc:1145] Deleting tablet 0c51ecf0f006400597f0e7f776698854
0620 07:01:24.911348 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.930778 (+ 19430us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.934067 (+ 3289us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:24.976512 (+ 42445us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4951271}
I20260620 07:01:24.976944 1169 tablet_replica.cc:330] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:24.964015 2836 tablet.cc:1722] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260620 07:01:24.978600 830 leader_election.cc:341] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:24.972190 2830 raft_consensus.cc:482] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06a32ef63b2b495a9ade1de48c024ae9)
I20260620 07:01:24.979437 2830 raft_consensus.cc:504] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } }
W20260620 07:01:24.979645 412 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.60:46775, user_credentials={real_user=slave}} blocked reactor thread for 78199.1us
I20260620 07:01:24.980069 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 6fbd069552314f2c9ee010c054386644 (table default.Table_6b7421166e034804801bd91c1a520a3d [id=ee69fd0e35dd410b9193d36a7d7e1c5a]) successfully deleted
I20260620 07:01:24.980453 2830 leader_election.cc:288] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:24.981448 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 103085us
I20260620 07:01:24.982200 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8aa75356fb54672a0ada533fc634613" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.982592 1169 raft_consensus.cc:2229] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:24.982748 1169 raft_consensus.cc:2258] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:24.984833 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033c8b817757441ea7ebc2dbf77aa2dd" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.985370 889 raft_consensus.cc:2454] T c8aa75356fb54672a0ada533fc634613 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:24.985677 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9d344f9e4b444e4b6018fdf0cf762fd" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:24.985909 1030 raft_consensus.cc:2454] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:24.986696 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8aa75356fb54672a0ada533fc634613" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:24.987241 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c06bf6c4d1af40479c81bd1d85e2848f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:24.987321 1169 ts_tablet_manager.cc:1905] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:24.996963 683 leader_election.cc:341] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c9d344f9e4b444e4b6018fdf0cf762fd
I20260620 07:01:24.989725 1168 tablet_bootstrap.cc:492] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:24.998441 1168 ts_tablet_manager.cc:1397] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.088s user 0.007s sys 0.000s
I20260620 07:01:24.998914 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 0c51ecf0f006400597f0e7f776698854 (table default.Table_48b14443dddd46969ee0299cee27e93e [id=3a5017c5c8104328b9446a42bf0354a6]) successfully deleted
I20260620 07:01:24.999209 1168 raft_consensus.cc:348] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:24.999495 1168 raft_consensus.cc:374] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:24.999588 1168 raft_consensus.cc:729] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:24.999866 1168 consensus_queue.cc:260] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:24.998071 831 leader_election.cc:341] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.000288 831 leader_election.cc:302] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:25.000576 2757 raft_consensus.cc:2726] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.002205 1168 ts_tablet_manager.cc:1428] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260620 07:01:25.002466 1168 tablet_bootstrap.cc:492] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.003762 1170 tablet_bootstrap.cc:492] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.006650 1170 ts_tablet_manager.cc:1397] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.003s
I20260620 07:01:25.007630 1170 raft_consensus.cc:348] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.007952 1170 raft_consensus.cc:374] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.008077 1170 raft_consensus.cc:729] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.008351 1170 consensus_queue.cc:260] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.009021 1170 ts_tablet_manager.cc:1428] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:25.009382 1170 tablet_bootstrap.cc:492] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:25.010226 681 leader_election.cc:341] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:25.010848 681 consensus_peers.cc:487] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fbd069552314f2c9ee010c054386644. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:25.011241 681 leader_election.cc:341] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.012671 1168 tablet_bootstrap.cc:654] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:25.020920 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47365e10ce274af891055b34e2f0a2bd consensus state has no leader
I20260620 07:01:25.022315 1165 ts_tablet_manager.cc:1918] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:25.022600 1165 log.cc:1196] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f2426d52b8ff40f39887545e0341a91a
I20260620 07:01:25.023141 1165 ts_tablet_manager.cc:1939] T f2426d52b8ff40f39887545e0341a91a P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:25.025099 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_75ae339dc91942fba5c8df14b5187448"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:25.025699 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75ae339dc91942fba5c8df14b5187448 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.027820 2840 tablet.cc:1722] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:25.023722 2838 tablet.cc:1722] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260620 07:01:25.029177 1167 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.701s user 0.077s sys 0.146s
I20260620 07:01:25.029222 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f2426d52b8ff40f39887545e0341a91a (table default.Table_8cec159b248a44ed97cd71cca66c5e9c [id=eaa024e7fc254777b8ed67fd19a9747f]) successfully deleted
W20260620 07:01:25.029381 1167 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.701s user 0.077s sys 0.146s
W20260620 07:01:25.029923 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ffb66de2e72b4d13ad4c58bec2720b5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffb66de2e72b4d13ad4c58bec2720b5a already in progress: creating tablet
I20260620 07:01:25.030690 1165 tablet_replica.cc:330] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:25.030879 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e28974261e7f4c67afafca0273238d96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e28974261e7f4c67afafca0273238d96 already in progress: creating tablet
W20260620 07:01:25.031086 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c24fe8318b4743df886d210fc94318fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c24fe8318b4743df886d210fc94318fe already in progress: creating tablet
I20260620 07:01:25.033355 1167 tablet_bootstrap.cc:492] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.033577 1167 ts_tablet_manager.cc:1397] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.707s user 0.079s sys 0.146s
I20260620 07:01:25.034412 1167 raft_consensus.cc:348] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.034725 1167 raft_consensus.cc:374] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.034854 1167 raft_consensus.cc:729] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.035166 1167 consensus_queue.cc:260] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.035738 1167 ts_tablet_manager.cc:1428] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:25.036046 1167 tablet_bootstrap.cc:492] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.037850 1167 tablet_bootstrap.cc:654] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.038003 1165 raft_consensus.cc:2229] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.038257 1165 raft_consensus.cc:2258] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.038898 1165 ts_tablet_manager.cc:1905] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.048617 1168 tablet_bootstrap.cc:492] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.048883 1168 ts_tablet_manager.cc:1397] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.000s
I20260620 07:01:25.049646 1168 raft_consensus.cc:348] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.050007 1168 raft_consensus.cc:374] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.050103 1168 raft_consensus.cc:729] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.050372 1166 ts_tablet_manager.cc:1918] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:25.050346 1168 consensus_queue.cc:260] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.050571 1166 log.cc:1196] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/35cb81ac0ebd4865b9d53259ed5787d1
I20260620 07:01:25.050977 1168 ts_tablet_manager.cc:1428] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:25.051038 1166 ts_tablet_manager.cc:1939] T 35cb81ac0ebd4865b9d53259ed5787d1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:25.053567 2757 raft_consensus.cc:482] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.054704 2757 raft_consensus.cc:504] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.055724 2757 leader_election.cc:288] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.056330 1168 tablet_bootstrap.cc:492] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.056906 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e6ef65b5f44f6d9f2100dd404b2e5f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.057078 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 35cb81ac0ebd4865b9d53259ed5787d1 (table default.Table_1aeab74931f24831bafc5e0ba0dd2a6e [id=1217f9b44b2f484d86191921e496bd0b]) successfully deleted
W20260620 07:01:25.057926 830 leader_election.cc:341] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.058350 1168 tablet_bootstrap.cc:654] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:25.058969 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3651ef9790d342ec96f554134ae714dc because the tablet was not found. No further retry: Not found: Tablet not found: 3651ef9790d342ec96f554134ae714dc
I20260620 07:01:25.061019 1167 tablet_bootstrap.cc:492] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.061327 1167 ts_tablet_manager.cc:1397] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20260620 07:01:25.063238 1167 raft_consensus.cc:348] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.063779 1167 raft_consensus.cc:374] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260620 07:01:25.063848 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 06fd96feb4a74b9f8d3243b7d774f388 because the tablet was not found. No further retry: Not found: Tablet not found: 06fd96feb4a74b9f8d3243b7d774f388
I20260620 07:01:25.064090 1167 raft_consensus.cc:729] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
W20260620 07:01:25.069495 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 58248.5us
I20260620 07:01:25.069773 681 leader_election.cc:302] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
W20260620 07:01:25.074174 830 consensus_peers.cc:487] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:25.075404 681 leader_election.cc:341] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.077113 2821 raft_consensus.cc:2781] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.077275 2821 raft_consensus.cc:482] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.077632 2821 raft_consensus.cc:3037] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.011416 1170 tablet_bootstrap.cc:654] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.025863 1169 ts_tablet_manager.cc:1918] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:25.078950 1169 log.cc:1196] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/9da80903ac124d1aae937c2329f9b13e
I20260620 07:01:25.079345 1169 ts_tablet_manager.cc:1939] T 9da80903ac124d1aae937c2329f9b13e P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:01:25.080574 683 leader_election.cc:341] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 033c8b817757441ea7ebc2dbf77aa2dd
I20260620 07:01:25.080866 683 leader_election.cc:302] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:25.081372 2452 raft_consensus.cc:2726] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:25.081441 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 69877.6us
I20260620 07:01:25.081358 1167 consensus_queue.cc:260] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.082304 1167 ts_tablet_manager.cc:1428] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260620 07:01:25.082700 1167 tablet_bootstrap.cc:492] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.084460 683 leader_election.cc:302] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.084836 2736 raft_consensus.cc:2781] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.084949 2736 raft_consensus.cc:686] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
W20260620 07:01:25.084980 683 leader_election.cc:341] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ad65565caddf4e878292d1178fbf6037
I20260620 07:01:25.085167 2736 consensus_queue.cc:237] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.086992 2838 tablet.cc:1722] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:25.087677 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e6ef65b5f44f6d9f2100dd404b2e5f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.087937 748 raft_consensus.cc:2454] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:25.096235 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1074) took 5165 ms. Trace:
I20260620 07:01:25.096376 1169 rpcz_store.cc:276] 0620 07:01:19.930728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.931075 (+ 347us) service_pool.cc:227] Handling call
0620 07:01:24.976903 (+5045828us) ts_tablet_manager.cc:1145] Deleting tablet 9da80903ac124d1aae937c2329f9b13e
0620 07:01:24.976914 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:24.990235 (+ 13321us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.025753 (+ 35518us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.096204 (+ 70451us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5451,"tablet-delete.queue_time_us":5022777}
I20260620 07:01:25.096728 1169 tablet_replica.cc:330] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:25.096940 1169 raft_consensus.cc:2229] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.097085 1169 raft_consensus.cc:2258] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.097527 1168 tablet_bootstrap.cc:492] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.097620 1169 ts_tablet_manager.cc:1905] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.097800 1168 ts_tablet_manager.cc:1397] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.042s user 0.017s sys 0.000s
I20260620 07:01:25.097723 2821 raft_consensus.cc:504] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.098383 1165 ts_tablet_manager.cc:1918] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:25.098371 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 9da80903ac124d1aae937c2329f9b13e (table default.Table_4248c917b1ab466086f9ae5cf25bbe7b [id=2943ebfc86e54b75a06a5727fdcc6190]) successfully deleted
I20260620 07:01:25.098573 1165 log.cc:1196] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/5c083ebc2e054e09a531a8768802dcb1
I20260620 07:01:25.098685 1168 raft_consensus.cc:348] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.099015 1168 raft_consensus.cc:374] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.099148 1168 raft_consensus.cc:729] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.099558 1168 consensus_queue.cc:260] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.100502 1168 ts_tablet_manager.cc:1428] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:25.100987 1168 tablet_bootstrap.cc:492] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.099053 1165 ts_tablet_manager.cc:1939] T 5c083ebc2e054e09a531a8768802dcb1 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:25.106431 1167 tablet_bootstrap.cc:654] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.106401 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]) successfully deleted
I20260620 07:01:25.114416 2821 leader_election.cc:288] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:25.075929 681 consensus_peers.cc:487] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:25.114742 681 leader_election.cc:341] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: ad65565caddf4e878292d1178fbf6037
I20260620 07:01:25.114857 681 leader_election.cc:302] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:25.115294 2736 raft_consensus.cc:2726] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:25.115695 1170 tablet_bootstrap.cc:492] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.115823 1170 ts_tablet_manager.cc:1397] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.107s user 0.003s sys 0.000s
I20260620 07:01:25.116547 831 leader_election.cc:302] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.116812 2757 raft_consensus.cc:2781] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.116890 2757 raft_consensus.cc:482] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.116951 2757 raft_consensus.cc:3037] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.117290 2752 consensus_queue.cc:1035] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:25.118501 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f6bdcd8cd2574acf867b7ec487559db2 because the tablet was not found. No further retry: Not found: Tablet not found: f6bdcd8cd2574acf867b7ec487559db2
W20260620 07:01:25.119092 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 3eda988492234d6aaeaee87f84f99d06 because the tablet was not found. No further retry: Not found: Tablet not found: 3eda988492234d6aaeaee87f84f99d06
W20260620 07:01:25.119760 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ffb66de2e72b4d13ad4c58bec2720b5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffb66de2e72b4d13ad4c58bec2720b5a already in progress: creating tablet
I20260620 07:01:25.119740 2757 raft_consensus.cc:504] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.120348 2757 leader_election.cc:288] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:25.120443 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9da80903ac124d1aae937c2329f9b13e because the tablet was not found. No further retry: Not found: Tablet not found: 9da80903ac124d1aae937c2329f9b13e
I20260620 07:01:25.121281 1010 tablet_service.cc:1514] Processing DeleteTablet for tablet 033c8b817757441ea7ebc2dbf77aa2dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:25.105868 1169 ts_tablet_manager.cc:1918] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:25.121747 1169 log.cc:1196] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/d0c41bf6a8a448ad809292d66ebf9c0e
I20260620 07:01:25.122107 1169 ts_tablet_manager.cc:1939] T d0c41bf6a8a448ad809292d66ebf9c0e P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:25.123857 1168 tablet_bootstrap.cc:654] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.124060 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_60f539bde5ea41c1925bcdd1f45f4e80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:25.124677 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60f539bde5ea41c1925bcdd1f45f4e80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.128443 1166 tablet_replica.cc:330] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:25.128777 1166 raft_consensus.cc:2229] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.129048 1166 raft_consensus.cc:2258] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.129415 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e6ef65b5f44f6d9f2100dd404b2e5f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.129673 1166 ts_tablet_manager.cc:1905] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:25.130121 830 leader_election.cc:341] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.132611 1167 tablet_bootstrap.cc:492] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.132807 1167 ts_tablet_manager.cc:1397] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.000s
I20260620 07:01:25.133410 1168 tablet_bootstrap.cc:492] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.133611 1168 ts_tablet_manager.cc:1397] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.000s
W20260620 07:01:25.133607 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 394d3124d03a438aa31d94967487b4be consensus state has no leader
I20260620 07:01:25.133849 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 02584f8ac08f4759a5f9a5aa699d0039 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:25.133731 1167 raft_consensus.cc:348] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.133962 1167 raft_consensus.cc:374] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.134020 1167 raft_consensus.cc:729] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.134194 1167 consensus_queue.cc:260] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.134378 1168 raft_consensus.cc:348] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.134572 1168 raft_consensus.cc:374] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.134624 1168 raft_consensus.cc:729] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.134508 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_81c644a3657343a499b7d5d82fc357a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:25.134720 1167 ts_tablet_manager.cc:1428] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:25.134994 1167 tablet_bootstrap.cc:492] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.134873 1168 consensus_queue.cc:260] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.135537 1168 ts_tablet_manager.cc:1428] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:25.135840 1168 tablet_bootstrap.cc:492] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:25.136646 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81c644a3657343a499b7d5d82fc357a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.137548 1168 tablet_bootstrap.cc:654] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.138453 1167 tablet_bootstrap.cc:654] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.146051 2757 raft_consensus.cc:482] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.146229 2757 raft_consensus.cc:504] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.146924 2757 leader_election.cc:288] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.147718 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a7fab4d1684604be1b81d4d4bbe560" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:25.148376 830 leader_election.cc:341] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:25.148844 725 consensus_meta.cc:287] T 0dcd4723da554dc3a7aefc75aad836ea P 2b84cae646b24bc7bd424eb8434ad425: Time spent flushing consensus metadata: real 0.736s user 0.023s sys 0.000s
I20260620 07:01:25.153447 1167 tablet_bootstrap.cc:492] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.153908 1167 ts_tablet_manager.cc:1397] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260620 07:01:25.154728 1167 raft_consensus.cc:348] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.154958 1167 raft_consensus.cc:374] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.155033 1167 raft_consensus.cc:729] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.155234 1167 consensus_queue.cc:260] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.155843 1167 ts_tablet_manager.cc:1428] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:25.156107 1167 tablet_bootstrap.cc:492] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.157749 1167 tablet_bootstrap.cc:654] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.159576 1168 tablet_bootstrap.cc:492] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.159755 1168 ts_tablet_manager.cc:1397] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260620 07:01:25.161105 1168 raft_consensus.cc:348] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.161405 1168 raft_consensus.cc:374] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.161478 1168 raft_consensus.cc:729] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.161724 1168 consensus_queue.cc:260] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.162437 1168 ts_tablet_manager.cc:1428] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:25.162767 1168 tablet_bootstrap.cc:492] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.166551 1167 tablet_bootstrap.cc:492] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.166700 1167 ts_tablet_manager.cc:1397] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260620 07:01:25.167814 1167 raft_consensus.cc:348] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.168036 1167 raft_consensus.cc:374] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.168118 1167 raft_consensus.cc:729] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.168462 1168 tablet_bootstrap.cc:654] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.168336 1167 consensus_queue.cc:260] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.168957 1167 ts_tablet_manager.cc:1428] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:25.168810 1170 raft_consensus.cc:348] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.169085 1170 raft_consensus.cc:374] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.169147 1170 raft_consensus.cc:729] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.169260 1167 tablet_bootstrap.cc:492] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.169417 1170 consensus_queue.cc:260] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.170060 1170 ts_tablet_manager.cc:1428] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.054s user 0.002s sys 0.001s
I20260620 07:01:25.170331 1170 tablet_bootstrap.cc:492] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:25.170940 1167 tablet_bootstrap.cc:654] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.172111 1166 ts_tablet_manager.cc:1918] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:25.174176 1170 tablet_bootstrap.cc:654] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.177855 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e6ef65b5f44f6d9f2100dd404b2e5f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:25.178073 754 raft_consensus.cc:3037] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.177882 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a7fab4d1684604be1b81d4d4bbe560" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:25.182524 831 leader_election.cc:341] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.182688 831 leader_election.cc:302] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:25.182955 2757 raft_consensus.cc:2726] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.185817 754 raft_consensus.cc:2454] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:25.186525 1168 tablet_bootstrap.cc:492] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.186848 1168 ts_tablet_manager.cc:1397] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.003s
I20260620 07:01:25.186702 831 leader_election.cc:302] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
W20260620 07:01:25.187150 683 leader_election.cc:341] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c9d344f9e4b444e4b6018fdf0cf762fd
I20260620 07:01:25.187299 2757 raft_consensus.cc:2781] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.187409 2757 raft_consensus.cc:686] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:25.187640 2757 consensus_queue.cc:237] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.188172 2837 tablet.cc:1722] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:25.188647 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1075) took 5257 ms. Trace:
I20260620 07:01:25.188759 1169 rpcz_store.cc:276] 0620 07:01:19.930841 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:19.931126 (+ 285us) service_pool.cc:227] Handling call
0620 07:01:25.096676 (+5165550us) ts_tablet_manager.cc:1145] Deleting tablet d0c41bf6a8a448ad809292d66ebf9c0e
0620 07:01:25.096690 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.102197 (+ 5507us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.105754 (+ 3557us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.188624 (+ 82870us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":65678,"tablet-delete.queue_time_us":5142455}
I20260620 07:01:25.189136 1169 tablet_replica.cc:330] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:25.189378 1169 raft_consensus.cc:2229] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:25.189741 1169 raft_consensus.cc:2258] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.190600 1169 ts_tablet_manager.cc:1905] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.191087 2838 tablet.cc:1722] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260620 07:01:25.193789 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 77936.2us
I20260620 07:01:25.198097 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet d0c41bf6a8a448ad809292d66ebf9c0e (table default.Table_d980ceff63f447adbc0aaf600b24f40e [id=ea3947fe0a794502a317ef69c47c0444]) successfully deleted
I20260620 07:01:25.199751 1168 raft_consensus.cc:348] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.200367 1168 raft_consensus.cc:374] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.200455 1168 raft_consensus.cc:729] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.202502 1168 consensus_queue.cc:260] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.204725 1169 ts_tablet_manager.cc:1918] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:25.204888 1169 log.cc:1196] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/6fbd069552314f2c9ee010c054386644
I20260620 07:01:25.205307 1169 ts_tablet_manager.cc:1939] T 6fbd069552314f2c9ee010c054386644 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:25.205348 1168 ts_tablet_manager.cc:1428] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260620 07:01:25.205633 944 tablet.cc:2369] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 07:01:25.206633 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1094) took 5055 ms. Trace:
I20260620 07:01:25.207209 1168 tablet_bootstrap.cc:492] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.182353 1167 tablet_bootstrap.cc:492] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.201896 2710 raft_consensus.cc:482] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.207911 1166 log.cc:1196] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/4655d289c94c4bce9707be375fc4b850
I20260620 07:01:25.208055 1167 ts_tablet_manager.cc:1397] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.003s
I20260620 07:01:25.207989 2710 raft_consensus.cc:504] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.208312 1166 ts_tablet_manager.cc:1939] T 4655d289c94c4bce9707be375fc4b850 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:25.208690 2710 leader_election.cc:288] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:25.206749 1169 rpcz_store.cc:276] 0620 07:01:20.151128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.154543 (+ 3415us) service_pool.cc:227] Handling call
0620 07:01:25.189085 (+5034542us) ts_tablet_manager.cc:1145] Deleting tablet 6fbd069552314f2c9ee010c054386644
0620 07:01:25.189100 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.194558 (+ 5458us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.204592 (+ 10034us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.206609 (+ 2017us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5034283}
I20260620 07:01:25.208986 1169 tablet_replica.cc:330] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:25.209206 1169 raft_consensus.cc:2229] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:25.209468 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8659e903084f15ac3d9ea8c4c0dc0f" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.209631 1169 raft_consensus.cc:2258] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.209707 754 raft_consensus.cc:2454] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
W20260620 07:01:25.209986 969 leader_election.cc:341] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8b8659e903084f15ac3d9ea8c4c0dc0f
I20260620 07:01:25.210355 1169 ts_tablet_manager.cc:1905] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.210379 968 leader_election.cc:302] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:25.215602 1168 tablet_bootstrap.cc:654] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.219594 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 4655d289c94c4bce9707be375fc4b850 (table default.Table_4b0078a40169404eb33b169cdb5f08df [id=8f652552eba04d87aad349983184c524]) successfully deleted
I20260620 07:01:25.222241 1166 tablet_replica.cc:330] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:25.222500 1166 raft_consensus.cc:2229] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.222661 1166 raft_consensus.cc:2258] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.223222 1166 ts_tablet_manager.cc:1905] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.223340 1167 raft_consensus.cc:348] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.223608 1167 raft_consensus.cc:374] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.223670 1167 raft_consensus.cc:729] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.223881 1167 consensus_queue.cc:260] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.224213 2531 raft_consensus.cc:2781] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.224309 2531 raft_consensus.cc:482] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.224380 2531 raft_consensus.cc:3037] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.224476 1167 ts_tablet_manager.cc:1428] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260620 07:01:25.224757 1167 tablet_bootstrap.cc:492] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.225623 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9d344f9e4b444e4b6018fdf0cf762fd" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.225976 1168 tablet_bootstrap.cc:492] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.226096 1168 ts_tablet_manager.cc:1397] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260620 07:01:25.226833 1168 raft_consensus.cc:348] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.227125 1168 raft_consensus.cc:374] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.227229 1167 tablet_bootstrap.cc:654] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.227242 1168 raft_consensus.cc:729] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.227208 2531 raft_consensus.cc:504] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.227648 1168 consensus_queue.cc:260] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.228281 2531 leader_election.cc:288] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:25.228570 969 leader_election.cc:341] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 8b8659e903084f15ac3d9ea8c4c0dc0f
I20260620 07:01:25.229605 1168 ts_tablet_manager.cc:1428] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:25.230525 1168 tablet_bootstrap.cc:492] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.232256 1168 tablet_bootstrap.cc:654] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.234284 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8659e903084f15ac3d9ea8c4c0dc0f" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:25.234546 754 raft_consensus.cc:3037] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.238200 754 raft_consensus.cc:2454] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:25.239528 968 leader_election.cc:302] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:25.239941 2531 raft_consensus.cc:2781] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.240065 2531 raft_consensus.cc:686] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:25.240338 2531 consensus_queue.cc:237] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.244225 2741 raft_consensus.cc:482] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.244390 2741 raft_consensus.cc:504] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.244944 2741 leader_election.cc:288] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.245296 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 6fbd069552314f2c9ee010c054386644 (table default.Table_6b7421166e034804801bd91c1a520a3d [id=ee69fd0e35dd410b9193d36a7d7e1c5a]) successfully deleted
W20260620 07:01:25.245847 683 leader_election.cc:341] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a0a5967c84434000a51fe7d819fac439
I20260620 07:01:25.247083 1168 tablet_bootstrap.cc:492] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.247265 1168 ts_tablet_manager.cc:1397] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
W20260620 07:01:25.247501 681 leader_election.cc:341] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: Tablet not RUNNING: STOPPED
I20260620 07:01:25.247982 1168 raft_consensus.cc:348] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.248245 1168 raft_consensus.cc:374] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.248330 1168 raft_consensus.cc:729] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.248581 1168 consensus_queue.cc:260] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.249689 681 leader_election.cc:302] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:25.250327 1168 ts_tablet_manager.cc:1428] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260620 07:01:25.254977 2741 raft_consensus.cc:2726] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260620 07:01:25.255385 681 consensus_peers.cc:487] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:25.257356 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0a5967c84434000a51fe7d819fac439" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.251479 1168 tablet_bootstrap.cc:492] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.260406 1170 tablet_bootstrap.cc:492] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.260742 1170 ts_tablet_manager.cc:1397] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.005s
I20260620 07:01:25.261595 1170 raft_consensus.cc:348] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.261811 1170 raft_consensus.cc:374] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.261896 1170 raft_consensus.cc:729] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.262141 1170 consensus_queue.cc:260] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.262938 1170 ts_tablet_manager.cc:1428] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:25.263545 1166 ts_tablet_manager.cc:1918] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:25.263691 1166 log.cc:1196] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/c9d344f9e4b444e4b6018fdf0cf762fd
I20260620 07:01:25.264106 1166 ts_tablet_manager.cc:1939] T c9d344f9e4b444e4b6018fdf0cf762fd P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:25.264146 1168 tablet_bootstrap.cc:654] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.265681 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet c9d344f9e4b444e4b6018fdf0cf762fd (table default.Table_f9c3eac07b6040a280cd24392454206b [id=9010989df9a341b986e65d49b59a5cd0]) successfully deleted
I20260620 07:01:25.265792 1166 tablet_replica.cc:330] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
W20260620 07:01:25.265969 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d53c90eff33044479838ff67dea93057 because the tablet was not found. No further retry: Not found: Tablet not found: d53c90eff33044479838ff67dea93057
I20260620 07:01:25.266032 1166 raft_consensus.cc:2229] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.266196 1166 raft_consensus.cc:2258] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:25.266451 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet c24fe8318b4743df886d210fc94318fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c24fe8318b4743df886d210fc94318fe already in progress: creating tablet
W20260620 07:01:25.266644 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet e28974261e7f4c67afafca0273238d96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e28974261e7f4c67afafca0273238d96 already in progress: creating tablet
I20260620 07:01:25.268222 1167 tablet_bootstrap.cc:492] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.268349 1167 ts_tablet_manager.cc:1397] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.005s
I20260620 07:01:25.269160 1167 raft_consensus.cc:348] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.269361 1167 raft_consensus.cc:374] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.269410 1167 raft_consensus.cc:729] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.270839 1167 consensus_queue.cc:260] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.271544 1167 ts_tablet_manager.cc:1428] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:25.271854 1167 tablet_bootstrap.cc:492] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:25.271673 830 consensus_peers.cc:487] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:25.273913 1167 tablet_bootstrap.cc:654] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.274806 1166 ts_tablet_manager.cc:1905] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:25.277582 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84c6ad4f5e5b43d9a25fbaaa3e789a69 consensus state has no leader
I20260620 07:01:25.279556 860 tablet_service.cc:1467] Processing CreateTablet for tablet d67ab2816d584e44982fe9891535dcb3 (DEFAULT_TABLE table=default.Table_85e143b73bf848c99ad2a5568f7eeeac [id=0b4bb71ce9124c95bebd1d53a45dd1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.279899 864 tablet_service.cc:1467] Processing CreateTablet for tablet 6e9db3bc4853403888d46729c325aab6 (DEFAULT_TABLE table=default.Table_ac24bada4af041fcb27885c714fca800 [id=a0cd83392bab457c8f4c90de4c5aa10d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.279630 869 tablet_service.cc:1467] Processing CreateTablet for tablet bafa78b4760a42a7b31e770f4f816b07 (DEFAULT_TABLE table=default.Table_93199bfdf1ec4d6a8091ba5096846e9e [id=53470cd8697b43c1a97d5fe034599df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.280049 420 catalog_manager.cc:5495] T 0fa3702db6004ecba6fff98c09623fe0 P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:25.280691 420 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:25.280999 420 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:25.281081 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d67ab2816d584e44982fe9891535dcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.281306 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e9db3bc4853403888d46729c325aab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.281333 420 catalog_manager.cc:5495] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:25.281780 420 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 52d2a46f972e45f5aeadb09101a68149 (table default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447]). Expected version 2 got 0
I20260620 07:01:25.282022 420 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
W20260620 07:01:25.283416 414 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 1776f6361710465ba5036c3bb84740a8 (table default.Table_043ce56467524870ad8c66601c8eb719 [id=7de42b09cc5844288d091524f1355379], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1776f6361710465ba5036c3bb84740a8 consensus state has no leader
I20260620 07:01:25.286959 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bafa78b4760a42a7b31e770f4f816b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.292043 1007 tablet_service.cc:1467] Processing CreateTablet for tablet e0d0ea8628dd49febe0bf89ff179efa3 (DEFAULT_TABLE table=default.Table_fd8e215a66e649fd92d7f993a4d78300 [id=48ea09643c684d958f17bdcb2be460c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.292487 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0d0ea8628dd49febe0bf89ff179efa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.292727 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 6e9db3bc4853403888d46729c325aab6 (DEFAULT_TABLE table=default.Table_ac24bada4af041fcb27885c714fca800 [id=a0cd83392bab457c8f4c90de4c5aa10d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.293062 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e9db3bc4853403888d46729c325aab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.294369 1169 ts_tablet_manager.cc:1918] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:25.294481 1169 log.cc:1196] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/3651ef9790d342ec96f554134ae714dc
I20260620 07:01:25.294829 1169 ts_tablet_manager.cc:1939] T 3651ef9790d342ec96f554134ae714dc P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:25.295076 1006 tablet_service.cc:1467] Processing CreateTablet for tablet f403d4fd5edf41e99369cbf3997bcca1 (DEFAULT_TABLE table=default.Table_3fe199dbdfb246a58b0bf5839c4ef15c [id=8f88c943f0304735a40632aeba7c8868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.295761 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f403d4fd5edf41e99369cbf3997bcca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.299124 2821 raft_consensus.cc:482] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.299098 1000 tablet_service.cc:1467] Processing CreateTablet for tablet e79af212d57442ae9d688d474c76fa98 (DEFAULT_TABLE table=default.Table_c6fd6bc54d634406b10b4a1467ba1850 [id=d450911948954ff384e1c3333513e931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.299499 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e79af212d57442ae9d688d474c76fa98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.299391 2821 raft_consensus.cc:504] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.300360 2821 leader_election.cc:288] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.292420 1005 tablet_service.cc:1467] Processing CreateTablet for tablet bafa78b4760a42a7b31e770f4f816b07 (DEFAULT_TABLE table=default.Table_93199bfdf1ec4d6a8091ba5096846e9e [id=53470cd8697b43c1a97d5fe034599df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.303117 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bafa78b4760a42a7b31e770f4f816b07. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:25.303294 681 leader_election.cc:341] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.305792 2757 raft_consensus.cc:482] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.305958 2757 raft_consensus.cc:504] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.306571 2757 leader_election.cc:288] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.292043 1010 tablet_service.cc:1467] Processing CreateTablet for tablet d67ab2816d584e44982fe9891535dcb3 (DEFAULT_TABLE table=default.Table_85e143b73bf848c99ad2a5568f7eeeac [id=0b4bb71ce9124c95bebd1d53a45dd1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.307135 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d67ab2816d584e44982fe9891535dcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.309098 1166 ts_tablet_manager.cc:1918] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:25.309288 1166 log.cc:1196] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/5c083ebc2e054e09a531a8768802dcb1
I20260620 07:01:25.309844 1166 ts_tablet_manager.cc:1939] T 5c083ebc2e054e09a531a8768802dcb1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:25.303416 681 leader_election.cc:302] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:25.310889 2821 raft_consensus.cc:2726] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.312021 1170 tablet_bootstrap.cc:492] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:25.312804 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bbf2f844b4c01ad5d6dc36e096ee5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.314468 860 tablet_service.cc:1467] Processing CreateTablet for tablet f403d4fd5edf41e99369cbf3997bcca1 (DEFAULT_TABLE table=default.Table_3fe199dbdfb246a58b0bf5839c4ef15c [id=8f88c943f0304735a40632aeba7c8868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.314667 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8ed68b221b4215812934844447d60e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:25.314994 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f403d4fd5edf41e99369cbf3997bcca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.315073 888 raft_consensus.cc:2454] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:25.315544 859 tablet_service.cc:1467] Processing CreateTablet for tablet e0d0ea8628dd49febe0bf89ff179efa3 (DEFAULT_TABLE table=default.Table_fd8e215a66e649fd92d7f993a4d78300 [id=48ea09643c684d958f17bdcb2be460c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.315889 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0d0ea8628dd49febe0bf89ff179efa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.319101 868 tablet_service.cc:1467] Processing CreateTablet for tablet e79af212d57442ae9d688d474c76fa98 (DEFAULT_TABLE table=default.Table_c6fd6bc54d634406b10b4a1467ba1850 [id=d450911948954ff384e1c3333513e931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.319541 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e79af212d57442ae9d688d474c76fa98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:25.323905 830 leader_election.cc:341] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.324528 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_27d83c05f310476ca4266dc0b9b58ab5" } new_table_name: "default.Table_98b443e1641e441fab0a67e601755db8" modify_external_catalogs: true
I20260620 07:01:25.327976 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8ed68b221b4215812934844447d60e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.330401 1170 tablet_bootstrap.cc:654] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:25.323349 683 consensus_peers.cc:487] T d0f7e6245c074c82a5a72be79ab1987f P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0f7e6245c074c82a5a72be79ab1987f. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:25.330974 683 leader_election.cc:302] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:25.331964 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bbf2f844b4c01ad5d6dc36e096ee5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.332530 2821 raft_consensus.cc:2781] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.332659 2821 raft_consensus.cc:482] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 07:01:25.332715 831 leader_election.cc:341] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.332854 831 leader_election.cc:302] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:25.332921 2821 raft_consensus.cc:3037] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.333138 2757 raft_consensus.cc:2726] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.336273 2821 raft_consensus.cc:504] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.337415 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8ed68b221b4215812934844447d60e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:25.337610 888 raft_consensus.cc:3037] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.340824 888 raft_consensus.cc:2454] T ce8ed68b221b4215812934844447d60e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:25.341547 683 leader_election.cc:302] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:25.341943 2830 raft_consensus.cc:2781] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.342077 2830 raft_consensus.cc:686] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:25.342301 2830 consensus_queue.cc:237] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.313726 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1097) took 5097 ms. Trace:
I20260620 07:01:25.345820 1169 rpcz_store.cc:276] 0620 07:01:20.216313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.217185 (+ 872us) service_pool.cc:227] Handling call
0620 07:01:25.208931 (+4991746us) ts_tablet_manager.cc:1145] Deleting tablet 3651ef9790d342ec96f554134ae714dc
0620 07:01:25.208946 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.213892 (+ 4946us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.294262 (+ 80370us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.313705 (+ 19443us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4991400}
I20260620 07:01:25.347051 1169 tablet_replica.cc:330] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:25.347620 1169 raft_consensus.cc:2229] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.348124 1169 raft_consensus.cc:2258] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.348950 2741 raft_consensus.cc:482] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.348958 2757 raft_consensus.cc:482] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.349081 2757 raft_consensus.cc:504] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.349083 2741 raft_consensus.cc:504] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.349614 2757 leader_election.cc:288] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.349614 2741 leader_election.cc:288] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.350533 1169 ts_tablet_manager.cc:1905] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.350648 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf978ab301954866aeb77b7abaf2c77e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:25.351382 830 leader_election.cc:341] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.351631 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf978ab301954866aeb77b7abaf2c77e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.351902 748 raft_consensus.cc:2454] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
W20260620 07:01:25.352401 683 leader_election.cc:341] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: f2426d52b8ff40f39887545e0341a91a
I20260620 07:01:25.352664 831 leader_election.cc:302] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.353050 2757 raft_consensus.cc:2781] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.353128 2757 raft_consensus.cc:482] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.353181 2757 raft_consensus.cc:3037] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.356423 2821 leader_election.cc:288] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:25.358381 681 leader_election.cc:341] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.361920 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2426d52b8ff40f39887545e0341a91a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.364087 1167 tablet_bootstrap.cc:492] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.364286 1167 ts_tablet_manager.cc:1397] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.093s user 0.004s sys 0.012s
I20260620 07:01:25.365262 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8ed68b221b4215812934844447d60e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.365621 1167 raft_consensus.cc:348] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.365906 1167 raft_consensus.cc:374] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.365976 1167 raft_consensus.cc:729] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.366230 1167 consensus_queue.cc:260] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.367017 1167 ts_tablet_manager.cc:1428] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:25.367364 1167 tablet_bootstrap.cc:492] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.367348 2757 raft_consensus.cc:504] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.367993 2757 leader_election.cc:288] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.368816 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf978ab301954866aeb77b7abaf2c77e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.369158 1167 tablet_bootstrap.cc:654] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:25.369271 830 leader_election.cc:341] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.369376 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf978ab301954866aeb77b7abaf2c77e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:25.369606 748 raft_consensus.cc:3037] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.372980 748 raft_consensus.cc:2454] T cf978ab301954866aeb77b7abaf2c77e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:25.373454 831 leader_election.cc:302] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.373710 2757 raft_consensus.cc:2781] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.373837 2757 raft_consensus.cc:686] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:25.374053 2757 consensus_queue.cc:237] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.379098 2757 consensus_queue.cc:1035] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:25.379132 725 tablet_service.cc:1467] Processing CreateTablet for tablet d67ab2816d584e44982fe9891535dcb3 (DEFAULT_TABLE table=default.Table_85e143b73bf848c99ad2a5568f7eeeac [id=0b4bb71ce9124c95bebd1d53a45dd1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.379534 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d67ab2816d584e44982fe9891535dcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.390837 725 tablet_service.cc:1467] Processing CreateTablet for tablet bafa78b4760a42a7b31e770f4f816b07 (DEFAULT_TABLE table=default.Table_93199bfdf1ec4d6a8091ba5096846e9e [id=53470cd8697b43c1a97d5fe034599df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.391449 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bafa78b4760a42a7b31e770f4f816b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.392032 1167 tablet_bootstrap.cc:492] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.392226 1167 ts_tablet_manager.cc:1397] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.001s
I20260620 07:01:25.393123 1167 raft_consensus.cc:348] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.393438 1167 raft_consensus.cc:374] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.393528 1167 raft_consensus.cc:729] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.393787 1167 consensus_queue.cc:260] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.394907 1167 ts_tablet_manager.cc:1428] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 07:01:25.395267 1167 tablet_bootstrap.cc:492] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.396123 718 tablet_service.cc:1467] Processing CreateTablet for tablet 6e9db3bc4853403888d46729c325aab6 (DEFAULT_TABLE table=default.Table_ac24bada4af041fcb27885c714fca800 [id=a0cd83392bab457c8f4c90de4c5aa10d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:25.396140 393 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 123325us
I20260620 07:01:25.396515 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e9db3bc4853403888d46729c325aab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.396736 1167 tablet_bootstrap.cc:654] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.398327 726 tablet_service.cc:1467] Processing CreateTablet for tablet e0d0ea8628dd49febe0bf89ff179efa3 (DEFAULT_TABLE table=default.Table_fd8e215a66e649fd92d7f993a4d78300 [id=48ea09643c684d958f17bdcb2be460c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.398674 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0d0ea8628dd49febe0bf89ff179efa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.402915 728 tablet_service.cc:1467] Processing CreateTablet for tablet f403d4fd5edf41e99369cbf3997bcca1 (DEFAULT_TABLE table=default.Table_3fe199dbdfb246a58b0bf5839c4ef15c [id=8f88c943f0304735a40632aeba7c8868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.403307 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f403d4fd5edf41e99369cbf3997bcca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.403276 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 5c083ebc2e054e09a531a8768802dcb1 (table default.Table_47d31a0327544bb19e95144d24753b08 [id=385bf04b4ae34c42a697ff301d15945d]) successfully deleted
I20260620 07:01:25.403834 1166 tablet_replica.cc:330] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:25.404110 1166 raft_consensus.cc:2229] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.404294 1166 raft_consensus.cc:2258] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.406121 726 tablet_service.cc:1467] Processing CreateTablet for tablet e79af212d57442ae9d688d474c76fa98 (DEFAULT_TABLE table=default.Table_c6fd6bc54d634406b10b4a1467ba1850 [id=d450911948954ff384e1c3333513e931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:25.406554 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e79af212d57442ae9d688d474c76fa98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:25.410619 2831 raft_consensus.cc:482] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.410802 2831 raft_consensus.cc:504] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.411578 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 3651ef9790d342ec96f554134ae714dc (table default.Table_5f1815876abd4a8282d506949e5adcda [id=e6ffdd91974a44eabefbcf60974613cb]) successfully deleted
I20260620 07:01:25.415668 2831 leader_election.cc:288] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.415659 1166 ts_tablet_manager.cc:1905] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:25.416419 1081 tablet.cc:2369] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 07:01:25.420192 1167 tablet_bootstrap.cc:492] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.420400 1167 ts_tablet_manager.cc:1397] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.001s
I20260620 07:01:25.421350 1167 raft_consensus.cc:348] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.421645 1167 raft_consensus.cc:374] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.421723 1167 raft_consensus.cc:729] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.421996 1167 consensus_queue.cc:260] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.422704 1167 ts_tablet_manager.cc:1428] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:25.423125 1167 tablet_bootstrap.cc:492] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.430470 2757 raft_consensus.cc:482] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.430640 2757 raft_consensus.cc:504] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.431344 2757 leader_election.cc:288] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.432163 1167 tablet_bootstrap.cc:654] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.432497 2710 raft_consensus.cc:482] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.432639 2710 raft_consensus.cc:504] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.433347 2710 leader_election.cc:288] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:25.434116 969 leader_election.cc:341] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 125e8a5e20bf484cade408f0358489a1
I20260620 07:01:25.438630 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b8ce279cfe4684bd296a48e8783e1b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:25.438900 888 raft_consensus.cc:2454] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:25.440752 683 leader_election.cc:302] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:25.441062 2741 raft_consensus.cc:2781] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.441148 2741 raft_consensus.cc:482] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.441216 2741 raft_consensus.cc:3037] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.446449 2741 raft_consensus.cc:504] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.447091 2741 leader_election.cc:288] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.447366 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b45cb0153184218ae4f706a898d0657" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.447798 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b45cb0153184218ae4f706a898d0657" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:25.448588 830 leader_election.cc:341] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:25.448735 831 leader_election.cc:341] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.448855 831 leader_election.cc:302] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:25.449154 2757 raft_consensus.cc:2726] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.449420 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b8ce279cfe4684bd296a48e8783e1b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:25.449688 895 raft_consensus.cc:3037] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.449630 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125e8a5e20bf484cade408f0358489a1" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.449887 748 raft_consensus.cc:2454] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:25.450376 1166 ts_tablet_manager.cc:1918] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:25.450544 1166 log.cc:1196] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/033c8b817757441ea7ebc2dbf77aa2dd
I20260620 07:01:25.450774 968 leader_election.cc:302] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:25.451009 1166 ts_tablet_manager.cc:1939] T 033c8b817757441ea7ebc2dbf77aa2dd P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:25.451175 2710 raft_consensus.cc:2781] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.451251 2710 raft_consensus.cc:482] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.451313 2710 raft_consensus.cc:3037] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.452188 1167 tablet_bootstrap.cc:492] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.452345 1167 ts_tablet_manager.cc:1397] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.001s
I20260620 07:01:25.452627 895 raft_consensus.cc:2454] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:25.453274 1167 raft_consensus.cc:348] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.453557 1167 raft_consensus.cc:374] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.453624 1167 raft_consensus.cc:729] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.453878 1167 consensus_queue.cc:260] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.454056 2710 raft_consensus.cc:504] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.456490 2710 leader_election.cc:288] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:25.457121 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125e8a5e20bf484cade408f0358489a1" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:25.457314 751 raft_consensus.cc:3037] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:25.457350 969 leader_election.cc:341] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 125e8a5e20bf484cade408f0358489a1
I20260620 07:01:25.457949 1167 ts_tablet_manager.cc:1428] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260620 07:01:25.458284 1167 tablet_bootstrap.cc:492] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.459483 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 033c8b817757441ea7ebc2dbf77aa2dd (table default.Table_dbcf6925600345658e340ad71565e073 [id=a7528a9274144f0ebbcd1efa102a2a1b]) successfully deleted
I20260620 07:01:25.459801 751 raft_consensus.cc:2454] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:25.460306 1167 tablet_bootstrap.cc:654] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.460605 968 leader_election.cc:302] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:25.460870 2872 raft_consensus.cc:482] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.461066 2710 raft_consensus.cc:2781] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.461004 2872 raft_consensus.cc:504] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.462049 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7294e5678ad44622a3249c1113b5e297" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.462316 754 raft_consensus.cc:2454] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:25.463228 968 leader_election.cc:302] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
W20260620 07:01:25.464483 413 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.61:33455, user_credentials={real_user=slave}} blocked reactor thread for 46739.4us
I20260620 07:01:25.467275 2875 raft_consensus.cc:2781] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.467453 2875 raft_consensus.cc:482] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.467576 2875 raft_consensus.cc:3037] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.470979 683 leader_election.cc:302] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:25.471449 2741 raft_consensus.cc:2781] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.471717 2741 raft_consensus.cc:686] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:25.471990 2741 consensus_queue.cc:237] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:25.475205 969 leader_election.cc:341] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7294e5678ad44622a3249c1113b5e297
I20260620 07:01:25.475464 2872 leader_election.cc:288] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:25.478932 2752 raft_consensus.cc:482] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.479087 2752 raft_consensus.cc:504] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.479598 2752 leader_election.cc:288] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.480626 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50200e70f4d3492083f6da65f867be31" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.481864 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50200e70f4d3492083f6da65f867be31" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:25.482545 830 leader_election.cc:341] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.487471 2875 raft_consensus.cc:504] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.488665 2875 leader_election.cc:288] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:25.489604 969 leader_election.cc:341] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 7294e5678ad44622a3249c1113b5e297
W20260620 07:01:25.491201 831 leader_election.cc:341] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.491335 831 leader_election.cc:302] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:25.491569 2878 raft_consensus.cc:2726] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.492612 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7294e5678ad44622a3249c1113b5e297" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:25.492910 748 raft_consensus.cc:3037] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.496923 1168 tablet_bootstrap.cc:492] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.497143 1168 ts_tablet_manager.cc:1397] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.247s user 0.035s sys 0.088s
I20260620 07:01:25.497920 1168 raft_consensus.cc:348] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.498219 1168 raft_consensus.cc:374] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.498304 1168 raft_consensus.cc:729] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.498550 1168 consensus_queue.cc:260] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.499313 1167 tablet_bootstrap.cc:492] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.499445 1167 ts_tablet_manager.cc:1397] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.003s
I20260620 07:01:25.500084 1167 raft_consensus.cc:348] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.500277 1167 raft_consensus.cc:374] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.500335 1167 raft_consensus.cc:729] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.500252 1168 ts_tablet_manager.cc:1428] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260620 07:01:25.500562 1167 consensus_queue.cc:260] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.500946 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 8afdfa2c293e4a19978bbf85a68753f7 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:25.501577 1168 tablet_bootstrap.cc:492] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.501741 1167 ts_tablet_manager.cc:1428] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:25.502018 1167 tablet_bootstrap.cc:492] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.503798 1168 tablet_bootstrap.cc:654] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.504554 1167 tablet_bootstrap.cc:654] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.515676 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_33849761b0d646b38ef15cb33a98f362" } modify_external_catalogs: true
I20260620 07:01:25.515916 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_33849761b0d646b38ef15cb33a98f362" } modify_external_catalogs: true
I20260620 07:01:25.518740 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3478a0c2fd4b42f597345cfc8ef000aa" } modify_external_catalogs: true
I20260620 07:01:25.518953 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3478a0c2fd4b42f597345cfc8ef000aa" } modify_external_catalogs: true
I20260620 07:01:25.521008 2875 raft_consensus.cc:482] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.521215 2875 raft_consensus.cc:504] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.521833 2875 leader_election.cc:288] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:25.522775 969 leader_election.cc:341] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e6bae5090f81417cbcf4b4d598b438da
W20260620 07:01:25.522778 681 leader_election.cc:341] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.522941 681 leader_election.cc:302] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:25.522996 968 leader_election.cc:341] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: e6bae5090f81417cbcf4b4d598b438da
I20260620 07:01:25.523092 968 leader_election.cc:302] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:25.523448 681 leader_election.cc:341] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.523509 2875 raft_consensus.cc:2726] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.523811 1168 tablet_bootstrap.cc:492] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.524165 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b8ce279cfe4684bd296a48e8783e1b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.524294 2452 raft_consensus.cc:2726] T f2426d52b8ff40f39887545e0341a91a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.524353 1168 ts_tablet_manager.cc:1397] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.003s
I20260620 07:01:25.524427 2452 raft_consensus.cc:482] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.524564 2452 raft_consensus.cc:504] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.525112 2452 leader_election.cc:288] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.525106 1168 raft_consensus.cc:348] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.525441 1168 raft_consensus.cc:374] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.525552 1168 raft_consensus.cc:729] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.525732 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b8ce279cfe4684bd296a48e8783e1b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.525839 1168 consensus_queue.cc:260] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.527104 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d48f0f9dd4911876ec8f812688439" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.527541 1168 ts_tablet_manager.cc:1428] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:25.528009 2821 raft_consensus.cc:482] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.528184 2821 raft_consensus.cc:504] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.528671 1168 tablet_bootstrap.cc:492] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.528844 2821 leader_election.cc:288] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.530244 1168 tablet_bootstrap.cc:654] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.532763 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4260b0c953c14a198dbf9b64a30e7e05" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.532968 1027 raft_consensus.cc:2454] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
W20260620 07:01:25.533420 681 leader_election.cc:341] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:25.533855 681 leader_election.cc:341] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.534262 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d48f0f9dd4911876ec8f812688439" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:25.534518 895 raft_consensus.cc:2454] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
W20260620 07:01:25.535041 681 leader_election.cc:341] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.536603 2875 raft_consensus.cc:482] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.536744 2875 raft_consensus.cc:504] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.537323 2875 leader_election.cc:288] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:25.538216 969 leader_election.cc:341] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 25b878def9344cbdae65b209cac4067f
W20260620 07:01:25.535065 683 leader_election.cc:341] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4260b0c953c14a198dbf9b64a30e7e05
I20260620 07:01:25.538093 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25b878def9344cbdae65b209cac4067f" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.543327 754 raft_consensus.cc:2454] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:25.543901 968 leader_election.cc:302] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:25.544118 1168 tablet_bootstrap.cc:492] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.544109 2710 raft_consensus.cc:686] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:25.544237 1168 ts_tablet_manager.cc:1397] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20260620 07:01:25.544500 683 leader_election.cc:302] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.544380 2710 consensus_queue.cc:237] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:25.544917 683 consensus_peers.cc:487] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c083ebc2e054e09a531a8768802dcb1. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:25.545433 2741 raft_consensus.cc:2781] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.545595 2741 raft_consensus.cc:482] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.545742 2741 raft_consensus.cc:3037] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.546187 1168 raft_consensus.cc:348] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.546450 1168 raft_consensus.cc:374] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.546548 1168 raft_consensus.cc:729] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.546835 1168 consensus_queue.cc:260] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:25.547415 681 consensus_peers.cc:487] T 5c083ebc2e054e09a531a8768802dcb1 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c083ebc2e054e09a531a8768802dcb1. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:25.548300 681 leader_election.cc:302] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:25.548697 1168 ts_tablet_manager.cc:1428] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:01:25.550010 2830 raft_consensus.cc:2781] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.550849 2830 raft_consensus.cc:482] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.551017 2830 raft_consensus.cc:3037] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.551199 2821 raft_consensus.cc:482] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.551393 2821 raft_consensus.cc:504] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.552043 2821 leader_election.cc:288] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.552884 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d9d4b5a69484176a7b0f4fded010867" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.553092 1027 raft_consensus.cc:2454] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:25.549499 2741 raft_consensus.cc:504] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.554757 681 leader_election.cc:302] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:25.555006 2741 leader_election.cc:288] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.555235 2741 raft_consensus.cc:2781] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.555312 2741 raft_consensus.cc:482] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.555392 2741 raft_consensus.cc:3037] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.555745 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d48f0f9dd4911876ec8f812688439" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.556941 2875 raft_consensus.cc:2781] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.557035 2875 raft_consensus.cc:482] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.557098 2875 raft_consensus.cc:3037] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.557950 2741 raft_consensus.cc:504] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.558465 2741 leader_election.cc:288] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.559950 2875 raft_consensus.cc:504] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.560671 2875 leader_election.cc:288] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:25.560634 681 leader_election.cc:341] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.561720 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25b878def9344cbdae65b209cac4067f" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:25.561921 754 raft_consensus.cc:3037] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.564424 754 raft_consensus.cc:2454] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:25.561427 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d9d4b5a69484176a7b0f4fded010867" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.566918 1027 raft_consensus.cc:3037] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.567214 2830 raft_consensus.cc:504] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.567912 2830 leader_election.cc:288] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.568102 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 0147ed61f6904914b04433b8db049b7a
I20260620 07:01:25.568558 426 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42866 (request call id 1481) took 1548 ms. Trace:
I20260620 07:01:25.568925 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 0147ed61f6904914b04433b8db049b7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:25.568646 426 rpcz_store.cc:276] 0620 07:01:24.020206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:24.578305 (+558099us) service_pool.cc:227] Handling call
0620 07:01:24.580944 (+ 2639us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x615000033024. stack: 00007f2486e7566e 00007f2486e75430 00007f2485efc5ed 00000000008ea064 00000000008ea02d 00007f249558e27d 00007f249558e373 00007f24923b0361 00007f2499d2366a 00007f2499eac2e6 00007f249119f126 00007f249119ee55 00007f248d9b19be 00007f248d9b079e 00007f248d9b6b25 00007f248d9b754f
0620 07:01:24.581375 (+ 431us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 07:01:24.581518 (+ 143us) catalog_manager.cc:2752] Modifying in-memory table state
0620 07:01:24.581596 (+ 78us) catalog_manager.cc:2761] Locking tablets
0620 07:01:25.276562 (+694966us) catalog_manager.cc:2775] Removing table and tablets from system table
0620 07:01:25.567927 (+291365us) catalog_manager.cc:2793] Removing table from by-name map
0620 07:01:25.568018 (+ 91us) catalog_manager.cc:2809] Committing in-memory state
0620 07:01:25.568068 (+ 50us) catalog_manager.cc:2813] Aborting table tasks
0620 07:01:25.568541 (+ 473us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:25.511845 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:25.511971 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:25.511978 (+ 7us) write_op.cc:435] Acquired schema lock
0620 07:01:25.511980 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:25.512109 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:25.512124 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:25.512129 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:25.512241 (+ 112us) tablet.cc:699] Row locks acquired
0620 07:01:25.512244 (+ 3us) write_op.cc:260] PREPARE: finished
0620 07:01:25.512274 (+ 30us) write_op.cc:270] Start()
0620 07:01:25.512312 (+ 38us) write_op.cc:276] Timestamp: P: 1781938885512230 usec, L: 0
0620 07:01:25.512316 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:25.560339 (+ 48023us) log.cc:842] Serialized 753 byte log entry
0620 07:01:25.561170 (+ 831us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x615000033024. stack: 00007f2486e7566e 00007f2486e75430 00007f2485efc5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f2492383d02 00007f24936b67f1 00007f24936b5359 00007f24936bd1bb 00007f24936bd038 00000000009edb7c 00007f2486ebb344 00007f2486ebe91b 00007f2486ebe798 00000000009edb7c
0620 07:01:25.567195 (+ 6025us) op_driver.cc:444] REPLICATION: finished
0620 07:01:25.567389 (+ 194us) write_op.cc:301] APPLY: starting
0620 07:01:25.567407 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:25.567455 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:25.567458 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:25.567536 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:25.567572 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0620 07:01:25.567579 (+ 7us) write_op.cc:312] APPLY: finished
0620 07:01:25.567666 (+ 87us) log.cc:842] Serialized 29 byte log entry
0620 07:01:25.567725 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:25.567747 (+ 22us) write_op.cc:454] Released schema lock
0620 07:01:25.567755 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:25.567814 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:25.567818 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":5541632,"child_traces":[["op",{"apply.queue_time_us":137,"apply.run_cpu_time_us":485,"apply.run_wall_time_us":484,"num_ops":2,"prepare.queue_time_us":234532,"raft.queue_time_us":79,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":608,"replication_time_us":54852,"spinlock_wait_cycles":109859712}]]}
I20260620 07:01:25.569519 1027 raft_consensus.cc:2454] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:25.570379 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 0147ed61f6904914b04433b8db049b7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0147ed61f6904914b04433b8db049b7a already in progress: creating tablet
I20260620 07:01:25.570688 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 0147ed61f6904914b04433b8db049b7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:25.565874 968 leader_election.cc:302] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:25.562718 1167 tablet_bootstrap.cc:492] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.572892 1167 ts_tablet_manager.cc:1397] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.071s user 0.005s sys 0.003s
I20260620 07:01:25.573638 681 leader_election.cc:302] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:25.573643 1167 raft_consensus.cc:348] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.573853 1167 raft_consensus.cc:374] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.573900 1167 raft_consensus.cc:729] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.574079 1167 consensus_queue.cc:260] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.574376 2875 raft_consensus.cc:2781] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.574190 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4260b0c953c14a198dbf9b64a30e7e05" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.574698 1027 raft_consensus.cc:3037] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.574581 1167 ts_tablet_manager.cc:1428] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:25.575191 1167 tablet_bootstrap.cc:492] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.574898 2875 raft_consensus.cc:686] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:25.575555 2875 consensus_queue.cc:237] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.577330 748 raft_consensus.cc:2454] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:25.578092 968 leader_election.cc:302] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:25.578341 2531 raft_consensus.cc:2781] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.578449 2531 raft_consensus.cc:686] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:25.578617 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9207048f2c47499699c0688deb12795c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:25.578655 2531 consensus_queue.cc:237] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:25.579242 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9207048f2c47499699c0688deb12795c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.576529 1167 tablet_bootstrap.cc:654] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.584582 2830 raft_consensus.cc:2781] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.585428 2830 raft_consensus.cc:686] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
W20260620 07:01:25.586257 969 leader_election.cc:341] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 25b878def9344cbdae65b209cac4067f
I20260620 07:01:25.586089 2830 consensus_queue.cc:237] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.593961 1027 raft_consensus.cc:2454] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:25.595367 681 leader_election.cc:302] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:25.595958 2741 raft_consensus.cc:2781] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.596071 2741 raft_consensus.cc:686] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:25.596271 2741 consensus_queue.cc:237] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.600659 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:25.601460 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 6c4b81f2b92f4363829034d3fe290742 (table default.Table_84dadb1417974806a37c5fc6f5347d2d [id=6fcbcf995f28481ea31b3a41340a978b]). Expected version 2 got 0
I20260620 07:01:25.601892 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:25.602416 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 52d2a46f972e45f5aeadb09101a68149 (table default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447]). Expected version 2 got 0
I20260620 07:01:25.602746 427 catalog_manager.cc:5495] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:25.603307 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet c8aa75356fb54672a0ada533fc634613 (table default.Table_830d1bf5012e446b871ec75b647e73b5 [id=9872a758911d490c98d27afe035475b2]). Expected version 2 got 0
I20260620 07:01:25.603628 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:25.603811 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:25.604156 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (table default.Table_35a0e30f853640ff94b025abf4fe9d66 [id=bd3649f95ee640eeaeb1d585ac20e4e4]). Expected version 4 got 0
I20260620 07:01:25.605041 427 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:25.606567 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d48f0f9dd4911876ec8f812688439" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:25.606774 888 raft_consensus.cc:3037] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.609855 888 raft_consensus.cc:2454] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
W20260620 07:01:25.616025 683 leader_election.cc:341] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 1d9d4b5a69484176a7b0f4fded010867
I20260620 07:01:25.616657 683 leader_election.cc:302] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.616950 2821 raft_consensus.cc:2781] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 07:01:25.617225 683 leader_election.cc:341] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 1d9d4b5a69484176a7b0f4fded010867
W20260620 07:01:25.617674 683 leader_election.cc:341] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4260b0c953c14a198dbf9b64a30e7e05
I20260620 07:01:25.618871 2821 raft_consensus.cc:686] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:25.619270 2821 consensus_queue.cc:237] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.620241 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 0147ed61f6904914b04433b8db049b7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:24 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:25.643967 1167 tablet_bootstrap.cc:492] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.644166 1167 ts_tablet_manager.cc:1397] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.006s
W20260620 07:01:25.644543 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 0147ed61f6904914b04433b8db049b7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0147ed61f6904914b04433b8db049b7a already in progress: creating tablet
I20260620 07:01:25.645028 1167 raft_consensus.cc:348] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.645242 1167 raft_consensus.cc:374] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.645287 1167 raft_consensus.cc:729] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.645517 1167 consensus_queue.cc:260] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.651508 2752 raft_consensus.cc:482] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.651671 2752 raft_consensus.cc:504] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.652313 2752 leader_election.cc:288] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.652807 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602f6d47f23e4d7f80f372a6a507d095" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:25.654556 830 leader_election.cc:341] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.654515 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602f6d47f23e4d7f80f372a6a507d095" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:25.655069 831 leader_election.cc:341] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.655182 831 leader_election.cc:302] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:25.655408 2752 raft_consensus.cc:2726] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.657390 1167 ts_tablet_manager.cc:1428] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260620 07:01:25.658545 1167 tablet_bootstrap.cc:492] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.660066 1027 raft_consensus.cc:3037] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.664722 1169 ts_tablet_manager.cc:1918] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:25.665015 1169 log.cc:1196] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/6a36a5319a044e9da7dc7b666484e257
I20260620 07:01:25.665380 1169 ts_tablet_manager.cc:1939] T 6a36a5319a044e9da7dc7b666484e257 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:01:25.667683 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2031edb67194127bcfe98fd4e47bf2d consensus state has no leader
I20260620 07:01:25.668111 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b789a2b9270e45d49dcf084716830659"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:25.668613 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b789a2b9270e45d49dcf084716830659 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.670871 1170 tablet_bootstrap.cc:492] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.671593 1170 ts_tablet_manager.cc:1397] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.360s user 0.005s sys 0.000s
I20260620 07:01:25.673053 1170 raft_consensus.cc:348] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.673492 1170 raft_consensus.cc:374] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.673604 1170 raft_consensus.cc:729] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.673942 1170 consensus_queue.cc:260] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.675215 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 037b05aa85ca4cc4be394d7e22e94b30
I20260620 07:01:25.677131 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 037b05aa85ca4cc4be394d7e22e94b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:25.678273 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 037b05aa85ca4cc4be394d7e22e94b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:25.679358 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 037b05aa85ca4cc4be394d7e22e94b30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 037b05aa85ca4cc4be394d7e22e94b30 already in progress: creating tablet
I20260620 07:01:25.679570 1029 raft_consensus.cc:3037] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.679965 1033 raft_consensus.cc:3037] T 76237044ff2f4c8b84c6af43badd164a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.680722 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 037b05aa85ca4cc4be394d7e22e94b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:25.682968 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 037b05aa85ca4cc4be394d7e22e94b30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 037b05aa85ca4cc4be394d7e22e94b30 already in progress: creating tablet
I20260620 07:01:25.683519 1170 ts_tablet_manager.cc:1428] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260620 07:01:25.684062 1170 tablet_bootstrap.cc:492] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:25.687938 1170 tablet_bootstrap.cc:654] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.711081 1167 tablet_bootstrap.cc:654] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.712565 2840 tablet.cc:1722] T eb0f7d4b6fa14811a1f02456418f95a4 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 07:01:25.715732 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1098) took 5457 ms. Trace:
I20260620 07:01:25.715857 1169 rpcz_store.cc:276] 0620 07:01:20.216426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.222873 (+ 6447us) service_pool.cc:227] Handling call
0620 07:01:25.346976 (+5124103us) ts_tablet_manager.cc:1145] Deleting tablet 6a36a5319a044e9da7dc7b666484e257
0620 07:01:25.346997 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.527818 (+180821us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.650564 (+122746us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.673905 (+ 23341us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5123714}
I20260620 07:01:25.719810 1169 tablet_replica.cc:330] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:25.720041 1169 raft_consensus.cc:2229] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.720199 1169 raft_consensus.cc:2258] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.720721 1169 ts_tablet_manager.cc:1905] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.721275 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 6a36a5319a044e9da7dc7b666484e257 (table default.Table_690ab28d5a40472ebf9dfa50126f6c42 [id=0b2270efe0844d8aa33eac8150145bad]) successfully deleted
I20260620 07:01:25.727219 1170 tablet_bootstrap.cc:492] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.727710 1170 ts_tablet_manager.cc:1397] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.018s
I20260620 07:01:25.728341 2830 raft_consensus.cc:482] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.728605 2830 raft_consensus.cc:504] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.728633 1170 raft_consensus.cc:348] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.728986 1170 raft_consensus.cc:374] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.729058 1170 raft_consensus.cc:729] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.729274 2830 leader_election.cc:288] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.729485 1170 consensus_queue.cc:260] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.729969 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c7f0513df34ddb8104b06e5733fb62" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:25.730182 888 raft_consensus.cc:2454] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:25.730209 1170 ts_tablet_manager.cc:1428] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 07:01:25.730698 683 leader_election.cc:302] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:25.731043 2830 raft_consensus.cc:2781] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.731113 2830 raft_consensus.cc:482] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.731173 2830 raft_consensus.cc:3037] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.734274 2830 raft_consensus.cc:504] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.735037 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c7f0513df34ddb8104b06e5733fb62" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.735502 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c7f0513df34ddb8104b06e5733fb62" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
W20260620 07:01:25.735566 681 leader_election.cc:341] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.735702 888 raft_consensus.cc:3037] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:25.738022 802 tablet.cc:2369] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 07:01:25.740604 1170 tablet_bootstrap.cc:492] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:25.741533 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d0b8f2fc0f0d47a69ad6b4edb94220f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:25.742129 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0b8f2fc0f0d47a69ad6b4edb94220f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.742358 1170 tablet_bootstrap.cc:654] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.745231 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9ac70d0657b842e6acbeaef5e2ef68e7
I20260620 07:01:25.746150 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b88f1e4e88394eacbd71b73f05c0b070" } modify_external_catalogs: true
I20260620 07:01:25.746399 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b88f1e4e88394eacbd71b73f05c0b070" } modify_external_catalogs: true
I20260620 07:01:25.747030 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 8afdfa2c293e4a19978bbf85a68753f7
I20260620 07:01:25.747329 422 catalog_manager.cc:6565] ReplaceTablet: tablet 8afdfa2c293e4a19978bbf85a68753f7 deleted and replaced by tablet e4cf4a885db64e0dbca90524d22bbf51
I20260620 07:01:25.747622 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_72c77ce50c2e43e3a966006e5fa68ceb" } modify_external_catalogs: true
I20260620 07:01:25.747799 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_72c77ce50c2e43e3a966006e5fa68ceb" } modify_external_catalogs: true
I20260620 07:01:25.749505 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_80461b90cd2b4ddb863570b10b593012" } new_table_name: "default.Table_c3b7c5dc4107402d8aa8577850add38d" modify_external_catalogs: true
I20260620 07:01:25.756390 1167 tablet_bootstrap.cc:492] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.756649 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac70d0657b842e6acbeaef5e2ef68e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:25.756718 1167 ts_tablet_manager.cc:1397] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.002s
I20260620 07:01:25.756881 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 8afdfa2c293e4a19978bbf85a68753f7 with delete_type TABLET_DATA_DELETED (replaced by tablet e4cf4a885db64e0dbca90524d22bbf51) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:25.757508 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9ac70d0657b842e6acbeaef5e2ef68e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ac70d0657b842e6acbeaef5e2ef68e7 already in progress: creating tablet
I20260620 07:01:25.757635 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac70d0657b842e6acbeaef5e2ef68e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:25.757635 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 8afdfa2c293e4a19978bbf85a68753f7 with delete_type TABLET_DATA_DELETED (replaced by tablet e4cf4a885db64e0dbca90524d22bbf51) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:25.757764 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 8afdfa2c293e4a19978bbf85a68753f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8afdfa2c293e4a19978bbf85a68753f7 already in progress: creating tablet
I20260620 07:01:25.758628 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 8afdfa2c293e4a19978bbf85a68753f7 with delete_type TABLET_DATA_DELETED (replaced by tablet e4cf4a885db64e0dbca90524d22bbf51) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:25.758708 1167 raft_consensus.cc:348] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.759092 1167 raft_consensus.cc:374] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.758630 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac70d0657b842e6acbeaef5e2ef68e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:25.759171 1167 raft_consensus.cc:729] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.759408 1167 consensus_queue.cc:260] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.760004 1167 ts_tablet_manager.cc:1428] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
W20260620 07:01:25.761104 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 8afdfa2c293e4a19978bbf85a68753f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8afdfa2c293e4a19978bbf85a68753f7 already in progress: creating tablet
W20260620 07:01:25.761333 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9ac70d0657b842e6acbeaef5e2ef68e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ac70d0657b842e6acbeaef5e2ef68e7 already in progress: creating tablet
I20260620 07:01:25.764269 1169 ts_tablet_manager.cc:1918] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:25.764405 1169 log.cc:1196] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/0435678022914e6991c974e116d1a9f7
I20260620 07:01:25.764699 1169 ts_tablet_manager.cc:1939] T 0435678022914e6991c974e116d1a9f7 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:25.765664 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8ed3b3839c1c4c85ae6723e50d955079" } new_table_name: "default.Table_814c241fc99a43019b3d93e0b56b6217" modify_external_catalogs: true
I20260620 07:01:25.765798 1167 tablet_bootstrap.cc:492] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.766112 1168 tablet_bootstrap.cc:492] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.767642 1168 tablet_bootstrap.cc:654] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.776165 2830 leader_election.cc:288] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.777230 1167 tablet_bootstrap.cc:654] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.777307 1170 tablet_bootstrap.cc:492] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.777489 1170 ts_tablet_manager.cc:1397] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.002s
I20260620 07:01:25.778352 1170 raft_consensus.cc:348] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.778743 1170 raft_consensus.cc:374] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.778865 1170 raft_consensus.cc:729] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.779102 1170 consensus_queue.cc:260] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.779758 1170 ts_tablet_manager.cc:1428] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:25.780089 1170 tablet_bootstrap.cc:492] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:25.780061 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c7f0513df34ddb8104b06e5733fb62" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.781746 1170 tablet_bootstrap.cc:654] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:25.781720 681 leader_election.cc:341] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.784622 425 master_service.cc:946] ReplaceTablet: received request to replace tablet dfdcc3deb4f14f90b54fc412cd533948 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:25.772956 888 raft_consensus.cc:2454] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:25.785238 683 leader_election.cc:302] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.785609 2830 raft_consensus.cc:2781] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.785945 2830 raft_consensus.cc:686] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:25.786167 2830 consensus_queue.cc:237] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.790352 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 30f56d1419de4d4f9a1bcde8ba38508f
I20260620 07:01:25.791507 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fb75ab3d65204929a77572eb89aff1b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:25.792105 1170 tablet_bootstrap.cc:492] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.792264 1170 ts_tablet_manager.cc:1397] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
W20260620 07:01:25.792294 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb75ab3d65204929a77572eb89aff1b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.793200 1170 raft_consensus.cc:348] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.793457 1170 raft_consensus.cc:374] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.793514 1170 raft_consensus.cc:729] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.793797 1170 consensus_queue.cc:260] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.794691 1170 ts_tablet_manager.cc:1428] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:25.795071 1170 tablet_bootstrap.cc:492] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:25.795341 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 30f56d1419de4d4f9a1bcde8ba38508f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:25.795336 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 30f56d1419de4d4f9a1bcde8ba38508f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:25.795617 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 30f56d1419de4d4f9a1bcde8ba38508f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:25.796183 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 30f56d1419de4d4f9a1bcde8ba38508f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f56d1419de4d4f9a1bcde8ba38508f already in progress: creating tablet
W20260620 07:01:25.796226 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 30f56d1419de4d4f9a1bcde8ba38508f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f56d1419de4d4f9a1bcde8ba38508f already in progress: creating tablet
I20260620 07:01:25.796893 1170 tablet_bootstrap.cc:654] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:25.806394 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3dba2e33592f43a7867756a8b93b3a75 consensus state has no leader
I20260620 07:01:25.806913 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d131b37d96464a1c8f8928aba24074e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:25.807487 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d131b37d96464a1c8f8928aba24074e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.814358 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet e0c27f9ca93741919eb4cbe8a8e6443d
I20260620 07:01:25.815114 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_608fa7fe9add4c14b2705f68900223d3" } new_table_name: "default.Table_a87ce82bae014e20a81eb119f1470ba0" modify_external_catalogs: true
I20260620 07:01:25.815820 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet e0c27f9ca93741919eb4cbe8a8e6443d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:25.816932 864 tablet_service.cc:1514] Processing DeleteTablet for tablet e0c27f9ca93741919eb4cbe8a8e6443d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:25.816987 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet e0c27f9ca93741919eb4cbe8a8e6443d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0c27f9ca93741919eb4cbe8a8e6443d already in progress: creating tablet
I20260620 07:01:25.818284 726 tablet_service.cc:1514] Processing DeleteTablet for tablet e0c27f9ca93741919eb4cbe8a8e6443d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:25 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:25.819262 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet e0c27f9ca93741919eb4cbe8a8e6443d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0c27f9ca93741919eb4cbe8a8e6443d already in progress: creating tablet
W20260620 07:01:25.824739 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f8767b1f8cb41e3ad3aebfd269fd2ef consensus state has no leader
I20260620 07:01:25.824994 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 5c083ebc2e054e09a531a8768802dcb1 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:25.825433 1167 tablet_bootstrap.cc:492] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.825493 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_8cec159b248a44ed97cd71cca66c5e9c" } new_table_name: "default.Table_284a77d0edad46df8826a8ae24ea1c78" modify_external_catalogs: true
I20260620 07:01:25.825639 1167 ts_tablet_manager.cc:1397] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.001s
I20260620 07:01:25.827603 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1099) took 5611 ms. Trace:
I20260620 07:01:25.827713 1169 rpcz_store.cc:276] 0620 07:01:20.216519 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.223310 (+ 6791us) service_pool.cc:227] Handling call
0620 07:01:25.719756 (+5496446us) ts_tablet_manager.cc:1145] Deleting tablet 0435678022914e6991c974e116d1a9f7
0620 07:01:25.719770 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.760901 (+ 41131us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.764154 (+ 3253us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.827575 (+ 63421us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5496270}
I20260620 07:01:25.828303 1167 raft_consensus.cc:348] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.828552 1167 raft_consensus.cc:374] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.828611 1167 raft_consensus.cc:729] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.828691 2752 raft_consensus.cc:482] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.828930 1169 tablet_replica.cc:330] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:25.828845 2752 raft_consensus.cc:504] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.829141 1169 raft_consensus.cc:2229] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.829231 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet dfdcc3deb4f14f90b54fc412cd533948
I20260620 07:01:25.829427 1169 raft_consensus.cc:2258] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.829660 2752 leader_election.cc:288] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.829824 425 catalog_manager.cc:6565] ReplaceTablet: tablet dfdcc3deb4f14f90b54fc412cd533948 deleted and replaced by tablet 1a07fb0e57604f53a5d020b8df1d40a9
I20260620 07:01:25.830188 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_805ad8ee7f924fb6a757cc558dc8efe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:25.830333 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet dfdcc3deb4f14f90b54fc412cd533948 with delete_type TABLET_DATA_DELETED (replaced by tablet 1a07fb0e57604f53a5d020b8df1d40a9) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:25.830758 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_805ad8ee7f924fb6a757cc558dc8efe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:25.831032 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet dfdcc3deb4f14f90b54fc412cd533948 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfdcc3deb4f14f90b54fc412cd533948 already in progress: creating tablet
I20260620 07:01:25.832475 1170 tablet_bootstrap.cc:492] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.832613 1170 ts_tablet_manager.cc:1397] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.003s
I20260620 07:01:25.833652 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95ba8444d70342f781bd84edefbca71f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:25.833608 1170 raft_consensus.cc:348] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.833806 1170 raft_consensus.cc:374] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.833849 1170 raft_consensus.cc:729] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.834046 864 tablet_service.cc:1514] Processing DeleteTablet for tablet dfdcc3deb4f14f90b54fc412cd533948 with delete_type TABLET_DATA_DELETED (replaced by tablet 1a07fb0e57604f53a5d020b8df1d40a9) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:25.834335 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95ba8444d70342f781bd84edefbca71f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.834246 1170 consensus_queue.cc:260] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.834949 1170 ts_tablet_manager.cc:1428] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:25.835296 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 0435678022914e6991c974e116d1a9f7 (table default.Table_9f21f8c0c60642fd97b87ce5e1befcaf [id=3497d9fc568f4979baf33dfdd30ce222]) successfully deleted
I20260620 07:01:25.835618 1170 tablet_bootstrap.cc:492] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:25.836970 830 leader_election.cc:341] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.840621 2830 raft_consensus.cc:482] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:25.840701 831 leader_election.cc:341] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.840829 831 leader_election.cc:302] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:25.841050 2752 raft_consensus.cc:2726] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.840821 2830 raft_consensus.cc:504] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:25.841243 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet dfdcc3deb4f14f90b54fc412cd533948 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfdcc3deb4f14f90b54fc412cd533948 already in progress: creating tablet
I20260620 07:01:25.841169 1167 consensus_queue.cc:260] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.841715 1167 ts_tablet_manager.cc:1428] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260620 07:01:25.841763 2830 leader_election.cc:288] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.841771 726 tablet_service.cc:1514] Processing DeleteTablet for tablet dfdcc3deb4f14f90b54fc412cd533948 with delete_type TABLET_DATA_DELETED (replaced by tablet 1a07fb0e57604f53a5d020b8df1d40a9) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:25.841977 1167 tablet_bootstrap.cc:492] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.843015 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf912f51bfd4df0afe7aa28815a897e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:25.843848 681 leader_election.cc:341] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.844262 1169 ts_tablet_manager.cc:1905] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.840832 1170 tablet_bootstrap.cc:654] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.844720 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf912f51bfd4df0afe7aa28815a897e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:25.844949 888 raft_consensus.cc:2454] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:25.845758 683 leader_election.cc:302] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.846210 1168 tablet_bootstrap.cc:492] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.846385 1168 ts_tablet_manager.cc:1397] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.000s
I20260620 07:01:25.847071 1168 raft_consensus.cc:348] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.847342 1168 raft_consensus.cc:374] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.847440 1168 raft_consensus.cc:729] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.847680 1168 consensus_queue.cc:260] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.848290 1168 ts_tablet_manager.cc:1428] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:25.848567 1168 tablet_bootstrap.cc:492] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.850150 1168 tablet_bootstrap.cc:654] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.850158 1167 tablet_bootstrap.cc:654] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.858366 422 master_service.cc:946] ReplaceTablet: received request to replace tablet 87b65473790e4c199ca49152a679ece7 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:25.859158 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_292c56fc332340afbfa26595764510f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:25.859661 1170 tablet_bootstrap.cc:492] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:01:25.859781 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_292c56fc332340afbfa26595764510f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.859866 1170 ts_tablet_manager.cc:1397] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260620 07:01:25.860677 1170 raft_consensus.cc:348] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.860982 1170 raft_consensus.cc:374] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.861090 1170 raft_consensus.cc:729] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.861382 1170 consensus_queue.cc:260] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.861716 2821 raft_consensus.cc:2781] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.861778 2821 raft_consensus.cc:482] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.861835 2821 raft_consensus.cc:3037] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.861891 2752 raft_consensus.cc:482] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.862021 2752 raft_consensus.cc:504] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.862624 2752 leader_election.cc:288] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.863261 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c9d2d029434f37ba23d65f6662893b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:25.863762 830 leader_election.cc:341] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.864380 1168 tablet_bootstrap.cc:492] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.864504 1168 ts_tablet_manager.cc:1397] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260620 07:01:25.864439 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c9d2d029434f37ba23d65f6662893b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.864470 2821 raft_consensus.cc:504] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.864998 2821 leader_election.cc:288] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:25.865091 831 leader_election.cc:341] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.865219 831 leader_election.cc:302] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:25.865424 2752 raft_consensus.cc:2726] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:25.865959 1168 raft_consensus.cc:348] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.866215 1169 ts_tablet_manager.cc:1918] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:25.866250 1168 raft_consensus.cc:374] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.866434 1168 raft_consensus.cc:729] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.866679 1170 ts_tablet_manager.cc:1428] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 07:01:25.866612 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf912f51bfd4df0afe7aa28815a897e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.866745 1168 consensus_queue.cc:260] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.867051 1170 tablet_bootstrap.cc:492] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:25.867400 681 leader_election.cc:341] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.867789 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf912f51bfd4df0afe7aa28815a897e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:25.867976 888 raft_consensus.cc:3037] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.866425 1169 log.cc:1196] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/06fd96feb4a74b9f8d3243b7d774f388
I20260620 07:01:25.868556 1170 tablet_bootstrap.cc:654] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.868673 1169 ts_tablet_manager.cc:1939] T 06fd96feb4a74b9f8d3243b7d774f388 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:25.868818 1168 ts_tablet_manager.cc:1428] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:01:25.869434 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1096) took 5653 ms. Trace:
I20260620 07:01:25.869900 1168 tablet_bootstrap.cc:492] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.870179 1167 tablet_bootstrap.cc:492] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.870306 1167 ts_tablet_manager.cc:1397] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20260620 07:01:25.870550 888 raft_consensus.cc:2454] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:25.871001 1167 raft_consensus.cc:348] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.871205 1167 raft_consensus.cc:374] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.871251 1167 raft_consensus.cc:729] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.871774 1167 consensus_queue.cc:260] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.871930 683 leader_election.cc:302] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.872308 1167 ts_tablet_manager.cc:1428] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:25.872686 1167 tablet_bootstrap.cc:492] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.874275 1167 tablet_bootstrap.cc:654] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.874310 1168 tablet_bootstrap.cc:654] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.874804 2821 raft_consensus.cc:2781] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.875057 2821 raft_consensus.cc:686] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:25.875293 2821 consensus_queue.cc:237] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.869531 1169 rpcz_store.cc:276] 0620 07:01:20.216214 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.225868 (+ 9654us) service_pool.cc:227] Handling call
0620 07:01:25.828876 (+5603008us) ts_tablet_manager.cc:1145] Deleting tablet 06fd96feb4a74b9f8d3243b7d774f388
0620 07:01:25.828889 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.862124 (+ 33235us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.865835 (+ 3711us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.869414 (+ 3579us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5602806}
I20260620 07:01:25.877209 1169 tablet_replica.cc:330] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:25.877398 1169 raft_consensus.cc:2229] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:25.877473 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 06fd96feb4a74b9f8d3243b7d774f388 (table default.Table_55a40d12ea5d42b8b6b51b6b11ae4f7b [id=d2b994c9f22b4fa7a068b180dc980bbd]) successfully deleted
I20260620 07:01:25.877687 1169 pending_rounds.cc:62] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:25.879037 1169 pending_rounds.cc:68] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821667846909952 op_type: NO_OP noop_request { }
I20260620 07:01:25.879071 2831 consensus_queue.cc:1035] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:25.879189 1169 raft_consensus.cc:2866] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:25.879271 1169 raft_consensus.cc:2258] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.879993 1169 ts_tablet_manager.cc:1905] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.882887 1168 tablet_bootstrap.cc:492] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:25.883090 1168 ts_tablet_manager.cc:1397] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260620 07:01:25.883955 1168 raft_consensus.cc:348] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.884246 1168 raft_consensus.cc:374] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.884406 1168 raft_consensus.cc:729] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.884685 1168 consensus_queue.cc:260] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.886704 1168 ts_tablet_manager.cc:1428] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:25.887194 1170 tablet_bootstrap.cc:492] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.887382 1170 ts_tablet_manager.cc:1397] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260620 07:01:25.888146 1168 tablet_bootstrap.cc:492] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:25.888154 1170 raft_consensus.cc:348] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.888374 1170 raft_consensus.cc:374] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.888477 1170 raft_consensus.cc:729] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.888823 1170 consensus_queue.cc:260] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.890128 1168 tablet_bootstrap.cc:654] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.890266 1170 ts_tablet_manager.cc:1428] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:25.891528 1170 tablet_bootstrap.cc:492] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:25.894645 1170 tablet_bootstrap.cc:654] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.896158 1167 tablet_bootstrap.cc:492] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.896317 1167 ts_tablet_manager.cc:1397] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260620 07:01:25.897161 1167 raft_consensus.cc:348] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.897401 1167 raft_consensus.cc:374] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.897464 1167 raft_consensus.cc:729] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.898763 1167 consensus_queue.cc:260] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.899537 1167 ts_tablet_manager.cc:1428] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 07:01:25.899814 1167 tablet_bootstrap.cc:492] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.902664 1167 tablet_bootstrap.cc:654] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.912914 1169 ts_tablet_manager.cc:1918] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:25.913072 1169 log.cc:1196] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ca86563e5b014bb88ccb74c628670c46
I20260620 07:01:25.913514 1169 ts_tablet_manager.cc:1939] T ca86563e5b014bb88ccb74c628670c46 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:25.914551 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1095) took 5701 ms. Trace:
I20260620 07:01:25.914685 1169 rpcz_store.cc:276] 0620 07:01:20.213412 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.230917 (+ 17505us) service_pool.cc:227] Handling call
0620 07:01:25.877163 (+5646246us) ts_tablet_manager.cc:1145] Deleting tablet ca86563e5b014bb88ccb74c628670c46
0620 07:01:25.877175 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.892558 (+ 15383us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.912752 (+ 20194us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.914522 (+ 1770us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5645974}
I20260620 07:01:25.916492 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ca86563e5b014bb88ccb74c628670c46 (table default.Table_078c21840d2f416da60744754f4b25b2 [id=81b33eb4aa244515a1fa2baf7d11124e]) successfully deleted
I20260620 07:01:25.916508 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1101) took 5604 ms. Trace:
I20260620 07:01:25.916615 1169 rpcz_store.cc:276] 0620 07:01:20.312466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.368451 (+ 55985us) service_pool.cc:227] Handling call
0620 07:01:25.916328 (+5547877us) ts_tablet_manager.cc:1145] Deleting tablet 5773d09ad37c45198d62886624c87eea
0620 07:01:25.916347 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.916487 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5547623}
I20260620 07:01:25.917008 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1100) took 5605 ms. Trace:
W20260620 07:01:25.917138 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5773d09ad37c45198d62886624c87eea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5773d09ad37c45198d62886624c87eea already in progress: creating tablet
I20260620 07:01:25.917130 1169 rpcz_store.cc:276] 0620 07:01:20.311421 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.375742 (+ 64321us) service_pool.cc:227] Handling call
0620 07:01:25.916884 (+5541142us) ts_tablet_manager.cc:1145] Deleting tablet b2f5c0f1c20f46b7b62fccea47f857d9
0620 07:01:25.916893 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.916990 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5540898}
I20260620 07:01:25.917665 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1102) took 5416 ms. Trace:
I20260620 07:01:25.917771 1169 rpcz_store.cc:276] 0620 07:01:20.501474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.501542 (+ 68us) service_pool.cc:227] Handling call
0620 07:01:25.917558 (+5416016us) ts_tablet_manager.cc:1145] Deleting tablet 1e3d4ea81afe43a2a6101e21cbd08f97
0620 07:01:25.917568 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.917644 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5415507}
W20260620 07:01:25.918008 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b2f5c0f1c20f46b7b62fccea47f857d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2f5c0f1c20f46b7b62fccea47f857d9 already in progress: creating tablet
I20260620 07:01:25.918097 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1105) took 5274 ms. Trace:
I20260620 07:01:25.918174 1169 rpcz_store.cc:276] 0620 07:01:20.643254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.643336 (+ 82us) service_pool.cc:227] Handling call
0620 07:01:25.917988 (+5274652us) ts_tablet_manager.cc:1145] Deleting tablet 31c56e80a73c442aa3cc65126a76c8be
0620 07:01:25.918000 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.918081 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5274402}
W20260620 07:01:25.918397 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 1e3d4ea81afe43a2a6101e21cbd08f97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e3d4ea81afe43a2a6101e21cbd08f97 already in progress: creating tablet
I20260620 07:01:25.918532 1169 tablet_replica.cc:330] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:01:25.918762 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 31c56e80a73c442aa3cc65126a76c8be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31c56e80a73c442aa3cc65126a76c8be already in progress: creating tablet
I20260620 07:01:25.923728 1167 tablet_bootstrap.cc:492] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.923875 1167 ts_tablet_manager.cc:1397] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.001s
I20260620 07:01:25.924611 1167 raft_consensus.cc:348] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.924830 1167 raft_consensus.cc:374] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.924887 1167 raft_consensus.cc:729] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.925145 1167 consensus_queue.cc:260] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.925686 1167 ts_tablet_manager.cc:1428] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:25.925962 1167 tablet_bootstrap.cc:492] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.926458 2531 raft_consensus.cc:482] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.926573 2531 raft_consensus.cc:504] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.927167 2531 leader_election.cc:288] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:25.927188 1170 tablet_bootstrap.cc:492] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:25.927317 1170 ts_tablet_manager.cc:1397] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.005s
W20260620 07:01:25.927853 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7419a8974c843748a9022c5fe1a8b34 consensus state has no leader
W20260620 07:01:25.927975 969 leader_election.cc:341] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 08ec769f903c4438bc1186d5fc1c5108
I20260620 07:01:25.927999 1170 raft_consensus.cc:348] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.928181 1170 raft_consensus.cc:374] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.928233 1170 raft_consensus.cc:729] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.928278 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_68ef820ecebc4d29aef38e8c12d8f643"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:25.928480 1167 tablet_bootstrap.cc:654] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:25.928845 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68ef820ecebc4d29aef38e8c12d8f643 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.929057 1170 consensus_queue.cc:260] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.929654 1169 raft_consensus.cc:2229] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:25.929963 1169 raft_consensus.cc:2258] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:25.930101 1170 ts_tablet_manager.cc:1428] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 07:01:25.930352 1170 tablet_bootstrap.cc:492] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:25.930598 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ec769f903c4438bc1186d5fc1c5108" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.930768 1169 ts_tablet_manager.cc:1905] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:25.930848 754 raft_consensus.cc:2454] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:25.931735 1170 tablet_bootstrap.cc:654] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.932148 968 leader_election.cc:302] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:25.933336 2531 raft_consensus.cc:2781] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.933437 2531 raft_consensus.cc:482] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.933519 2531 raft_consensus.cc:3037] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.936143 2531 raft_consensus.cc:504] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:25.937749 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9736d57fe0e4edea762508fe0a8d2a5 consensus state has no leader
I20260620 07:01:25.938258 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_75c7cbf049f24b07ae2f6f1027095af2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:25.938905 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75c7cbf049f24b07ae2f6f1027095af2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:25.939319 2920 tablet.cc:1722] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:25.940500 2531 leader_election.cc:288] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
W20260620 07:01:25.941196 969 leader_election.cc:341] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 08ec769f903c4438bc1186d5fc1c5108
I20260620 07:01:25.942220 2878 raft_consensus.cc:482] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.942360 2878 raft_consensus.cc:504] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.942942 2878 leader_election.cc:288] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.943585 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228af95ef5b24823a4a98b876a50d9af" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:25.944939 830 leader_election.cc:341] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.945267 1167 tablet_bootstrap.cc:492] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:25.945427 1167 ts_tablet_manager.cc:1397] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260620 07:01:25.946401 1167 raft_consensus.cc:348] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.946594 1167 raft_consensus.cc:374] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:25.946660 1167 raft_consensus.cc:729] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:25.932152 2919 tablet.cc:1722] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:25.937294 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ec769f903c4438bc1186d5fc1c5108" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:25.946924 754 raft_consensus.cc:3037] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.946818 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228af95ef5b24823a4a98b876a50d9af" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:25.946923 1167 consensus_queue.cc:260] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:25.947073 748 raft_consensus.cc:2454] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:25.947467 1167 ts_tablet_manager.cc:1428] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:25.947824 1167 tablet_bootstrap.cc:492] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:25.948127 831 leader_election.cc:302] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.948457 2878 raft_consensus.cc:2781] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.948534 2878 raft_consensus.cc:482] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.948592 2878 raft_consensus.cc:3037] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.949705 754 raft_consensus.cc:2454] T 08ec769f903c4438bc1186d5fc1c5108 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:25.950166 968 leader_election.cc:302] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:25.950495 2531 raft_consensus.cc:2781] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.950673 2531 raft_consensus.cc:686] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:25.951036 2531 consensus_queue.cc:237] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.951794 2878 raft_consensus.cc:504] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.952816 1167 tablet_bootstrap.cc:654] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:25.953079 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228af95ef5b24823a4a98b876a50d9af" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:25.953717 1169 ts_tablet_manager.cc:1918] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:25.953709 830 leader_election.cc:341] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.953841 1169 log.cc:1196] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/f6bdcd8cd2574acf867b7ec487559db2
I20260620 07:01:25.952805 2878 leader_election.cc:288] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.954114 1169 ts_tablet_manager.cc:1939] T f6bdcd8cd2574acf867b7ec487559db2 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:25.954295 2830 raft_consensus.cc:482] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.954448 2830 raft_consensus.cc:504] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.955330 2830 leader_election.cc:288] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.956317 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602f6d47f23e4d7f80f372a6a507d095" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:25.957020 681 leader_election.cc:341] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.958820 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602f6d47f23e4d7f80f372a6a507d095" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:25.959053 895 raft_consensus.cc:2454] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:25.959021 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228af95ef5b24823a4a98b876a50d9af" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:25.959185 754 raft_consensus.cc:3037] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.963246 683 leader_election.cc:302] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.963907 2830 raft_consensus.cc:2781] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:25.964064 2830 raft_consensus.cc:482] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:25.964155 2830 raft_consensus.cc:3037] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.966850 2830 raft_consensus.cc:504] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.968924 2830 leader_election.cc:288] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.969914 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602f6d47f23e4d7f80f372a6a507d095" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:25.970651 681 leader_election.cc:341] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.972566 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602f6d47f23e4d7f80f372a6a507d095" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:25.972774 895 raft_consensus.cc:3037] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:25.973474 754 raft_consensus.cc:2454] T 228af95ef5b24823a4a98b876a50d9af P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:25.973855 831 leader_election.cc:302] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.975487 895 raft_consensus.cc:2454] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:25.975903 2752 consensus_queue.cc:1035] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:25.976257 683 leader_election.cc:302] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:25.976361 2752 raft_consensus.cc:2781] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.976464 2752 raft_consensus.cc:686] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:25.976608 2830 raft_consensus.cc:2781] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:25.976673 2752 consensus_queue.cc:237] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.976794 2830 raft_consensus.cc:686] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:25.977401 2830 consensus_queue.cc:237] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.981178 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1106) took 5320 ms. Trace:
I20260620 07:01:25.981310 1169 rpcz_store.cc:276] 0620 07:01:20.660923 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:20.660999 (+ 76us) service_pool.cc:227] Handling call
0620 07:01:25.918483 (+5257484us) ts_tablet_manager.cc:1145] Deleting tablet f6bdcd8cd2574acf867b7ec487559db2
0620 07:01:25.918495 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.936935 (+ 18440us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.953614 (+ 16679us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:25.981150 (+ 27536us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5257283}
I20260620 07:01:25.981802 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1132) took 4930 ms. Trace:
I20260620 07:01:25.981889 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet f6bdcd8cd2574acf867b7ec487559db2 (table default.Table_a1392579a049482496f7035d9dacbb76 [id=017e06014ef0443086ed5034c5dc1a37]) successfully deleted
I20260620 07:01:25.981896 1169 rpcz_store.cc:276] 0620 07:01:21.051768 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.051933 (+ 165us) service_pool.cc:227] Handling call
0620 07:01:25.981661 (+4929728us) ts_tablet_manager.cc:1145] Deleting tablet 7a024765ed144281a81db3b75cd271bf
0620 07:01:25.981677 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.981787 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4927239}
I20260620 07:01:25.983572 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1141) took 4738 ms. Trace:
I20260620 07:01:25.983645 1169 rpcz_store.cc:276] 0620 07:01:21.245197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.245384 (+ 187us) service_pool.cc:227] Handling call
0620 07:01:25.983466 (+4738082us) ts_tablet_manager.cc:1145] Deleting tablet 3ebca13b8fb646778c1e8b9db404904f
0620 07:01:25.983475 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.983559 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4737848}
I20260620 07:01:25.983886 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1143) took 4723 ms. Trace:
I20260620 07:01:25.983966 1169 rpcz_store.cc:276] 0620 07:01:21.260295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.302035 (+ 41740us) service_pool.cc:227] Handling call
0620 07:01:25.983804 (+4681769us) ts_tablet_manager.cc:1145] Deleting tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87
0620 07:01:25.983811 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:25.983872 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4681571}
I20260620 07:01:25.984261 1169 tablet_replica.cc:330] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:01:25.984337 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 7a024765ed144281a81db3b75cd271bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a024765ed144281a81db3b75cd271bf already in progress: creating tablet
I20260620 07:01:25.984504 1169 raft_consensus.cc:2229] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 07:01:25.984543 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 3ebca13b8fb646778c1e8b9db404904f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ebca13b8fb646778c1e8b9db404904f already in progress: creating tablet
I20260620 07:01:25.984668 1169 raft_consensus.cc:2258] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:25.985170 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3ffd02dc9d848e78bf3eb2ecd1c5e87 already in progress: creating tablet
I20260620 07:01:25.992301 2878 raft_consensus.cc:482] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:25.992460 2878 raft_consensus.cc:504] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:25.993026 2878 leader_election.cc:288] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:25.995127 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09886cbd967549118d3b1ba116f7834f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:25.997288 830 leader_election.cc:341] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:25.999132 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09886cbd967549118d3b1ba116f7834f" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:26.000245 831 leader_election.cc:341] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.000520 831 leader_election.cc:302] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:26.000932 2752 raft_consensus.cc:2726] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.004917 1169 ts_tablet_manager.cc:1905] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:26.005384 830 consensus_peers.cc:487] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.041221 1169 ts_tablet_manager.cc:1918] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:26.041442 1169 log.cc:1196] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/3eda988492234d6aaeaee87f84f99d06
I20260620 07:01:26.041944 1169 ts_tablet_manager.cc:1939] T 3eda988492234d6aaeaee87f84f99d06 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:26.046082 2531 raft_consensus.cc:482] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.046245 2531 raft_consensus.cc:504] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.046887 2531 leader_election.cc:288] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:26.047945 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4b81f2b92f4363829034d3fe290742" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:26.048308 681 consensus_peers.cc:487] T c8aa75356fb54672a0ada533fc634613 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.067358 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e21790f4766445e49a41a34b5f77b037"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.068173 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e21790f4766445e49a41a34b5f77b037 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.068702 2752 raft_consensus.cc:482] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.068835 2752 raft_consensus.cc:504] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.069702 2752 leader_election.cc:288] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.070116 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_75ae339dc91942fba5c8df14b5187448" } modify_external_catalogs: true
I20260620 07:01:26.070297 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_75ae339dc91942fba5c8df14b5187448" } modify_external_catalogs: true
I20260620 07:01:26.067303 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4b81f2b92f4363829034d3fe290742" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:26.071753 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0dd59f4c2a4d8580bcefdcc47fd2fa" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.072063 969 leader_election.cc:302] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:26.072616 830 leader_election.cc:341] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.072723 2531 raft_consensus.cc:2726] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.074822 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1149) took 4727 ms. Trace:
I20260620 07:01:26.074981 1169 rpcz_store.cc:276] 0620 07:01:21.347084 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.347845 (+ 761us) service_pool.cc:227] Handling call
0620 07:01:25.984212 (+4636367us) ts_tablet_manager.cc:1145] Deleting tablet 3eda988492234d6aaeaee87f84f99d06
0620 07:01:25.984224 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:26.020908 (+ 36684us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.041072 (+ 20164us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.074762 (+ 33690us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4636219}
I20260620 07:01:26.075378 1169 tablet_replica.cc:330] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:26.075529 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 3eda988492234d6aaeaee87f84f99d06 (table default.Table_06bc01b8cb5d447ea25fd376cc255a6d [id=188e640d71fa4d34ba29242cb1198020]) successfully deleted
I20260620 07:01:26.075618 1169 raft_consensus.cc:2229] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.075788 1169 raft_consensus.cc:2258] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.076372 1169 ts_tablet_manager.cc:1905] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.076435 1170 tablet_bootstrap.cc:492] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:26.076550 1170 ts_tablet_manager.cc:1397] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.146s user 0.009s sys 0.023s
I20260620 07:01:26.077175 1170 raft_consensus.cc:348] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.077373 1170 raft_consensus.cc:374] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.077431 1170 raft_consensus.cc:729] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.077787 1170 consensus_queue.cc:260] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.078477 1170 ts_tablet_manager.cc:1428] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:26.078997 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0dd59f4c2a4d8580bcefdcc47fd2fa" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:26.079902 831 leader_election.cc:341] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.080104 831 leader_election.cc:302] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:26.080384 2752 raft_consensus.cc:2726] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.080770 1170 tablet_bootstrap.cc:492] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:26.082435 1170 tablet_bootstrap.cc:654] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.087553 1167 tablet_bootstrap.cc:492] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:26.087725 1167 ts_tablet_manager.cc:1397] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.140s user 0.008s sys 0.009s
I20260620 07:01:26.092723 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:26.092902 1009 tablet_service.cc:1467] Processing CreateTablet for tablet d6638df90fde4bd9b7374ea7f2e7dd20 (DEFAULT_TABLE table=default.Table_0db8d65e3d3c4f9fb6a8a55800d15171 [id=b518e3f82a674e46b43ac37fe982cfba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.093088 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 52d2a46f972e45f5aeadb09101a68149 (table default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447]). Expected version 2 got 0
I20260620 07:01:26.093372 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6638df90fde4bd9b7374ea7f2e7dd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.093331 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (table default.Table_35a0e30f853640ff94b025abf4fe9d66 [id=bd3649f95ee640eeaeb1d585ac20e4e4]). Expected version 4 got 0
I20260620 07:01:26.093757 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 50200e70f4d3492083f6da65f867be31 (table default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]). Expected version 1 got 0
I20260620 07:01:26.093926 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 228af95ef5b24823a4a98b876a50d9af (table default.Table_8658418f64d1429a914ad81355f9cdc0 [id=d01569425ba447b59b2349fe24a75acd]). Expected version 2 got 0
I20260620 07:01:26.094090 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet d9a7fab4d1684604be1b81d4d4bbe560 (table default.Table_e85e7f993b574dd1bf681863cdd76b40 [id=a7902aafbaad4905a6b5b03ad669eeae]). Expected version 4 got 0
I20260620 07:01:26.094286 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:26.094451 419 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:26.096864 1170 tablet_bootstrap.cc:492] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:26.096900 726 tablet_service.cc:1467] Processing CreateTablet for tablet d6638df90fde4bd9b7374ea7f2e7dd20 (DEFAULT_TABLE table=default.Table_0db8d65e3d3c4f9fb6a8a55800d15171 [id=b518e3f82a674e46b43ac37fe982cfba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.097065 1170 ts_tablet_manager.cc:1397] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.005s
I20260620 07:01:26.097342 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6638df90fde4bd9b7374ea7f2e7dd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.095218 423 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_a7132339336c4cde8e1bf9740c940062 [id=ea9135e430a142ab992288c43fe54bf7] alter complete (version 1)
I20260620 07:01:26.097826 1170 raft_consensus.cc:348] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.098089 1170 raft_consensus.cc:374] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.098148 1170 raft_consensus.cc:729] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.098376 1170 consensus_queue.cc:260] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.099079 1170 ts_tablet_manager.cc:1428] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:26.099545 424 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_3afdf58081b24bb3b6aa051008f4efdc [id=d7198485f2104c2092955ef5305900cf] alter complete (version 3)
I20260620 07:01:26.099642 860 tablet_service.cc:1467] Processing CreateTablet for tablet 283e5d460e2c4619b98f623180e88e57 (DEFAULT_TABLE table=default.Table_261cfafacec24351ad15b54adafc3c8a [id=b5c7cf0314444ab791030c34ea6a8b6e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:26.099912 424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.3:51975 (request call id 153) took 892 ms (client timeout 1000 ms). Trace:
I20260620 07:01:26.100044 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 283e5d460e2c4619b98f623180e88e57. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:26.100353 423 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.1:52621 (request call id 128) took 2038 ms (client timeout 1000 ms). Trace:
W20260620 07:01:26.100003 424 rpcz_store.cc:269] 0620 07:01:25.207348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:25.277891 (+ 70543us) service_pool.cc:227] Handling call
0620 07:01:25.321727 (+ 43836us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x615000033024. stack: 00007f2486e7566e 00007f2486e75430 00007f2485efc5ed 00000000008ea064 00000000008ea02d 00007f249558e27d 00007f249558e373 00007f24923b0361 00007f2499d2366a 00007f2499ea5d8f 00007f249119a946 00007f249119a675 00007f248d9b19be 00007f248d9b079e 00007f248d9b6b25 00007f248d9b754f
0620 07:01:26.099892 (+778165us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:25.621928 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:25.622102 (+ 174us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:25.622113 (+ 11us) write_op.cc:435] Acquired schema lock
0620 07:01:25.622118 (+ 5us) tablet.cc:660] Decoding operations
0620 07:01:25.622275 (+ 157us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:25.622296 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:25.622304 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:25.622462 (+ 158us) tablet.cc:699] Row locks acquired
0620 07:01:25.622466 (+ 4us) write_op.cc:260] PREPARE: finished
0620 07:01:25.622509 (+ 43us) write_op.cc:270] Start()
0620 07:01:25.622560 (+ 51us) write_op.cc:276] Timestamp: P: 1781938885622449 usec, L: 0
0620 07:01:25.622567 (+ 7us) op_driver.cc:331] REPLICATION: starting
0620 07:01:25.643145 (+ 20578us) log.cc:842] Serialized 356 byte log entry
0620 07:01:25.648706 (+ 5561us) op_driver.cc:444] REPLICATION: finished
0620 07:01:25.648841 (+ 135us) write_op.cc:301] APPLY: starting
0620 07:01:25.648858 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:25.648899 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:25.648948 (+ 49us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:25.649002 (+ 54us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:25.649034 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:25.649039 (+ 5us) write_op.cc:312] APPLY: finished
0620 07:01:25.649118 (+ 79us) log.cc:842] Serialized 23 byte log entry
0620 07:01:25.649184 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:25.649200 (+ 16us) write_op.cc:454] Released schema lock
0620 07:01:25.649205 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:25.649266 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:25.649269 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":99499392,"child_traces":[["op",{"apply.queue_time_us":88,"apply.run_cpu_time_us":486,"apply.run_wall_time_us":485,"num_ops":1,"prepare.queue_time_us":298273,"prepare.run_cpu_time_us":1212,"prepare.run_wall_time_us":24739,"raft.queue_time_us":98,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":262,"replication_time_us":26121}]]}
I20260620 07:01:26.100808 424 master_service.cc:946] ReplaceTablet: received request to replace tablet f5072c573ce54477881cafb63e18b030 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:26.101284 864 tablet_service.cc:1467] Processing CreateTablet for tablet d6638df90fde4bd9b7374ea7f2e7dd20 (DEFAULT_TABLE table=default.Table_0db8d65e3d3c4f9fb6a8a55800d15171 [id=b518e3f82a674e46b43ac37fe982cfba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.101670 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6638df90fde4bd9b7374ea7f2e7dd20. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:26.104561 420 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.2:45945 (request call id 150) took 1846 ms (client timeout 1000 ms). Trace:
W20260620 07:01:26.104650 420 rpcz_store.cc:269] 0620 07:01:24.257628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:24.300173 (+ 42545us) service_pool.cc:227] Handling call
0620 07:01:24.325529 (+ 25356us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x615000033024. stack: 00007f2486e7566e 00007f2486e75430 00007f2485efc5ed 00000000008ea064 00000000008ea02d 00007f249558e27d 00007f249558e373 00007f24923b0361 00007f2499d2366a 00007f2499ea5d8f 00007f249119a946 00007f249119a675 00007f248d9b19be 00007f248d9b079e 00007f248d9b6b25 00007f248d9b754f
0620 07:01:26.104539 (+1779010us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:25.581048 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:25.581152 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:25.581158 (+ 6us) write_op.cc:435] Acquired schema lock
0620 07:01:25.581161 (+ 3us) tablet.cc:660] Decoding operations
0620 07:01:25.581275 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:25.581339 (+ 64us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:25.581345 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0620 07:01:25.581450 (+ 105us) tablet.cc:699] Row locks acquired
0620 07:01:25.581452 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:25.581486 (+ 34us) write_op.cc:270] Start()
0620 07:01:25.581521 (+ 35us) write_op.cc:276] Timestamp: P: 1781938885581433 usec, L: 0
0620 07:01:25.581524 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:25.581703 (+ 179us) log.cc:842] Serialized 895 byte log entry
0620 07:01:25.595129 (+ 13426us) op_driver.cc:444] REPLICATION: finished
0620 07:01:25.595328 (+ 199us) write_op.cc:301] APPLY: starting
0620 07:01:25.595349 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:25.595400 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:25.595440 (+ 40us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:25.595524 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:25.595564 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0620 07:01:25.595571 (+ 7us) write_op.cc:312] APPLY: finished
0620 07:01:25.595671 (+ 100us) log.cc:842] Serialized 29 byte log entry
0620 07:01:25.595737 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:25.595764 (+ 27us) write_op.cc:454] Released schema lock
0620 07:01:25.595772 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:25.595835 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:25.595838 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":17,"spinlock_wait_cycles":56204032,"child_traces":[["op",{"apply.queue_time_us":141,"apply.run_cpu_time_us":566,"apply.run_wall_time_us":566,"num_ops":2,"prepare.queue_time_us":298391,"prepare.run_cpu_time_us":791,"prepare.run_wall_time_us":40814,"raft.queue_time_us":52,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":701,"replication_time_us":13571}]]}
I20260620 07:01:26.107681 1170 tablet_bootstrap.cc:492] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:26.108111 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a34f01ce5d4d5696248dc88802dafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.108481 868 tablet_service.cc:1467] Processing CreateTablet for tablet ce2fe10be469448aa7b93940de696b1e (DEFAULT_TABLE table=default.Table_1d305578ac2743299339f0493f87c17c [id=dcc05e95a1954942a81ccb824f28a80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.108551 857 tablet_service.cc:1467] Processing CreateTablet for tablet ae724e2ba09940b89e1fa5e8fbdd1152 (DEFAULT_TABLE table=default.Table_e403391c444144cda9f7e7d6ca92f65c [id=aaccad2812924e8e9bc28077cd31623e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.108844 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce2fe10be469448aa7b93940de696b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.109021 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae724e2ba09940b89e1fa5e8fbdd1152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.109319 859 tablet_service.cc:1467] Processing CreateTablet for tablet 63f3d086ab4a4c9aa8fc0d2c5a17ae10 (DEFAULT_TABLE table=default.Table_0416b6a241aa4455868e1ef3823352e6 [id=acf24a7dd22541d784feeba3ca1d8915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.109653 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63f3d086ab4a4c9aa8fc0d2c5a17ae10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.112591 725 tablet_service.cc:1467] Processing CreateTablet for tablet 63f3d086ab4a4c9aa8fc0d2c5a17ae10 (DEFAULT_TABLE table=default.Table_0416b6a241aa4455868e1ef3823352e6 [id=acf24a7dd22541d784feeba3ca1d8915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.113021 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63f3d086ab4a4c9aa8fc0d2c5a17ae10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.113389 869 tablet_service.cc:1467] Processing CreateTablet for tablet ff9c81ddc54348f9a11841a7e77e4797 (DEFAULT_TABLE table=default.Table_e1cad206b4964e4da33b9e26800196f9 [id=cadd5fc1eae04eca86806c22a08c9636]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.113723 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9c81ddc54348f9a11841a7e77e4797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.114758 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 294f8a632f9d4191b925d1da605bd80e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.116084 1170 tablet_bootstrap.cc:654] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.118121 2891 tablet_replica.cc:330] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.118350 2891 raft_consensus.cc:2229] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.118500 2891 raft_consensus.cc:2258] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.118551 1167 raft_consensus.cc:348] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.119068 2891 ts_tablet_manager.cc:1905] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.119109 862 tablet_service.cc:1467] Processing CreateTablet for tablet 9ad9a1a8edc641c5a396759f8cf8637d (DEFAULT_TABLE table=default.Table_cd6c42421a00468cac15da0c491e82d3 [id=9d457a55f9d2406998fe00acee5fe1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.120452 867 tablet_service.cc:1467] Processing CreateTablet for tablet 629f1bf0a90d4b1391c9e07b5cbc2ecb (DEFAULT_TABLE table=default.Table_e43e2f34f5d84283922c1db46aa91fb3 [id=ce7bb1595a274bb3aa104c19384fa142]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.120990 873 tablet_service.cc:1467] Processing CreateTablet for tablet e474a3aa4f6e482380435ca93827920d (DEFAULT_TABLE table=default.Table_1028eae925e7471382514b1425be0d87 [id=80c85c3d7b324a8f93d88ae40f2c0ea5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.118757 1167 raft_consensus.cc:374] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.121398 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.121588 870 tablet_service.cc:1514] Processing DeleteTablet for tablet c06bf6c4d1af40479c81bd1d85e2848f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.121748 872 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf912f51bfd4df0afe7aa28815a897e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.121901 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.122042 866 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.121234 1167 raft_consensus.cc:729] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.122185 875 tablet_service.cc:1514] Processing DeleteTablet for tablet ee90d961729b4088b0a312ec770d3cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.122470 1167 consensus_queue.cc:260] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.123335 1167 ts_tablet_manager.cc:1428] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20260620 07:01:26.123711 1167 tablet_bootstrap.cc:492] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:26.125403 1167 tablet_bootstrap.cc:654] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.126087 728 tablet_service.cc:1467] Processing CreateTablet for tablet 283e5d460e2c4619b98f623180e88e57 (DEFAULT_TABLE table=default.Table_261cfafacec24351ad15b54adafc3c8a [id=b5c7cf0314444ab791030c34ea6a8b6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.126492 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 283e5d460e2c4619b98f623180e88e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.126526 1006 tablet_service.cc:1467] Processing CreateTablet for tablet ce2fe10be469448aa7b93940de696b1e (DEFAULT_TABLE table=default.Table_1d305578ac2743299339f0493f87c17c [id=dcc05e95a1954942a81ccb824f28a80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.126863 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce2fe10be469448aa7b93940de696b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.130420 1007 tablet_service.cc:1467] Processing CreateTablet for tablet 9ad9a1a8edc641c5a396759f8cf8637d (DEFAULT_TABLE table=default.Table_cd6c42421a00468cac15da0c491e82d3 [id=9d457a55f9d2406998fe00acee5fe1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.130759 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ad9a1a8edc641c5a396759f8cf8637d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.131021 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 63f3d086ab4a4c9aa8fc0d2c5a17ae10 (DEFAULT_TABLE table=default.Table_0416b6a241aa4455868e1ef3823352e6 [id=acf24a7dd22541d784feeba3ca1d8915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.131330 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63f3d086ab4a4c9aa8fc0d2c5a17ae10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.133203 1010 tablet_service.cc:1467] Processing CreateTablet for tablet 283e5d460e2c4619b98f623180e88e57 (DEFAULT_TABLE table=default.Table_261cfafacec24351ad15b54adafc3c8a [id=b5c7cf0314444ab791030c34ea6a8b6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.133370 1170 tablet_bootstrap.cc:492] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:26.133496 1170 ts_tablet_manager.cc:1397] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.003s
I20260620 07:01:26.133520 1010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 283e5d460e2c4619b98f623180e88e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.134164 1004 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b878def9344cbdae65b209cac4067f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.134382 1166 tablet_replica.cc:330] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.134385 999 tablet_service.cc:1467] Processing CreateTablet for tablet 629f1bf0a90d4b1391c9e07b5cbc2ecb (DEFAULT_TABLE table=default.Table_e43e2f34f5d84283922c1db46aa91fb3 [id=ce7bb1595a274bb3aa104c19384fa142]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.134473 1002 tablet_service.cc:1467] Processing CreateTablet for tablet ae724e2ba09940b89e1fa5e8fbdd1152 (DEFAULT_TABLE table=default.Table_e403391c444144cda9f7e7d6ca92f65c [id=aaccad2812924e8e9bc28077cd31623e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.134649 1166 raft_consensus.cc:2229] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:26.134711 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 629f1bf0a90d4b1391c9e07b5cbc2ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.134591 1170 raft_consensus.cc:348] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.134820 1170 raft_consensus.cc:374] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.134898 1166 pending_rounds.cc:62] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:26.134941 1166 pending_rounds.cc:68] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821675345883136 op_type: NO_OP noop_request { }
I20260620 07:01:26.135052 1166 raft_consensus.cc:2866] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:26.135133 1166 raft_consensus.cc:2258] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.135248 1170 raft_consensus.cc:729] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.135484 1170 consensus_queue.cc:260] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.135550 996 tablet_service.cc:1467] Processing CreateTablet for tablet e474a3aa4f6e482380435ca93827920d (DEFAULT_TABLE table=default.Table_1028eae925e7471382514b1425be0d87 [id=80c85c3d7b324a8f93d88ae40f2c0ea5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.135792 1166 ts_tablet_manager.cc:1905] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.135834 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e474a3aa4f6e482380435ca93827920d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.136543 1170 ts_tablet_manager.cc:1428] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:26.137683 1170 tablet_bootstrap.cc:492] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:26.138083 2531 raft_consensus.cc:482] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.138180 1005 tablet_service.cc:1467] Processing CreateTablet for tablet ff9c81ddc54348f9a11841a7e77e4797 (DEFAULT_TABLE table=default.Table_e1cad206b4964e4da33b9e26800196f9 [id=cadd5fc1eae04eca86806c22a08c9636]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.138513 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9c81ddc54348f9a11841a7e77e4797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.138196 2531 raft_consensus.cc:504] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.139393 1170 tablet_bootstrap.cc:654] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.139416 2531 leader_election.cc:288] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:26.140054 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877a71e8db5f4bf689df39f83735f326" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.140365 748 raft_consensus.cc:2454] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:26.140820 718 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f7e6245c074c82a5a72be79ab1987f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.141376 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 485ce059be9b4900adb1dbc3268efb55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.141417 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae724e2ba09940b89e1fa5e8fbdd1152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.142587 968 leader_election.cc:302] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:26.142668 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 777a6b981b7f43a4ba8978ba6f3971e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.143127 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.143647 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ad9a1a8edc641c5a396759f8cf8637d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.143812 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 5926946427294a5ca6fbc72d3e1b612d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.144523 1169 ts_tablet_manager.cc:1918] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.144625 1169 log.cc:1196] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/8d2c706414684bb1bacc6f9b870fc9c1
I20260620 07:01:26.144904 1169 ts_tablet_manager.cc:1939] T 8d2c706414684bb1bacc6f9b870fc9c1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:26.145545 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da80903ac124d1aae937c2329f9b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 95ba8444d70342f781bd84edefbca71f) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.145802 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1150) took 4798 ms. Trace:
I20260620 07:01:26.145896 1169 rpcz_store.cc:276] 0620 07:01:21.347174 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.348035 (+ 861us) service_pool.cc:227] Handling call
0620 07:01:26.075320 (+4727285us) ts_tablet_manager.cc:1145] Deleting tablet 8d2c706414684bb1bacc6f9b870fc9c1
0620 07:01:26.075335 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:26.141467 (+ 66132us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.144434 (+ 2967us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.145783 (+ 1349us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4727153}
I20260620 07:01:26.146219 1169 tablet_replica.cc:330] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:26.146404 1169 raft_consensus.cc:2229] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.146536 1169 raft_consensus.cc:2258] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.146598 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb with delete_type TABLET_DATA_DELETED (replaced by tablet 9cebdd8c947845528affd32316d9b336) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.146931 2531 raft_consensus.cc:2781] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.147032 2531 raft_consensus.cc:482] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.147104 2531 raft_consensus.cc:3037] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.147734 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e474a3aa4f6e482380435ca93827920d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.147899 1170 tablet_bootstrap.cc:492] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:26.148006 1170 ts_tablet_manager.cc:1397] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260620 07:01:26.148631 1170 raft_consensus.cc:348] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.148870 1170 raft_consensus.cc:374] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.148912 1170 raft_consensus.cc:729] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.149084 1170 consensus_queue.cc:260] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.149730 2891 ts_tablet_manager.cc:1918] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.149829 2891 log.cc:1196] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/294f8a632f9d4191b925d1da605bd80e
I20260620 07:01:26.150097 2891 ts_tablet_manager.cc:1939] T 294f8a632f9d4191b925d1da605bd80e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.150475 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 629f1bf0a90d4b1391c9e07b5cbc2ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.150573 1170 ts_tablet_manager.cc:1428] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:26.150550 728 tablet_service.cc:1467] Processing CreateTablet for tablet 9ad9a1a8edc641c5a396759f8cf8637d (DEFAULT_TABLE table=default.Table_cd6c42421a00468cac15da0c491e82d3 [id=9d457a55f9d2406998fe00acee5fe1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.150949 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ad9a1a8edc641c5a396759f8cf8637d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.151296 1170 tablet_bootstrap.cc:492] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:26.152647 1170 tablet_bootstrap.cc:654] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.153734 2830 raft_consensus.cc:482] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.153851 2830 raft_consensus.cc:504] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.154418 2830 leader_election.cc:288] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.155082 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91f8c4955c164e6b9061ac607bbe081c" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.155299 1027 raft_consensus.cc:2454] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:26.155539 726 tablet_service.cc:1467] Processing CreateTablet for tablet ce2fe10be469448aa7b93940de696b1e (DEFAULT_TABLE table=default.Table_1d305578ac2743299339f0493f87c17c [id=dcc05e95a1954942a81ccb824f28a80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.155830 681 leader_election.cc:302] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:26.155956 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce2fe10be469448aa7b93940de696b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.156121 2830 raft_consensus.cc:2781] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.156183 2830 raft_consensus.cc:482] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.156235 2830 raft_consensus.cc:3037] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.159086 1167 tablet_bootstrap.cc:492] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:26.159240 1167 ts_tablet_manager.cc:1397] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.002s
I20260620 07:01:26.159173 725 tablet_service.cc:1467] Processing CreateTablet for tablet ff9c81ddc54348f9a11841a7e77e4797 (DEFAULT_TABLE table=default.Table_e1cad206b4964e4da33b9e26800196f9 [id=cadd5fc1eae04eca86806c22a08c9636]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.159212 2830 raft_consensus.cc:504] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.159580 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9c81ddc54348f9a11841a7e77e4797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.160000 1167 raft_consensus.cc:348] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.160213 1167 raft_consensus.cc:374] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.160279 1167 raft_consensus.cc:729] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.160465 1167 consensus_queue.cc:260] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:26.160555 969 consensus_peers.cc:487] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b8659e903084f15ac3d9ea8c4c0dc0f. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.160573 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91f8c4955c164e6b9061ac607bbe081c" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:26.160781 1027 raft_consensus.cc:3037] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.161342 2830 leader_election.cc:288] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.162774 718 tablet_service.cc:1514] Processing DeleteTablet for tablet a6c7b3977b604cb69df671318fae1212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.163784 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fbd069552314f2c9ee010c054386644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.164388 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a34f01ce5d4d5696248dc88802dafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:26.169643 969 leader_election.cc:341] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 877a71e8db5f4bf689df39f83735f326
I20260620 07:01:26.173580 1170 tablet_bootstrap.cc:492] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:26.173820 1170 ts_tablet_manager.cc:1397] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.001s
I20260620 07:01:26.173830 1166 ts_tablet_manager.cc:1918] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:26.173934 1166 log.cc:1196] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/25b878def9344cbdae65b209cac4067f
W20260620 07:01:26.174109 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 00a34f01ce5d4d5696248dc88802dafd because the tablet was not found. No further retry: Not found: Tablet not found: 00a34f01ce5d4d5696248dc88802dafd
I20260620 07:01:26.174501 1166 ts_tablet_manager.cc:1939] T 25b878def9344cbdae65b209cac4067f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:26.174633 1170 raft_consensus.cc:348] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.174932 1170 raft_consensus.cc:374] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.175045 1170 raft_consensus.cc:729] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.175312 1170 consensus_queue.cc:260] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.175964 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 3651ef9790d342ec96f554134ae714dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.176029 1170 ts_tablet_manager.cc:1428] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:26.176298 1170 tablet_bootstrap.cc:492] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:26.176978 722 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f9d7421b549468e8a7782f467473bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:19 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.176640 718 tablet_service.cc:1514] Processing DeleteTablet for tablet ca86563e5b014bb88ccb74c628670c46 with delete_type TABLET_DATA_DELETED (replaced by tablet ceb16b2060f34a32870bcf6fb143efe7) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.177631 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c51ecf0f006400597f0e7f776698854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:00 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.178097 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c0bb50405d0446488272384523c2deb with delete_type TABLET_DATA_DELETED (replaced by tablet 98544574a8cd4a86a443284a421fa030) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.178546 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4bebaa8ed1431d8c775f4856a3d808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.178915 1170 tablet_bootstrap.cc:654] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.179021 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 113dd3d57c144088ae7204dc5229f883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.179430 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b781d0578834708ae64b24419959cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.179829 718 tablet_service.cc:1514] Processing DeleteTablet for tablet c73bcb81a0c84cdfb4dea0561647828a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.180634 718 tablet_service.cc:1467] Processing CreateTablet for tablet 629f1bf0a90d4b1391c9e07b5cbc2ecb (DEFAULT_TABLE table=default.Table_e43e2f34f5d84283922c1db46aa91fb3 [id=ce7bb1595a274bb3aa104c19384fa142]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.181120 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 629f1bf0a90d4b1391c9e07b5cbc2ecb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:26.100441 423 rpcz_store.cc:269] 0620 07:01:24.061533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:24.146216 (+ 84683us) service_pool.cc:227] Handling call
0620 07:01:24.298287 (+152071us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x615000033024. stack: 00007f2486e7566e 00007f2486e75430 00007f2485efc5ed 00000000008ea064 00000000008ea02d 00007f249558e27d 00007f249558e373 00007f24923b0361 00007f2499d2366a 00007f2499ea5d8f 00007f249119a946 00007f249119a675 00007f248d9b19be 00007f248d9b079e 00007f248d9b6b25 00007f248d9b754f
0620 07:01:26.100330 (+1802043us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:24.660190 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:24.661561 (+ 1371us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:24.661810 (+ 249us) write_op.cc:435] Acquired schema lock
0620 07:01:24.661817 (+ 7us) tablet.cc:660] Decoding operations
0620 07:01:24.666608 (+ 4791us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:24.666892 (+ 284us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:24.666902 (+ 10us) tablet.cc:683] Acquiring locks for 3 operations
0620 07:01:24.668546 (+ 1644us) tablet.cc:699] Row locks acquired
0620 07:01:24.668551 (+ 5us) write_op.cc:260] PREPARE: finished
0620 07:01:24.669747 (+ 1196us) write_op.cc:270] Start()
0620 07:01:24.670391 (+ 644us) write_op.cc:276] Timestamp: P: 1781938884669104 usec, L: 0
0620 07:01:24.670400 (+ 9us) op_driver.cc:331] REPLICATION: starting
0620 07:01:24.673812 (+ 3412us) log.cc:842] Serialized 1266 byte log entry
0620 07:01:24.684591 (+ 10779us) op_driver.cc:444] REPLICATION: finished
0620 07:01:24.684680 (+ 89us) write_op.cc:301] APPLY: starting
0620 07:01:24.684700 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:24.684758 (+ 58us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:24.684791 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:24.684901 (+ 110us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:24.684943 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0620 07:01:24.684953 (+ 10us) write_op.cc:312] APPLY: finished
0620 07:01:24.685074 (+ 121us) log.cc:842] Serialized 35 byte log entry
0620 07:01:24.685140 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:24.685168 (+ 28us) write_op.cc:454] Released schema lock
0620 07:01:24.685177 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:24.685241 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:24.685247 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0620 07:01:24.843117 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:24.843403 (+ 286us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:24.847680 (+ 4277us) write_op.cc:435] Acquired schema lock
0620 07:01:24.847685 (+ 5us) tablet.cc:660] Decoding operations
0620 07:01:24.847820 (+ 135us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:24.847832 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:24.847837 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:24.847901 (+ 64us) tablet.cc:699] Row locks acquired
0620 07:01:24.847904 (+ 3us) write_op.cc:260] PREPARE: finished
0620 07:01:24.847939 (+ 35us) write_op.cc:270] Start()
0620 07:01:24.847978 (+ 39us) write_op.cc:276] Timestamp: P: 1781938884847903 usec, L: 0
0620 07:01:24.847984 (+ 6us) op_driver.cc:331] REPLICATION: starting
0620 07:01:24.848186 (+ 202us) log.cc:842] Serialized 356 byte log entry
0620 07:01:24.917022 (+ 68836us) op_driver.cc:444] REPLICATION: finished
0620 07:01:24.917113 (+ 91us) write_op.cc:301] APPLY: starting
0620 07:01:24.917133 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:24.917176 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:24.917214 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:24.917280 (+ 66us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:24.917322 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:24.917338 (+ 16us) write_op.cc:312] APPLY: finished
0620 07:01:24.917431 (+ 93us) log.cc:842] Serialized 23 byte log entry
0620 07:01:24.917493 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:24.917513 (+ 20us) write_op.cc:454] Released schema lock
0620 07:01:24.917521 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:24.917572 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:24.917575 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2398,"reported_tablets":42,"spinlock_wait_cycles":345762688,"child_traces":[["op",{"apply.queue_time_us":36,"apply.run_cpu_time_us":623,"apply.run_wall_time_us":623,"num_ops":3,"prepare.queue_time_us":277218,"prepare.run_cpu_time_us":1876,"prepare.run_wall_time_us":17259,"raft.queue_time_us":691,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":466,"replication_time_us":14162}],["op",{"apply.queue_time_us":37,"apply.run_cpu_time_us":507,"apply.run_wall_time_us":507,"num_ops":1,"prepare.queue_time_us":143762,"prepare.run_cpu_time_us":772,"prepare.run_wall_time_us":5136,"replication_time_us":69012}]]}
W20260620 07:01:26.185818 683 leader_election.cc:341] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 91f8c4955c164e6b9061ac607bbe081c
W20260620 07:01:26.187069 683 leader_election.cc:341] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 91f8c4955c164e6b9061ac607bbe081c
I20260620 07:01:26.191151 1170 tablet_bootstrap.cc:492] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:26.191402 1170 ts_tablet_manager.cc:1397] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.004s
I20260620 07:01:26.192148 1170 raft_consensus.cc:348] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.192481 1170 raft_consensus.cc:374] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.192593 1170 raft_consensus.cc:729] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.192703 2531 raft_consensus.cc:504] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.192867 1170 consensus_queue.cc:260] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.193347 2531 leader_election.cc:288] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:26.193631 1170 ts_tablet_manager.cc:1428] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:26.193665 1027 raft_consensus.cc:2454] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:26.193984 1170 tablet_bootstrap.cc:492] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:26.195837 969 leader_election.cc:341] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 877a71e8db5f4bf689df39f83735f326
I20260620 07:01:26.196748 1170 tablet_bootstrap.cc:654] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.200505 722 tablet_service.cc:1467] Processing CreateTablet for tablet ae724e2ba09940b89e1fa5e8fbdd1152 (DEFAULT_TABLE table=default.Table_e403391c444144cda9f7e7d6ca92f65c [id=aaccad2812924e8e9bc28077cd31623e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.200915 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae724e2ba09940b89e1fa5e8fbdd1152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.201891 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 25b878def9344cbdae65b209cac4067f (table default.Table_9e2f2ecd97ee48f89579302e371615a7 [id=07e9b630b86b44ad8440941033df1efc]) successfully deleted
I20260620 07:01:26.201980 681 leader_election.cc:302] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:26.202870 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877a71e8db5f4bf689df39f83735f326" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:26.203049 748 raft_consensus.cc:3037] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.204312 1167 ts_tablet_manager.cc:1428] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.045s user 0.000s sys 0.002s
I20260620 07:01:26.204599 1167 tablet_bootstrap.cc:492] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:26.205595 748 raft_consensus.cc:2454] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:26.207150 2935 raft_consensus.cc:2781] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.207296 2935 raft_consensus.cc:686] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:26.207535 2935 consensus_queue.cc:237] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.207792 968 leader_election.cc:302] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:26.208542 2891 tablet_replica.cc:330] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.208915 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 294f8a632f9d4191b925d1da605bd80e (table default.Table_76c9c7cd30ad48e1ae0eca9e170fd5d5 [id=5d6d90a583ff484a8c9352efad051b4f]) successfully deleted
W20260620 07:01:26.209153 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 960fca9c94764f3d8d2daae20a0f8388 because the tablet was not found. No further retry: Not found: Tablet not found: 960fca9c94764f3d8d2daae20a0f8388
I20260620 07:01:26.209584 2752 raft_consensus.cc:482] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.209750 2752 raft_consensus.cc:504] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.210377 2752 leader_election.cc:288] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.211526 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4444360e8ade484f958816c5b80dca7e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.212401 2531 raft_consensus.cc:2781] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.212682 2531 raft_consensus.cc:686] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:26.212920 2531 consensus_queue.cc:237] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:26.214857 830 leader_election.cc:341] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.215767 718 tablet_service.cc:1467] Processing CreateTablet for tablet e474a3aa4f6e482380435ca93827920d (DEFAULT_TABLE table=default.Table_1028eae925e7471382514b1425be0d87 [id=80c85c3d7b324a8f93d88ae40f2c0ea5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.216449 2875 consensus_queue.cc:1035] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:26.221427 1167 tablet_bootstrap.cc:654] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.223124 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_088b8f1d026f4a638631c284a7c66e42" } modify_external_catalogs: true
I20260620 07:01:26.223305 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_088b8f1d026f4a638631c284a7c66e42" } modify_external_catalogs: true
I20260620 07:01:26.226652 424 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 6c4b81f2b92f4363829034d3fe290742 (table default.Table_84dadb1417974806a37c5fc6f5347d2d [id=6fcbcf995f28481ea31b3a41340a978b]). Expected version 2 got 0
I20260620 07:01:26.226691 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d3219442b0f145f7b2e94b234889b7de" } new_table_name: "default.Table_47fb70d8908741c9b50ebddcc884e54b" modify_external_catalogs: true
I20260620 07:01:26.226945 424 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:26.227139 424 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet ba189cfcef094a7bb45bc7d5f4ee5b71 (table default.Table_35a0e30f853640ff94b025abf4fe9d66 [id=bd3649f95ee640eeaeb1d585ac20e4e4]). Expected version 4 got 0
I20260620 07:01:26.209470 2891 raft_consensus.cc:2229] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.228695 2891 raft_consensus.cc:2258] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.229600 1167 tablet_bootstrap.cc:492] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:26.229598 2891 ts_tablet_manager.cc:1905] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.229737 1167 ts_tablet_manager.cc:1397] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20260620 07:01:26.230448 1167 raft_consensus.cc:348] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.230660 1167 raft_consensus.cc:374] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.230713 1167 raft_consensus.cc:729] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.237097 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 8d2c706414684bb1bacc6f9b870fc9c1 (table default.Table_27b3605ce0ed4b8a8c04f4f83227b678 [id=7cff577663c14bf997e9091e37d1c832]) successfully deleted
I20260620 07:01:26.217229 1169 ts_tablet_manager.cc:1905] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.231688 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4444360e8ade484f958816c5b80dca7e" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.244321 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e474a3aa4f6e482380435ca93827920d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:26.244287 831 leader_election.cc:341] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.244441 831 leader_election.cc:302] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:26.244778 2752 raft_consensus.cc:2726] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.248701 2891 ts_tablet_manager.cc:1918] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.248899 2891 log.cc:1196] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/c06bf6c4d1af40479c81bd1d85e2848f
I20260620 07:01:26.249250 2891 ts_tablet_manager.cc:1939] T c06bf6c4d1af40479c81bd1d85e2848f P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.249890 2891 tablet_replica.cc:330] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.250125 2891 raft_consensus.cc:2229] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.250310 2891 raft_consensus.cc:2258] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.250883 2891 ts_tablet_manager.cc:1905] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.250965 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet c06bf6c4d1af40479c81bd1d85e2848f (table default.Table_625f280b139743a0a8a21f7e57df0f21 [id=34c82c4f4c1f42e9b70f1a8a3463f282]) successfully deleted
I20260620 07:01:26.255836 2752 consensus_queue.cc:1035] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:26.258733 2891 ts_tablet_manager.cc:1918] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.258976 2891 log.cc:1196] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/fbf912f51bfd4df0afe7aa28815a897e
I20260620 07:01:26.259649 2891 ts_tablet_manager.cc:1939] T fbf912f51bfd4df0afe7aa28815a897e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.260311 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet fbf912f51bfd4df0afe7aa28815a897e (table default.Table_1c43b2d4813c4afa9752e8e55c232a42 [id=3fd599fba7f44137a7b32121a1507b2f]) successfully deleted
I20260620 07:01:26.260386 2891 tablet_replica.cc:330] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.260584 2891 raft_consensus.cc:2229] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.260763 2891 raft_consensus.cc:2258] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.261287 2891 ts_tablet_manager.cc:1905] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.262952 1168 tablet_bootstrap.cc:492] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:26.263120 1168 ts_tablet_manager.cc:1397] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.375s user 0.050s sys 0.017s
I20260620 07:01:26.263918 1168 raft_consensus.cc:348] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.264242 1168 raft_consensus.cc:374] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.264343 1168 raft_consensus.cc:729] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.264637 1168 consensus_queue.cc:260] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.265262 1168 ts_tablet_manager.cc:1428] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:26.265864 1168 tablet_bootstrap.cc:492] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:26.267714 1168 tablet_bootstrap.cc:654] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.268627 2741 raft_consensus.cc:482] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.268807 2741 raft_consensus.cc:504] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.269428 2741 leader_election.cc:288] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.270504 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88c01c4e10f345fc84e3e253e8501aff" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:26.271268 683 leader_election.cc:341] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 88c01c4e10f345fc84e3e253e8501aff
W20260620 07:01:26.271654 681 leader_election.cc:341] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.271782 681 leader_election.cc:302] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:26.272197 2821 raft_consensus.cc:2726] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.273133 2891 ts_tablet_manager.cc:1918] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.275274 2891 log.cc:1196] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/13c7f0513df34ddb8104b06e5733fb62
I20260620 07:01:26.275609 2891 ts_tablet_manager.cc:1939] T 13c7f0513df34ddb8104b06e5733fb62 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.276113 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 13c7f0513df34ddb8104b06e5733fb62 (table default.Table_09cc34c1ecf8432980b9247bf2be1e8d [id=0597dd0aeaa9466b8804375281de13b6]) successfully deleted
I20260620 07:01:26.276201 2891 tablet_replica.cc:330] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.276401 2891 raft_consensus.cc:2229] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.276557 2891 raft_consensus.cc:2258] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.277056 2891 ts_tablet_manager.cc:1905] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:26.280169 830 consensus_peers.cc:487] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.282444 1170 tablet_bootstrap.cc:492] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:26.282609 1170 ts_tablet_manager.cc:1397] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.089s user 0.005s sys 0.000s
I20260620 07:01:26.283300 1170 raft_consensus.cc:348] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.283517 1170 raft_consensus.cc:374] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.283572 1170 raft_consensus.cc:729] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.283764 1170 consensus_queue.cc:260] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:26.284209 413 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet e0c27f9ca93741919eb4cbe8a8e6443d (table default.Table_b88f1e4e88394eacbd71b73f05c0b070 [id=a5fc4a20926f40d68c5e42092b4260bd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e0c27f9ca93741919eb4cbe8a8e6443d consensus state has no leader
I20260620 07:01:26.284988 1170 ts_tablet_manager.cc:1428] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:26.286819 2891 ts_tablet_manager.cc:1918] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.286944 2891 log.cc:1196] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/3a8d48f0f9dd4911876ec8f812688439
I20260620 07:01:26.287240 2891 ts_tablet_manager.cc:1939] T 3a8d48f0f9dd4911876ec8f812688439 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.287762 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 3a8d48f0f9dd4911876ec8f812688439 (table default.Table_92f22e086c354b20820548c568f04d5f [id=f25842df576f4bf4bc6238f4916cfb30]) successfully deleted
I20260620 07:01:26.287870 2891 tablet_replica.cc:330] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.288057 2891 raft_consensus.cc:2229] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.288215 2891 raft_consensus.cc:2258] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.288755 2891 ts_tablet_manager.cc:1905] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.299975 1168 tablet_bootstrap.cc:492] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:26.300144 2891 ts_tablet_manager.cc:1918] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.300247 2891 log.cc:1196] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/ee90d961729b4088b0a312ec770d3cd0
I20260620 07:01:26.300253 1168 ts_tablet_manager.cc:1397] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.004s
I20260620 07:01:26.300571 2891 ts_tablet_manager.cc:1939] T ee90d961729b4088b0a312ec770d3cd0 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.301060 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet ee90d961729b4088b0a312ec770d3cd0 (table default.Table_87c64053fbc3481390a21b3940acb5ab [id=e942f08f38194edbb28ef9d04779f0ac]) successfully deleted
I20260620 07:01:26.301442 1168 raft_consensus.cc:348] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.301748 1168 raft_consensus.cc:374] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.301846 1168 raft_consensus.cc:729] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.283828 1167 consensus_queue.cc:260] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.307542 1168 consensus_queue.cc:260] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.308190 1167 ts_tablet_manager.cc:1428] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.078s user 0.002s sys 0.000s
I20260620 07:01:26.311210 1168 ts_tablet_manager.cc:1428] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260620 07:01:26.312697 1168 tablet_bootstrap.cc:492] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:26.315492 1168 tablet_bootstrap.cc:654] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.317664 427 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_39a2812476a64b64bdff8924d31a88c3 [id=7230178ddc264a3faaa90ddc66afffd1] alter complete (version 2)
W20260620 07:01:26.321409 427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.1:52621 (request call id 129) took 1207 ms (client timeout 1000 ms). Trace:
I20260620 07:01:26.321957 2821 raft_consensus.cc:482] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.322101 2821 raft_consensus.cc:504] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.322743 2821 leader_election.cc:288] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.322976 419 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_84dadb1417974806a37c5fc6f5347d2d [id=6fcbcf995f28481ea31b3a41340a978b] alter complete (version 2)
W20260620 07:01:26.324015 683 leader_election.cc:341] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ee90d961729b4088b0a312ec770d3cd0
I20260620 07:01:26.323968 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee90d961729b4088b0a312ec770d3cd0" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:26.324554 681 leader_election.cc:341] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.324647 681 leader_election.cc:302] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:26.325548 2821 raft_consensus.cc:2726] T ee90d961729b4088b0a312ec770d3cd0 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.329101 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b878def9344cbdae65b209cac4067f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.329582 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 7294e5678ad44622a3249c1113b5e297 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.329810 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bae5090f81417cbcf4b4d598b438da with delete_type TABLET_DATA_DELETED (replaced by tablet ffb66de2e72b4d13ad4c58bec2720b5a) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.330449 1166 tablet_replica.cc:330] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.330673 1166 raft_consensus.cc:2229] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:26.330883 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 485ce059be9b4900adb1dbc3268efb55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.331343 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d9d4b5a69484176a7b0f4fded010867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.331494 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.331533 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.331648 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f8c4955c164e6b9061ac607bbe081c with delete_type TABLET_DATA_DELETED (replaced by tablet 0e864cac7431439b9eb18d0cd98a7755) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.331727 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4bebaa8ed1431d8c775f4856a3d808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.331775 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bc3dd1306af4e49a9fec197b5740374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.331902 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet 4260b0c953c14a198dbf9b64a30e7e05 with delete_type TABLET_DATA_DELETED (replaced by tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.332084 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ec769f903c4438bc1186d5fc1c5108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.332140 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 125e8a5e20bf484cade408f0358489a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 48726d9a3aa745fca3bcd9b6e8807c49) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.332261 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 877a71e8db5f4bf689df39f83735f326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:01 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.330910 1166 pending_rounds.cc:62] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:26.332347 1166 pending_rounds.cc:68] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821675333500928 op_type: NO_OP noop_request { }
I20260620 07:01:26.332486 1166 raft_consensus.cc:2866] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:26.332576 1166 raft_consensus.cc:2258] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.332655 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 5926946427294a5ca6fbc72d3e1b612d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:26.333807 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 25b878def9344cbdae65b209cac4067f because the tablet was not found. No further retry: Not found: Tablet not found: 25b878def9344cbdae65b209cac4067f
W20260620 07:01:26.334098 681 consensus_peers.cc:487] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.335100 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 95ba8444d70342f781bd84edefbca71f with delete_type TABLET_DATA_DELETED (replaced by tablet 5db563ce7027457fa0185ef94f3c05b5) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.335427 862 tablet_service.cc:1514] Processing DeleteTablet for tablet ee90d961729b4088b0a312ec770d3cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.335597 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.335747 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.335896 864 tablet_service.cc:1514] Processing DeleteTablet for tablet cf978ab301954866aeb77b7abaf2c77e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.336063 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 294f8a632f9d4191b925d1da605bd80e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.336211 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b8ce279cfe4684bd296a48e8783e1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.336354 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 4444360e8ade484f958816c5b80dca7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.336491 866 tablet_service.cc:1514] Processing DeleteTablet for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d02b00437d04192bfd7fb7e7a6b55f3) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.336642 865 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f with delete_type TABLET_DATA_DELETED (replaced by tablet d1b347b220184e238760e03197d81014) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.336786 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 602f6d47f23e4d7f80f372a6a507d095 with delete_type TABLET_DATA_DELETED (replaced by tablet a54ea2c027bb4d4b82fcdb8aa6eb1475) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.336858 2875 raft_consensus.cc:482] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.337008 2875 raft_consensus.cc:504] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.337411 1166 ts_tablet_manager.cc:1905] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.338186 2875 leader_election.cc:288] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:26.340411 2891 tablet_replica.cc:330] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.340909 2891 raft_consensus.cc:2229] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.341084 2891 raft_consensus.cc:2258] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.341261 725 tablet_service.cc:1514] Processing DeleteTablet for tablet f2426d52b8ff40f39887545e0341a91a with delete_type TABLET_DATA_DELETED (replaced by tablet b9736d57fe0e4edea762508fe0a8d2a5) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.341655 2891 ts_tablet_manager.cc:1905] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.342069 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:26.342839 969 leader_election.cc:341] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: af743ffd2eb2427caa3779c7fceb8f30
W20260620 07:01:26.343088 969 consensus_peers.cc:487] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 125e8a5e20bf484cade408f0358489a1. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.343207 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eda988492234d6aaeaee87f84f99d06 with delete_type TABLET_DATA_DELETED (replaced by tablet a590f553b9e041c4830234897dbbf09f) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.343950 725 tablet_service.cc:1514] Processing DeleteTablet for tablet a0a5967c84434000a51fe7d819fac439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.344988 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 816218c726a9473e9849b7a97c820678 with delete_type TABLET_DATA_DELETED (replaced by tablet 494a2bc5b3b843c6b29f019974fa0a92) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.346354 1166 ts_tablet_manager.cc:1918] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:26.347045 872 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf912f51bfd4df0afe7aa28815a897e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.347154 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 87b65473790e4c199ca49152a679ece7
I20260620 07:01:26.347432 872 tablet_service.cc:1514] Processing DeleteTablet for tablet c06bf6c4d1af40479c81bd1d85e2848f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.347594 422 catalog_manager.cc:6565] ReplaceTablet: tablet 87b65473790e4c199ca49152a679ece7 deleted and replaced by tablet 727f5d4d7ad14e8889605bedf27d215f
I20260620 07:01:26.348074 425 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f5cfc99bd7424cf98d8ff41f7e63f2d3
I20260620 07:01:26.348893 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 30ea95affc1a4657afd13a01e2cc304d
I20260620 07:01:26.352464 1166 log.cc:1196] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/7294e5678ad44622a3249c1113b5e297
I20260620 07:01:26.352969 1166 ts_tablet_manager.cc:1939] T 7294e5678ad44622a3249c1113b5e297 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:26.353914 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 7294e5678ad44622a3249c1113b5e297 (table default.Table_51c799b6e1ca4b06828745a6337bdaa0 [id=15a7bd9071df42ba9ad669edd278e5f1]) successfully deleted
I20260620 07:01:26.354058 1168 tablet_bootstrap.cc:492] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:26.354213 1166 tablet_replica.cc:330] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.354265 1168 ts_tablet_manager.cc:1397] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.001s
I20260620 07:01:26.354435 1166 raft_consensus.cc:2229] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.354593 1166 raft_consensus.cc:2258] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.348548 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 87b65473790e4c199ca49152a679ece7 with delete_type TABLET_DATA_DELETED (replaced by tablet 727f5d4d7ad14e8889605bedf27d215f) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.350765 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 30ea95affc1a4657afd13a01e2cc304d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.355199 1166 ts_tablet_manager.cc:1905] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.355140 1168 raft_consensus.cc:348] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.355340 1168 raft_consensus.cc:374] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.355386 1168 raft_consensus.cc:729] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.358815 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:26.359151 419 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.2:45945 (request call id 151) took 941 ms (client timeout 1000 ms). Trace:
I20260620 07:01:26.356276 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 87b65473790e4c199ca49152a679ece7 with delete_type TABLET_DATA_DELETED (replaced by tablet 727f5d4d7ad14e8889605bedf27d215f) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.356673 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 30ea95affc1a4657afd13a01e2cc304d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.359957 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b8ce279cfe4684bd296a48e8783e1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.360344 1168 consensus_queue.cc:260] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:26.321558 427 rpcz_store.cc:269] 0620 07:01:25.113846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:25.121080 (+ 7234us) service_pool.cc:227] Handling call
0620 07:01:26.321372 (+1200292us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:25.668947 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:25.669016 (+ 69us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:25.669020 (+ 4us) write_op.cc:435] Acquired schema lock
0620 07:01:25.669023 (+ 3us) tablet.cc:660] Decoding operations
0620 07:01:25.669100 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:25.669107 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:25.669111 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:25.669157 (+ 46us) tablet.cc:699] Row locks acquired
0620 07:01:25.669159 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:25.669182 (+ 23us) write_op.cc:270] Start()
0620 07:01:25.669203 (+ 21us) write_op.cc:276] Timestamp: P: 1781938885669123 usec, L: 0
0620 07:01:25.669206 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:25.669322 (+ 116us) log.cc:842] Serialized 524 byte log entry
0620 07:01:25.736510 (+ 67188us) op_driver.cc:444] REPLICATION: finished
0620 07:01:25.738074 (+ 1564us) write_op.cc:301] APPLY: starting
0620 07:01:25.738082 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:25.738120 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:25.738140 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:25.738170 (+ 30us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:25.738191 (+ 21us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:25.738198 (+ 7us) write_op.cc:312] APPLY: finished
0620 07:01:25.738239 (+ 41us) log.cc:842] Serialized 23 byte log entry
0620 07:01:25.738269 (+ 30us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:25.738281 (+ 12us) write_op.cc:454] Released schema lock
0620 07:01:25.738285 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:25.738322 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:25.738325 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0620 07:01:26.268582 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:26.268714 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:26.268719 (+ 5us) write_op.cc:435] Acquired schema lock
0620 07:01:26.268722 (+ 3us) tablet.cc:660] Decoding operations
0620 07:01:26.271634 (+ 2912us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:26.271646 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:26.271652 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:26.271722 (+ 70us) tablet.cc:699] Row locks acquired
0620 07:01:26.271724 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:26.271767 (+ 43us) write_op.cc:270] Start()
0620 07:01:26.271805 (+ 38us) write_op.cc:276] Timestamp: P: 1781938886271740 usec, L: 0
0620 07:01:26.271809 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:26.272025 (+ 216us) log.cc:842] Serialized 356 byte log entry
0620 07:01:26.315164 (+ 43139us) op_driver.cc:444] REPLICATION: finished
0620 07:01:26.316122 (+ 958us) write_op.cc:301] APPLY: starting
0620 07:01:26.316135 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:26.316164 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:26.316186 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:26.316231 (+ 45us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:26.316275 (+ 44us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:26.316280 (+ 5us) write_op.cc:312] APPLY: finished
0620 07:01:26.316343 (+ 63us) log.cc:842] Serialized 23 byte log entry
0620 07:01:26.316391 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:26.316405 (+ 14us) write_op.cc:454] Released schema lock
0620 07:01:26.316412 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:26.316465 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:26.316468 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1540,"apply.run_cpu_time_us":298,"apply.run_wall_time_us":297,"num_ops":1,"prepare.queue_time_us":63008,"prepare.run_cpu_time_us":684,"prepare.run_wall_time_us":69472,"raft.queue_time_us":1465,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"replication_time_us":67294,"thread_start_us":66505,"threads_started":1}],["op",{"apply.queue_time_us":928,"apply.run_cpu_time_us":387,"apply.run_wall_time_us":387,"num_ops":1,"prepare.queue_time_us":166376,"prepare.run_cpu_time_us":826,"prepare.run_wall_time_us":4829,"raft.queue_time_us":47,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":7,"replication_time_us":43339}]]}
I20260620 07:01:26.357604 2891 ts_tablet_manager.cc:1918] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.361123 2891 log.cc:1196] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/95ba8444d70342f781bd84edefbca71f
I20260620 07:01:26.361515 1169 ts_tablet_manager.cc:1918] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.362268 725 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e6ef65b5f44f6d9f2100dd404b2e5f with delete_type TABLET_DATA_DELETED (replaced by tablet d1b347b220184e238760e03197d81014) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.362593 2891 ts_tablet_manager.cc:1939] T 95ba8444d70342f781bd84edefbca71f P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.362576 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af743ffd2eb2427caa3779c7fceb8f30" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.362803 754 raft_consensus.cc:2454] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:26.363197 968 leader_election.cc:302] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:26.363689 2531 raft_consensus.cc:482] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.363823 2531 raft_consensus.cc:504] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.364373 2531 leader_election.cc:288] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:26.364512 2531 raft_consensus.cc:2781] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.364564 2531 raft_consensus.cc:482] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.364617 2531 raft_consensus.cc:3037] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.361887 1168 ts_tablet_manager.cc:1428] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260620 07:01:26.367332 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5926946427294a5ca6fbc72d3e1b612d" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.367533 754 raft_consensus.cc:2454] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:26.367660 1168 tablet_bootstrap.cc:492] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:26.367924 2935 raft_consensus.cc:482] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.368039 2935 raft_consensus.cc:504] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.368323 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 87b65473790e4c199ca49152a679ece7 with delete_type TABLET_DATA_DELETED (replaced by tablet 727f5d4d7ad14e8889605bedf27d215f) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.368505 2935 leader_election.cc:288] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:26.360399 419 rpcz_store.cc:269] 0620 07:01:25.417670 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:25.498971 (+ 81301us) service_pool.cc:227] Handling call
0620 07:01:25.517790 (+ 18819us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x615000033024. stack: 00007f2486e7566e 00007f2486e75430 00007f2485efc5ed 00000000008ea064 00000000008ea02d 00007f249558e27d 00007f249558e373 00007f24923b0361 00007f2499d2366a 00007f2499ea5d8f 00007f249119a946 00007f249119a675 00007f248d9b19be 00007f248d9b079e 00007f248d9b6b25 00007f248d9b754f
0620 07:01:26.359128 (+841338us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:26.273441 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:26.273547 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:26.273554 (+ 7us) write_op.cc:435] Acquired schema lock
0620 07:01:26.273556 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:26.273664 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:26.273675 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:26.273680 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:26.273759 (+ 79us) tablet.cc:699] Row locks acquired
0620 07:01:26.273762 (+ 3us) write_op.cc:260] PREPARE: finished
0620 07:01:26.273799 (+ 37us) write_op.cc:270] Start()
0620 07:01:26.273841 (+ 42us) write_op.cc:276] Timestamp: P: 1781938886273772 usec, L: 0
0620 07:01:26.273846 (+ 5us) op_driver.cc:331] REPLICATION: starting
0620 07:01:26.274056 (+ 210us) log.cc:842] Serialized 356 byte log entry
0620 07:01:26.315204 (+ 41148us) op_driver.cc:444] REPLICATION: finished
0620 07:01:26.316537 (+ 1333us) write_op.cc:301] APPLY: starting
0620 07:01:26.316546 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:26.316570 (+ 24us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:26.316616 (+ 46us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:26.316664 (+ 48us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:26.316692 (+ 28us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:26.316697 (+ 5us) write_op.cc:312] APPLY: finished
0620 07:01:26.316752 (+ 55us) log.cc:842] Serialized 23 byte log entry
0620 07:01:26.316790 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:26.316802 (+ 12us) write_op.cc:454] Released schema lock
0620 07:01:26.316807 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:26.316861 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:26.316868 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13943,"reported_tablets":31,"spinlock_wait_cycles":40266624,"child_traces":[["op",{"apply.queue_time_us":1307,"apply.run_cpu_time_us":379,"apply.run_wall_time_us":378,"num_ops":1,"prepare.queue_time_us":161883,"prepare.run_cpu_time_us":736,"prepare.run_wall_time_us":3844,"raft.queue_time_us":3072,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":9,"replication_time_us":41345}]]}
I20260620 07:01:26.369288 1168 tablet_bootstrap.cc:654] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.369302 968 leader_election.cc:302] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:26.369606 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b45cb0153184218ae4f706a898d0657" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.370113 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 30ea95affc1a4657afd13a01e2cc304d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.370254 2875 raft_consensus.cc:2781] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.370322 2875 raft_consensus.cc:482] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.370374 2875 raft_consensus.cc:3037] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.371289 2891 tablet_replica.cc:330] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.373816 2891 raft_consensus.cc:2229] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:26.374522 2891 raft_consensus.cc:2258] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.375818 2891 ts_tablet_manager.cc:1905] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:26.375870 681 leader_election.cc:341] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.377558 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 95ba8444d70342f781bd84edefbca71f (table default.Table_4248c917b1ab466086f9ae5cf25bbe7b [id=2943ebfc86e54b75a06a5727fdcc6190]) successfully deleted
W20260620 07:01:26.377842 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet ee90d961729b4088b0a312ec770d3cd0 because the tablet was not found. No further retry: Not found: Tablet not found: ee90d961729b4088b0a312ec770d3cd0
W20260620 07:01:26.378021 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3a8d48f0f9dd4911876ec8f812688439 because the tablet was not found. No further retry: Not found: Tablet not found: 3a8d48f0f9dd4911876ec8f812688439
I20260620 07:01:26.378036 2935 raft_consensus.cc:482] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.378044 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b45cb0153184218ae4f706a898d0657" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:26.378226 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 13c7f0513df34ddb8104b06e5733fb62 because the tablet was not found. No further retry: Not found: Tablet not found: 13c7f0513df34ddb8104b06e5733fb62
I20260620 07:01:26.378248 889 raft_consensus.cc:2454] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:26.378167 2935 raft_consensus.cc:504] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.378762 2935 leader_election.cc:288] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.379436 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "294f8a632f9d4191b925d1da605bd80e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:26.380206 681 leader_election.cc:341] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.380995 683 leader_election.cc:302] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:26.381419 2935 raft_consensus.cc:2781] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.381501 2935 raft_consensus.cc:482] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.381587 2935 raft_consensus.cc:3037] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.382653 1168 tablet_bootstrap.cc:492] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:26.382863 1168 ts_tablet_manager.cc:1397] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.001s
I20260620 07:01:26.383008 2757 raft_consensus.cc:482] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.383778 2757 raft_consensus.cc:504] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.384532 2757 leader_election.cc:288] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.384747 2935 raft_consensus.cc:504] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.385782 1168 raft_consensus.cc:348] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.386185 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b45cb0153184218ae4f706a898d0657" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:26.386866 681 leader_election.cc:341] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:26.387714 683 leader_election.cc:341] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 294f8a632f9d4191b925d1da605bd80e
I20260620 07:01:26.387806 683 leader_election.cc:302] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:26.388121 2741 raft_consensus.cc:2726] T 294f8a632f9d4191b925d1da605bd80e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.388356 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203485ac9bc54f138bb4f2d547291418" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.388526 754 raft_consensus.cc:2454] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:26.387552 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b45cb0153184218ae4f706a898d0657" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:26.391243 2741 raft_consensus.cc:482] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.391307 889 raft_consensus.cc:3037] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.391371 2741 raft_consensus.cc:504] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.391891 2741 leader_election.cc:288] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.392532 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bbf2f844b4c01ad5d6dc36e096ee5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:26.393036 681 leader_election.cc:341] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.395140 889 raft_consensus.cc:2454] T 3b45cb0153184218ae4f706a898d0657 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:26.388964 831 leader_election.cc:302] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:26.395599 2757 raft_consensus.cc:2781] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.395732 2757 raft_consensus.cc:482] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.395810 2757 raft_consensus.cc:3037] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.396293 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bbf2f844b4c01ad5d6dc36e096ee5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:26.396482 888 raft_consensus.cc:2454] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:26.397092 683 leader_election.cc:302] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:26.397360 683 leader_election.cc:302] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:26.397550 2821 raft_consensus.cc:2781] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.397665 2821 raft_consensus.cc:686] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:26.397703 2741 raft_consensus.cc:2781] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.397755 2741 raft_consensus.cc:482] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.397805 2741 raft_consensus.cc:3037] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.397895 2821 consensus_queue.cc:237] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.398622 2757 raft_consensus.cc:504] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.399683 2757 leader_election.cc:288] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.400297 1168 raft_consensus.cc:374] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.400470 1168 raft_consensus.cc:729] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.401530 2741 raft_consensus.cc:504] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.403757 2741 leader_election.cc:288] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.405035 1027 raft_consensus.cc:3037] T 00a3ccec08ee4c8480a808b1402eb4a9 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.404920 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bbf2f844b4c01ad5d6dc36e096ee5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:26.406095 681 leader_election.cc:341] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.407068 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bbf2f844b4c01ad5d6dc36e096ee5" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:26.407325 889 raft_consensus.cc:3037] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.407292 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203485ac9bc54f138bb4f2d547291418" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:26.407508 751 raft_consensus.cc:3037] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.410358 889 raft_consensus.cc:2454] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:26.410468 751 raft_consensus.cc:2454] T 203485ac9bc54f138bb4f2d547291418 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:26.411178 2531 raft_consensus.cc:504] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.411533 2935 leader_election.cc:288] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.400835 1168 consensus_queue.cc:260] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.418322 1168 ts_tablet_manager.cc:1428] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20260620 07:01:26.419281 831 leader_election.cc:302] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:26.419684 2757 raft_consensus.cc:2781] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.419723 683 leader_election.cc:302] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:26.419803 2757 raft_consensus.cc:686] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:26.420063 2928 raft_consensus.cc:482] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.420197 2928 raft_consensus.cc:504] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.420933 2928 leader_election.cc:288] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.421085 2928 raft_consensus.cc:2781] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.421195 2928 raft_consensus.cc:686] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:26.421038 2757 consensus_queue.cc:237] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.421461 2928 consensus_queue.cc:237] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:26.423278 683 consensus_peers.cc:487] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d9d4b5a69484176a7b0f4fded010867. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.431151 1168 tablet_bootstrap.cc:492] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:26.433126 2531 leader_election.cc:288] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:26.435209 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50200e70f4d3492083f6da65f867be31" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:26.435626 895 raft_consensus.cc:2454] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:26.436046 2935 consensus_queue.cc:1035] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:26.439034 1168 tablet_bootstrap.cc:654] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.440384 2935 raft_consensus.cc:482] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.440601 2935 raft_consensus.cc:504] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.441345 2935 leader_election.cc:288] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.442301 683 leader_election.cc:302] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:26.442728 2741 raft_consensus.cc:2781] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.442879 2741 raft_consensus.cc:482] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.443028 2741 raft_consensus.cc:3037] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.446281 2821 raft_consensus.cc:482] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.446455 2821 raft_consensus.cc:504] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.446687 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a7fab4d1684604be1b81d4d4bbe560" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:26.447041 895 raft_consensus.cc:2454] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:26.447067 2821 leader_election.cc:288] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.451758 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09886cbd967549118d3b1ba116f7834f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:26.452008 888 raft_consensus.cc:2454] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:26.452531 683 leader_election.cc:302] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:26.452996 2821 raft_consensus.cc:2781] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.453378 2821 raft_consensus.cc:482] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.453533 2821 raft_consensus.cc:3037] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.453001 683 leader_election.cc:302] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:26.457218 2935 raft_consensus.cc:2781] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.457264 2821 raft_consensus.cc:504] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.457368 2935 raft_consensus.cc:482] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.457798 2935 raft_consensus.cc:3037] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.458580 2821 leader_election.cc:288] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.459165 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a7fab4d1684604be1b81d4d4bbe560" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:26.459453 895 raft_consensus.cc:3037] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.462584 895 raft_consensus.cc:2454] T d9a7fab4d1684604be1b81d4d4bbe560 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:26.463331 2935 raft_consensus.cc:504] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.464344 2935 leader_election.cc:288] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.441147 2891 ts_tablet_manager.cc:1918] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:26.465456 2891 log.cc:1196] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/cf978ab301954866aeb77b7abaf2c77e
I20260620 07:01:26.465878 2891 ts_tablet_manager.cc:1939] T cf978ab301954866aeb77b7abaf2c77e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.467536 1168 tablet_bootstrap.cc:492] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:26.467693 1168 ts_tablet_manager.cc:1397] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.000s
I20260620 07:01:26.469166 2891 tablet_replica.cc:330] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.469472 2891 raft_consensus.cc:2229] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.469638 2891 raft_consensus.cc:2258] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.471607 1168 raft_consensus.cc:348] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.471818 1168 raft_consensus.cc:374] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.471884 1168 raft_consensus.cc:729] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.472054 1168 consensus_queue.cc:260] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.472467 1168 ts_tablet_manager.cc:1428] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:26.472714 1168 tablet_bootstrap.cc:492] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:26.473776 2891 ts_tablet_manager.cc:1905] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.474977 2952 raft_consensus.cc:482] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.475354 683 leader_election.cc:302] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:26.475544 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet cf978ab301954866aeb77b7abaf2c77e (table default.Table_92260deae314470797bd29ca83c08e68 [id=2aae99ca0f614c63b2d25aa6ce51bc29]) successfully deleted
W20260620 07:01:26.476174 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 294f8a632f9d4191b925d1da605bd80e because the tablet was not found. No further retry: Not found: Tablet not found: 294f8a632f9d4191b925d1da605bd80e
I20260620 07:01:26.476372 2831 raft_consensus.cc:2781] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.476511 2831 raft_consensus.cc:686] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:26.476662 1170 tablet_bootstrap.cc:492] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:26.476720 2831 consensus_queue.cc:237] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.478361 1170 tablet_bootstrap.cc:654] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.478358 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09886cbd967549118d3b1ba116f7834f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:26.478613 889 raft_consensus.cc:3037] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.479835 2952 raft_consensus.cc:504] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.481148 2952 leader_election.cc:288] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:26.482765 1167 tablet_bootstrap.cc:492] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:26.485291 1167 tablet_bootstrap.cc:654] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.427014 2953 raft_consensus.cc:482] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.487054 2953 raft_consensus.cc:504] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.487960 2953 leader_election.cc:288] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:26.497645 889 raft_consensus.cc:2454] T 09886cbd967549118d3b1ba116f7834f P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:26.498446 2830 raft_consensus.cc:482] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.498652 2830 raft_consensus.cc:504] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.499382 2830 leader_election.cc:288] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.500366 1168 tablet_bootstrap.cc:654] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:26.502050 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 85484.8us
I20260620 07:01:26.504446 2757 raft_consensus.cc:482] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.504721 2757 raft_consensus.cc:504] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.505329 2757 leader_election.cc:288] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.362269 1169 log.cc:1196] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/7294e5678ad44622a3249c1113b5e297
I20260620 07:01:26.482276 2741 raft_consensus.cc:504] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.506122 1169 ts_tablet_manager.cc:1939] T 7294e5678ad44622a3249c1113b5e297 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:26.506958 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1151) took 5159 ms. Trace:
I20260620 07:01:26.507102 1169 rpcz_store.cc:276] 0620 07:01:21.347260 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.348184 (+ 924us) service_pool.cc:227] Handling call
0620 07:01:26.146177 (+4797993us) ts_tablet_manager.cc:1145] Deleting tablet 7294e5678ad44622a3249c1113b5e297
0620 07:01:26.146187 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:26.280242 (+134055us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.361335 (+ 81093us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.506937 (+145602us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4797878}
I20260620 07:01:26.507642 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 7294e5678ad44622a3249c1113b5e297 (table default.Table_51c799b6e1ca4b06828745a6337bdaa0 [id=15a7bd9071df42ba9ad669edd278e5f1]) successfully deleted
I20260620 07:01:26.507732 1169 tablet_replica.cc:330] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:26.508157 1169 raft_consensus.cc:2229] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.508414 1169 raft_consensus.cc:2258] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.509059 1169 ts_tablet_manager.cc:1905] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.509184 2891 ts_tablet_manager.cc:1918] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.509487 2741 leader_election.cc:288] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.510067 2891 log.cc:1196] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/29b8ce279cfe4684bd296a48e8783e1b
I20260620 07:01:26.510586 2891 ts_tablet_manager.cc:1939] T 29b8ce279cfe4684bd296a48e8783e1b P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.511370 891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba189cfcef094a7bb45bc7d5f4ee5b71" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:26.512378 2891 tablet_replica.cc:330] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.513327 2891 raft_consensus.cc:2229] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.513747 2891 raft_consensus.cc:2258] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.514485 2891 ts_tablet_manager.cc:1905] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:26.518926 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ce786042d8641c08e5e3b2c048a5c03 consensus state has no leader
I20260620 07:01:26.522703 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_64537400790649eabbf7a0ba6b44a258"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.523321 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64537400790649eabbf7a0ba6b44a258 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.523479 2928 raft_consensus.cc:482] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.523615 2928 raft_consensus.cc:504] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.524504 2928 leader_election.cc:288] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.524603 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cd9d406b4ab84e899550e53fce092e5f" } modify_external_catalogs: true
I20260620 07:01:26.524755 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cd9d406b4ab84e899550e53fce092e5f" } modify_external_catalogs: true
I20260620 07:01:26.512014 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203485ac9bc54f138bb4f2d547291418" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.512315 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203485ac9bc54f138bb4f2d547291418" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:26.526237 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_de78f6f1d44c439e80a2c83edf4e5076" } modify_external_catalogs: true
I20260620 07:01:26.526386 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_de78f6f1d44c439e80a2c83edf4e5076" } modify_external_catalogs: true
W20260620 07:01:26.512733 969 leader_election.cc:341] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 5926946427294a5ca6fbc72d3e1b612d
W20260620 07:01:26.527266 969 leader_election.cc:341] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e37f336c01974ba79caeb25f4781667a
W20260620 07:01:26.527444 969 leader_election.cc:341] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: af743ffd2eb2427caa3779c7fceb8f30
I20260620 07:01:26.527452 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3d5201c0850244a9942fe26795fe7b97" } new_table_name: "default.Table_ef4e1810bb6a4deb88caac93c8e7158a" modify_external_catalogs: true
W20260620 07:01:26.528290 830 leader_election.cc:341] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.528789 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_4dcddab70ddf4517b28b0f7d19ed8549"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.529354 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4dcddab70ddf4517b28b0f7d19ed8549 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.528913 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_372f2b67fb3f40de80d976f4dcf68621" } modify_external_catalogs: true
I20260620 07:01:26.528937 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_aac644bb3f1b42539dba61270f047268"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:26.529659 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_372f2b67fb3f40de80d976f4dcf68621" } modify_external_catalogs: true
W20260620 07:01:26.530277 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aac644bb3f1b42539dba61270f047268 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.512733 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883d1959ed484c58935db467aa2dc50a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:26.539172 830 leader_election.cc:341] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.544891 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c7b23abc0801498582f75de9cca26256" } new_table_name: "default.Table_63dba8ba67db47c792c97d6cfd5b6af6" modify_external_catalogs: true
I20260620 07:01:26.545447 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af743ffd2eb2427caa3779c7fceb8f30" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:26.545672 751 raft_consensus.cc:3037] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.546952 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9647383a4f1b46278348bc25aae2d621" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:26.547163 888 raft_consensus.cc:2454] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:26.548532 751 raft_consensus.cc:2454] T af743ffd2eb2427caa3779c7fceb8f30 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:26.548854 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba189cfcef094a7bb45bc7d5f4ee5b71" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.550228 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 3f0c8e56305044069e49f8bacf3579c1 (DEFAULT_TABLE table=default.Table_fb75ab3d65204929a77572eb89aff1b4 [id=64926f57832a42929e4b5b67c8a3a154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.550945 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f0c8e56305044069e49f8bacf3579c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.551342 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37f336c01974ba79caeb25f4781667a" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.551441 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50200e70f4d3492083f6da65f867be31" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:26.551537 754 raft_consensus.cc:2454] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:26.551620 888 raft_consensus.cc:3037] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.554327 888 raft_consensus.cc:2454] T 50200e70f4d3492083f6da65f867be31 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:26.557655 718 tablet_service.cc:1467] Processing CreateTablet for tablet 3f0c8e56305044069e49f8bacf3579c1 (DEFAULT_TABLE table=default.Table_fb75ab3d65204929a77572eb89aff1b4 [id=64926f57832a42929e4b5b67c8a3a154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.558367 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f0c8e56305044069e49f8bacf3579c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.560629 1170 tablet_bootstrap.cc:492] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:26.560770 1170 ts_tablet_manager.cc:1397] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.084s user 0.007s sys 0.000s
I20260620 07:01:26.561376 1170 raft_consensus.cc:348] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.561581 1170 raft_consensus.cc:374] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.561623 1170 raft_consensus.cc:729] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.561817 1170 consensus_queue.cc:260] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.562376 1170 ts_tablet_manager.cc:1428] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:26.562860 1170 tablet_bootstrap.cc:492] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:26.563982 1167 tablet_bootstrap.cc:492] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:26.564144 1167 ts_tablet_manager.cc:1397] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.081s user 0.001s sys 0.004s
I20260620 07:01:26.564977 1170 tablet_bootstrap.cc:654] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.568096 999 tablet_service.cc:1467] Processing CreateTablet for tablet 9706ffcd72734e7ebb2f031a014599b0 (DEFAULT_TABLE table=default.Table_d0b8f2fc0f0d47a69ad6b4edb94220f7 [id=b4864eaad9cd4eb6970c6167593b7fe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.568666 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9706ffcd72734e7ebb2f031a014599b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.570021 1169 ts_tablet_manager.cc:1918] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.572651 2531 raft_consensus.cc:482] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.572785 2531 raft_consensus.cc:504] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.572943 1167 raft_consensus.cc:348] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.573112 1167 raft_consensus.cc:374] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.573160 1167 raft_consensus.cc:729] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.573346 2531 leader_election.cc:288] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:26.573783 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50200e70f4d3492083f6da65f867be31" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.573786 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a96030064de046e5873bdaab6f3dff60" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:26.574460 1029 raft_consensus.cc:3037] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.574461 1167 consensus_queue.cc:260] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.575204 1167 ts_tablet_manager.cc:1428] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260620 07:01:26.576495 1167 tablet_bootstrap.cc:492] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:26.576712 1006 tablet_service.cc:1467] Processing CreateTablet for tablet fee01a1c6af94713bce1d74ac3d86482 (DEFAULT_TABLE table=default.Table_60f539bde5ea41c1925bcdd1f45f4e80 [id=91776e8c01314b8da0e0837fff170572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.577155 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fee01a1c6af94713bce1d74ac3d86482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.578034 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 6c001d52185e4a9abc68db8cfc52c0a9 (DEFAULT_TABLE table=default.Table_292c56fc332340afbfa26595764510f3 [id=61f095b27f804768a21bedf4b41b21ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.578267 1167 tablet_bootstrap.cc:654] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.578490 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c001d52185e4a9abc68db8cfc52c0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.580801 2531 raft_consensus.cc:482] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.581013 2531 raft_consensus.cc:504] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.581684 2531 leader_election.cc:288] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:26.588630 969 leader_election.cc:341] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0a4bebaa8ed1431d8c775f4856a3d808
I20260620 07:01:26.594063 2875 raft_consensus.cc:504] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.587632 725 tablet_service.cc:1467] Processing CreateTablet for tablet 9706ffcd72734e7ebb2f031a014599b0 (DEFAULT_TABLE table=default.Table_d0b8f2fc0f0d47a69ad6b4edb94220f7 [id=b4864eaad9cd4eb6970c6167593b7fe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.603523 1169 log.cc:1196] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/033c8b817757441ea7ebc2dbf77aa2dd
I20260620 07:01:26.603786 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9706ffcd72734e7ebb2f031a014599b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.603896 1169 ts_tablet_manager.cc:1939] T 033c8b817757441ea7ebc2dbf77aa2dd P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:26.587977 726 tablet_service.cc:1467] Processing CreateTablet for tablet fee01a1c6af94713bce1d74ac3d86482 (DEFAULT_TABLE table=default.Table_60f539bde5ea41c1925bcdd1f45f4e80 [id=91776e8c01314b8da0e0837fff170572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.604260 683 leader_election.cc:302] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:26.596693 728 tablet_service.cc:1467] Processing CreateTablet for tablet 1a07fb0e57604f53a5d020b8df1d40a9 (DEFAULT_TABLE table=default.Table_45a3fdc28a0143deb5a12984f8fd8144 [id=dc2e07584fb642de943bcfa4e41183c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.604501 2741 raft_consensus.cc:482] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.598387 722 tablet_service.cc:1467] Processing CreateTablet for tablet 1687a9dcdc5a482e96abcedb541a3122 (DEFAULT_TABLE table=default.Table_805ad8ee7f924fb6a757cc558dc8efe7 [id=da07f6b5765c404bae88442317874d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.604630 2741 raft_consensus.cc:504] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.604822 2830 raft_consensus.cc:2781] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.604986 2830 raft_consensus.cc:686] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:26.605268 2741 leader_election.cc:288] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.605211 2830 consensus_queue.cc:237] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.600286 715 tablet_service.cc:1467] Processing CreateTablet for tablet 04204324b4904b2daf1bd4a49bfa5e5f (DEFAULT_TABLE table=default.Table_d131b37d96464a1c8f8928aba24074e6 [id=c2ef3338af784ac3bb44de53fc431d1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.600893 720 tablet_service.cc:1467] Processing CreateTablet for tablet e4cf4a885db64e0dbca90524d22bbf51 (DEFAULT_TABLE table=default.Table_a4f3e4033b514356b31b22033f8bd248 [id=c09c12eaaa2b4fa8a9df97ca78bddd51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.607379 718 tablet_service.cc:1467] Processing CreateTablet for tablet 6c001d52185e4a9abc68db8cfc52c0a9 (DEFAULT_TABLE table=default.Table_292c56fc332340afbfa26595764510f3 [id=61f095b27f804768a21bedf4b41b21ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.609751 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5dec136895d44411bf4afdb0341d1b07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.610373 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5dec136895d44411bf4afdb0341d1b07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.611873 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_81ae71986307417fb2e9aa73158820bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.612300 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81ae71986307417fb2e9aa73158820bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.612789 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 47365e10ce274af891055b34e2f0a2bd
W20260620 07:01:26.613386 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f322a11252cb4a82b87e2737d0faa75e consensus state has no leader
I20260620 07:01:26.613349 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_2478c0ed7b254bec883d76e134a5a88a" } new_table_name: "default.Table_6f2d01e6c0c14868af423c12a1997043" modify_external_catalogs: true
I20260620 07:01:26.613648 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_975d0608ca3b4bef8479a03d4028e427" } new_table_name: "default.Table_0704fd7046494ca38d7c79bb126db351" modify_external_catalogs: true
W20260620 07:01:26.616775 412 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc -> Peer f32c3995c70946c38ce1a3094aaaffb1 (127.0.97.60:46775): Couldn't send request to peer f32c3995c70946c38ce1a3094aaaffb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.60:46775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 07:01:26.617728 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b54ee547016d41d9abeb94ea26d0960f consensus state has no leader
I20260620 07:01:26.618037 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 09eddf4734144bdaba24759647553020 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:26.618667 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d5d2c32ec24b4fd6957fe5f4297f5eda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.619290 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5d2c32ec24b4fd6957fe5f4297f5eda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.620420 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet b6e2c297072741eb927dff9bcf6a573f (table default.Table_82b05df0be154af2a16995218ce6f735 [id=d1ba4ce259044c45a86b285abab7b5ef]). Expected version 1 got 0
I20260620 07:01:26.620733 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 228af95ef5b24823a4a98b876a50d9af (table default.Table_8658418f64d1429a914ad81355f9cdc0 [id=d01569425ba447b59b2349fe24a75acd]). Expected version 2 got 0
I20260620 07:01:26.620936 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:26.621064 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 52d2a46f972e45f5aeadb09101a68149 (table default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447]). Expected version 2 got 0
I20260620 07:01:26.621235 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 50200e70f4d3492083f6da65f867be31 (table default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]). Expected version 1 got 0
I20260620 07:01:26.621428 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet c8aa75356fb54672a0ada533fc634613 (table default.Table_830d1bf5012e446b871ec75b647e73b5 [id=9872a758911d490c98d27afe035475b2]). Expected version 2 got 0
I20260620 07:01:26.621676 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:26.621898 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:26.622025 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 967cc8f19ad64278910c86ffc4cb3ed2 (table default.Table_8623961b53aa4dadb03edf663b16790f [id=ce2f89c1e2544dbd8f7c27716b0b8624]). Expected version 2 got 0
I20260620 07:01:26.622265 421 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet d9a7fab4d1684604be1b81d4d4bbe560 (table default.Table_e85e7f993b574dd1bf681863cdd76b40 [id=a7902aafbaad4905a6b5b03ad669eeae]). Expected version 4 got 0
I20260620 07:01:26.622471 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883d1959ed484c58935db467aa2dc50a" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.623000 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 55f7ae7d91484d6c99faf7a0d837b546
I20260620 07:01:26.623577 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6b2e4f0fd4174f7bb596389267a43d5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:26.624444 683 leader_election.cc:302] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
W20260620 07:01:26.624480 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b2e4f0fd4174f7bb596389267a43d5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.624684 2831 raft_consensus.cc:2781] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.624774 2831 raft_consensus.cc:482] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.624840 2831 raft_consensus.cc:3037] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:26.625072 683 consensus_peers.cc:487] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4260b0c953c14a198dbf9b64a30e7e05. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.625558 683 leader_election.cc:302] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:26.625788 2821 raft_consensus.cc:2781] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.625909 2821 raft_consensus.cc:686] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:26.627377 2821 consensus_queue.cc:237] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.628159 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 29b8ce279cfe4684bd296a48e8783e1b (table default.Table_cae8e192c99a43f3975359ae78131167 [id=81b7028a393b4c80a76f60c519581f3f]) successfully deleted
I20260620 07:01:26.628533 2831 raft_consensus.cc:504] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:26.628713 683 leader_election.cc:341] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e37f336c01974ba79caeb25f4781667a
I20260620 07:01:26.629246 2831 leader_election.cc:288] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.630546 865 tablet_service.cc:1467] Processing CreateTablet for tablet 3f0c8e56305044069e49f8bacf3579c1 (DEFAULT_TABLE table=default.Table_fb75ab3d65204929a77572eb89aff1b4 [id=64926f57832a42929e4b5b67c8a3a154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.631053 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f0c8e56305044069e49f8bacf3579c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.634599 727 tablet_service.cc:1467] Processing CreateTablet for tablet 5b06cbbddf0747479d83a915c63295a8 (DEFAULT_TABLE table=default.Table_b789a2b9270e45d49dcf084716830659 [id=a50430fc56744936ac5959e85e6764f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.639894 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a96030064de046e5873bdaab6f3dff60" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.640738 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b06cbbddf0747479d83a915c63295a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.640918 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1152) took 5293 ms. Trace:
I20260620 07:01:26.641006 1169 rpcz_store.cc:276] 0620 07:01:21.347364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.348332 (+ 968us) service_pool.cc:227] Handling call
0620 07:01:26.507670 (+5159338us) ts_tablet_manager.cc:1145] Deleting tablet 033c8b817757441ea7ebc2dbf77aa2dd
0620 07:01:26.507684 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:26.566401 (+ 58717us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.569926 (+ 3525us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.640895 (+ 70969us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5159229}
I20260620 07:01:26.641294 1169 tablet_replica.cc:330] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:26.641477 1169 raft_consensus.cc:2229] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.641604 1169 raft_consensus.cc:2258] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.642076 1169 ts_tablet_manager.cc:1905] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.642935 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04204324b4904b2daf1bd4a49bfa5e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.643083 865 tablet_service.cc:1467] Processing CreateTablet for tablet 9706ffcd72734e7ebb2f031a014599b0 (DEFAULT_TABLE table=default.Table_d0b8f2fc0f0d47a69ad6b4edb94220f7 [id=b4864eaad9cd4eb6970c6167593b7fe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.643386 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fee01a1c6af94713bce1d74ac3d86482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.643486 865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9706ffcd72734e7ebb2f031a014599b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.643735 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1687a9dcdc5a482e96abcedb541a3122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.644062 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4cf4a885db64e0dbca90524d22bbf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.644411 728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a07fb0e57604f53a5d020b8df1d40a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.651114 872 tablet_service.cc:1467] Processing CreateTablet for tablet fee01a1c6af94713bce1d74ac3d86482 (DEFAULT_TABLE table=default.Table_60f539bde5ea41c1925bcdd1f45f4e80 [id=91776e8c01314b8da0e0837fff170572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.522495 1166 ts_tablet_manager.cc:1918] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.651348 1166 log.cc:1196] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/e6bae5090f81417cbcf4b4d598b438da
I20260620 07:01:26.651508 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fee01a1c6af94713bce1d74ac3d86482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.651670 1166 ts_tablet_manager.cc:1939] T e6bae5090f81417cbcf4b4d598b438da P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:26.599411 1006 tablet_service.cc:1467] Processing CreateTablet for tablet 04204324b4904b2daf1bd4a49bfa5e5f (DEFAULT_TABLE table=default.Table_d131b37d96464a1c8f8928aba24074e6 [id=c2ef3338af784ac3bb44de53fc431d1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.652621 1006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04204324b4904b2daf1bd4a49bfa5e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.652756 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 033c8b817757441ea7ebc2dbf77aa2dd (table default.Table_dbcf6925600345658e340ad71565e073 [id=a7528a9274144f0ebbcd1efa102a2a1b]) successfully deleted
I20260620 07:01:26.653246 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 47365e10ce274af891055b34e2f0a2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.653635 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 55f7ae7d91484d6c99faf7a0d837b546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.622514 421 catalog_manager.cc:5495] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:26.602762 1000 tablet_service.cc:1467] Processing CreateTablet for tablet e4cf4a885db64e0dbca90524d22bbf51 (DEFAULT_TABLE table=default.Table_a4f3e4033b514356b31b22033f8bd248 [id=c09c12eaaa2b4fa8a9df97ca78bddd51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.655067 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4cf4a885db64e0dbca90524d22bbf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.603327 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 5b06cbbddf0747479d83a915c63295a8 (DEFAULT_TABLE table=default.Table_b789a2b9270e45d49dcf084716830659 [id=a50430fc56744936ac5959e85e6764f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.658404 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b06cbbddf0747479d83a915c63295a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.605515 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 1687a9dcdc5a482e96abcedb541a3122 (DEFAULT_TABLE table=default.Table_805ad8ee7f924fb6a757cc558dc8efe7 [id=da07f6b5765c404bae88442317874d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.662312 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1687a9dcdc5a482e96abcedb541a3122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.606853 999 tablet_service.cc:1467] Processing CreateTablet for tablet 1a07fb0e57604f53a5d020b8df1d40a9 (DEFAULT_TABLE table=default.Table_45a3fdc28a0143deb5a12984f8fd8144 [id=dc2e07584fb642de943bcfa4e41183c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.615787 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 47365e10ce274af891055b34e2f0a2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.663228 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a07fb0e57604f53a5d020b8df1d40a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.664556 1024 raft_consensus.cc:3037] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.609123 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 757542e0df4e412f8fa63d1bb69f00de (DEFAULT_TABLE table=default.Table_9207048f2c47499699c0688deb12795c [id=b845d35371ce41919ce7023d5f566029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.622757 1027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a7fab4d1684604be1b81d4d4bbe560" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.623276 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09886cbd967549118d3b1ba116f7834f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.624091 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a7fab4d1684604be1b81d4d4bbe560" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:26.626500 1031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09886cbd967549118d3b1ba116f7834f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:26.628794 1032 raft_consensus.cc:3037] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.631615 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 55f7ae7d91484d6c99faf7a0d837b546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.638648 1026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9647383a4f1b46278348bc25aae2d621" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.638747 1028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50200e70f4d3492083f6da65f867be31" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:26.638895 1025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37f336c01974ba79caeb25f4781667a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.672034 866 tablet_service.cc:1467] Processing CreateTablet for tablet 6c001d52185e4a9abc68db8cfc52c0a9 (DEFAULT_TABLE table=default.Table_292c56fc332340afbfa26595764510f3 [id=61f095b27f804768a21bedf4b41b21ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.672169 1025 raft_consensus.cc:2454] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:26.639448 1021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c06bf6c4d1af40479c81bd1d85e2848f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.639679 1023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9647383a4f1b46278348bc25aae2d621" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:26.640673 1167 tablet_bootstrap.cc:492] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:26.672474 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c001d52185e4a9abc68db8cfc52c0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.672586 1167 ts_tablet_manager.cc:1397] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.097s user 0.006s sys 0.000s
I20260620 07:01:26.673231 1167 raft_consensus.cc:348] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.673439 1167 raft_consensus.cc:374] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.673499 1167 raft_consensus.cc:729] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.673658 1167 consensus_queue.cc:260] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.673875 1166 tablet_replica.cc:330] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.674117 1167 ts_tablet_manager.cc:1428] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260620 07:01:26.674337 1167 tablet_bootstrap.cc:492] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:26.644994 2950 raft_consensus.cc:482] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.674883 2950 raft_consensus.cc:504] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.675487 2950 leader_election.cc:288] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:26.676842 1167 tablet_bootstrap.cc:654] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.678409 2875 leader_election.cc:288] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:26.651082 2968 tablet.cc:1722] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:26.680260 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet e6bae5090f81417cbcf4b4d598b438da (table default.Table_2887bc68d41444e7a3da02fea7842d8d [id=e872cbca26c7448ea0b1e65fd692f96e]) successfully deleted
W20260620 07:01:26.680797 969 leader_election.cc:341] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 5926946427294a5ca6fbc72d3e1b612d
I20260620 07:01:26.680452 1166 raft_consensus.cc:2229] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.681980 1166 raft_consensus.cc:2258] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.682869 1166 ts_tablet_manager.cc:1905] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:26.681754 969 leader_election.cc:341] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 2c0bb50405d0446488272384523c2deb
I20260620 07:01:26.687500 866 tablet_service.cc:1467] Processing CreateTablet for tablet 1a07fb0e57604f53a5d020b8df1d40a9 (DEFAULT_TABLE table=default.Table_45a3fdc28a0143deb5a12984f8fd8144 [id=dc2e07584fb642de943bcfa4e41183c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.687976 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a07fb0e57604f53a5d020b8df1d40a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.688630 1169 ts_tablet_manager.cc:1918] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.691262 875 tablet_service.cc:1467] Processing CreateTablet for tablet 1687a9dcdc5a482e96abcedb541a3122 (DEFAULT_TABLE table=default.Table_805ad8ee7f924fb6a757cc558dc8efe7 [id=da07f6b5765c404bae88442317874d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.691641 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1687a9dcdc5a482e96abcedb541a3122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.704857 1169 log.cc:1196] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/d53c90eff33044479838ff67dea93057
I20260620 07:01:26.705490 1169 ts_tablet_manager.cc:1939] T d53c90eff33044479838ff67dea93057 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:26.706694 2830 raft_consensus.cc:482] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.707000 2830 raft_consensus.cc:504] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.707875 2830 leader_election.cc:288] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.701125 1170 tablet_bootstrap.cc:492] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
W20260620 07:01:26.707943 393 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 44346.4us
W20260620 07:01:26.701761 681 leader_election.cc:341] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.702471 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4bebaa8ed1431d8c775f4856a3d808" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.708680 754 raft_consensus.cc:2454] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:26.709312 1170 ts_tablet_manager.cc:1397] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.147s user 0.003s sys 0.000s
I20260620 07:01:26.710359 1170 raft_consensus.cc:348] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.710716 1170 raft_consensus.cc:374] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.710986 1170 raft_consensus.cc:729] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.711323 1170 consensus_queue.cc:260] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.713070 1170 ts_tablet_manager.cc:1428] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:26.713853 875 tablet_service.cc:1467] Processing CreateTablet for tablet e4cf4a885db64e0dbca90524d22bbf51 (DEFAULT_TABLE table=default.Table_a4f3e4033b514356b31b22033f8bd248 [id=c09c12eaaa2b4fa8a9df97ca78bddd51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.714061 1166 ts_tablet_manager.cc:1918] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.714344 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4cf4a885db64e0dbca90524d22bbf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.715049 1166 log.cc:1196] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/485ce059be9b4900adb1dbc3268efb55
I20260620 07:01:26.716320 1166 ts_tablet_manager.cc:1939] T 485ce059be9b4900adb1dbc3268efb55 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:26.718492 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c001d52185e4a9abc68db8cfc52c0a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:26.721657 681 consensus_peers.cc:487] T ce8ed68b221b4215812934844447d60e P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.721728 2831 consensus_queue.cc:1035] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:26.722986 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 58a4f3b5450948768c8db382d200cc19
I20260620 07:01:26.723197 968 leader_election.cc:302] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:26.723428 2875 raft_consensus.cc:2781] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.723549 2875 raft_consensus.cc:686] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:26.723780 2875 consensus_queue.cc:237] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.723873 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_62727117a5b94ad5aa59354b192f9de1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.724460 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62727117a5b94ad5aa59354b192f9de1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.726505 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 58a4f3b5450948768c8db382d200cc19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.726852 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 58a4f3b5450948768c8db382d200cc19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.718286 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 757542e0df4e412f8fa63d1bb69f00de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.727943 2757 raft_consensus.cc:482] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.728085 2757 raft_consensus.cc:504] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.728673 2757 leader_election.cc:288] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.729642 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1936a2b27a1f4fda9ceb295c9c00acf8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:26.730162 830 leader_election.cc:341] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.731388 1168 tablet_bootstrap.cc:492] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:26.731657 1168 ts_tablet_manager.cc:1397] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.259s user 0.007s sys 0.002s
I20260620 07:01:26.732548 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 485ce059be9b4900adb1dbc3268efb55 (table default.Table_3ab345e4abbc4b6c9cf08c26e1a95287 [id=96b547ecb1de4ab3838dab042caeac95]) successfully deleted
I20260620 07:01:26.732630 1168 raft_consensus.cc:348] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.732899 1168 raft_consensus.cc:374] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.732992 1168 raft_consensus.cc:729] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.733258 1168 consensus_queue.cc:260] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.733968 1166 tablet_replica.cc:330] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.734153 1166 raft_consensus.cc:2229] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.734304 1166 raft_consensus.cc:2258] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.734578 1168 ts_tablet_manager.cc:1428] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 07:01:26.735246 873 tablet_service.cc:1467] Processing CreateTablet for tablet 5b06cbbddf0747479d83a915c63295a8 (DEFAULT_TABLE table=default.Table_b789a2b9270e45d49dcf084716830659 [id=a50430fc56744936ac5959e85e6764f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.735638 873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b06cbbddf0747479d83a915c63295a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.735690 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_af758c3cf01c4a64a7acf1f3c7e75dfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.736233 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af758c3cf01c4a64a7acf1f3c7e75dfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:26.737484 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fa7a6b405c44d27850b68c20bd46a80 consensus state has no leader
I20260620 07:01:26.737790 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_865d7722c6fc4b1c8fec64adfc18d9e2" } modify_external_catalogs: true
I20260620 07:01:26.737948 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_865d7722c6fc4b1c8fec64adfc18d9e2" } modify_external_catalogs: true
I20260620 07:01:26.734833 1166 ts_tablet_manager.cc:1905] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.739805 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_d29391a0c5f041bab2d02e7e92399fe0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.740384 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d29391a0c5f041bab2d02e7e92399fe0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.742040 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_835e5822e64d4231bffd011bf691fab2" } modify_external_catalogs: true
I20260620 07:01:26.742226 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_835e5822e64d4231bffd011bf691fab2" } modify_external_catalogs: true
I20260620 07:01:26.745090 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 55f7ae7d91484d6c99faf7a0d837b546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.745406 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 47365e10ce274af891055b34e2f0a2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.746109 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 58a4f3b5450948768c8db382d200cc19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.746624 868 tablet_service.cc:1467] Processing CreateTablet for tablet 757542e0df4e412f8fa63d1bb69f00de (DEFAULT_TABLE table=default.Table_9207048f2c47499699c0688deb12795c [id=b845d35371ce41919ce7023d5f566029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.747018 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 757542e0df4e412f8fa63d1bb69f00de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:26.750615 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b09f83cd81ce404d9738bbad2ad671cc consensus state has no leader
I20260620 07:01:26.750911 418 master_service.cc:946] ReplaceTablet: received request to replace tablet 7f85c8a0ea484b57bb50425867e2774e from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:26.751451 418 master_service.cc:946] ReplaceTablet: received request to replace tablet d05a505f73b24e0ba7159a3d411e5f4f from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:26.753014 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c718b2278f3a4d398487bd0ece7c67d6" } new_table_name: "default.Table_da61e105c66643feb20e5b32e7c7b638" modify_external_catalogs: true
I20260620 07:01:26.754150 727 tablet_service.cc:1467] Processing CreateTablet for tablet 757542e0df4e412f8fa63d1bb69f00de (DEFAULT_TABLE table=default.Table_9207048f2c47499699c0688deb12795c [id=b845d35371ce41919ce7023d5f566029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.754576 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_6bd08cc07a7c46f085831175e52f2681"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.755313 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bd08cc07a7c46f085831175e52f2681 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.755404 968 leader_election.cc:302] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:26.755714 2875 raft_consensus.cc:2726] T ba189cfcef094a7bb45bc7d5f4ee5b71 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.755963 1002 tablet_service.cc:1467] Processing CreateTablet for tablet df345c636c95498f86f7cdab49561c8c (DEFAULT_TABLE table=default.Table_81c644a3657343a499b7d5d82fc357a8 [id=ca3871dae98b4bbfadddfbb582bd2553]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.756338 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df345c636c95498f86f7cdab49561c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.756618 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9647383a4f1b46278348bc25aae2d621" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:26.756810 888 raft_consensus.cc:3037] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.757189 887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4444360e8ade484f958816c5b80dca7e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:26.757670 2968 tablet.cc:1722] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:26.758566 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1936a2b27a1f4fda9ceb295c9c00acf8" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.759429 2757 raft_consensus.cc:482] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.759514 888 raft_consensus.cc:2454] T 9647383a4f1b46278348bc25aae2d621 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:26.759547 2757 raft_consensus.cc:504] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.760082 2757 leader_election.cc:288] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.761940 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42118f181da4fa489a919a9b4c6664b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:26.762511 830 leader_election.cc:341] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.767565 732 tablet_service.cc:1467] Processing CreateTablet for tablet df345c636c95498f86f7cdab49561c8c (DEFAULT_TABLE table=default.Table_81c644a3657343a499b7d5d82fc357a8 [id=ca3871dae98b4bbfadddfbb582bd2553]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.768227 1166 ts_tablet_manager.cc:1918] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.768857 1166 log.cc:1196] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/1d9d4b5a69484176a7b0f4fded010867
I20260620 07:01:26.769367 1166 ts_tablet_manager.cc:1939] T 1d9d4b5a69484176a7b0f4fded010867 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:26.771731 1166 tablet_replica.cc:330] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.771857 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 1d9d4b5a69484176a7b0f4fded010867 (table default.Table_e027fe5ccca8447d86ad610b8cec54f0 [id=a974a44b8ef1483883a25d46c2673d20]) successfully deleted
I20260620 07:01:26.775246 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1147) took 5428 ms. Trace:
I20260620 07:01:26.775453 1169 rpcz_store.cc:276] 0620 07:01:21.346934 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.349862 (+ 2928us) service_pool.cc:227] Handling call
0620 07:01:26.641254 (+5291392us) ts_tablet_manager.cc:1145] Deleting tablet d53c90eff33044479838ff67dea93057
0620 07:01:26.641263 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:26.685873 (+ 44610us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.688496 (+ 2623us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.775182 (+ 86686us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5291243}
I20260620 07:01:26.775946 1169 tablet_replica.cc:330] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:26.776058 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet d53c90eff33044479838ff67dea93057 (table default.Table_7a520f90f9534374822183a6768a4d99 [id=22da0fcad0664913b2d2c6f80e9f1801]) successfully deleted
I20260620 07:01:26.776242 1169 raft_consensus.cc:2229] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.776489 1169 raft_consensus.cc:2258] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.776680 424 catalog_manager.cc:5495] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:26.776924 866 tablet_service.cc:1467] Processing CreateTablet for tablet 04204324b4904b2daf1bd4a49bfa5e5f (DEFAULT_TABLE table=default.Table_d131b37d96464a1c8f8928aba24074e6 [id=c2ef3338af784ac3bb44de53fc431d1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.777073 1169 ts_tablet_manager.cc:1905] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.777172 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 228af95ef5b24823a4a98b876a50d9af (table default.Table_8658418f64d1429a914ad81355f9cdc0 [id=d01569425ba447b59b2349fe24a75acd]). Expected version 2 got 0
I20260620 07:01:26.777344 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04204324b4904b2daf1bd4a49bfa5e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.777336 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 50200e70f4d3492083f6da65f867be31 (table default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]). Expected version 1 got 0
I20260620 07:01:26.777529 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet d9a7fab4d1684604be1b81d4d4bbe560 (table default.Table_e85e7f993b574dd1bf681863cdd76b40 [id=a7902aafbaad4905a6b5b03ad669eeae]). Expected version 4 got 0
I20260620 07:01:26.777667 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:26.777812 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:26.778040 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 52d2a46f972e45f5aeadb09101a68149 (table default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447]). Expected version 2 got 0
I20260620 07:01:26.778190 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:26.778298 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet d42118f181da4fa489a919a9b4c6664b (table default.Table_fad68c6e6cfc4535a522d7ffe529d11a [id=d79fe48235ef4ad4be5ffa8663fe9c12]). Expected version 2 got 0
I20260620 07:01:26.778453 424 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet c8aa75356fb54672a0ada533fc634613 (table default.Table_830d1bf5012e446b871ec75b647e73b5 [id=9872a758911d490c98d27afe035475b2]). Expected version 2 got 0
I20260620 07:01:26.780256 1168 tablet_bootstrap.cc:492] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:26.785060 720 tablet_service.cc:1467] Processing CreateTablet for tablet f45b2718610b49b9bfeda29bcded86ae (DEFAULT_TABLE table=default.Table_f8716b3d4c6b4a0ea6e96829cb10b456 [id=d2aa01768ace476dbf068c1fd22c9828]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.785928 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f45b2718610b49b9bfeda29bcded86ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.790592 426 master_service.cc:946] ReplaceTablet: received request to replace tablet 27570f4ff9bd4da89fa20113467709dd from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:26.793671 1170 tablet_bootstrap.cc:492] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:26.796298 1170 tablet_bootstrap.cc:654] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.803407 1166 raft_consensus.cc:2229] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
W20260620 07:01:26.798770 831 leader_election.cc:341] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.805111 831 leader_election.cc:302] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:26.805466 1166 pending_rounds.cc:62] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:26.805824 1166 pending_rounds.cc:68] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821680023355392 op_type: NO_OP noop_request { }
I20260620 07:01:26.806044 1166 raft_consensus.cc:2866] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:26.806082 420 master_service.cc:946] ReplaceTablet: received request to replace tablet 510c096ae5d348adbb8c9e8be51487c5 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:26.806202 1166 raft_consensus.cc:2258] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.806733 1168 tablet_bootstrap.cc:654] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.807138 1166 ts_tablet_manager.cc:1905] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.809866 2757 raft_consensus.cc:2726] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.810901 1167 tablet_bootstrap.cc:492] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
W20260620 07:01:26.811569 831 leader_election.cc:341] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.811518 1167 ts_tablet_manager.cc:1397] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.137s user 0.014s sys 0.005s
I20260620 07:01:26.811769 831 leader_election.cc:302] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:26.812029 2757 raft_consensus.cc:2726] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:26.798264 683 consensus_peers.cc:487] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a8d48f0f9dd4911876ec8f812688439. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:26.812872 683 consensus_peers.cc:487] T 29b8ce279cfe4684bd296a48e8783e1b P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29b8ce279cfe4684bd296a48e8783e1b. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:26.813033 683 leader_election.cc:341] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: Tablet not RUNNING: STOPPED
W20260620 07:01:26.813313 683 leader_election.cc:341] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c06bf6c4d1af40479c81bd1d85e2848f
I20260620 07:01:26.814097 1167 raft_consensus.cc:348] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.814739 1167 raft_consensus.cc:374] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.814915 1167 raft_consensus.cc:729] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.815263 683 leader_election.cc:302] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:26.815609 2830 raft_consensus.cc:2781] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.815770 2830 raft_consensus.cc:686] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:26.816049 2830 consensus_queue.cc:237] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.815788 1167 consensus_queue.cc:260] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.819079 2757 raft_consensus.cc:482] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.819226 2757 raft_consensus.cc:504] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.819783 2757 leader_election.cc:288] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.820007 875 tablet_service.cc:1467] Processing CreateTablet for tablet df345c636c95498f86f7cdab49561c8c (DEFAULT_TABLE table=default.Table_81c644a3657343a499b7d5d82fc357a8 [id=ca3871dae98b4bbfadddfbb582bd2553]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.820370 1166 ts_tablet_manager.cc:1918] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:26.820422 875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df345c636c95498f86f7cdab49561c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.820474 1166 log.cc:1196] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/af743ffd2eb2427caa3779c7fceb8f30
I20260620 07:01:26.820801 1166 ts_tablet_manager.cc:1939] T af743ffd2eb2427caa3779c7fceb8f30 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:26.821830 1167 ts_tablet_manager.cc:1428] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260620 07:01:26.822216 1168 tablet_bootstrap.cc:492] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:26.823426 1167 tablet_bootstrap.cc:492] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:26.824709 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60ce7d59a97544fda80a54f7124d1dba" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.825974 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet e37f336c01974ba79caeb25f4781667a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.799983 999 tablet_service.cc:1467] Processing CreateTablet for tablet f45b2718610b49b9bfeda29bcded86ae (DEFAULT_TABLE table=default.Table_f8716b3d4c6b4a0ea6e96829cb10b456 [id=d2aa01768ace476dbf068c1fd22c9828]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.773686 968 leader_election.cc:302] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
W20260620 07:01:26.827039 968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 53376.4us
I20260620 07:01:26.827250 968 leader_election.cc:302] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:26.827550 968 leader_election.cc:302] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:26.827598 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f45b2718610b49b9bfeda29bcded86ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.828735 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42118f181da4fa489a919a9b4c6664b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.829270 2875 raft_consensus.cc:2781] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.829353 2875 raft_consensus.cc:482] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.829409 2875 raft_consensus.cc:3037] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.829767 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4444360e8ade484f958816c5b80dca7e" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:26.826391 830 leader_election.cc:341] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.832223 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 757542e0df4e412f8fa63d1bb69f00de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.832109 2875 raft_consensus.cc:504] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.832660 2875 leader_election.cc:288] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:26.832803 2875 raft_consensus.cc:2726] T a96030064de046e5873bdaab6f3dff60 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.833091 2875 raft_consensus.cc:2781] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.833158 2875 raft_consensus.cc:482] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.833166 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df345c636c95498f86f7cdab49561c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.833212 2875 raft_consensus.cc:3037] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:26.833873 969 leader_election.cc:341] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e37f336c01974ba79caeb25f4781667a
I20260620 07:01:26.835939 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5926946427294a5ca6fbc72d3e1b612d" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:26.836141 751 raft_consensus.cc:3037] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.839288 1168 ts_tablet_manager.cc:1397] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.001s
W20260620 07:01:26.839866 681 leader_election.cc:341] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.839717 2830 consensus_queue.cc:1035] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260620 07:01:26.840188 681 leader_election.cc:341] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:26.840444 681 leader_election.cc:341] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:26.840683 681 leader_election.cc:341] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:26.840950 681 leader_election.cc:341] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.841107 751 raft_consensus.cc:2454] T 5926946427294a5ca6fbc72d3e1b612d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
W20260620 07:01:26.841190 681 leader_election.cc:341] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.841399 681 leader_election.cc:302] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
W20260620 07:01:26.841740 681 leader_election.cc:341] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.841825 681 leader_election.cc:302] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
W20260620 07:01:26.842132 681 leader_election.cc:341] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.842577 2741 raft_consensus.cc:2781] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.842653 2741 raft_consensus.cc:482] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.842715 2741 raft_consensus.cc:3037] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.842689 2953 consensus_queue.cc:1035] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:26.843962 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c0bb50405d0446488272384523c2deb" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.844159 754 raft_consensus.cc:2454] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:26.845225 2741 raft_consensus.cc:504] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.845322 2875 raft_consensus.cc:504] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.845794 2741 leader_election.cc:288] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.845945 2741 raft_consensus.cc:2726] T c06bf6c4d1af40479c81bd1d85e2848f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:26.846433 681 leader_election.cc:341] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.846542 681 leader_election.cc:302] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:26.846747 2875 leader_election.cc:288] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:26.846807 969 leader_election.cc:341] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0a4bebaa8ed1431d8c775f4856a3d808
I20260620 07:01:26.847280 1166 tablet_replica.cc:330] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.847482 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet af743ffd2eb2427caa3779c7fceb8f30 (table default.Table_16bc98530ef6482fbf02e2aa78c0ea47 [id=26c4b0db3c984eb8a79d9aa31548a229]) successfully deleted
I20260620 07:01:26.847786 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4bebaa8ed1431d8c775f4856a3d808" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:26.847929 748 raft_consensus.cc:3037] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.847520 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37f336c01974ba79caeb25f4781667a" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:26.848502 754 raft_consensus.cc:2379] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06a32ef63b2b495a9ade1de48c024ae9 in current term 1: Already voted for candidate 2b84cae646b24bc7bd424eb8434ad425 in this term.
I20260620 07:01:26.848982 1166 raft_consensus.cc:2229] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:26.849344 1166 raft_consensus.cc:2258] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.850346 1166 ts_tablet_manager.cc:1905] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.850513 748 raft_consensus.cc:2454] T 0a4bebaa8ed1431d8c775f4856a3d808 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:26.854162 2831 raft_consensus.cc:2726] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:26.855068 681 consensus_peers.cc:487] T 3a8d48f0f9dd4911876ec8f812688439 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.857985 1166 ts_tablet_manager.cc:1918] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:26.858261 1166 log.cc:1196] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/8b8659e903084f15ac3d9ea8c4c0dc0f
W20260620 07:01:26.859613 681 consensus_peers.cc:487] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:26.860232 681 consensus_peers.cc:487] T 1d9d4b5a69484176a7b0f4fded010867 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d9d4b5a69484176a7b0f4fded010867. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:26.867722 681 consensus_peers.cc:487] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.870239 868 tablet_service.cc:1467] Processing CreateTablet for tablet f45b2718610b49b9bfeda29bcded86ae (DEFAULT_TABLE table=default.Table_f8716b3d4c6b4a0ea6e96829cb10b456 [id=d2aa01768ace476dbf068c1fd22c9828]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:26.870744 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f45b2718610b49b9bfeda29bcded86ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:26.878444 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60ce7d59a97544fda80a54f7124d1dba" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:26.862210 1167 tablet_bootstrap.cc:654] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.866865 968 leader_election.cc:302] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
W20260620 07:01:26.867110 969 consensus_peers.cc:487] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08ec769f903c4438bc1186d5fc1c5108. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:26.879498 2875 raft_consensus.cc:2781] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.879653 2875 raft_consensus.cc:686] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:26.879907 2875 consensus_queue.cc:237] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.880421 1166 ts_tablet_manager.cc:1939] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:26.869725 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37f336c01974ba79caeb25f4781667a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:26.881188 1020 raft_consensus.cc:2379] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b84cae646b24bc7bd424eb8434ad425 in current term 1: Already voted for candidate 06a32ef63b2b495a9ade1de48c024ae9 in this term.
I20260620 07:01:26.881597 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 8b8659e903084f15ac3d9ea8c4c0dc0f (table default.Table_5d2a4e7b8377498685861a195b5c2401 [id=91c7f13bfdb84770a1ef410a269a10e0]) successfully deleted
I20260620 07:01:26.881943 1166 tablet_replica.cc:330] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.882114 1166 raft_consensus.cc:2229] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.882270 1166 raft_consensus.cc:2258] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.882937 1166 ts_tablet_manager.cc:1905] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:26.883685 683 consensus_peers.cc:487] T 13c7f0513df34ddb8104b06e5733fb62 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13c7f0513df34ddb8104b06e5733fb62. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:26.884294 831 leader_election.cc:341] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.884414 831 leader_election.cc:302] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:26.884635 2830 consensus_queue.cc:1035] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:26.885267 2830 raft_consensus.cc:482] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.885398 2830 raft_consensus.cc:504] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.886124 2830 leader_election.cc:288] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.886735 968 leader_election.cc:302] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:26.887984 2953 raft_consensus.cc:2781] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:26.888065 2953 raft_consensus.cc:482] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:26.888121 2953 raft_consensus.cc:3037] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.890538 2953 raft_consensus.cc:504] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.891079 2878 raft_consensus.cc:2726] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.890611 968 leader_election.cc:302] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
W20260620 07:01:26.891220 831 leader_election.cc:341] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.891330 831 leader_election.cc:302] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:26.891418 2531 consensus_queue.cc:1035] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:26.891541 2878 raft_consensus.cc:2726] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.891832 2531 raft_consensus.cc:2726] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260620 07:01:26.892957 969 leader_election.cc:341] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 2c0bb50405d0446488272384523c2deb
I20260620 07:01:26.893036 968 leader_election.cc:302] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:26.894672 2950 raft_consensus.cc:2781] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.894832 2950 raft_consensus.cc:686] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:26.894852 2953 leader_election.cc:288] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:26.895114 2950 consensus_queue.cc:237] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.886865 1168 raft_consensus.cc:348] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.898952 1168 raft_consensus.cc:374] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.899312 1168 raft_consensus.cc:729] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.899787 1168 consensus_queue.cc:260] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.901283 1168 ts_tablet_manager.cc:1428] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.062s user 0.002s sys 0.000s
I20260620 07:01:26.901804 2986 tablet.cc:1722] T 2a064674792b42d49e9ff20a7496f820 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:26.903669 1166 ts_tablet_manager.cc:1918] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.907037 1166 log.cc:1196] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/91f8c4955c164e6b9061ac607bbe081c
I20260620 07:01:26.907572 1166 ts_tablet_manager.cc:1939] T 91f8c4955c164e6b9061ac607bbe081c P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:26.908987 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 91f8c4955c164e6b9061ac607bbe081c (table default.Table_95bf37d6a97f41a5ba9d681d07d75283 [id=ceb3d35427694e1099764949625fac6f]) successfully deleted
I20260620 07:01:26.909698 1166 tablet_replica.cc:330] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.910698 1166 raft_consensus.cc:2229] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:26.911666 1166 pending_rounds.cc:62] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:26.911761 1166 pending_rounds.cc:68] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821680725217280 op_type: NO_OP noop_request { }
I20260620 07:01:26.912873 1166 raft_consensus.cc:2866] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:26.913940 1166 raft_consensus.cc:2258] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.914400 1168 tablet_bootstrap.cc:492] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:26.915696 1166 ts_tablet_manager.cc:1905] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.904225 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c0bb50405d0446488272384523c2deb" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:26.916311 754 raft_consensus.cc:3037] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:26.915678 2891 ts_tablet_manager.cc:1918] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.919183 754 raft_consensus.cc:2454] T 2c0bb50405d0446488272384523c2deb P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
W20260620 07:01:26.920825 683 leader_election.cc:341] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: e37f336c01974ba79caeb25f4781667a
I20260620 07:01:26.920948 683 leader_election.cc:302] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:26.921121 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95ba8444d70342f781bd84edefbca71f" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.921403 2821 raft_consensus.cc:2726] T e37f336c01974ba79caeb25f4781667a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.919516 2891 log.cc:1196] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/4444360e8ade484f958816c5b80dca7e
W20260620 07:01:26.921824 683 leader_election.cc:341] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 95ba8444d70342f781bd84edefbca71f
I20260620 07:01:26.928254 1170 tablet_bootstrap.cc:492] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:26.928489 1170 ts_tablet_manager.cc:1397] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.135s user 0.006s sys 0.000s
I20260620 07:01:26.929230 1170 raft_consensus.cc:348] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.929556 1170 raft_consensus.cc:374] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:26.929673 1170 raft_consensus.cc:729] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:26.930023 1170 consensus_queue.cc:260] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:26.932166 681 leader_election.cc:341] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.932390 681 leader_election.cc:302] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:26.932833 2821 raft_consensus.cc:2726] T 95ba8444d70342f781bd84edefbca71f P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:26.932824 1166 ts_tablet_manager.cc:1918] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:26.933444 1169 ts_tablet_manager.cc:1918] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:26.932651 2891 ts_tablet_manager.cc:1939] T 4444360e8ade484f958816c5b80dca7e P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:26.934389 968 leader_election.cc:302] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:26.938189 1166 log.cc:1196] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/0a4bebaa8ed1431d8c775f4856a3d808
I20260620 07:01:26.938769 1166 ts_tablet_manager.cc:1939] T 0a4bebaa8ed1431d8c775f4856a3d808 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:26.944135 2950 raft_consensus.cc:2781] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:26.944276 2950 raft_consensus.cc:686] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:26.944497 2950 consensus_queue.cc:237] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:26.916127 1168 tablet_bootstrap.cc:654] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:26.948089 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 4444360e8ade484f958816c5b80dca7e (table default.Table_411089a06f704215ae2532a11925490c [id=6601ffafdbb94a36a8ac3340fdf24cb3]) successfully deleted
I20260620 07:01:26.953053 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 0a4bebaa8ed1431d8c775f4856a3d808 (table default.Table_ed11da599e5c4b44b63531233e52da80 [id=5129c45c780d450ea02914b5e4c1754f]) successfully deleted
I20260620 07:01:26.951902 2891 tablet_replica.cc:330] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:26.953886 1166 tablet_replica.cc:330] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:26.954538 1166 raft_consensus.cc:2229] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.955147 1166 raft_consensus.cc:2258] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.956393 1166 ts_tablet_manager.cc:1905] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:26.957624 2891 raft_consensus.cc:2229] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:26.959923 2891 raft_consensus.cc:2258] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:26.964560 2878 raft_consensus.cc:482] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:26.964702 2878 raft_consensus.cc:504] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:26.965307 2878 leader_election.cc:288] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.966387 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a043d035b0c84d6290041d1c7c03bc35" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:26.967020 830 leader_election.cc:341] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:26.971339 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1b81bd1cb0e2498a8cec55e7ca761d72
I20260620 07:01:26.972762 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b81bd1cb0e2498a8cec55e7ca761d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.972760 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b81bd1cb0e2498a8cec55e7ca761d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.974495 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_b7c0037f61ba4658be52134884a77e39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.975486 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7c0037f61ba4658be52134884a77e39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:26.977051 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:26.977461 423 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:26.974751 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_02a45919228e4ba1b070bc4490657c31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:26.978854 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02a45919228e4ba1b070bc4490657c31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:26.979482 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54871462333d4249bbd9da7e21035980 consensus state has no leader
I20260620 07:01:26.980342 422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_84dadb1417974806a37c5fc6f5347d2d" } modify_external_catalogs: true
I20260620 07:01:26.980624 422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_84dadb1417974806a37c5fc6f5347d2d" } modify_external_catalogs: true
I20260620 07:01:26.983012 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 9f4cb1dd491c4533809474375c5467b1
I20260620 07:01:26.984145 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f4cb1dd491c4533809474375c5467b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:26.984958 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f4cb1dd491c4533809474375c5467b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.985286 425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_b0a98e7f341240fc9ea439e7b2464285" } new_table_name: "default.Table_0b1ed6f34ac1496e99cb08b23352a349" modify_external_catalogs: true
I20260620 07:01:26.987596 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 27570f4ff9bd4da89fa20113467709dd
I20260620 07:01:26.989223 426 catalog_manager.cc:6565] ReplaceTablet: tablet 27570f4ff9bd4da89fa20113467709dd deleted and replaced by tablet 173bb94c6b264a30a2fdda78d996d52a
I20260620 07:01:26.989806 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 27570f4ff9bd4da89fa20113467709dd with delete_type TABLET_DATA_DELETED (replaced by tablet 173bb94c6b264a30a2fdda78d996d52a) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.989984 426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f1984579a670481b9fbcc82593055fa3" } modify_external_catalogs: true
I20260620 07:01:26.990235 426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_f1984579a670481b9fbcc82593055fa3" } modify_external_catalogs: true
I20260620 07:01:26.991312 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_930aed9ced5a425ab5fd1f3e6a7ee4e2" } new_table_name: "default.Table_2bdf369d46154605988d5cba37d049cf" modify_external_catalogs: true
I20260620 07:01:26.997313 1024 raft_consensus.cc:3037] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.002904 421 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_35a0e30f853640ff94b025abf4fe9d66 [id=bd3649f95ee640eeaeb1d585ac20e4e4] alter complete (version 4)
I20260620 07:01:27.006089 1166 ts_tablet_manager.cc:1918] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.006338 1166 log.cc:1196] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/2bc3dd1306af4e49a9fec197b5740374
I20260620 07:01:27.006939 1166 ts_tablet_manager.cc:1939] T 2bc3dd1306af4e49a9fec197b5740374 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:27.007102 421 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.1:52621 (request call id 130) took 753 ms (client timeout 1000 ms). Trace:
I20260620 07:01:27.008041 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 2bc3dd1306af4e49a9fec197b5740374 (table default.Table_49d850227cc94454b2919e6c54793f35 [id=501af04cab4f4a0da5d8396e8f629397]) successfully deleted
W20260620 07:01:27.007293 421 rpcz_store.cc:269] 0620 07:01:26.253394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.303575 (+ 50181us) service_pool.cc:227] Handling call
0620 07:01:27.007080 (+703505us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:26.727991 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:26.728089 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:26.728097 (+ 8us) write_op.cc:435] Acquired schema lock
0620 07:01:26.728102 (+ 5us) tablet.cc:660] Decoding operations
0620 07:01:26.728195 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:26.728205 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:26.728209 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:26.728270 (+ 61us) tablet.cc:699] Row locks acquired
0620 07:01:26.728272 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:26.728300 (+ 28us) write_op.cc:270] Start()
0620 07:01:26.728340 (+ 40us) write_op.cc:276] Timestamp: P: 1781938886728283 usec, L: 0
0620 07:01:26.728343 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:26.728475 (+ 132us) log.cc:842] Serialized 524 byte log entry
0620 07:01:26.771233 (+ 42758us) op_driver.cc:444] REPLICATION: finished
0620 07:01:26.771902 (+ 669us) write_op.cc:301] APPLY: starting
0620 07:01:26.771912 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:26.771938 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:26.771980 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:26.772028 (+ 48us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:26.772053 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:26.772061 (+ 8us) write_op.cc:312] APPLY: finished
0620 07:01:26.772117 (+ 56us) log.cc:842] Serialized 23 byte log entry
0620 07:01:26.772157 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:26.772168 (+ 11us) write_op.cc:454] Released schema lock
0620 07:01:26.772173 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:26.772220 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:26.772223 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0620 07:01:26.835075 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:26.835203 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:26.835210 (+ 7us) write_op.cc:435] Acquired schema lock
0620 07:01:26.835213 (+ 3us) tablet.cc:660] Decoding operations
0620 07:01:26.835337 (+ 124us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:26.835382 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:26.835388 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:26.835462 (+ 74us) tablet.cc:699] Row locks acquired
0620 07:01:26.835464 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:26.835502 (+ 38us) write_op.cc:270] Start()
0620 07:01:26.835539 (+ 37us) write_op.cc:276] Timestamp: P: 1781938886835473 usec, L: 0
0620 07:01:26.835543 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:26.835751 (+ 208us) log.cc:842] Serialized 356 byte log entry
0620 07:01:27.000937 (+165186us) op_driver.cc:444] REPLICATION: finished
0620 07:01:27.001030 (+ 93us) write_op.cc:301] APPLY: starting
0620 07:01:27.001052 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:27.001099 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:27.001153 (+ 54us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:27.001216 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:27.001256 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:27.001262 (+ 6us) write_op.cc:312] APPLY: finished
0620 07:01:27.001350 (+ 88us) log.cc:842] Serialized 23 byte log entry
0620 07:01:27.001535 (+ 185us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:27.001557 (+ 22us) write_op.cc:454] Released schema lock
0620 07:01:27.001566 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:27.001636 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:27.001641 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":60,"child_traces":[["op",{"apply.queue_time_us":640,"apply.run_cpu_time_us":359,"apply.run_wall_time_us":359,"num_ops":1,"prepare.queue_time_us":365,"prepare.run_cpu_time_us":562,"prepare.run_wall_time_us":562,"raft.queue_time_us":51,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":42874}],["op",{"apply.queue_time_us":34,"apply.run_cpu_time_us":667,"apply.run_wall_time_us":667,"num_ops":1,"prepare.queue_time_us":709,"prepare.run_cpu_time_us":814,"prepare.run_wall_time_us":814,"raft.queue_time_us":579,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":165367}]]}
I20260620 07:01:27.008420 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_39654cee1c26433a94f549acb9787681" } modify_external_catalogs: true
I20260620 07:01:27.008612 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_39654cee1c26433a94f549acb9787681" } modify_external_catalogs: true
I20260620 07:01:27.008919 1166 tablet_replica.cc:330] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.009156 1166 raft_consensus.cc:2229] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:27.010118 1166 pending_rounds.cc:62] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:27.011137 1166 pending_rounds.cc:68] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821675404627968 op_type: NO_OP noop_request { }
I20260620 07:01:27.011730 1166 raft_consensus.cc:2866] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:27.012797 1166 raft_consensus.cc:2258] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.013681 1166 ts_tablet_manager.cc:1905] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.017970 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c0bb50405d0446488272384523c2deb with delete_type TABLET_DATA_DELETED (replaced by tablet 98544574a8cd4a86a443284a421fa030) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:27.018424 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet af743ffd2eb2427caa3779c7fceb8f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:26.933904 1169 log.cc:1196] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/c9d344f9e4b444e4b6018fdf0cf762fd
I20260620 07:01:27.024178 1169 ts_tablet_manager.cc:1939] T c9d344f9e4b444e4b6018fdf0cf762fd P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:27.025117 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1146) took 5678 ms. Trace:
I20260620 07:01:27.025233 1169 rpcz_store.cc:276] 0620 07:01:21.346843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.350041 (+ 3198us) service_pool.cc:227] Handling call
0620 07:01:26.775860 (+5425819us) ts_tablet_manager.cc:1145] Deleting tablet c9d344f9e4b444e4b6018fdf0cf762fd
0620 07:01:26.775876 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:26.780573 (+ 4697us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:26.932979 (+152406us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.025095 (+ 92116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5425711}
I20260620 07:01:27.025689 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1155) took 5453 ms. Trace:
I20260620 07:01:27.025803 1169 rpcz_store.cc:276] 0620 07:01:21.572138 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.572187 (+ 49us) service_pool.cc:227] Handling call
0620 07:01:27.025547 (+5453360us) ts_tablet_manager.cc:1145] Deleting tablet 633f3666050846dc9fc59a365110406d
0620 07:01:27.025559 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.025672 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5453159}
I20260620 07:01:27.026178 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1157) took 5451 ms. Trace:
I20260620 07:01:26.942073 2821 raft_consensus.cc:482] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.026466 2821 raft_consensus.cc:504] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.027215 2821 leader_election.cc:288] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:26.970819 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a043d035b0c84d6290041d1c7c03bc35" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.027485 2968 tablet.cc:1722] T 2a064674792b42d49e9ff20a7496f820 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:26.971316 1170 ts_tablet_manager.cc:1428] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.043s user 0.002s sys 0.000s
I20260620 07:01:27.027992 1170 tablet_bootstrap.cc:492] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:26.988597 720 tablet_service.cc:1514] Processing DeleteTablet for tablet 27570f4ff9bd4da89fa20113467709dd with delete_type TABLET_DATA_DELETED (replaced by tablet 173bb94c6b264a30a2fdda78d996d52a) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.005482 728 tablet_service.cc:1514] Processing DeleteTablet for tablet 294f8a632f9d4191b925d1da605bd80e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.012246 1167 tablet_bootstrap.cc:492] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.005897 722 tablet_service.cc:1514] Processing DeleteTablet for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d02b00437d04192bfd7fb7e7a6b55f3) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.006615 726 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf912f51bfd4df0afe7aa28815a897e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.028914 1167 ts_tablet_manager.cc:1397] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.206s user 0.016s sys 0.008s
I20260620 07:01:27.006659 725 tablet_service.cc:1514] Processing DeleteTablet for tablet c06bf6c4d1af40479c81bd1d85e2848f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.006695 715 tablet_service.cc:1514] Processing DeleteTablet for tablet cf978ab301954866aeb77b7abaf2c77e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.007038 716 tablet_service.cc:1514] Processing DeleteTablet for tablet ee90d961729b4088b0a312ec770d3cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.007382 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 602f6d47f23e4d7f80f372a6a507d095 with delete_type TABLET_DATA_DELETED (replaced by tablet a54ea2c027bb4d4b82fcdb8aa6eb1475) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:26.984395 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f4cb1dd491c4533809474375c5467b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.029599 1170 tablet_bootstrap.cc:654] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:26.977051 681 consensus_peers.cc:487] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:27.030750 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 53819.3us
I20260620 07:01:27.032899 2830 raft_consensus.cc:482] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.033032 2830 raft_consensus.cc:504] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.033664 2830 leader_election.cc:288] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.033600 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a34f01ce5d4d5696248dc88802dafd" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:26.975100 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b81bd1cb0e2498a8cec55e7ca761d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:27.034989 681 leader_election.cc:341] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.035985 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f591ba26b91b47f9a8933878d478655d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:27.035511 2891 ts_tablet_manager.cc:1905] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:27.036507 681 consensus_peers.cc:487] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:27.037370 681 leader_election.cc:341] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.040700 2875 raft_consensus.cc:482] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:27.040695 831 leader_election.cc:341] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.040822 831 leader_election.cc:302] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:27.040845 2875 raft_consensus.cc:504] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.041018 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 27570f4ff9bd4da89fa20113467709dd with delete_type TABLET_DATA_DELETED (replaced by tablet 173bb94c6b264a30a2fdda78d996d52a) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.041531 2875 leader_election.cc:288] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.041913 1167 raft_consensus.cc:348] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.042090 1167 raft_consensus.cc:374] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.042141 1167 raft_consensus.cc:729] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.044467 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e30fb1d050c4439bb72a21a0f2b13eb" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.044685 748 raft_consensus.cc:2454] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:27.045208 968 leader_election.cc:302] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:27.047377 1167 consensus_queue.cc:260] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.047663 2984 tablet.cc:1722] T 2a064674792b42d49e9ff20a7496f820 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:27.047995 1167 ts_tablet_manager.cc:1428] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260620 07:01:27.048261 2950 raft_consensus.cc:2781] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.048352 2950 raft_consensus.cc:482] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.048421 2950 raft_consensus.cc:3037] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.026062 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet c9d344f9e4b444e4b6018fdf0cf762fd (table default.Table_f9c3eac07b6040a280cd24392454206b [id=9010989df9a341b986e65d49b59a5cd0]) successfully deleted
W20260620 07:01:27.056978 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 633f3666050846dc9fc59a365110406d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 633f3666050846dc9fc59a365110406d already in progress: creating tablet
I20260620 07:01:27.058254 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 510c096ae5d348adbb8c9e8be51487c5
W20260620 07:01:27.058272 830 consensus_peers.cc:487] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.058703 420 catalog_manager.cc:6565] ReplaceTablet: tablet 510c096ae5d348adbb8c9e8be51487c5 deleted and replaced by tablet 254ffbdd6f144380b2a5ede367a61e0b
I20260620 07:01:27.060496 2950 raft_consensus.cc:504] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.061131 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 2a064674792b42d49e9ff20a7496f820 (table default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6]). Expected version 2 got 0
I20260620 07:01:27.061424 420 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
W20260620 07:01:27.061950 969 leader_election.cc:341] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0e30fb1d050c4439bb72a21a0f2b13eb
W20260620 07:01:27.062273 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 941d471c9f41437cb79dfc030ef9cf17 consensus state has no leader
I20260620 07:01:27.062918 1167 tablet_bootstrap.cc:492] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.062952 2935 raft_consensus.cc:482] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.063077 2935 raft_consensus.cc:504] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.062634 427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_134cbe70adc84e5192e047ec16322c43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:27.063879 2935 leader_election.cc:288] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:27.064509 427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_134cbe70adc84e5192e047ec16322c43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.064613 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e30fb1d050c4439bb72a21a0f2b13eb with delete_type TABLET_DATA_DELETED (replaced by tablet 9cebdd8c947845528affd32316d9b336) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:27.065395 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_39a2812476a64b64bdff8924d31a88c3" } new_table_name: "default.Table_e06eccff5fb24e1d8add984cbf947f32" modify_external_catalogs: true
I20260620 07:01:27.066918 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 510c096ae5d348adbb8c9e8be51487c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 254ffbdd6f144380b2a5ede367a61e0b) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.068605 1170 tablet_bootstrap.cc:492] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:27.068796 1170 ts_tablet_manager.cc:1397] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.003s
I20260620 07:01:27.069478 1170 raft_consensus.cc:348] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.069936 1170 raft_consensus.cc:374] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.070048 1170 raft_consensus.cc:729] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.070325 1170 consensus_queue.cc:260] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:27.070752 424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.2:45945 (request call id 152) took 768 ms (client timeout 1000 ms). Trace:
I20260620 07:01:27.064630 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0dd59f4c2a4d8580bcefdcc47fd2fa" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:27.071312 681 leader_election.cc:341] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:27.070990 424 rpcz_store.cc:269] 0620 07:01:26.302603 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.330401 (+ 27798us) service_pool.cc:227] Handling call
0620 07:01:26.520805 (+190404us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x615000033024. stack: 00007f2486e7566e 00007f2486e75430 00007f2485efc5ed 00000000008ea064 00000000008ea02d 00007f249558e27d 00007f249558e373 00007f24923b0361 00007f2499d2366a 00007f2499ea5d8f 00007f249119a946 00007f249119a675 00007f248d9b19be 00007f248d9b079e 00007f248d9b6b25 00007f248d9b754f
0620 07:01:27.070730 (+549925us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:26.781107 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:26.781255 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:26.781262 (+ 7us) write_op.cc:435] Acquired schema lock
0620 07:01:26.781264 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:26.781404 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:26.781416 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:26.781420 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:26.781488 (+ 68us) tablet.cc:699] Row locks acquired
0620 07:01:26.781490 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:26.781527 (+ 37us) write_op.cc:270] Start()
0620 07:01:26.781569 (+ 42us) write_op.cc:276] Timestamp: P: 1781938886781503 usec, L: 0
0620 07:01:26.781575 (+ 6us) op_driver.cc:331] REPLICATION: starting
0620 07:01:26.781780 (+ 205us) log.cc:842] Serialized 524 byte log entry
0620 07:01:26.801749 (+ 19969us) op_driver.cc:444] REPLICATION: finished
0620 07:01:26.803065 (+ 1316us) write_op.cc:301] APPLY: starting
0620 07:01:26.803074 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:26.803099 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:26.803142 (+ 43us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:26.803182 (+ 40us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:26.803204 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:26.803210 (+ 6us) write_op.cc:312] APPLY: finished
0620 07:01:26.803257 (+ 47us) log.cc:842] Serialized 23 byte log entry
0620 07:01:26.803292 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:26.803303 (+ 11us) write_op.cc:454] Released schema lock
0620 07:01:26.803307 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:26.803364 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:26.803368 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":36,"spinlock_wait_cycles":362633984,"child_traces":[["op",{"apply.queue_time_us":1282,"apply.run_cpu_time_us":341,"apply.run_wall_time_us":340,"num_ops":1,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":794,"prepare.run_wall_time_us":855,"raft.queue_time_us":36,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":20158,"spinlock_wait_cycles":384}]]}
I20260620 07:01:27.071946 1170 ts_tablet_manager.cc:1428] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 07:01:27.071827 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_12a2a4f37259432d8af8fbc3c5f05001"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:27.070901 422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6c4b81f2b92f4363829034d3fe290742
W20260620 07:01:27.072486 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12a2a4f37259432d8af8fbc3c5f05001 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.073168 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6817cdda2b4448508cc2226285e89f46" } new_table_name: "default.Table_7fa1a7454e724c24ad01c5ce4eb29ff3" modify_external_catalogs: true
I20260620 07:01:27.074069 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c4b81f2b92f4363829034d3fe290742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:27.071827 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_72e1273cb3d6472992740ef38593c8f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.075847 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72e1273cb3d6472992740ef38593c8f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:27.077052 425 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b45d144514134cb6a644087e62c436e3 consensus state has no leader
I20260620 07:01:27.077486 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e56ae00270294044b9b0dd06dcbb1a68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.078135 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e56ae00270294044b9b0dd06dcbb1a68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.079560 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c4b81f2b92f4363829034d3fe290742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.080451 1167 tablet_bootstrap.cc:654] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.080886 426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 6470f04c28964e63ba7296b2fe74d3d3
I20260620 07:01:27.081179 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 510c096ae5d348adbb8c9e8be51487c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 254ffbdd6f144380b2a5ede367a61e0b) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:27.081967 1170 tablet_bootstrap.cc:492] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:27.083390 2950 leader_election.cc:288] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.083549 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 6470f04c28964e63ba7296b2fe74d3d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.084194 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e30fb1d050c4439bb72a21a0f2b13eb" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:27.084314 1170 tablet_bootstrap.cc:654] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.084438 748 raft_consensus.cc:3037] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.084633 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_aedc41a53643402b930f25a17b8f8e6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:27.085220 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 6470f04c28964e63ba7296b2fe74d3d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:27.087563 748 raft_consensus.cc:2454] T 0e30fb1d050c4439bb72a21a0f2b13eb P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
W20260620 07:01:27.087864 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aedc41a53643402b930f25a17b8f8e6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.087994 968 leader_election.cc:302] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.088255 2950 raft_consensus.cc:2781] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.089155 2950 raft_consensus.cc:686] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
W20260620 07:01:27.089905 969 leader_election.cc:341] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 0e30fb1d050c4439bb72a21a0f2b13eb
I20260620 07:01:27.089641 2950 consensus_queue.cc:237] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.091300 2878 raft_consensus.cc:482] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.091439 2878 raft_consensus.cc:504] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.091986 2878 leader_election.cc:288] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.092686 2891 ts_tablet_manager.cc:1918] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:27.092787 2891 log.cc:1196] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/b17bbf2f844b4c01ad5d6dc36e096ee5
I20260620 07:01:27.093058 2891 ts_tablet_manager.cc:1939] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:27.092499 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574371fb6915427687df660e733407df" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:27.094394 830 leader_election.cc:341] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.095621 2830 raft_consensus.cc:482] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.095781 2830 raft_consensus.cc:504] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.096578 2830 leader_election.cc:288] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.026278 1169 rpcz_store.cc:276] 0620 07:01:21.574628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.574675 (+ 47us) service_pool.cc:227] Handling call
0620 07:01:27.026060 (+5451385us) ts_tablet_manager.cc:1145] Deleting tablet b53304f072cb4a00a17de5df6f59168b
0620 07:01:27.026071 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.026161 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5451115}
I20260620 07:01:27.098296 1169 tablet_replica.cc:330] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:27.098501 1169 raft_consensus.cc:2229] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:27.098765 1169 raft_consensus.cc:2258] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.099359 1169 ts_tablet_manager.cc:1905] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:27.099612 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b53304f072cb4a00a17de5df6f59168b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b53304f072cb4a00a17de5df6f59168b already in progress: creating tablet
I20260620 07:01:27.103349 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d08b4b09221d46b09dd97c0b7ef9b71d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:27.104957 681 leader_election.cc:341] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:27.105464 831 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:34639, user_credentials={real_user=slave}} blocked reactor thread for 64762.6us
I20260620 07:01:27.105993 2878 raft_consensus.cc:2726] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:27.106369 888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0dd59f4c2a4d8580bcefdcc47fd2fa" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:27.106547 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f591ba26b91b47f9a8933878d478655d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:27.107052 891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d08b4b09221d46b09dd97c0b7ef9b71d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:27.106739 889 raft_consensus.cc:2454] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:27.106563 888 raft_consensus.cc:2454] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:27.107997 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d48f0f9dd4911876ec8f812688439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.108222 1170 tablet_bootstrap.cc:492] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:27.108282 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c4b81f2b92f4363829034d3fe290742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.108397 1170 ts_tablet_manager.cc:1397] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.000s
I20260620 07:01:27.108366 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 6470f04c28964e63ba7296b2fe74d3d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:26 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.108983 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 510c096ae5d348adbb8c9e8be51487c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 254ffbdd6f144380b2a5ede367a61e0b) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.109138 866 tablet_service.cc:1514] Processing DeleteTablet for tablet 95ba8444d70342f781bd84edefbca71f with delete_type TABLET_DATA_DELETED (replaced by tablet 5db563ce7027457fa0185ef94f3c05b5) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.109089 1170 raft_consensus.cc:348] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.109289 1170 raft_consensus.cc:374] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.109341 1170 raft_consensus.cc:729] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.109344 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b8ce279cfe4684bd296a48e8783e1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:11 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.109529 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa with delete_type TABLET_DATA_DELETED (replaced by tablet 0833926b10164039b5a374969d53bc9e) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.109544 1170 consensus_queue.cc:260] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.109815 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c9d2d029434f37ba23d65f6662893b with delete_type TABLET_DATA_DELETED (replaced by tablet 8aa5c040d5e84006935e9f06424a34b4) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.110042 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 09886cbd967549118d3b1ba116f7834f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.110204 864 tablet_service.cc:1514] Processing DeleteTablet for tablet 4444360e8ade484f958816c5b80dca7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.110257 1170 ts_tablet_manager.cc:1428] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:27.110314 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.110425 859 tablet_service.cc:1514] Processing DeleteTablet for tablet ee90d961729b4088b0a312ec770d3cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.110529 1170 tablet_bootstrap.cc:492] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:27.110574 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 60ce7d59a97544fda80a54f7124d1dba with delete_type TABLET_DATA_DELETED (replaced by tablet bcdb23f67ac2402b9471748d98b8dae9) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.110751 870 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c7f0513df34ddb8104b06e5733fb62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:09 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.111060 876 tablet_service.cc:1514] Processing DeleteTablet for tablet cf978ab301954866aeb77b7abaf2c77e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:13 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:27.111682 683 leader_election.cc:341] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 00a34f01ce5d4d5696248dc88802dafd
I20260620 07:01:27.111780 683 leader_election.cc:302] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:27.112227 1166 ts_tablet_manager.cc:1918] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.112262 1170 tablet_bootstrap.cc:654] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:27.112236 683 leader_election.cc:341] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.112339 1166 log.cc:1196] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/4260b0c953c14a198dbf9b64a30e7e05
I20260620 07:01:27.112349 683 leader_election.cc:302] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:27.112968 683 leader_election.cc:302] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.113013 2830 raft_consensus.cc:2726] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:27.113341 683 leader_election.cc:302] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.114413 2935 raft_consensus.cc:2781] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.114511 2935 raft_consensus.cc:482] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.114593 2935 raft_consensus.cc:3037] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.114926 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574371fb6915427687df660e733407df" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.114971 2830 raft_consensus.cc:2781] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.115303 2830 raft_consensus.cc:482] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.115392 2830 raft_consensus.cc:3037] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.115501 749 raft_consensus.cc:2454] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:27.116878 1168 tablet_bootstrap.cc:492] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.117002 1168 ts_tablet_manager.cc:1397] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.203s user 0.003s sys 0.000s
I20260620 07:01:27.117245 2935 raft_consensus.cc:504] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.117671 1168 raft_consensus.cc:348] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.117820 2935 leader_election.cc:288] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.117879 1168 raft_consensus.cc:374] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.117933 1168 raft_consensus.cc:729] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.117898 2830 raft_consensus.cc:504] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.118152 1168 consensus_queue.cc:260] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.112363 2821 raft_consensus.cc:2726] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 07:01:27.118779 1168 ts_tablet_manager.cc:1428] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:27.119089 2830 leader_election.cc:288] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.119858 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0dd59f4c2a4d8580bcefdcc47fd2fa" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:27.120252 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f591ba26b91b47f9a8933878d478655d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:27.120471 681 leader_election.cc:341] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.120632 887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0dd59f4c2a4d8580bcefdcc47fd2fa" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:27.120798 887 raft_consensus.cc:3037] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:27.120793 681 leader_election.cc:341] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.121402 1166 ts_tablet_manager.cc:1939] T 4260b0c953c14a198dbf9b64a30e7e05 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:27.101855 423 catalog_manager.cc:5495] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:27.122257 2878 consensus_queue.cc:1035] T 228af95ef5b24823a4a98b876a50d9af P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:27.121987 423 catalog_manager.cc:5495] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:27.122556 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet d9a7fab4d1684604be1b81d4d4bbe560 (table default.Table_e85e7f993b574dd1bf681863cdd76b40 [id=a7902aafbaad4905a6b5b03ad669eeae]). Expected version 4 got 0
I20260620 07:01:27.122669 831 leader_election.cc:302] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.123028 423 catalog_manager.cc:5495] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:27.123327 2878 raft_consensus.cc:2781] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.123406 2878 raft_consensus.cc:482] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.123457 2878 raft_consensus.cc:3037] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.123816 423 catalog_manager.cc:5495] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:27.125974 2878 raft_consensus.cc:504] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.126226 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 4260b0c953c14a198dbf9b64a30e7e05 (table default.Table_d66e26edeccc4a138950de609d6c107f [id=dbe2ab45243b4aeca16c961149135563]) successfully deleted
I20260620 07:01:27.126554 1166 tablet_replica.cc:330] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.126757 1166 raft_consensus.cc:2229] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:27.127120 1166 raft_consensus.cc:2258] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.128533 1166 ts_tablet_manager.cc:1905] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.129105 887 raft_consensus.cc:2454] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:27.129333 2878 leader_election.cc:288] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:27.129694 683 consensus_peers.cc:487] T fbf912f51bfd4df0afe7aa28815a897e P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbf912f51bfd4df0afe7aa28815a897e. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.132721 683 leader_election.cc:302] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.133010 2831 raft_consensus.cc:2781] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.133121 2831 raft_consensus.cc:686] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:27.133333 2831 consensus_queue.cc:237] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.133482 1167 tablet_bootstrap.cc:492] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.133673 1167 ts_tablet_manager.cc:1397] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.000s
I20260620 07:01:27.134644 1167 raft_consensus.cc:348] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.135421 1167 raft_consensus.cc:374] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.135547 1167 raft_consensus.cc:729] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.135804 1167 consensus_queue.cc:260] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.136273 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574371fb6915427687df660e733407df" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:27.136457 754 raft_consensus.cc:3037] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.136824 1167 ts_tablet_manager.cc:1428] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:27.138041 1167 tablet_bootstrap.cc:492] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.139894 754 raft_consensus.cc:2454] T 574371fb6915427687df660e733407df P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
I20260620 07:01:27.141067 831 leader_election.cc:302] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:27.141317 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7a44aedbe24c4d9798663bfe3e1e5342
I20260620 07:01:27.142629 2878 raft_consensus.cc:2781] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.142774 2878 raft_consensus.cc:686] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:27.143097 2878 consensus_queue.cc:237] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.143227 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a44aedbe24c4d9798663bfe3e1e5342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:27.143361 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a44aedbe24c4d9798663bfe3e1e5342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:27.144279 969 consensus_peers.cc:487] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 877a71e8db5f4bf689df39f83735f326. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.144598 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a44aedbe24c4d9798663bfe3e1e5342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.146093 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574371fb6915427687df660e733407df" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:27.147337 1167 tablet_bootstrap.cc:654] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:27.147349 830 leader_election.cc:341] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.148814 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f591ba26b91b47f9a8933878d478655d" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:27.149921 895 raft_consensus.cc:3037] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.157438 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet b17bbf2f844b4c01ad5d6dc36e096ee5 (table default.Table_8d053cfb76e143659a645e3f8eaba768 [id=6f8cad1f8c064ec880389a6c890171dc]) successfully deleted
I20260620 07:01:27.155442 895 raft_consensus.cc:2454] T f591ba26b91b47f9a8933878d478655d P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:27.155776 1168 tablet_bootstrap.cc:492] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:27.157212 2891 tablet_replica.cc:330] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:27.165750 2891 raft_consensus.cc:2229] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:27.166065 2891 raft_consensus.cc:2258] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.166652 2891 ts_tablet_manager.cc:1905] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.167238 683 leader_election.cc:302] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.167693 2830 raft_consensus.cc:2781] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.167971 2830 raft_consensus.cc:686] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:27.168381 2830 consensus_queue.cc:237] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.171345 1168 tablet_bootstrap.cc:654] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.171782 1166 ts_tablet_manager.cc:1918] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.171912 1166 log.cc:1196] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/08ec769f903c4438bc1186d5fc1c5108
I20260620 07:01:27.172273 1166 ts_tablet_manager.cc:1939] T 08ec769f903c4438bc1186d5fc1c5108 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:27.175937 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 08ec769f903c4438bc1186d5fc1c5108 (table default.Table_6265551265c24c08b658f79709b7887d [id=654e042eb7604d72a01475f1d80bb47c]) successfully deleted
I20260620 07:01:27.179260 1167 tablet_bootstrap.cc:492] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.179543 1167 ts_tablet_manager.cc:1397] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.000s
I20260620 07:01:27.180315 1167 raft_consensus.cc:348] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.180629 1167 raft_consensus.cc:374] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.180787 1167 raft_consensus.cc:729] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.181242 1167 consensus_queue.cc:260] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.185267 1167 ts_tablet_manager.cc:1428] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 07:01:27.186146 1167 tablet_bootstrap.cc:492] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.188143 1167 tablet_bootstrap.cc:654] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.186517 1166 tablet_replica.cc:330] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.192901 1166 raft_consensus.cc:2229] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:27.193295 1166 raft_consensus.cc:2258] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.194360 1166 ts_tablet_manager.cc:1905] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.207814 1167 tablet_bootstrap.cc:492] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.208133 1167 ts_tablet_manager.cc:1397] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260620 07:01:27.208984 1167 raft_consensus.cc:348] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.209182 1170 tablet_bootstrap.cc:492] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:27.208985 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 50200e70f4d3492083f6da65f867be31 (table default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]). Expected version 1 got 0
I20260620 07:01:27.209327 1167 raft_consensus.cc:374] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.209545 1167 raft_consensus.cc:729] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.209833 1167 consensus_queue.cc:260] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.210307 1170 ts_tablet_manager.cc:1397] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.100s user 0.011s sys 0.006s
I20260620 07:01:27.211731 1167 ts_tablet_manager.cc:1428] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:27.212888 1167 tablet_bootstrap.cc:492] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.213235 423 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet c8aa75356fb54672a0ada533fc634613 (table default.Table_830d1bf5012e446b871ec75b647e73b5 [id=9872a758911d490c98d27afe035475b2]). Expected version 2 got 0
I20260620 07:01:27.214814 1167 tablet_bootstrap.cc:654] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.215006 1168 tablet_bootstrap.cc:492] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.215204 1168 ts_tablet_manager.cc:1397] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.060s user 0.008s sys 0.000s
I20260620 07:01:27.215854 1166 ts_tablet_manager.cc:1918] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.216089 1168 raft_consensus.cc:348] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.216423 1168 raft_consensus.cc:374] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.216535 1168 raft_consensus.cc:729] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.216759 1166 log.cc:1196] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/125e8a5e20bf484cade408f0358489a1
I20260620 07:01:27.216835 1168 consensus_queue.cc:260] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.217221 1166 ts_tablet_manager.cc:1939] T 125e8a5e20bf484cade408f0358489a1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:27.217514 1168 ts_tablet_manager.cc:1428] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:27.217104 1170 raft_consensus.cc:348] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.218300 1170 raft_consensus.cc:374] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.218688 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 125e8a5e20bf484cade408f0358489a1 (table default.Table_072aff5d28cf4c61bbecd2cadb3e58c3 [id=bb41cdc85465446193c33f0722351f6a]) successfully deleted
I20260620 07:01:27.218694 1170 raft_consensus.cc:729] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.219496 1166 tablet_replica.cc:330] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.219709 1166 raft_consensus.cc:2229] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:27.219792 2821 raft_consensus.cc:482] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.219973 1166 pending_rounds.cc:62] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:27.220016 1166 pending_rounds.cc:68] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821677930344448 op_type: NO_OP noop_request { }
I20260620 07:01:27.219901 2821 raft_consensus.cc:504] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.220119 1166 raft_consensus.cc:2866] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:27.220196 1166 raft_consensus.cc:2258] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.220558 2821 leader_election.cc:288] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.221279 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a043d035b0c84d6290041d1c7c03bc35" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:27.221474 895 raft_consensus.cc:2454] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:27.222136 683 leader_election.cc:302] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:27.221750 1170 consensus_queue.cc:260] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.222803 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a043d035b0c84d6290041d1c7c03bc35" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:27.222929 2935 raft_consensus.cc:2781] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.223006 2935 raft_consensus.cc:482] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.223065 2935 raft_consensus.cc:3037] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:27.223366 681 leader_election.cc:341] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.223932 1166 ts_tablet_manager.cc:1905] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.225886 2935 raft_consensus.cc:504] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.226935 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a043d035b0c84d6290041d1c7c03bc35" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:27.227078 2935 leader_election.cc:288] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.227201 895 raft_consensus.cc:3037] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.228799 1170 ts_tablet_manager.cc:1428] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.017s user 0.002s sys 0.001s
I20260620 07:01:27.230159 1167 tablet_bootstrap.cc:492] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.230085 1170 tablet_bootstrap.cc:492] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:27.230263 895 raft_consensus.cc:2454] T a043d035b0c84d6290041d1c7c03bc35 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:27.230422 1167 ts_tablet_manager.cc:1397] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260620 07:01:27.231235 1167 raft_consensus.cc:348] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.231436 683 leader_election.cc:302] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters:
I20260620 07:01:27.231444 1167 raft_consensus.cc:374] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.231546 1167 raft_consensus.cc:729] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.231774 1167 consensus_queue.cc:260] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.231982 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a043d035b0c84d6290041d1c7c03bc35" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:27.232245 1168 tablet_bootstrap.cc:492] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:27.233515 1167 ts_tablet_manager.cc:1428] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260620 07:01:27.233868 681 leader_election.cc:341] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.234375 2935 raft_consensus.cc:2781] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.234474 1167 tablet_bootstrap.cc:492] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.234503 2935 raft_consensus.cc:686] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:27.234704 2935 consensus_queue.cc:237] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.237196 1170 tablet_bootstrap.cc:654] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.240586 1167 tablet_bootstrap.cc:654] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.242627 2950 raft_consensus.cc:482] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.242856 2950 raft_consensus.cc:504] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.243579 2950 leader_election.cc:288] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.244554 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ad723586ff545049dad658221e6455b" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:27.247521 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ad723586ff545049dad658221e6455b" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.248100 968 leader_election.cc:302] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:27.248477 2950 raft_consensus.cc:2726] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:27.248468 1170 tablet_bootstrap.cc:492] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:27.249043 1170 ts_tablet_manager.cc:1397] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.006s
I20260620 07:01:27.250928 1166 ts_tablet_manager.cc:1918] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.253147 1170 raft_consensus.cc:348] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.254093 1166 log.cc:1196] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/877a71e8db5f4bf689df39f83735f326
I20260620 07:01:27.254300 1170 raft_consensus.cc:374] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.255366 1170 raft_consensus.cc:729] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.256858 1166 ts_tablet_manager.cc:1939] T 877a71e8db5f4bf689df39f83735f326 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:27.259176 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 877a71e8db5f4bf689df39f83735f326 (table default.Table_890aba75c15e4e5990b4c0cae43dd28e [id=a302748f0b1e46209ebe7622280629a5]) successfully deleted
I20260620 07:01:27.264520 1166 tablet_replica.cc:330] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.264909 1166 raft_consensus.cc:2229] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:27.266185 1168 tablet_bootstrap.cc:654] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.266934 2878 raft_consensus.cc:482] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.267063 2878 raft_consensus.cc:504] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.267654 2878 leader_election.cc:288] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.273371 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e3bac62777904f028c5af42ef8b750cc" } modify_external_catalogs: true
I20260620 07:01:27.273592 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_e3bac62777904f028c5af42ef8b750cc" } modify_external_catalogs: true
I20260620 07:01:27.275876 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9b375ba8ab3542caac374b6b3b8c6505"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.276588 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b375ba8ab3542caac374b6b3b8c6505 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.278146 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_317c0eeefaf14d2691a3729bcdb80093"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:27.268224 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40e1ea4d1c74be2906381064c73f8c5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:27.279127 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2de8ddbab4c6462999b074d9b375b3f6 consensus state has no leader
W20260620 07:01:27.279285 830 leader_election.cc:341] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.279551 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_de6c16eb4d8e49f59c88af00c2d27547" } new_table_name: "default.Table_e9ff997a58604cb891d260339cec422e" modify_external_catalogs: true
I20260620 07:01:27.281023 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ba2e85fd379f4437946d4bb6af649094" } modify_external_catalogs: true
I20260620 07:01:27.281277 1166 pending_rounds.cc:62] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:27.281175 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_ba2e85fd379f4437946d4bb6af649094" } modify_external_catalogs: true
I20260620 07:01:27.281351 1166 pending_rounds.cc:68] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821680662839296 op_type: NO_OP noop_request { }
I20260620 07:01:27.281471 1166 raft_consensus.cc:2866] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:27.281562 1166 raft_consensus.cc:2258] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.282406 1166 ts_tablet_manager.cc:1905] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.283241 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_5688641172744bbaa96ac9337b399dd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.283972 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5688641172744bbaa96ac9337b399dd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.287096 1168 tablet_bootstrap.cc:492] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.287266 1168 ts_tablet_manager.cc:1397] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.000s
I20260620 07:01:27.287906 1168 raft_consensus.cc:348] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.288232 1168 raft_consensus.cc:374] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.288350 1168 raft_consensus.cc:729] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.288589 1168 consensus_queue.cc:260] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.289215 1168 ts_tablet_manager.cc:1428] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:27.289866 1168 tablet_bootstrap.cc:492] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:27.291247 1168 tablet_bootstrap.cc:654] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.295257 2950 raft_consensus.cc:482] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.295441 2950 raft_consensus.cc:504] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.296031 2950 leader_election.cc:288] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:27.296442 412 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2de8ddbab4c6462999b074d9b375b3f6 (table default.Table_7fa1a7454e724c24ad01c5ce4eb29ff3 [id=24bd02bfb1b5486a8cc6b4272c74d2e9], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2de8ddbab4c6462999b074d9b375b3f6 consensus state has no leader
I20260620 07:01:27.296696 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fa3702db6004ecba6fff98c09623fe0" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
W20260620 07:01:27.299425 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_317c0eeefaf14d2691a3729bcdb80093 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.301888 1166 ts_tablet_manager.cc:1918] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.302057 1166 log.cc:1196] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/5926946427294a5ca6fbc72d3e1b612d
I20260620 07:01:27.302490 1166 ts_tablet_manager.cc:1939] T 5926946427294a5ca6fbc72d3e1b612d P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:27.303593 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 5926946427294a5ca6fbc72d3e1b612d (table default.Table_0948b3a7b876431dafb498c00e40cc2e [id=fe4914615d844910998e00900b81fe05]) successfully deleted
I20260620 07:01:27.303759 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_c41bac2c663c4696912c8121d03cfbb3" } new_table_name: "default.Table_20460c78c50b4194927debf91aeef3e9" modify_external_catalogs: true
W20260620 07:01:27.304318 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 87b65473790e4c199ca49152a679ece7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87b65473790e4c199ca49152a679ece7 already in progress: creating tablet
W20260620 07:01:27.304890 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 30ea95affc1a4657afd13a01e2cc304d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30ea95affc1a4657afd13a01e2cc304d already in progress: creating tablet
W20260620 07:01:27.308611 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 47365e10ce274af891055b34e2f0a2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47365e10ce274af891055b34e2f0a2bd already in progress: creating tablet
W20260620 07:01:27.309206 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 55f7ae7d91484d6c99faf7a0d837b546 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55f7ae7d91484d6c99faf7a0d837b546 already in progress: creating tablet
I20260620 07:01:27.309507 1166 tablet_replica.cc:330] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.309736 1166 raft_consensus.cc:2229] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:27.309952 1166 raft_consensus.cc:2258] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.311079 1166 ts_tablet_manager.cc:1905] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.317162 1166 ts_tablet_manager.cc:1918] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260620 07:01:27.318706 1024 raft_consensus.cc:3037] T 9ad723586ff545049dad658221e6455b P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.327744 2891 ts_tablet_manager.cc:1918] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.327886 2891 log.cc:1196] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/f0e6ef65b5f44f6d9f2100dd404b2e5f
I20260620 07:01:27.328274 2891 ts_tablet_manager.cc:1939] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:27.332919 1166 log.cc:1196] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/58a4f3b5450948768c8db382d200cc19
I20260620 07:01:27.334012 1166 ts_tablet_manager.cc:1939] T 58a4f3b5450948768c8db382d200cc19 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
W20260620 07:01:27.334757 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 791b70bb1e364c4ebba9b85d400fc146 consensus state has no leader
I20260620 07:01:27.335341 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet d1bdd04f565d45e6848717ed18d92996
I20260620 07:01:27.335912 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 58a4f3b5450948768c8db382d200cc19 (table default.Table_cd9d406b4ab84e899550e53fce092e5f [id=3852c2f12adc4283b184a70b473d3260]) successfully deleted
I20260620 07:01:27.336447 999 tablet_service.cc:1514] Processing DeleteTablet for tablet d1bdd04f565d45e6848717ed18d92996 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:27.336678 876 tablet_service.cc:1514] Processing DeleteTablet for tablet d1bdd04f565d45e6848717ed18d92996 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.337047 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 81ec9c7688dc4f5a80e2a5ea3bd68633
I20260620 07:01:27.338137 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.338129 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:27.338441 1166 tablet_replica.cc:330] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.338959 1166 raft_consensus.cc:2229] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:27.341903 1166 raft_consensus.cc:2258] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.342965 1166 ts_tablet_manager.cc:1905] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.343576 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_cd9ed1b6b58f4fd3aaca36647171dcce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.344322 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd9ed1b6b58f4fd3aaca36647171dcce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.344563 2878 raft_consensus.cc:482] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.344720 2878 raft_consensus.cc:504] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.345357 2878 leader_election.cc:288] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.345963 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d08b4b09221d46b09dd97c0b7ef9b71d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:27.346110 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7156ae6b8b524116ae5517637382e5ee" } new_table_name: "default.Table_5ebc12db0ccb47108108a4bd3998a4b0" modify_external_catalogs: true
W20260620 07:01:27.346541 830 leader_election.cc:341] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.347301 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_60f539bde5ea41c1925bcdd1f45f4e80" } modify_external_catalogs: true
I20260620 07:01:27.347532 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_60f539bde5ea41c1925bcdd1f45f4e80" } modify_external_catalogs: true
I20260620 07:01:27.349318 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f89578c82dcb4b56bf397d90a0585ce6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.350344 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f89578c82dcb4b56bf397d90a0585ce6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.351094 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3fe199dbdfb246a58b0bf5839c4ef15c" } modify_external_catalogs: true
I20260620 07:01:27.351298 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3fe199dbdfb246a58b0bf5839c4ef15c" } modify_external_catalogs: true
I20260620 07:01:27.352349 2878 raft_consensus.cc:482] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.352509 2878 raft_consensus.cc:504] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.353072 427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9e3ed63a3519442893a8e57bbe75d01c" } modify_external_catalogs: true
I20260620 07:01:27.353175 2878 leader_election.cc:288] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.353216 427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_9e3ed63a3519442893a8e57bbe75d01c" } modify_external_catalogs: true
I20260620 07:01:27.353837 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f5004b6e28431db1a2b9d1e8c0cfcf" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:27.354396 830 leader_election.cc:341] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.361363 1166 ts_tablet_manager.cc:1918] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260620 07:01:27.370963 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ff10ed196984f1b8b1295a17f49f420 consensus state has no leader
I20260620 07:01:27.374897 1166 log.cc:1196] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/e37f336c01974ba79caeb25f4781667a
I20260620 07:01:27.375459 1166 ts_tablet_manager.cc:1939] T e37f336c01974ba79caeb25f4781667a P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:27.376685 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet e37f336c01974ba79caeb25f4781667a (table default.Table_fa5e48ba0ba24f30a0212db6021bc618 [id=faf33298650347f1860fd8982c8a242a]) successfully deleted
I20260620 07:01:27.377606 1167 tablet_bootstrap.cc:492] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.377736 1167 ts_tablet_manager.cc:1397] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.143s user 0.005s sys 0.000s
I20260620 07:01:27.378443 1167 raft_consensus.cc:348] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.378666 1167 raft_consensus.cc:374] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.378718 1167 raft_consensus.cc:729] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.378979 1167 consensus_queue.cc:260] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.379539 1167 ts_tablet_manager.cc:1428] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:27.379791 1167 tablet_bootstrap.cc:492] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.381006 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1293) took 1042 ms. Trace:
I20260620 07:01:27.381109 2891 rpcz_store.cc:276] 0620 07:01:26.335183 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.336599 (+ 1416us) service_pool.cc:227] Handling call
0620 07:01:27.157174 (+820575us) ts_tablet_manager.cc:1145] Deleting tablet f0e6ef65b5f44f6d9f2100dd404b2e5f
0620 07:01:27.157182 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.266506 (+109324us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.327626 (+ 61120us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.377964 (+ 50338us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":820443}
I20260620 07:01:27.381381 1167 tablet_bootstrap.cc:654] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.381526 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet f0e6ef65b5f44f6d9f2100dd404b2e5f (table default.Table_bb633c146e9743d092c50bf2e1aeb423 [id=5a6f00263fcb44be91e7cfadb7702509]) successfully deleted
I20260620 07:01:27.382633 2891 tablet_replica.cc:330] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:27.384200 2891 raft_consensus.cc:2229] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:27.390969 1167 tablet_bootstrap.cc:492] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.391149 1167 ts_tablet_manager.cc:1397] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.001s
I20260620 07:01:27.392751 1024 raft_consensus.cc:3037] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.396461 1167 raft_consensus.cc:348] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.396780 1167 raft_consensus.cc:374] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260620 07:01:27.396750 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 1b81bd1cb0e2498a8cec55e7ca761d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b81bd1cb0e2498a8cec55e7ca761d72 already in progress: creating tablet
I20260620 07:01:27.396920 1167 raft_consensus.cc:729] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.397212 1167 consensus_queue.cc:260] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.397418 2891 raft_consensus.cc:2258] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.397848 1167 ts_tablet_manager.cc:1428] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260620 07:01:27.398137 1167 tablet_bootstrap.cc:492] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:27.399132 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 9f4cb1dd491c4533809474375c5467b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f4cb1dd491c4533809474375c5467b1 already in progress: creating tablet
I20260620 07:01:27.399537 2891 ts_tablet_manager.cc:1905] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:27.400064 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 27570f4ff9bd4da89fa20113467709dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27570f4ff9bd4da89fa20113467709dd already in progress: creating tablet
I20260620 07:01:27.400465 1166 tablet_replica.cc:330] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.400735 1166 raft_consensus.cc:2229] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:27.400926 1167 tablet_bootstrap.cc:654] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.401104 1166 pending_rounds.cc:62] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:27.401224 1166 pending_rounds.cc:68] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821680926957568 op_type: NO_OP noop_request { }
I20260620 07:01:27.401456 1166 raft_consensus.cc:2866] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:27.401611 1166 raft_consensus.cc:2258] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.402438 1166 ts_tablet_manager.cc:1905] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.271297 1169 ts_tablet_manager.cc:1918] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.402724 1169 log.cc:1196] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/2bc3dd1306af4e49a9fec197b5740374
I20260620 07:01:27.403162 1169 ts_tablet_manager.cc:1939] T 2bc3dd1306af4e49a9fec197b5740374 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:27.403944 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1158) took 5813 ms. Trace:
I20260620 07:01:27.404063 1169 rpcz_store.cc:276] 0620 07:01:21.590146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.590201 (+ 55us) service_pool.cc:227] Handling call
0620 07:01:27.098244 (+5508043us) ts_tablet_manager.cc:1145] Deleting tablet 2bc3dd1306af4e49a9fec197b5740374
0620 07:01:27.098258 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.203755 (+105497us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.271170 (+ 67415us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.403921 (+132751us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5507779}
I20260620 07:01:27.404475 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1159) took 5621 ms. Trace:
I20260620 07:01:27.404563 1169 rpcz_store.cc:276] 0620 07:01:21.783289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.783339 (+ 50us) service_pool.cc:227] Handling call
0620 07:01:27.404340 (+5621001us) ts_tablet_manager.cc:1145] Deleting tablet b99781ba1ed44f6895af7da082618616
0620 07:01:27.404351 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.404454 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5620798}
I20260620 07:01:27.404795 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 2bc3dd1306af4e49a9fec197b5740374 (table default.Table_49d850227cc94454b2919e6c54793f35 [id=501af04cab4f4a0da5d8396e8f629397]) successfully deleted
I20260620 07:01:27.289567 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40e1ea4d1c74be2906381064c73f8c5" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:27.289705 683 consensus_peers.cc:487] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b17bbf2f844b4c01ad5d6dc36e096ee5. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:27.405154 683 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.2:39311, user_credentials={real_user=slave}} blocked reactor thread for 115484us
I20260620 07:01:27.404896 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1160) took 5621 ms. Trace:
I20260620 07:01:27.297433 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fa3702db6004ecba6fff98c09623fe0" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.405288 1169 rpcz_store.cc:276] 0620 07:01:21.783401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.783575 (+ 174us) service_pool.cc:227] Handling call
0620 07:01:27.404793 (+5621218us) ts_tablet_manager.cc:1145] Deleting tablet 14bbd042527e4f55aec6fbd996b132aa
0620 07:01:27.404802 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.404881 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5621079}
I20260620 07:01:27.342476 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.405594 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1162) took 5611 ms. Trace:
I20260620 07:01:27.342622 732 tablet_service.cc:1514] Processing DeleteTablet for tablet d1bdd04f565d45e6848717ed18d92996 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:27.383579 681 consensus_peers.cc:487] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.405668 1169 rpcz_store.cc:276] 0620 07:01:21.793847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.793895 (+ 48us) service_pool.cc:227] Handling call
0620 07:01:27.405507 (+5611612us) ts_tablet_manager.cc:1145] Deleting tablet f83dc03de5ad407b85daff91e19ff012
0620 07:01:27.405519 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.405581 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5611427}
I20260620 07:01:27.406268 1169 tablet_replica.cc:330] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:27.406179 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f5004b6e28431db1a2b9d1e8c0cfcf" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.406488 1169 raft_consensus.cc:2229] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:27.406647 1169 raft_consensus.cc:2258] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.406651 968 leader_election.cc:302] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:27.406179 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d08b4b09221d46b09dd97c0b7ef9b71d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.406900 748 raft_consensus.cc:2454] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 0.
I20260620 07:01:27.407181 1169 ts_tablet_manager.cc:1905] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:27.407423 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b99781ba1ed44f6895af7da082618616 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b99781ba1ed44f6895af7da082618616 already in progress: creating tablet
W20260620 07:01:27.407642 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 14bbd042527e4f55aec6fbd996b132aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14bbd042527e4f55aec6fbd996b132aa already in progress: creating tablet
W20260620 07:01:27.407877 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet f83dc03de5ad407b85daff91e19ff012 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f83dc03de5ad407b85daff91e19ff012 already in progress: creating tablet
I20260620 07:01:27.408133 1170 consensus_queue.cc:260] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:27.407042 831 leader_election.cc:341] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.409580 831 leader_election.cc:302] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:27.409837 2878 raft_consensus.cc:2726] T b40e1ea4d1c74be2906381064c73f8c5 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:27.410089 2878 consensus_queue.cc:1035] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:27.410204 831 leader_election.cc:341] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.410298 831 leader_election.cc:302] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:27.410615 2878 raft_consensus.cc:2726] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:27.410643 831 leader_election.cc:302] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.412210 2757 raft_consensus.cc:2781] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.412283 2757 raft_consensus.cc:482] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.412338 2757 raft_consensus.cc:3037] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.413311 1169 ts_tablet_manager.cc:1918] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.7
I20260620 07:01:27.413414 1169 log.cc:1196] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/ad65565caddf4e878292d1178fbf6037
I20260620 07:01:27.413710 1169 ts_tablet_manager.cc:1939] T ad65565caddf4e878292d1178fbf6037 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:27.414192 2950 raft_consensus.cc:2726] T 0fa3702db6004ecba6fff98c09623fe0 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:27.414433 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1163) took 5619 ms. Trace:
I20260620 07:01:27.414451 2950 raft_consensus.cc:482] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.414516 1169 rpcz_store.cc:276] 0620 07:01:21.794826 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:21.794870 (+ 44us) service_pool.cc:227] Handling call
0620 07:01:27.406226 (+5611356us) ts_tablet_manager.cc:1145] Deleting tablet ad65565caddf4e878292d1178fbf6037
0620 07:01:27.406238 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.410241 (+ 4003us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.413216 (+ 2975us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.414412 (+ 1196us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5611193}
I20260620 07:01:27.414569 2950 raft_consensus.cc:504] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.415902 2950 leader_election.cc:288] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:27.416757 969 leader_election.cc:341] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4128a4e9a228456cb5cd08eef2bf73d4
I20260620 07:01:27.418479 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4128a4e9a228456cb5cd08eef2bf73d4" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.418773 751 raft_consensus.cc:2454] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:27.419008 2757 raft_consensus.cc:504] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.420207 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d08b4b09221d46b09dd97c0b7ef9b71d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:27.420537 2757 leader_election.cc:288] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.420842 968 leader_election.cc:302] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
W20260620 07:01:27.420892 830 leader_election.cc:341] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.421377 2950 raft_consensus.cc:2781] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.421468 2950 raft_consensus.cc:482] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.421527 2950 raft_consensus.cc:3037] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:27.422111 683 consensus_peers.cc:487] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91f8c4955c164e6b9061ac607bbe081c. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.422634 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d08b4b09221d46b09dd97c0b7ef9b71d" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:27.422814 748 raft_consensus.cc:3037] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.424661 2950 raft_consensus.cc:504] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.425472 748 raft_consensus.cc:2454] T d08b4b09221d46b09dd97c0b7ef9b71d P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978f112862c64141b1009856bef3d624 in term 1.
W20260620 07:01:27.426426 969 leader_election.cc:341] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 4128a4e9a228456cb5cd08eef2bf73d4
I20260620 07:01:27.426470 831 leader_election.cc:302] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.426993 2830 raft_consensus.cc:482] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.427130 2830 raft_consensus.cc:504] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.427242 2992 raft_consensus.cc:2781] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.427357 2992 raft_consensus.cc:686] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [term 1 LEADER]: Becoming Leader. State: Replica: 978f112862c64141b1009856bef3d624, State: Running, Role: LEADER
I20260620 07:01:27.427646 2830 leader_election.cc:288] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:27.427668 681 consensus_peers.cc:487] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.427619 2992 consensus_queue.cc:237] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.428231 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42118f181da4fa489a919a9b4c6664b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:27.429005 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet ad65565caddf4e878292d1178fbf6037 (table default.Table_5f9fe9ba01454a26b0b7344560204fbe [id=be57b2e7e64a4f669ef82569004d523e]) successfully deleted
W20260620 07:01:27.429741 681 leader_election.cc:341] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.430020 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4128a4e9a228456cb5cd08eef2bf73d4" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:27.430222 751 raft_consensus.cc:3037] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.430198 887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42118f181da4fa489a919a9b4c6664b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:27.430434 887 raft_consensus.cc:2454] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:27.431504 683 leader_election.cc:302] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.432551 2830 raft_consensus.cc:2781] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.432659 2830 raft_consensus.cc:482] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.432729 2830 raft_consensus.cc:3037] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:27.436260 830 consensus_peers.cc:487] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.436558 2950 leader_election.cc:288] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.437471 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 51d13068f0864e7f90eaa2021e3972b4 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:27.439277 681 consensus_peers.cc:487] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91f8c4955c164e6b9061ac607bbe081c. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.439734 751 raft_consensus.cc:2454] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:27.440207 968 leader_election.cc:302] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.440660 2950 raft_consensus.cc:2781] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.441395 2950 raft_consensus.cc:686] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:27.441855 2950 consensus_queue.cc:237] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.442591 2830 raft_consensus.cc:504] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.443439 2830 leader_election.cc:288] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.443893 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42118f181da4fa489a919a9b4c6664b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:27.444625 681 leader_election.cc:341] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.444937 887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42118f181da4fa489a919a9b4c6664b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:27.445138 887 raft_consensus.cc:3037] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.448251 887 raft_consensus.cc:2454] T d42118f181da4fa489a919a9b4c6664b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:27.449013 2952 raft_consensus.cc:482] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.449150 2952 raft_consensus.cc:504] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.449666 2952 leader_election.cc:288] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:27.450317 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88c01c4e10f345fc84e3e253e8501aff" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
W20260620 07:01:27.450404 969 leader_election.cc:341] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 88c01c4e10f345fc84e3e253e8501aff
I20260620 07:01:27.450626 751 raft_consensus.cc:2454] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:27.451192 968 leader_election.cc:302] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.451548 2952 raft_consensus.cc:2781] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.451610 2952 raft_consensus.cc:482] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.451663 2952 raft_consensus.cc:3037] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.452400 683 leader_election.cc:302] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.453172 2831 raft_consensus.cc:2781] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.453297 2831 raft_consensus.cc:686] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:27.453527 2831 consensus_queue.cc:237] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.454278 2952 raft_consensus.cc:504] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.455538 2952 leader_election.cc:288] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 978f112862c64141b1009856bef3d624 (127.0.97.2:39311)
I20260620 07:01:27.455952 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88c01c4e10f345fc84e3e253e8501aff" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:27.456175 751 raft_consensus.cc:3037] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.459452 751 raft_consensus.cc:2454] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
W20260620 07:01:27.459515 969 leader_election.cc:341] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 88c01c4e10f345fc84e3e253e8501aff
I20260620 07:01:27.459996 968 leader_election.cc:302] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.460569 2952 raft_consensus.cc:2781] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.461397 2952 raft_consensus.cc:686] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:27.461915 2952 consensus_queue.cc:237] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.469004 1170 ts_tablet_manager.cc:1428] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.219s user 0.000s sys 0.003s
W20260620 07:01:27.477418 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0ca4bb86788c4ba1ac48ca5a57a3a85d consensus state has no leader
I20260620 07:01:27.477541 2831 raft_consensus.cc:482] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.477672 2831 raft_consensus.cc:504] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.478087 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet fee01a1c6af94713bce1d74ac3d86482
I20260620 07:01:27.478199 2831 leader_election.cc:288] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.479008 999 tablet_service.cc:1514] Processing DeleteTablet for tablet fee01a1c6af94713bce1d74ac3d86482 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:27.479245 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet f403d4fd5edf41e99369cbf3997bcca1
I20260620 07:01:27.479869 999 tablet_service.cc:1514] Processing DeleteTablet for tablet f403d4fd5edf41e99369cbf3997bcca1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:27.480677 681 leader_election.cc:341] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Not found: Tablet not found: 485ce059be9b4900adb1dbc3268efb55
I20260620 07:01:27.481967 732 tablet_service.cc:1514] Processing DeleteTablet for tablet fee01a1c6af94713bce1d74ac3d86482 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.482811 732 tablet_service.cc:1514] Processing DeleteTablet for tablet f403d4fd5edf41e99369cbf3997bcca1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:27.484026 876 tablet_service.cc:1514] Processing DeleteTablet for tablet fee01a1c6af94713bce1d74ac3d86482 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:27.484558 876 tablet_service.cc:1514] Processing DeleteTablet for tablet f403d4fd5edf41e99369cbf3997bcca1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:27.484916 683 leader_election.cc:341] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 485ce059be9b4900adb1dbc3268efb55
I20260620 07:01:27.485081 683 leader_election.cc:302] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 978f112862c64141b1009856bef3d624
I20260620 07:01:27.485531 2741 raft_consensus.cc:2726] T 485ce059be9b4900adb1dbc3268efb55 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:27.488859 1170 tablet_bootstrap.cc:492] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:27.490643 1170 tablet_bootstrap.cc:654] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.501772 1166 ts_tablet_manager.cc:1918] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.501938 1166 log.cc:1196] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/2c0bb50405d0446488272384523c2deb
I20260620 07:01:27.502293 1167 tablet_bootstrap.cc:492] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.502422 1166 ts_tablet_manager.cc:1939] T 2c0bb50405d0446488272384523c2deb P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:27.502477 1167 ts_tablet_manager.cc:1397] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.104s user 0.005s sys 0.029s
I20260620 07:01:27.502621 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_0c124f33917343158da9a97ee4db0037"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:27.503386 1167 raft_consensus.cc:348] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.503644 1167 raft_consensus.cc:374] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.503729 1167 raft_consensus.cc:729] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
W20260620 07:01:27.503861 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c124f33917343158da9a97ee4db0037 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.504048 1167 consensus_queue.cc:260] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.504652 1167 ts_tablet_manager.cc:1428] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:27.505082 1167 tablet_bootstrap.cc:492] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.506898 1167 tablet_bootstrap.cc:654] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.508991 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_89e0f1c6fa62420b9cbe029db38773a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.509895 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89e0f1c6fa62420b9cbe029db38773a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.510754 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 2c0bb50405d0446488272384523c2deb (table default.Table_429cabf4e04f4125b89d28e55eca678b [id=f31a91ff5fe241a1832414544e7a1e4f]) successfully deleted
W20260620 07:01:27.511555 412 catalog_manager.cc:4808] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet af743ffd2eb2427caa3779c7fceb8f30 because the tablet was not found. No further retry: Not found: Tablet not found: af743ffd2eb2427caa3779c7fceb8f30
I20260620 07:01:27.511624 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_3afdf58081b24bb3b6aa051008f4efdc" } new_table_name: "default.Table_83859d2f5d954a00ab1fa95d4bf74474" modify_external_catalogs: true
I20260620 07:01:27.512102 1166 tablet_replica.cc:330] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.512403 1166 raft_consensus.cc:2229] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:27.512733 1166 pending_rounds.cc:62] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:27.513075 1166 pending_rounds.cc:68] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821681525116928 op_type: NO_OP noop_request { }
I20260620 07:01:27.513291 1166 raft_consensus.cc:2866] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:27.513127 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_74258787ad6041b8925b763f00a6df09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:27.513566 1166 raft_consensus.cc:2258] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 07:01:27.513707 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74258787ad6041b8925b763f00a6df09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.515405 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_72fa239fcaae4b759d6da2afd5c2fa70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.515899 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72fa239fcaae4b759d6da2afd5c2fa70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.517776 1166 ts_tablet_manager.cc:1905] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.520398 1167 tablet_bootstrap.cc:492] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.520571 1167 ts_tablet_manager.cc:1397] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.003s
I20260620 07:01:27.521626 1167 raft_consensus.cc:348] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.521847 1167 raft_consensus.cc:374] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.522079 1167 raft_consensus.cc:729] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.522331 1167 consensus_queue.cc:260] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.522879 1167 ts_tablet_manager.cc:1428] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260620 07:01:27.523187 1167 tablet_bootstrap.cc:492] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.524886 1167 tablet_bootstrap.cc:654] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.534027 1168 tablet_bootstrap.cc:492] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.534279 1168 ts_tablet_manager.cc:1397] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.244s user 0.025s sys 0.005s
I20260620 07:01:27.535521 1166 ts_tablet_manager.cc:1918] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.535109 1168 raft_consensus.cc:348] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.536360 1168 raft_consensus.cc:374] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.536502 1168 raft_consensus.cc:729] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.536787 1168 consensus_queue.cc:260] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.537478 1168 ts_tablet_manager.cc:1428] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 07:01:27.538056 1168 tablet_bootstrap.cc:492] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:27.539767 1168 tablet_bootstrap.cc:654] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
W20260620 07:01:27.493997 681 consensus_peers.cc:487] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:27.539930 681 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 45985.6us
I20260620 07:01:27.540915 2831 raft_consensus.cc:482] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.541047 2831 raft_consensus.cc:504] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.541651 2831 leader_election.cc:288] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.542398 1166 log.cc:1196] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/0e30fb1d050c4439bb72a21a0f2b13eb
I20260620 07:01:27.543531 1166 ts_tablet_manager.cc:1939] T 0e30fb1d050c4439bb72a21a0f2b13eb P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:27.544039 1167 tablet_bootstrap.cc:492] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.544180 1167 ts_tablet_manager.cc:1397] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.001s
I20260620 07:01:27.537109 2830 consensus_queue.cc:1035] T 3b45cb0153184218ae4f706a898d0657 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:27.544685 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "494a2bc5b3b843c6b29f019974fa0a92" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:27.545321 681 leader_election.cc:341] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.546320 887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "494a2bc5b3b843c6b29f019974fa0a92" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:27.546533 887 raft_consensus.cc:2454] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:27.547407 1167 raft_consensus.cc:348] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.547597 1167 raft_consensus.cc:374] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.547639 1167 raft_consensus.cc:729] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.547834 1167 consensus_queue.cc:260] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.548473 1167 ts_tablet_manager.cc:1428] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:27.549047 1167 tablet_bootstrap.cc:492] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.550696 683 leader_election.cc:302] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.551353 2821 raft_consensus.cc:2781] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.551440 2821 raft_consensus.cc:482] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.551472 1167 tablet_bootstrap.cc:654] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.551496 2821 raft_consensus.cc:3037] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.552244 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 0e30fb1d050c4439bb72a21a0f2b13eb (table default.Table_debb21e4366f4317ae8f74130390b8d3 [id=37e74ef650534d1c90d6669ca2b43d19]) successfully deleted
I20260620 07:01:27.552582 1166 tablet_replica.cc:330] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:27.552747 1166 raft_consensus.cc:2229] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:27.552912 1166 raft_consensus.cc:2258] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.553707 1168 tablet_bootstrap.cc:492] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.553825 1168 ts_tablet_manager.cc:1397] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.006s
I20260620 07:01:27.554157 2821 raft_consensus.cc:504] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.554522 1168 raft_consensus.cc:348] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.554709 1168 raft_consensus.cc:374] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.554766 1168 raft_consensus.cc:729] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.555296 1168 consensus_queue.cc:260] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.555783 1166 ts_tablet_manager.cc:1905] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.556315 1168 ts_tablet_manager.cc:1428] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:27.556386 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "494a2bc5b3b843c6b29f019974fa0a92" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:27.556740 1168 tablet_bootstrap.cc:492] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:27.557545 681 leader_election.cc:341] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.557796 2821 leader_election.cc:288] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.558557 1168 tablet_bootstrap.cc:654] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.566323 1168 tablet_bootstrap.cc:492] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.566481 1168 ts_tablet_manager.cc:1397] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260620 07:01:27.567337 1168 raft_consensus.cc:348] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.567546 1168 raft_consensus.cc:374] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.567595 1168 raft_consensus.cc:729] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.567754 1168 consensus_queue.cc:260] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.568989 1168 ts_tablet_manager.cc:1428] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 07:01:27.569836 1168 tablet_bootstrap.cc:492] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:27.571377 1168 tablet_bootstrap.cc:654] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.572031 2950 raft_consensus.cc:482] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.572173 2950 raft_consensus.cc:504] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.572778 2950 leader_election.cc:288] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:27.573421 969 leader_election.cc:341] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 00a34f01ce5d4d5696248dc88802dafd
I20260620 07:01:27.573426 2821 consensus_queue.cc:1035] T 09886cbd967549118d3b1ba116f7834f P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:27.573909 1166 ts_tablet_manager.cc:1918] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:27.575661 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a34f01ce5d4d5696248dc88802dafd" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.575991 748 raft_consensus.cc:2379] T 00a34f01ce5d4d5696248dc88802dafd P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06a32ef63b2b495a9ade1de48c024ae9 in current term 1: Already voted for candidate 978f112862c64141b1009856bef3d624 in this term.
I20260620 07:01:27.576460 968 leader_election.cc:302] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:27.576901 2950 raft_consensus.cc:3037] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.577315 887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "494a2bc5b3b843c6b29f019974fa0a92" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:27.577535 887 raft_consensus.cc:3037] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.579772 1167 tablet_bootstrap.cc:492] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.579919 1167 ts_tablet_manager.cc:1397] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.001s
I20260620 07:01:27.580231 887 raft_consensus.cc:2454] T 494a2bc5b3b843c6b29f019974fa0a92 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:27.580552 2950 raft_consensus.cc:2726] T 00a34f01ce5d4d5696248dc88802dafd P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:27.580785 1166 log.cc:1196] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/6c4b81f2b92f4363829034d3fe290742
I20260620 07:01:27.580739 1167 raft_consensus.cc:348] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.580971 1167 raft_consensus.cc:374] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.581036 1167 raft_consensus.cc:729] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.581454 1166 ts_tablet_manager.cc:1939] T 6c4b81f2b92f4363829034d3fe290742 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:27.581297 1167 consensus_queue.cc:260] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.582166 1167 ts_tablet_manager.cc:1428] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:27.582465 1167 tablet_bootstrap.cc:492] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.584570 1167 tablet_bootstrap.cc:654] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.586968 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 6c4b81f2b92f4363829034d3fe290742 (table default.Table_84dadb1417974806a37c5fc6f5347d2d [id=6fcbcf995f28481ea31b3a41340a978b]) successfully deleted
W20260620 07:01:27.587986 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 510c096ae5d348adbb8c9e8be51487c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 510c096ae5d348adbb8c9e8be51487c5 already in progress: creating tablet
W20260620 07:01:27.588768 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 6470f04c28964e63ba7296b2fe74d3d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6470f04c28964e63ba7296b2fe74d3d3 already in progress: creating tablet
W20260620 07:01:27.589589 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 7a44aedbe24c4d9798663bfe3e1e5342 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a44aedbe24c4d9798663bfe3e1e5342 already in progress: creating tablet
W20260620 07:01:27.591336 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet d1bdd04f565d45e6848717ed18d92996 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1bdd04f565d45e6848717ed18d92996 already in progress: creating tablet
W20260620 07:01:27.592051 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 81ec9c7688dc4f5a80e2a5ea3bd68633 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81ec9c7688dc4f5a80e2a5ea3bd68633 already in progress: creating tablet
W20260620 07:01:27.592733 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet fee01a1c6af94713bce1d74ac3d86482 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fee01a1c6af94713bce1d74ac3d86482 already in progress: creating tablet
W20260620 07:01:27.593818 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet f403d4fd5edf41e99369cbf3997bcca1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f403d4fd5edf41e99369cbf3997bcca1 already in progress: creating tablet
W20260620 07:01:27.618602 2809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 07:01:27.619807 2809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 07:01:27.619954 2809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260620 07:01:27.620059 1168 tablet_bootstrap.cc:492] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.620189 1168 ts_tablet_manager.cc:1397] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.003s
I20260620 07:01:27.620939 1168 raft_consensus.cc:348] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.621140 1168 raft_consensus.cc:374] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.621186 1168 raft_consensus.cc:729] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.621382 1168 consensus_queue.cc:260] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.621922 1168 ts_tablet_manager.cc:1428] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:27.622270 1168 tablet_bootstrap.cc:492] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:27.624578 1168 tablet_bootstrap.cc:654] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.632490 1168 tablet_bootstrap.cc:492] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.634335 1168 ts_tablet_manager.cc:1397] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260620 07:01:27.635622 1168 raft_consensus.cc:348] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.635922 1168 raft_consensus.cc:374] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.636025 1168 raft_consensus.cc:729] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
W20260620 07:01:27.636399 2809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 07:01:27.636562 2809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260620 07:01:27.636298 1168 consensus_queue.cc:260] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:27.636659 2809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 07:01:27.636760 2809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 07:01:27.638242 1168 ts_tablet_manager.cc:1428] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 07:01:27.639281 1168 tablet_bootstrap.cc:492] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624: Bootstrap starting.
W20260620 07:01:27.641746 681 consensus_peers.cc:487] T b17bbf2f844b4c01ad5d6dc36e096ee5 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.641945 1168 tablet_bootstrap.cc:654] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.649446 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_31daa578625b4b91b8e4c8cc5601310a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.650305 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31daa578625b4b91b8e4c8cc5601310a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.651714 683 leader_election.cc:302] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:27.652261 2830 raft_consensus.cc:2781] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.652470 2830 raft_consensus.cc:686] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:27.652741 2830 consensus_queue.cc:237] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.657294 2809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:36007,127.0.97.61:33455,127.0.97.60:46775
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:46775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=44063
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 06:01:36 UTC on ccycloud.quasar-ouulox.root.comops.site
build id 4457022
ASAN enabled
I20260620 07:01:27.658028 1168 tablet_bootstrap.cc:492] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.658362 1168 ts_tablet_manager.cc:1397] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.006s
I20260620 07:01:27.659600 2809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 07:01:27.659648 1168 raft_consensus.cc:348] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.660404 1168 raft_consensus.cc:374] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.660540 1168 raft_consensus.cc:729] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.660845 1168 consensus_queue.cc:260] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.662627 1167 tablet_bootstrap.cc:492] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.662820 1167 ts_tablet_manager.cc:1397] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.080s user 0.013s sys 0.025s
I20260620 07:01:27.662966 2809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 07:01:27.663033 1168 ts_tablet_manager.cc:1428] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 07:01:27.663805 1167 raft_consensus.cc:348] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.664173 1167 raft_consensus.cc:374] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.664252 1167 raft_consensus.cc:729] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.664547 1168 tablet_bootstrap.cc:492] T 9b42347720fd49d8a2d0a3425cc6f185 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:27.664610 1167 consensus_queue.cc:260] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.664930 2891 ts_tablet_manager.cc:1918] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:27.667734 1167 ts_tablet_manager.cc:1428] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:27.668067 1167 tablet_bootstrap.cc:492] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.669399 1167 tablet_bootstrap.cc:654] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.682726 1167 tablet_bootstrap.cc:492] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.682912 1167 ts_tablet_manager.cc:1397] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20260620 07:01:27.683575 1167 raft_consensus.cc:348] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.683789 1167 raft_consensus.cc:374] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.683840 1167 raft_consensus.cc:729] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.684093 1167 consensus_queue.cc:260] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.685139 1167 ts_tablet_manager.cc:1428] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:27.685390 1167 tablet_bootstrap.cc:492] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.687347 1167 tablet_bootstrap.cc:654] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.697727 1167 tablet_bootstrap.cc:492] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.697877 1167 ts_tablet_manager.cc:1397] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260620 07:01:27.698601 1167 raft_consensus.cc:348] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.698843 1167 raft_consensus.cc:374] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.698901 1167 raft_consensus.cc:729] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.699241 1167 consensus_queue.cc:260] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.700527 1167 ts_tablet_manager.cc:1428] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 07:01:27.701269 1167 tablet_bootstrap.cc:492] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.704064 1167 tablet_bootstrap.cc:654] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.719956 1167 tablet_bootstrap.cc:492] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.720142 1167 ts_tablet_manager.cc:1397] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.005s
I20260620 07:01:27.720831 1167 raft_consensus.cc:348] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.721148 1167 raft_consensus.cc:374] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.721221 1167 raft_consensus.cc:729] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.721469 1167 consensus_queue.cc:260] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.722504 1167 ts_tablet_manager.cc:1428] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:27.722761 1167 tablet_bootstrap.cc:492] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.727326 1167 tablet_bootstrap.cc:654] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.741683 1167 tablet_bootstrap.cc:492] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:27.741863 1167 ts_tablet_manager.cc:1397] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.000s
I20260620 07:01:27.742856 1167 raft_consensus.cc:348] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.743134 1167 raft_consensus.cc:374] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.743184 1167 raft_consensus.cc:729] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.743425 1167 consensus_queue.cc:260] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.743934 1167 ts_tablet_manager.cc:1428] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 07:01:27.744230 1167 tablet_bootstrap.cc:492] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:27.746096 1167 tablet_bootstrap.cc:654] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.749337 3056 tablet.cc:1722] T dac4a1434751433488eb2913b1ddfd23 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:27.751027 1020 raft_consensus.cc:3037] T c8aa75356fb54672a0ada533fc634613 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.762701 2741 raft_consensus.cc:482] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.763131 2741 raft_consensus.cc:504] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.765077 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777a6b981b7f43a4ba8978ba6f3971e1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:27.765409 1032 raft_consensus.cc:2454] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:27.766278 681 leader_election.cc:302] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:27.766999 2821 raft_consensus.cc:2781] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.767241 2821 raft_consensus.cc:482] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.768003 2950 raft_consensus.cc:482] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.768092 2821 raft_consensus.cc:3037] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.768186 2950 raft_consensus.cc:504] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.768628 2952 raft_consensus.cc:482] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.768733 2952 raft_consensus.cc:504] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.768903 2950 leader_election.cc:288] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.769207 2952 leader_election.cc:288] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:27.770112 969 leader_election.cc:341] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 816218c726a9473e9849b7a97c820678
I20260620 07:01:27.770206 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c7b3977b604cb69df671318fae1212" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.770484 751 raft_consensus.cc:2454] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
W20260620 07:01:27.770540 969 leader_election.cc:341] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a6c7b3977b604cb69df671318fae1212
I20260620 07:01:27.771325 968 leader_election.cc:302] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.771646 2952 raft_consensus.cc:2781] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.771719 2952 raft_consensus.cc:482] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.771776 2952 raft_consensus.cc:3037] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.773839 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "816218c726a9473e9849b7a97c820678" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.774353 748 raft_consensus.cc:2454] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:27.774835 2952 raft_consensus.cc:504] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.775306 968 leader_election.cc:302] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.775454 2952 leader_election.cc:288] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.775754 2950 raft_consensus.cc:2781] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.775846 2950 raft_consensus.cc:482] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.775942 2950 raft_consensus.cc:3037] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:27.777298 969 leader_election.cc:341] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a6c7b3977b604cb69df671318fae1212
I20260620 07:01:27.779938 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c7b3977b604cb69df671318fae1212" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:27.780232 751 raft_consensus.cc:3037] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.785614 2950 raft_consensus.cc:504] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:27.788254 969 leader_election.cc:341] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 816218c726a9473e9849b7a97c820678
I20260620 07:01:27.787506 2950 leader_election.cc:288] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.791589 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "816218c726a9473e9849b7a97c820678" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:27.792383 754 raft_consensus.cc:3037] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.797112 754 raft_consensus.cc:2454] T 816218c726a9473e9849b7a97c820678 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:27.798259 968 leader_election.cc:302] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.798985 2952 raft_consensus.cc:2781] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.799117 2952 raft_consensus.cc:686] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:27.799345 751 raft_consensus.cc:2454] T a6c7b3977b604cb69df671318fae1212 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:27.799337 2952 consensus_queue.cc:237] T 816218c726a9473e9849b7a97c820678 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.800061 968 leader_election.cc:302] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.800454 2531 raft_consensus.cc:2781] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.800555 2531 raft_consensus.cc:686] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:27.800730 2531 consensus_queue.cc:237] T a6c7b3977b604cb69df671318fae1212 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.817448 2831 consensus_queue.cc:1035] T d9a7fab4d1684604be1b81d4d4bbe560 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:27.818701 2831 consensus_queue.cc:1035] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:27.834108 1170 tablet_bootstrap.cc:492] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:27.834616 1170 ts_tablet_manager.cc:1397] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.365s user 0.001s sys 0.004s
I20260620 07:01:27.844194 2821 raft_consensus.cc:504] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.853380 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d19cb15909754e9ea35d90bcdd7f1209" } new_table_name: "default.Table_1657a1ce04d44f2b890cecce68d58772" modify_external_catalogs: true
I20260620 07:01:27.855885 422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6f137eb5fc0241e0911941c9b92797f6" } new_table_name: "default.Table_7adbfce4902441e69333bdf53f138856" modify_external_catalogs: true
I20260620 07:01:27.860618 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1432787a22fe4263ab159019091759df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:27.861450 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1432787a22fe4263ab159019091759df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:27.864342 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_be4d9d9276824bb4885ee335ba4e86da" } modify_external_catalogs: true
I20260620 07:01:27.864751 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_be4d9d9276824bb4885ee335ba4e86da" } modify_external_catalogs: true
I20260620 07:01:27.875765 2741 leader_election.cc:288] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:27.877982 681 consensus_peers.cc:487] T 50200e70f4d3492083f6da65f867be31 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.882861 3053 tablet.cc:1722] T dac4a1434751433488eb2913b1ddfd23 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:27.888346 2952 raft_consensus.cc:482] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.888511 2952 raft_consensus.cc:504] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.889056 2952 leader_election.cc:288] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:27.889935 969 leader_election.cc:341] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 113dd3d57c144088ae7204dc5229f883
I20260620 07:01:27.890537 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "113dd3d57c144088ae7204dc5229f883" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.890914 748 raft_consensus.cc:2454] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:27.891525 968 leader_election.cc:302] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.891815 2952 raft_consensus.cc:2781] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.891911 2952 raft_consensus.cc:482] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.891996 2952 raft_consensus.cc:3037] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.895458 2952 raft_consensus.cc:504] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:27.895988 683 leader_election.cc:341] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 777a6b981b7f43a4ba8978ba6f3971e1
I20260620 07:01:27.896314 2952 leader_election.cc:288] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:27.896970 969 leader_election.cc:341] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 113dd3d57c144088ae7204dc5229f883
I20260620 07:01:27.897636 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "113dd3d57c144088ae7204dc5229f883" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:27.897853 751 raft_consensus.cc:3037] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.901070 2952 raft_consensus.cc:482] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.901228 2952 raft_consensus.cc:504] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
I20260620 07:01:27.901823 2952 leader_election.cc:288] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.901799 751 raft_consensus.cc:2454] T 113dd3d57c144088ae7204dc5229f883 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
W20260620 07:01:27.904816 969 leader_election.cc:341] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c73bcb81a0c84cdfb4dea0561647828a
I20260620 07:01:27.905949 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73bcb81a0c84cdfb4dea0561647828a" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.906265 751 raft_consensus.cc:2454] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:27.906703 968 leader_election.cc:302] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.907297 2952 raft_consensus.cc:2781] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.907420 2952 raft_consensus.cc:686] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:27.907437 968 leader_election.cc:302] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.907709 2950 raft_consensus.cc:2781] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:27.907806 2950 raft_consensus.cc:482] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:27.907869 2950 raft_consensus.cc:3037] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.907707 2952 consensus_queue.cc:237] T 113dd3d57c144088ae7204dc5229f883 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.910825 2950 raft_consensus.cc:504] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
W20260620 07:01:27.912484 969 leader_election.cc:341] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: c73bcb81a0c84cdfb4dea0561647828a
I20260620 07:01:27.912817 2950 leader_election.cc:288] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.667232 1168 tablet_bootstrap.cc:654] T 9b42347720fd49d8a2d0a3425cc6f185 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.913605 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73bcb81a0c84cdfb4dea0561647828a" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:27.913770 2891 log.cc:1196] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/602f6d47f23e4d7f80f372a6a507d095
I20260620 07:01:27.913810 751 raft_consensus.cc:3037] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.914206 2891 ts_tablet_manager.cc:1939] T 602f6d47f23e4d7f80f372a6a507d095 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:27.709838 2757 raft_consensus.cc:482] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.914719 2757 raft_consensus.cc:504] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.915343 2757 leader_election.cc:288] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.915309 1170 raft_consensus.cc:348] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.916109 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68066afde80c4a8daf042a52629fe6cd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:27.916927 830 leader_election.cc:341] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:27.936784 3056 tablet.cc:1722] T 390a327225344afda3076c341202cc1d P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:27.937369 1168 tablet_bootstrap.cc:492] T 9b42347720fd49d8a2d0a3425cc6f185 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:27.941563 1168 ts_tablet_manager.cc:1397] T 9b42347720fd49d8a2d0a3425cc6f185 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.278s user 0.012s sys 0.001s
I20260620 07:01:27.942512 3068 tablet.cc:1722] T dac4a1434751433488eb2913b1ddfd23 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260620 07:01:27.943660 1168 raft_consensus.cc:348] T 9b42347720fd49d8a2d0a3425cc6f185 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.943944 1168 raft_consensus.cc:374] T 9b42347720fd49d8a2d0a3425cc6f185 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.944067 1168 raft_consensus.cc:729] T 9b42347720fd49d8a2d0a3425cc6f185 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.944343 1168 consensus_queue.cc:260] T 9b42347720fd49d8a2d0a3425cc6f185 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.935042 3053 tablet.cc:1722] T 390a327225344afda3076c341202cc1d P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:27.945029 1168 ts_tablet_manager.cc:1428] T 9b42347720fd49d8a2d0a3425cc6f185 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 07:01:27.945281 1168 tablet_bootstrap.cc:492] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:27.915573 1170 raft_consensus.cc:374] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:27.945732 1170 raft_consensus.cc:729] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:27.946043 1170 consensus_queue.cc:260] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.947120 1170 ts_tablet_manager.cc:1428] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.112s user 0.002s sys 0.000s
I20260620 07:01:27.948307 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1171) took 5795 ms. Trace:
I20260620 07:01:27.948410 1169 rpcz_store.cc:276] 0620 07:01:22.152461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.152535 (+ 74us) service_pool.cc:227] Handling call
0620 07:01:27.808388 (+5655853us) ts_tablet_manager.cc:1145] Deleting tablet 5d394816a1114bf688692a825a176c92
0620 07:01:27.948172 (+139784us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.948288 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5262024}
I20260620 07:01:27.948812 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1172) took 5795 ms. Trace:
I20260620 07:01:27.948891 1169 rpcz_store.cc:276] 0620 07:01:22.153154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.153214 (+ 60us) service_pool.cc:227] Handling call
0620 07:01:27.948704 (+5795490us) ts_tablet_manager.cc:1145] Deleting tablet 2f1be61424224fa6a2e14985266defbb
0620 07:01:27.948716 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.948796 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5795230}
I20260620 07:01:27.949216 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1174) took 5773 ms. Trace:
I20260620 07:01:27.949312 1169 rpcz_store.cc:276] 0620 07:01:22.175949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.177900 (+ 1951us) service_pool.cc:227] Handling call
0620 07:01:27.949121 (+5771221us) ts_tablet_manager.cc:1145] Deleting tablet 393521cca6b44618bbfb71423f36c6a1
0620 07:01:27.949131 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.949203 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5770963}
I20260620 07:01:27.949558 1169 tablet_replica.cc:330] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:27.949753 1169 raft_consensus.cc:2229] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:27.949898 1169 raft_consensus.cc:2258] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:27.950433 1169 ts_tablet_manager.cc:1905] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:27.952174 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1294) took 1616 ms. Trace:
I20260620 07:01:27.952333 2891 rpcz_store.cc:276] 0620 07:01:26.335253 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.336757 (+ 1504us) service_pool.cc:227] Handling call
0620 07:01:27.382585 (+1045828us) ts_tablet_manager.cc:1145] Deleting tablet 602f6d47f23e4d7f80f372a6a507d095
0620 07:01:27.382597 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.659140 (+276543us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.664825 (+ 5685us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.952155 (+287330us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1045708}
I20260620 07:01:27.952808 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1295) took 1605 ms. Trace:
I20260620 07:01:27.952994 2891 rpcz_store.cc:276] 0620 07:01:26.346938 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.346999 (+ 61us) service_pool.cc:227] Handling call
0620 07:01:27.952714 (+1605715us) ts_tablet_manager.cc:1145] Deleting tablet fbf912f51bfd4df0afe7aa28815a897e
0620 07:01:27.952725 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.952791 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1605546}
I20260620 07:01:27.953342 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1296) took 1606 ms. Trace:
I20260620 07:01:27.953451 2891 rpcz_store.cc:276] 0620 07:01:26.347359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.347398 (+ 39us) service_pool.cc:227] Handling call
0620 07:01:27.953273 (+1605875us) ts_tablet_manager.cc:1145] Deleting tablet c06bf6c4d1af40479c81bd1d85e2848f
0620 07:01:27.953283 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.953331 (+ 48us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1605737}
I20260620 07:01:27.953806 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1297) took 1597 ms. Trace:
I20260620 07:01:27.953930 2891 rpcz_store.cc:276] 0620 07:01:26.356161 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.356219 (+ 58us) service_pool.cc:227] Handling call
0620 07:01:27.953695 (+1597476us) ts_tablet_manager.cc:1145] Deleting tablet 87b65473790e4c199ca49152a679ece7
0620 07:01:27.953706 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.953791 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1593845}
I20260620 07:01:27.954310 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1298) took 1597 ms. Trace:
I20260620 07:01:27.954432 2891 rpcz_store.cc:276] 0620 07:01:26.356555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.356609 (+ 54us) service_pool.cc:227] Handling call
0620 07:01:27.954200 (+1597591us) ts_tablet_manager.cc:1145] Deleting tablet 30ea95affc1a4657afd13a01e2cc304d
0620 07:01:27.954211 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.954295 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1594258}
I20260620 07:01:27.954852 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1310) took 1209 ms. Trace:
I20260620 07:01:27.954985 2891 rpcz_store.cc:276] 0620 07:01:26.744968 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.745011 (+ 43us) service_pool.cc:227] Handling call
0620 07:01:27.954713 (+1209702us) ts_tablet_manager.cc:1145] Deleting tablet 55f7ae7d91484d6c99faf7a0d837b546
0620 07:01:27.954729 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.954827 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209492}
I20260620 07:01:27.955314 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1309) took 1210 ms. Trace:
I20260620 07:01:27.955435 2891 rpcz_store.cc:276] 0620 07:01:26.744872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.745372 (+ 500us) service_pool.cc:227] Handling call
0620 07:01:27.955231 (+1209859us) ts_tablet_manager.cc:1145] Deleting tablet 47365e10ce274af891055b34e2f0a2bd
0620 07:01:27.955240 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.955302 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209537}
I20260620 07:01:27.955982 2891 tablet_replica.cc:330] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: stopping tablet replica
W20260620 07:01:27.959295 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5d394816a1114bf688692a825a176c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d394816a1114bf688692a825a176c92 already in progress: creating tablet
W20260620 07:01:27.959864 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2f1be61424224fa6a2e14985266defbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f1be61424224fa6a2e14985266defbb already in progress: creating tablet
W20260620 07:01:27.960233 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 393521cca6b44618bbfb71423f36c6a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 393521cca6b44618bbfb71423f36c6a1 already in progress: creating tablet
I20260620 07:01:27.961277 2952 raft_consensus.cc:482] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:27.961521 2952 raft_consensus.cc:504] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.966879 1169 ts_tablet_manager.cc:1918] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:27.967617 2952 leader_election.cc:288] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:27.967643 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d2a46f972e45f5aeadb09101a68149" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.968061 1169 log.cc:1196] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/4444360e8ade484f958816c5b80dca7e
W20260620 07:01:27.973232 681 consensus_peers.cc:487] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58a4f3b5450948768c8db382d200cc19. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:27.974761 1170 tablet_bootstrap.cc:492] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:27.976256 2821 leader_election.cc:288] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:27.975119 1169 ts_tablet_manager.cc:1939] T 4444360e8ade484f958816c5b80dca7e P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:27.976361 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777a6b981b7f43a4ba8978ba6f3971e1" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:27.976608 1024 raft_consensus.cc:3037] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:27.977478 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1173) took 5802 ms. Trace:
I20260620 07:01:27.977679 1169 rpcz_store.cc:276] 0620 07:01:22.175051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.209849 (+ 34798us) service_pool.cc:227] Handling call
0620 07:01:27.949522 (+5739673us) ts_tablet_manager.cc:1145] Deleting tablet 4444360e8ade484f958816c5b80dca7e
0620 07:01:27.949531 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.954452 (+ 4921us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.966736 (+ 12284us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:27.977448 (+ 10712us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5739359}
I20260620 07:01:27.979045 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 4444360e8ade484f958816c5b80dca7e (table default.Table_411089a06f704215ae2532a11925490c [id=6601ffafdbb94a36a8ac3340fdf24cb3]) successfully deleted
I20260620 07:01:27.979578 1024 raft_consensus.cc:2454] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:27.979648 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1175) took 5732 ms. Trace:
I20260620 07:01:27.979874 1169 rpcz_store.cc:276] 0620 07:01:22.247641 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.255350 (+ 7709us) service_pool.cc:227] Handling call
0620 07:01:27.978890 (+5723540us) ts_tablet_manager.cc:1145] Deleting tablet c0f594983a7540db9c245c64a87a3edd
0620 07:01:27.978904 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.979630 (+ 726us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5723033}
I20260620 07:01:27.979986 681 leader_election.cc:302] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:27.980829 2831 raft_consensus.cc:2781] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.981050 2831 raft_consensus.cc:686] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:27.981482 2831 consensus_queue.cc:237] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:27.982369 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68066afde80c4a8daf042a52629fe6cd" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:27.919872 751 raft_consensus.cc:2454] T c73bcb81a0c84cdfb4dea0561647828a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:27.984081 968 leader_election.cc:302] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:27.984570 2952 raft_consensus.cc:2781] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:27.984925 2952 raft_consensus.cc:686] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:27.985224 2952 consensus_queue.cc:237] T c73bcb81a0c84cdfb4dea0561647828a P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } }
W20260620 07:01:27.985723 683 leader_election.cc:341] T 777a6b981b7f43a4ba8978ba6f3971e1 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 777a6b981b7f43a4ba8978ba6f3971e1
I20260620 07:01:27.986625 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 602f6d47f23e4d7f80f372a6a507d095 (table default.Table_15538b00a4f041cfb5143bd9afba2a95 [id=1fd990051b8b4d7abcef0e69f95e4f26]) successfully deleted
W20260620 07:01:27.986928 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet fbf912f51bfd4df0afe7aa28815a897e because the tablet was not found. No further retry: Not found: Tablet not found: fbf912f51bfd4df0afe7aa28815a897e
I20260620 07:01:27.987892 2741 consensus_queue.cc:1035] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:27.991428 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1176) took 5500 ms. Trace:
W20260620 07:01:27.991487 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet c0f594983a7540db9c245c64a87a3edd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0f594983a7540db9c245c64a87a3edd already in progress: creating tablet
I20260620 07:01:27.991671 1169 rpcz_store.cc:276] 0620 07:01:22.490530 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.490586 (+ 56us) service_pool.cc:227] Handling call
0620 07:01:27.991282 (+5500696us) ts_tablet_manager.cc:1145] Deleting tablet 2d262a232e884ed9be976b6b7a8e7a9c
0620 07:01:27.991297 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.991406 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5500515}
W20260620 07:01:27.992166 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 2d262a232e884ed9be976b6b7a8e7a9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d262a232e884ed9be976b6b7a8e7a9c already in progress: creating tablet
I20260620 07:01:27.978690 1170 tablet_bootstrap.cc:654] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:27.996631 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1178) took 5463 ms. Trace:
I20260620 07:01:27.996845 1169 rpcz_store.cc:276] 0620 07:01:22.532966 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.533027 (+ 61us) service_pool.cc:227] Handling call
0620 07:01:27.992014 (+5458987us) ts_tablet_manager.cc:1145] Deleting tablet 5855497e5b22493bb60024d30cc23e03
0620 07:01:27.996330 (+ 4316us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:27.996602 (+ 272us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5458778}
W20260620 07:01:27.997824 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 5855497e5b22493bb60024d30cc23e03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5855497e5b22493bb60024d30cc23e03 already in progress: creating tablet
I20260620 07:01:27.999387 1170 tablet_bootstrap.cc:492] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:28.001161 1170 ts_tablet_manager.cc:1397] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.003s
W20260620 07:01:28.002556 683 consensus_peers.cc:487] T 602f6d47f23e4d7f80f372a6a507d095 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 602f6d47f23e4d7f80f372a6a507d095. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.001981 1170 raft_consensus.cc:348] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.005216 1170 raft_consensus.cc:374] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.005354 1170 raft_consensus.cc:729] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.005492 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1179) took 5472 ms. Trace:
I20260620 07:01:28.005578 1169 rpcz_store.cc:276] 0620 07:01:22.533084 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.533268 (+ 184us) service_pool.cc:227] Handling call
0620 07:01:27.997396 (+5464128us) ts_tablet_manager.cc:1145] Deleting tablet b1f648ab301c4e3c83bd33230653f395
0620 07:01:28.005333 (+ 7937us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.005473 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5463982}
I20260620 07:01:28.005709 1170 consensus_queue.cc:260] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:28.006197 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet b1f648ab301c4e3c83bd33230653f395 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1f648ab301c4e3c83bd33230653f395 already in progress: creating tablet
I20260620 07:01:28.006567 1170 ts_tablet_manager.cc:1428] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:28.012950 1024 raft_consensus.cc:3037] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.019079 1169 tablet_replica.cc:330] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:28.019352 1169 raft_consensus.cc:2229] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:28.019515 1169 raft_consensus.cc:2258] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.020016 1167 tablet_bootstrap.cc:492] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:28.020196 1167 ts_tablet_manager.cc:1397] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.276s user 0.025s sys 0.070s
I20260620 07:01:28.020215 1169 ts_tablet_manager.cc:1905] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.027647 1169 ts_tablet_manager.cc:1918] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:28.027830 1169 log.cc:1196] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/4128a4e9a228456cb5cd08eef2bf73d4
I20260620 07:01:28.028218 1169 ts_tablet_manager.cc:1939] T 4128a4e9a228456cb5cd08eef2bf73d4 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:01:28.029825 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet c06bf6c4d1af40479c81bd1d85e2848f because the tablet was not found. No further retry: Not found: Tablet not found: c06bf6c4d1af40479c81bd1d85e2848f
W20260620 07:01:28.030105 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 87b65473790e4c199ca49152a679ece7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87b65473790e4c199ca49152a679ece7 already in progress: creating tablet
W20260620 07:01:28.030299 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 30ea95affc1a4657afd13a01e2cc304d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30ea95affc1a4657afd13a01e2cc304d already in progress: creating tablet
W20260620 07:01:28.030486 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 55f7ae7d91484d6c99faf7a0d837b546 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55f7ae7d91484d6c99faf7a0d837b546 already in progress: creating tablet
W20260620 07:01:28.032111 681 consensus_peers.cc:487] T 9647383a4f1b46278348bc25aae2d621 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:28.030653 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 47365e10ce274af891055b34e2f0a2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47365e10ce274af891055b34e2f0a2bd already in progress: creating tablet
W20260620 07:01:28.038272 681 consensus_peers.cc:487] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.047062 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6c58dbd76d954a0795909e2dadcd02ba" } modify_external_catalogs: true
I20260620 07:01:28.047302 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6c58dbd76d954a0795909e2dadcd02ba" } modify_external_catalogs: true
I20260620 07:01:27.965648 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d2a46f972e45f5aeadb09101a68149" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:28.058578 1170 tablet_bootstrap.cc:492] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:28.058655 3083 raft_consensus.cc:482] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.060561 1170 tablet_bootstrap.cc:654] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.060845 1167 raft_consensus.cc:348] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.061079 1167 raft_consensus.cc:374] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.061136 1167 raft_consensus.cc:729] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.061326 1167 consensus_queue.cc:260] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.061852 1167 ts_tablet_manager.cc:1428] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.042s user 0.000s sys 0.000s
I20260620 07:01:28.062153 1167 tablet_bootstrap.cc:492] T 294f8a632f9d4191b925d1da605bd80e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:28.063045 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef297ddf4b394e8ba9b610dfac05ebba consensus state has no leader
I20260620 07:01:28.064241 1167 tablet_bootstrap.cc:654] T 294f8a632f9d4191b925d1da605bd80e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.072683 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1177) took 5539 ms. Trace:
I20260620 07:01:28.073321 1169 rpcz_store.cc:276] 0620 07:01:22.532853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.533883 (+ 1030us) service_pool.cc:227] Handling call
0620 07:01:28.005860 (+5471977us) ts_tablet_manager.cc:1145] Deleting tablet 4128a4e9a228456cb5cd08eef2bf73d4
0620 07:01:28.018956 (+ 13096us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.024104 (+ 5148us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.027511 (+ 3407us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.072653 (+ 45142us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5471808}
I20260620 07:01:28.074352 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1180) took 5541 ms. Trace:
I20260620 07:01:28.074502 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 4128a4e9a228456cb5cd08eef2bf73d4 (table default.Table_84d6206e72c44b3aa76c398a1b6fee91 [id=c263c37cb6584037bd9fbd704dd61f5f]) successfully deleted
W20260620 07:01:28.075932 3073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 07:01:28.016176 830 consensus_peers.cc:487] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 07:01:28.081403 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 65262us
I20260620 07:01:28.031426 2992 raft_consensus.cc:482] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.007961 2757 raft_consensus.cc:482] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.082234 2992 raft_consensus.cc:504] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.082482 2757 raft_consensus.cc:504] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.083160 2757 leader_election.cc:288] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.060199 2891 raft_consensus.cc:2229] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:28.083550 2891 raft_consensus.cc:2258] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.083746 2992 leader_election.cc:288] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.084214 2891 ts_tablet_manager.cc:1905] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:28.084388 422 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 254ffbdd6f144380b2a5ede367a61e0b has no consensus state
I20260620 07:01:28.084888 3068 tablet.cc:1722] T 390a327225344afda3076c341202cc1d P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260620 07:01:28.085035 969 leader_election.cc:302] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:28.087222 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dba2e33592f43a7867756a8b93b3a75" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:28.088268 830 leader_election.cc:341] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.088604 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0bdb4b4ed324bee8f7c09341fdc73bb" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:28.088781 831 leader_election.cc:341] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:28.089509 830 leader_election.cc:341] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.088896 831 leader_election.cc:302] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:28.090495 2757 raft_consensus.cc:2726] T 68066afde80c4a8daf042a52629fe6cd P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:28.091334 3068 tablet.cc:1722] T 52d2a46f972e45f5aeadb09101a68149 P 978f112862c64141b1009856bef3d624: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:27.955830 1168 tablet_bootstrap.cc:654] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.066686 3084 raft_consensus.cc:482] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.093506 3084 raft_consensus.cc:504] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.098330 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a4c4bb33fc634d93a25e595dde5ff8db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.098871 2950 raft_consensus.cc:482] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.098829 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b77b7ecb5cc47a88dac7181322a7a2b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:28.099001 2950 raft_consensus.cc:504] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.099144 2757 raft_consensus.cc:482] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.099545 2950 leader_election.cc:288] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
I20260620 07:01:28.099298 2757 raft_consensus.cc:504] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:28.099888 830 leader_election.cc:341] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.100275 2757 leader_election.cc:288] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.100188 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e54aacb71a934efa86c03061489eeccb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.100792 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e54aacb71a934efa86c03061489eeccb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.100875 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8ddfba5500406eba8f184bd5039170" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:28.101372 969 leader_election.cc:341] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a0a5967c84434000a51fe7d819fac439
W20260620 07:01:28.101922 830 leader_election.cc:341] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:28.102250 3080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:01:28.102613 3083 raft_consensus.cc:504] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.103741 2891 ts_tablet_manager.cc:1918] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260620 07:01:28.103943 2891 log.cc:1196] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-1/wal/wals/58a4f3b5450948768c8db382d200cc19
I20260620 07:01:28.104424 2891 ts_tablet_manager.cc:1939] T 58a4f3b5450948768c8db382d200cc19 P 978f112862c64141b1009856bef3d624: Deleting consensus metadata
I20260620 07:01:28.105886 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1311) took 1360 ms. Trace:
I20260620 07:01:28.106050 2891 rpcz_store.cc:276] 0620 07:01:26.745337 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.746060 (+ 723us) service_pool.cc:227] Handling call
0620 07:01:27.955946 (+1209886us) ts_tablet_manager.cc:1145] Deleting tablet 58a4f3b5450948768c8db382d200cc19
0620 07:01:27.955955 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.098184 (+142229us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.103616 (+ 5432us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.105824 (+ 2208us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2506,"tablet-delete.queue_time_us":1209738}
I20260620 07:01:28.106482 2757 consensus_queue.cc:1035] T 574371fb6915427687df660e733407df P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:28.106653 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4c4bb33fc634d93a25e595dde5ff8db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.106527 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1315) took 1133 ms. Trace:
I20260620 07:01:28.107095 2891 rpcz_store.cc:276] 0620 07:01:26.972638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.972694 (+ 56us) service_pool.cc:227] Handling call
0620 07:01:28.106370 (+1133676us) ts_tablet_manager.cc:1145] Deleting tablet 1b81bd1cb0e2498a8cec55e7ca761d72
0620 07:01:28.106384 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.106482 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1133447}
I20260620 07:01:28.108120 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1316) took 1124 ms. Trace:
I20260620 07:01:28.108242 2891 rpcz_store.cc:276] 0620 07:01:26.983946 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:26.984070 (+ 124us) service_pool.cc:227] Handling call
0620 07:01:28.107953 (+1123883us) ts_tablet_manager.cc:1145] Deleting tablet 9f4cb1dd491c4533809474375c5467b1
0620 07:01:28.107967 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.108072 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1123623}
I20260620 07:01:28.108615 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1317) took 1068 ms. Trace:
I20260620 07:01:28.108721 2891 rpcz_store.cc:276] 0620 07:01:27.040463 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:27.040966 (+ 503us) service_pool.cc:227] Handling call
0620 07:01:28.108477 (+1067511us) ts_tablet_manager.cc:1145] Deleting tablet 27570f4ff9bd4da89fa20113467709dd
0620 07:01:28.108490 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.108573 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1067343}
I20260620 07:01:28.109097 2891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45984 (request call id 1328) took 1001 ms. Trace:
I20260620 07:01:28.109191 2891 rpcz_store.cc:276] 0620 07:01:27.107880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:27.107934 (+ 54us) service_pool.cc:227] Handling call
0620 07:01:28.108960 (+1001026us) ts_tablet_manager.cc:1145] Deleting tablet 3a8d48f0f9dd4911876ec8f812688439
0620 07:01:28.108971 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.109042 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1000834}
I20260620 07:01:28.109442 2891 tablet_replica.cc:330] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624: stopping tablet replica
I20260620 07:01:28.109781 2891 raft_consensus.cc:2229] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:28.110033 2891 raft_consensus.cc:2258] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.110090 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2057b7689b1c4c65901ed8ec04279568" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:28.111037 2891 ts_tablet_manager.cc:1905] T 6c4b81f2b92f4363829034d3fe290742 P 978f112862c64141b1009856bef3d624: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:28.111078 830 leader_election.cc:341] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.111198 3083 leader_election.cc:288] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.111852 3084 leader_election.cc:288] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.118968 414 catalog_manager.cc:4841] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): tablet 58a4f3b5450948768c8db382d200cc19 (table default.Table_cd9d406b4ab84e899550e53fce092e5f [id=3852c2f12adc4283b184a70b473d3260]) successfully deleted
W20260620 07:01:28.119318 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 1b81bd1cb0e2498a8cec55e7ca761d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b81bd1cb0e2498a8cec55e7ca761d72 already in progress: creating tablet
I20260620 07:01:28.119339 2952 raft_consensus.cc:2726] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:28.119501 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 9f4cb1dd491c4533809474375c5467b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f4cb1dd491c4533809474375c5467b1 already in progress: creating tablet
W20260620 07:01:28.119638 414 catalog_manager.cc:4821] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 27570f4ff9bd4da89fa20113467709dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27570f4ff9bd4da89fa20113467709dd already in progress: creating tablet
W20260620 07:01:28.119768 414 catalog_manager.cc:4808] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): delete failed for tablet 3a8d48f0f9dd4911876ec8f812688439 because the tablet was not found. No further retry: Not found: Tablet not found: 3a8d48f0f9dd4911876ec8f812688439
W20260620 07:01:28.089253 681 consensus_peers.cc:487] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.096485 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dba2e33592f43a7867756a8b93b3a75" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:28.097229 748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0bdb4b4ed324bee8f7c09341fdc73bb" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:28.100097 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0a5967c84434000a51fe7d819fac439" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:28.126317 754 raft_consensus.cc:2454] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 0.
I20260620 07:01:28.101718 3053 tablet.cc:1722] T 52d2a46f972e45f5aeadb09101a68149 P 2b84cae646b24bc7bd424eb8434ad425: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:28.103016 749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b77b7ecb5cc47a88dac7181322a7a2b" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:28.104596 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8ddfba5500406eba8f184bd5039170" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:28.126979 968 leader_election.cc:302] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:28.120301 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2057b7689b1c4c65901ed8ec04279568" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:28.127418 2952 raft_consensus.cc:2781] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260620 07:01:28.127378 831 leader_election.cc:341] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.127487 2952 raft_consensus.cc:482] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:28.127552 2952 raft_consensus.cc:3037] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.127537 831 leader_election.cc:302] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:28.127810 2757 raft_consensus.cc:2726] T a0bdb4b4ed324bee8f7c09341fdc73bb P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:28.127894 1169 rpcz_store.cc:276] 0620 07:01:22.533179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.534090 (+ 911us) service_pool.cc:227] Handling call
0620 07:01:28.074199 (+5540109us) ts_tablet_manager.cc:1145] Deleting tablet ded117a6342e473e992c6a9d192462f1
0620 07:01:28.074211 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.074329 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5539968}
I20260620 07:01:28.129043 1169 tablet_replica.cc:330] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
W20260620 07:01:28.129019 831 leader_election.cc:341] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.129249 1169 raft_consensus.cc:2229] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:28.129279 831 leader_election.cc:302] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:28.129401 1169 raft_consensus.cc:2258] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.129698 2757 raft_consensus.cc:2726] T 8b77b7ecb5cc47a88dac7181322a7a2b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:28.130125 1169 ts_tablet_manager.cc:1905] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:28.130110 831 leader_election.cc:341] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.130287 831 leader_election.cc:302] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:28.130554 2952 raft_consensus.cc:504] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.130738 2757 raft_consensus.cc:2726] T 0f8ddfba5500406eba8f184bd5039170 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:28.131230 2952 leader_election.cc:288] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:28.131553 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet ded117a6342e473e992c6a9d192462f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ded117a6342e473e992c6a9d192462f1 already in progress: creating tablet
I20260620 07:01:28.131704 752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0a5967c84434000a51fe7d819fac439" candidate_uuid: "06a32ef63b2b495a9ade1de48c024ae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425"
I20260620 07:01:28.131983 752 raft_consensus.cc:3037] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
W20260620 07:01:28.133198 969 leader_election.cc:341] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: a0a5967c84434000a51fe7d819fac439
I20260620 07:01:28.133865 2821 consensus_queue.cc:1035] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:28.134585 752 raft_consensus.cc:2454] T a0a5967c84434000a51fe7d819fac439 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a32ef63b2b495a9ade1de48c024ae9 in term 1.
I20260620 07:01:28.134753 2821 raft_consensus.cc:482] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.135043 2821 raft_consensus.cc:504] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.135707 2821 leader_election.cc:288] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
W20260620 07:01:28.136448 831 leader_election.cc:341] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.137454 831 leader_election.cc:302] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:28.138068 2757 raft_consensus.cc:2726] T 3dba2e33592f43a7867756a8b93b3a75 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:28.138141 968 leader_election.cc:302] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters: 978f112862c64141b1009856bef3d624
I20260620 07:01:28.138417 2952 raft_consensus.cc:2781] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 07:01:28.138810 831 leader_election.cc:341] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.139293 2952 raft_consensus.cc:686] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Running, Role: LEADER
I20260620 07:01:28.139344 831 leader_election.cc:302] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:28.139611 2952 consensus_queue.cc:237] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.140264 2757 raft_consensus.cc:2726] T 2057b7689b1c4c65901ed8ec04279568 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:28.143999 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7d3fe8285a864648bee0f14dd8103287" } new_table_name: "default.Table_10a013b7873847c1b0c8761503bf2945" modify_external_catalogs: true
I20260620 07:01:28.145834 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960fca9c94764f3d8d2daae20a0f8388" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:28.146081 1020 raft_consensus.cc:2454] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:28.146661 681 leader_election.cc:302] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:28.147032 2821 raft_consensus.cc:2781] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 07:01:28.147172 2821 raft_consensus.cc:482] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:28.147297 2821 raft_consensus.cc:3037] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Advancing to term 2
I20260620 07:01:28.150992 2950 raft_consensus.cc:482] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.151417 2950 raft_consensus.cc:504] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.152225 2950 leader_election.cc:288] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639)
W20260620 07:01:28.153481 968 leader_election.cc:341] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Not found: Tablet not found: ca86563e5b014bb88ccb74c628670c46
W20260620 07:01:28.154412 969 leader_election.cc:341] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: ca86563e5b014bb88ccb74c628670c46
I20260620 07:01:28.154539 969 leader_election.cc:302] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9; no voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624
I20260620 07:01:28.155112 2950 raft_consensus.cc:2726] T ca86563e5b014bb88ccb74c628670c46 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 07:01:28.156951 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 140696dbd9e44a0cbe5d4639110aa580 consensus state has no leader
I20260620 07:01:28.158169 2821 raft_consensus.cc:504] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.161175 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:28.161518 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet 52d2a46f972e45f5aeadb09101a68149 (table default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447]). Expected version 2 got 0
I20260620 07:01:28.161628 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960fca9c94764f3d8d2daae20a0f8388" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:28.161679 999 tablet_service.cc:1467] Processing CreateTablet for tablet 881ee619e0bb4200a1979b171a705100 (DEFAULT_TABLE table=default.Table_5dec136895d44411bf4afdb0341d1b07 [id=a558e74bead44fcea9245c1c77c2b108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.161875 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet c8aa75356fb54672a0ada533fc634613 (table default.Table_830d1bf5012e446b871ec75b647e73b5 [id=9872a758911d490c98d27afe035475b2]). Expected version 2 got 0
I20260620 07:01:28.161831 1020 raft_consensus.cc:3037] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 2
I20260620 07:01:28.162099 422 catalog_manager.cc:5587] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041) does not have the latest schema for tablet d9a7fab4d1684604be1b81d4d4bbe560 (table default.Table_e85e7f993b574dd1bf681863cdd76b40 [id=a7902aafbaad4905a6b5b03ad669eeae]). Expected version 4 got 0
I20260620 07:01:28.163370 421 catalog_manager.cc:5495] T 203485ac9bc54f138bb4f2d547291418 P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:28.163952 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a043d035b0c84d6290041d1c7c03bc35 (table default.Table_0a2bf60c5def4608bdcaf85341a43520 [id=7484c725195043378c662bc4573904c4]). Expected version 1 got 0
I20260620 07:01:28.164155 421 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 883d1959ed484c58935db467aa2dc50a (table default.Table_7eafc8e838624e3e9873bc01998b5daa [id=e4ea9f9e77f74312a2ead7c22390b268]). Expected version 2 got 0
I20260620 07:01:28.164029 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_a1e658593bae421c8b146d30adfed604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.164578 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1e658593bae421c8b146d30adfed604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.164934 1020 raft_consensus.cc:2454] T 960fca9c94764f3d8d2daae20a0f8388 P 06a32ef63b2b495a9ade1de48c024ae9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 2.
I20260620 07:01:28.162071 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 881ee619e0bb4200a1979b171a705100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.166937 732 tablet_service.cc:1467] Processing CreateTablet for tablet 881ee619e0bb4200a1979b171a705100 (DEFAULT_TABLE table=default.Table_5dec136895d44411bf4afdb0341d1b07 [id=a558e74bead44fcea9245c1c77c2b108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.169891 2809 server_base.cc:1034] running on GCE node
I20260620 07:01:28.172322 681 leader_election.cc:302] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425; no voters:
I20260620 07:01:28.172804 2831 raft_consensus.cc:2781] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 07:01:28.173069 1168 tablet_bootstrap.cc:492] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:28.173277 1168 ts_tablet_manager.cc:1397] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.228s user 0.003s sys 0.003s
I20260620 07:01:28.173594 1032 raft_consensus.cc:3037] T d0f7e6245c074c82a5a72be79ab1987f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.174211 1168 raft_consensus.cc:348] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.174933 1168 raft_consensus.cc:374] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.175190 3056 tablet.cc:1722] T 52d2a46f972e45f5aeadb09101a68149 P 06a32ef63b2b495a9ade1de48c024ae9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260620 07:01:28.175101 1168 raft_consensus.cc:729] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.177279 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 51d13068f0864e7f90eaa2021e3972b4
I20260620 07:01:28.177765 424 catalog_manager.cc:6565] ReplaceTablet: tablet 51d13068f0864e7f90eaa2021e3972b4 deleted and replaced by tablet 6bfd6c22e367499eb685ba03ade31376
I20260620 07:01:28.178112 424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_54df90bb27e3499c9be26f19e09b05ba" } new_table_name: "default.Table_3ae8a4cf33da45f5a1fa51d528d2a0af" modify_external_catalogs: true
I20260620 07:01:28.178435 2831 raft_consensus.cc:686] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [term 2 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:28.178704 2831 consensus_queue.cc:237] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.180557 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 881ee619e0bb4200a1979b171a705100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.180723 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d13068f0864e7f90eaa2021e3972b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bfd6c22e367499eb685ba03ade31376) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.182168 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 59717a2e5c104946b7382f9b9c52bfe9
I20260620 07:01:28.182806 420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d5d5e550e63747639ad05d1e42f47abe" } modify_external_catalogs: true
I20260620 07:01:28.182966 420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d5d5e550e63747639ad05d1e42f47abe" } modify_external_catalogs: true
I20260620 07:01:28.183920 1169 ts_tablet_manager.cc:1918] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:28.184067 1169 log.cc:1196] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/25b878def9344cbdae65b209cac4067f
I20260620 07:01:28.184412 1169 ts_tablet_manager.cc:1939] T 25b878def9344cbdae65b209cac4067f P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:28.187837 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 59717a2e5c104946b7382f9b9c52bfe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.188686 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 59717a2e5c104946b7382f9b9c52bfe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.192042 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1194) took 5507 ms. Trace:
I20260620 07:01:28.192183 1169 rpcz_store.cc:276] 0620 07:01:22.684359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.684407 (+ 48us) service_pool.cc:227] Handling call
0620 07:01:28.128164 (+5443757us) ts_tablet_manager.cc:1145] Deleting tablet 25b878def9344cbdae65b209cac4067f
0620 07:01:28.128998 (+ 834us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.174111 (+ 45113us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.183765 (+ 9654us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.191978 (+ 8213us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5443558}
I20260620 07:01:28.192803 1169 tablet_replica.cc:330] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:28.194141 1169 raft_consensus.cc:2229] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:28.194451 1169 raft_consensus.cc:2258] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.199194 1170 tablet_bootstrap.cc:492] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:28.199350 1170 ts_tablet_manager.cc:1397] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.141s user 0.001s sys 0.004s
I20260620 07:01:28.199756 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 5843215411324504bc0d57139f650cc3
I20260620 07:01:28.200433 1170 raft_consensus.cc:348] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.200666 1170 raft_consensus.cc:374] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.200587 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_33a035b548274b128372fc94c2dd645a" } modify_external_catalogs: true
I20260620 07:01:28.200716 1170 raft_consensus.cc:729] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.200690 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d13068f0864e7f90eaa2021e3972b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bfd6c22e367499eb685ba03ade31376) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.200754 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_33a035b548274b128372fc94c2dd645a" } modify_external_catalogs: true
I20260620 07:01:28.200917 1170 consensus_queue.cc:260] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.201531 1170 ts_tablet_manager.cc:1428] T f2f5004b6e28431db1a2b9d1e8c0cfcf P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 07:01:28.201802 1170 tablet_bootstrap.cc:492] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:28.203377 1170 tablet_bootstrap.cc:654] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.203707 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7a03deb42fc449768017e503e27c72aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.204342 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a03deb42fc449768017e503e27c72aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:28.205171 424 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c7974b34152648549a4856ca037ee3cd consensus state has no leader
I20260620 07:01:28.205621 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_fd5e9293c9f347f5b7c45d487e226ab8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.206187 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd5e9293c9f347f5b7c45d487e226ab8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.206979 2821 leader_election.cc:288] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.208478 1169 ts_tablet_manager.cc:1905] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.209594 419 catalog_manager.cc:5495] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:28.210392 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet d9a7fab4d1684604be1b81d4d4bbe560 (table default.Table_e85e7f993b574dd1bf681863cdd76b40 [id=a7902aafbaad4905a6b5b03ad669eeae]). Expected version 4 got 0
I20260620 07:01:28.210649 419 catalog_manager.cc:5495] T a043d035b0c84d6290041d1c7c03bc35 P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:28.211437 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a043d035b0c84d6290041d1c7c03bc35 (table default.Table_0a2bf60c5def4608bdcaf85341a43520 [id=7484c725195043378c662bc4573904c4]). Expected version 1 got 0
I20260620 07:01:28.211730 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 228af95ef5b24823a4a98b876a50d9af (table default.Table_8658418f64d1429a914ad81355f9cdc0 [id=d01569425ba447b59b2349fe24a75acd]). Expected version 2 got 0
I20260620 07:01:28.212030 419 catalog_manager.cc:5495] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1). New cstate: current_term: 1 leader_uuid: "2b84cae646b24bc7bd424eb8434ad425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:28.212620 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet d42118f181da4fa489a919a9b4c6664b (table default.Table_fad68c6e6cfc4535a522d7ffe529d11a [id=d79fe48235ef4ad4be5ffa8663fe9c12]). Expected version 2 got 0
I20260620 07:01:28.213107 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 883d1959ed484c58935db467aa2dc50a (table default.Table_7eafc8e838624e3e9873bc01998b5daa [id=e4ea9f9e77f74312a2ead7c22390b268]). Expected version 2 got 0
I20260620 07:01:28.213630 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 50200e70f4d3492083f6da65f867be31 (table default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]). Expected version 1 got 0
I20260620 07:01:28.214416 419 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet c8aa75356fb54672a0ada533fc634613 (table default.Table_830d1bf5012e446b871ec75b647e73b5 [id=9872a758911d490c98d27afe035475b2]). Expected version 2 got 0
I20260620 07:01:28.215147 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet ce8ed68b221b4215812934844447d60e
I20260620 07:01:28.210664 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 5843215411324504bc0d57139f650cc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.216053 427 master_service.cc:946] ReplaceTablet: received request to replace tablet 30a29b251bfd419c93e0e2dac8693937 from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:28.216836 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 25b878def9344cbdae65b209cac4067f (table default.Table_9e2f2ecd97ee48f89579302e371615a7 [id=07e9b630b86b44ad8440941033df1efc]) successfully deleted
I20260620 07:01:28.217628 732 tablet_service.cc:1514] Processing DeleteTablet for tablet ce8ed68b221b4215812934844447d60e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:28.217715 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 59717a2e5c104946b7382f9b9c52bfe9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59717a2e5c104946b7382f9b9c52bfe9 already in progress: creating tablet
W20260620 07:01:28.217911 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 51d13068f0864e7f90eaa2021e3972b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51d13068f0864e7f90eaa2021e3972b4 already in progress: creating tablet
I20260620 07:01:28.217941 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 5843215411324504bc0d57139f650cc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:28.220024 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 5843215411324504bc0d57139f650cc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5843215411324504bc0d57139f650cc3 already in progress: creating tablet
I20260620 07:01:28.220534 999 tablet_service.cc:1514] Processing DeleteTablet for tablet ce8ed68b221b4215812934844447d60e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.220999 423 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_6040d82ea52842d4b13f03833c939b36 [id=c086fc9d1bb843ce811a4028237375f6] alter complete (version 2)
I20260620 07:01:28.222204 420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet a75be0eee2454e0fad995e0f74a82a80
I20260620 07:01:28.222857 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_9cdf31fc9143436b9bad6d300ef62901"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.223771 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 4d15ee88d2814b2e8055f4ca8be415ad
W20260620 07:01:28.224254 423 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.1:52621 (request call id 131) took 1205 ms (client timeout 1000 ms). Trace:
I20260620 07:01:28.224359 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_052afcdc95c84ff1965547f864e0741f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.224887 426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.3:51975 (request call id 158) took 1144 ms (client timeout 1000 ms). Trace:
W20260620 07:01:28.224997 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_052afcdc95c84ff1965547f864e0741f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:28.224970 426 rpcz_store.cc:269] 0620 07:01:27.080608 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:27.082131 (+ 1523us) service_pool.cc:227] Handling call
0620 07:01:28.224868 (+1142737us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":2}
I20260620 07:01:28.226130 426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0d4f78078f134da08fa9407a9d062a50" } new_table_name: "default.Table_870e0051d0b7473db736d728bc4e9030" modify_external_catalogs: true
I20260620 07:01:28.226503 1169 ts_tablet_manager.cc:1918] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:28.226619 1169 log.cc:1196] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/877a71e8db5f4bf689df39f83735f326
W20260620 07:01:28.227206 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cdf31fc9143436b9bad6d300ef62901 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:28.228686 421 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.2:45945 (request call id 153) took 1124 ms (client timeout 1000 ms). Trace:
W20260620 07:01:28.228892 421 rpcz_store.cc:269] 0620 07:01:27.104273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:27.142512 (+ 38239us) service_pool.cc:227] Handling call
0620 07:01:28.228650 (+1086138us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:28.173003 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:28.173089 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:28.173093 (+ 4us) write_op.cc:435] Acquired schema lock
0620 07:01:28.173095 (+ 2us) tablet.cc:660] Decoding operations
0620 07:01:28.173173 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:28.173181 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:28.173186 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:28.173231 (+ 45us) tablet.cc:699] Row locks acquired
0620 07:01:28.173234 (+ 3us) write_op.cc:260] PREPARE: finished
0620 07:01:28.173255 (+ 21us) write_op.cc:270] Start()
0620 07:01:28.173280 (+ 25us) write_op.cc:276] Timestamp: P: 1781938888173197 usec, L: 0
0620 07:01:28.173283 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 07:01:28.173438 (+ 155us) log.cc:842] Serialized 524 byte log entry
0620 07:01:28.197128 (+ 23690us) op_driver.cc:444] REPLICATION: finished
0620 07:01:28.198289 (+ 1161us) write_op.cc:301] APPLY: starting
0620 07:01:28.198301 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:28.198335 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:28.198366 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:28.198421 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:28.198462 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:28.198486 (+ 24us) write_op.cc:312] APPLY: finished
0620 07:01:28.198548 (+ 62us) log.cc:842] Serialized 23 byte log entry
0620 07:01:28.198588 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:28.198604 (+ 16us) write_op.cc:454] Released schema lock
0620 07:01:28.198611 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:28.198662 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:28.198666 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":1124,"apply.run_cpu_time_us":416,"apply.run_wall_time_us":416,"num_ops":1,"prepare.queue_time_us":8121,"prepare.run_cpu_time_us":590,"prepare.run_wall_time_us":1416,"raft.queue_time_us":1449,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":23826,"spinlock_wait_cycles":27392}]]}
W20260620 07:01:28.230520 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet ce8ed68b221b4215812934844447d60e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce8ed68b221b4215812934844447d60e already in progress: creating tablet
I20260620 07:01:28.230886 999 tablet_service.cc:1514] Processing DeleteTablet for tablet a75be0eee2454e0fad995e0f74a82a80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.230997 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 4128a4e9a228456cb5cd08eef2bf73d4 with delete_type TABLET_DATA_DELETED (replaced by tablet c292d437da9741af8ed8d05d8932d870) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.231232 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d15ee88d2814b2e8055f4ca8be415ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.232018 3098 tablet_replica.cc:330] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:28.232401 2950 consensus_queue.cc:1035] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 07:01:28.232729 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet a75be0eee2454e0fad995e0f74a82a80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a75be0eee2454e0fad995e0f74a82a80 already in progress: creating tablet
I20260620 07:01:28.233546 3098 raft_consensus.cc:2229] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
W20260620 07:01:28.224345 423 rpcz_store.cc:269] 0620 07:01:27.019326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:27.020059 (+ 733us) service_pool.cc:227] Handling call
0620 07:01:28.224232 (+1204173us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 07:01:27.220198 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:27.220335 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:27.220342 (+ 7us) write_op.cc:435] Acquired schema lock
0620 07:01:27.220345 (+ 3us) tablet.cc:660] Decoding operations
0620 07:01:27.220586 (+ 241us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:27.220599 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:27.220605 (+ 6us) tablet.cc:683] Acquiring locks for 4 operations
0620 07:01:27.220722 (+ 117us) tablet.cc:699] Row locks acquired
0620 07:01:27.220724 (+ 2us) write_op.cc:260] PREPARE: finished
0620 07:01:27.220768 (+ 44us) write_op.cc:270] Start()
0620 07:01:27.220805 (+ 37us) write_op.cc:276] Timestamp: P: 1781938887220698 usec, L: 0
0620 07:01:27.220809 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:27.221003 (+ 194us) log.cc:842] Serialized 1638 byte log entry
0620 07:01:27.314886 (+ 93883us) op_driver.cc:444] REPLICATION: finished
0620 07:01:27.315509 (+ 623us) write_op.cc:301] APPLY: starting
0620 07:01:27.315531 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:27.315590 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:27.315628 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:27.315740 (+ 112us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:27.315777 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0620 07:01:27.315783 (+ 6us) write_op.cc:312] APPLY: finished
0620 07:01:27.315893 (+ 110us) log.cc:842] Serialized 41 byte log entry
0620 07:01:27.315962 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:27.315989 (+ 27us) write_op.cc:454] Released schema lock
0620 07:01:27.315997 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:27.322283 (+ 6286us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:27.322291 (+ 8us) write_op.cc:454] Released schema lock
Related trace 'op':
0620 07:01:27.355837 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 07:01:27.355976 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0620 07:01:27.355982 (+ 6us) write_op.cc:435] Acquired schema lock
0620 07:01:27.355985 (+ 3us) tablet.cc:660] Decoding operations
0620 07:01:27.356089 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0620 07:01:27.356101 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0620 07:01:27.356105 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0620 07:01:27.356176 (+ 71us) tablet.cc:699] Row locks acquired
0620 07:01:27.356180 (+ 4us) write_op.cc:260] PREPARE: finished
0620 07:01:27.356213 (+ 33us) write_op.cc:270] Start()
0620 07:01:27.356245 (+ 32us) write_op.cc:276] Timestamp: P: 1781938887356188 usec, L: 0
0620 07:01:27.356249 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 07:01:27.356422 (+ 173us) log.cc:842] Serialized 356 byte log entry
0620 07:01:27.385331 (+ 28909us) op_driver.cc:444] REPLICATION: finished
0620 07:01:27.385510 (+ 179us) write_op.cc:301] APPLY: starting
0620 07:01:27.385524 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0620 07:01:27.385564 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0620 07:01:27.385598 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 07:01:27.385658 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 07:01:27.385695 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 07:01:27.385701 (+ 6us) write_op.cc:312] APPLY: finished
0620 07:01:27.385783 (+ 82us) log.cc:842] Serialized 23 byte log entry
0620 07:01:27.385850 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:27.385869 (+ 19us) write_op.cc:454] Released schema lock
0620 07:01:27.385878 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0620 07:01:27.385983 (+ 105us) write_op.cc:489] Releasing partition, row and schema locks
0620 07:01:27.385987 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":563,"apply.run_cpu_time_us":660,"apply.run_wall_time_us":6855,"num_ops":4,"prepare.queue_time_us":261,"prepare.run_cpu_time_us":916,"prepare.run_wall_time_us":917,"raft.queue_time_us":402,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":94048}],["op",{"apply.queue_time_us":133,"apply.run_cpu_time_us":531,"apply.run_wall_time_us":530,"num_ops":1,"prepare.queue_time_us":38706,"prepare.run_cpu_time_us":705,"prepare.run_wall_time_us":7802,"raft.queue_time_us":7053,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":12,"replication_time_us":29061}]]}
I20260620 07:01:28.233815 3098 pending_rounds.cc:62] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:28.233856 3098 pending_rounds.cc:68] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821682964631552 op_type: NO_OP noop_request { }
I20260620 07:01:28.233954 3098 raft_consensus.cc:2866] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:28.234030 3098 raft_consensus.cc:2258] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.234012 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_7eddefe573ea487a924d49a751e75527"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.234583 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7eddefe573ea487a924d49a751e75527 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.234755 3098 ts_tablet_manager.cc:1905] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.241401 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d0dd59f4c2a4d8580bcefdcc47fd2fa with delete_type TABLET_DATA_DELETED (replaced by tablet 0833926b10164039b5a374969d53bc9e) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.241952 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 4444360e8ade484f958816c5b80dca7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:21 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.241948 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 95ba8444d70342f781bd84edefbca71f with delete_type TABLET_DATA_DELETED (replaced by tablet 5db563ce7027457fa0185ef94f3c05b5) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.242451 3098 ts_tablet_manager.cc:1918] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:28.242837 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 09886cbd967549118d3b1ba116f7834f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:28.243010 3050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 07:01:28.243250 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 574371fb6915427687df660e733407df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.243726 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d15ee88d2814b2e8055f4ca8be415ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.244647 718 tablet_service.cc:1514] Processing DeleteTablet for tablet f591ba26b91b47f9a8933878d478655d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.246701 2809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 07:01:28.250262 732 tablet_service.cc:1514] Processing DeleteTablet for tablet a75be0eee2454e0fad995e0f74a82a80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:28.250598 683 leader_election.cc:341] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 960fca9c94764f3d8d2daae20a0f8388
I20260620 07:01:28.230523 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2c521b51a0ba46608d77b53b7993d36f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.251564 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c521b51a0ba46608d77b53b7993d36f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:28.254249 683 leader_election.cc:341] T 960fca9c94764f3d8d2daae20a0f8388 P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Not found: Tablet not found: 960fca9c94764f3d8d2daae20a0f8388
I20260620 07:01:28.255023 1169 ts_tablet_manager.cc:1939] T 877a71e8db5f4bf689df39f83735f326 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:28.256088 732 tablet_service.cc:1467] Processing CreateTablet for tablet 445bf56c50e34192a5dfc63a669c88c1 (DEFAULT_TABLE table=default.Table_6b2e4f0fd4174f7bb596389267a43d5b [id=50b40cec011345bca642aa32565fc67c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.256515 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 445bf56c50e34192a5dfc63a669c88c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.257236 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1195) took 5572 ms. Trace:
I20260620 07:01:28.259095 1169 rpcz_store.cc:276] 0620 07:01:22.684847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.684891 (+ 44us) service_pool.cc:227] Handling call
0620 07:01:28.192756 (+5507865us) ts_tablet_manager.cc:1145] Deleting tablet 877a71e8db5f4bf689df39f83735f326
0620 07:01:28.192767 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.223246 (+ 30479us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.226393 (+ 3147us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.257218 (+ 30825us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5507696}
I20260620 07:01:28.260004 1169 tablet_replica.cc:330] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:28.260128 718 tablet_service.cc:1467] Processing CreateTablet for tablet 572fc5e8cc3b4169b3c43b43d7859848 (DEFAULT_TABLE table=default.Table_81ae71986307417fb2e9aa73158820bf [id=27b6c3715b50429bbf6c540e4cdd8765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.260965 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 572fc5e8cc3b4169b3c43b43d7859848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.260938 1169 raft_consensus.cc:2229] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:28.261776 1169 raft_consensus.cc:2258] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.262571 2809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 07:01:28.268791 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 877a71e8db5f4bf689df39f83735f326 (table default.Table_890aba75c15e4e5990b4c0cae43dd28e [id=a302748f0b1e46209ebe7622280629a5]) successfully deleted
I20260620 07:01:28.269188 1169 ts_tablet_manager.cc:1905] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.253358 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 445bf56c50e34192a5dfc63a669c88c1 (DEFAULT_TABLE table=default.Table_6b2e4f0fd4174f7bb596389267a43d5b [id=50b40cec011345bca642aa32565fc67c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.273355 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 445bf56c50e34192a5dfc63a669c88c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.276532 2935 raft_consensus.cc:482] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.276677 2935 raft_consensus.cc:504] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.277230 2935 leader_election.cc:288] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.277995 727 tablet_service.cc:1467] Processing CreateTablet for tablet ed698b442fc14f32be7f8411c8c5fcff (DEFAULT_TABLE table=default.Table_4dcddab70ddf4517b28b0f7d19ed8549 [id=691c82b255c9492f9b139dc359bc0f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.278399 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed698b442fc14f32be7f8411c8c5fcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.254565 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 572fc5e8cc3b4169b3c43b43d7859848 (DEFAULT_TABLE table=default.Table_81ae71986307417fb2e9aa73158820bf [id=27b6c3715b50429bbf6c540e4cdd8765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.279225 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 572fc5e8cc3b4169b3c43b43d7859848. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:28.283226 426 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 225344e71a134bdeafaf456bc05e3a1c consensus state has no leader
I20260620 07:01:28.256170 999 tablet_service.cc:1467] Processing CreateTablet for tablet ed698b442fc14f32be7f8411c8c5fcff (DEFAULT_TABLE table=default.Table_4dcddab70ddf4517b28b0f7d19ed8549 [id=691c82b255c9492f9b139dc359bc0f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.283740 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed698b442fc14f32be7f8411c8c5fcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.284873 422 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_83859d2f5d954a00ab1fa95d4bf74474 [id=d7198485f2104c2092955ef5305900cf] alter complete (version 4)
I20260620 07:01:28.286151 427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 30a29b251bfd419c93e0e2dac8693937
I20260620 07:01:28.286576 427 catalog_manager.cc:6565] ReplaceTablet: tablet 30a29b251bfd419c93e0e2dac8693937 deleted and replaced by tablet 6f8c44e24b234e858f1897480ff4fdae
I20260620 07:01:28.286888 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a7b2b32e8a5c46dd901a9511cd6954d6" } new_table_name: "default.Table_1bc7b97ed56a4ed0a6c6f085e3a10053" modify_external_catalogs: true
I20260620 07:01:28.287308 1020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60ce7d59a97544fda80a54f7124d1dba" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:28.287968 681 leader_election.cc:341] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.290491 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 30a29b251bfd419c93e0e2dac8693937 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f8c44e24b234e858f1897480ff4fdae) from {username='slave'} at 127.0.0.1:41218
W20260620 07:01:28.294782 681 consensus_peers.cc:487] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c4b81f2b92f4363829034d3fe290742. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.295150 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 9b42347720fd49d8a2d0a3425cc6f185 (table default.Table_63763f9222b540e8bdf206733bcd6a85 [id=ee2c7d71ca5f41f5ae1e65fd2760cf37]). Expected version 1 got 0
I20260620 07:01:28.295367 426 catalog_manager.cc:5495] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 978f112862c64141b1009856bef3d624 (127.0.97.2). New cstate: current_term: 1 leader_uuid: "978f112862c64141b1009856bef3d624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260620 07:01:28.263996 1167 tablet_bootstrap.cc:492] T 294f8a632f9d4191b925d1da605bd80e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:28.271508 1002 tablet_service.cc:1467] Processing CreateTablet for tablet a2cb9efad8b345f78abbf321e16a24d0 (DEFAULT_TABLE table=default.Table_e21790f4766445e49a41a34b5f77b037 [id=294dcb9e1320407e9632896ff27b96ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.296168 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 50200e70f4d3492083f6da65f867be31 (table default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]). Expected version 1 got 0
I20260620 07:01:28.296527 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2cb9efad8b345f78abbf321e16a24d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.296409 1167 ts_tablet_manager.cc:1397] T 294f8a632f9d4191b925d1da605bd80e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.234s user 0.000s sys 0.005s
I20260620 07:01:28.296810 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet d9a7fab4d1684604be1b81d4d4bbe560 (table default.Table_e85e7f993b574dd1bf681863cdd76b40 [id=a7902aafbaad4905a6b5b03ad669eeae]). Expected version 4 got 0
I20260620 07:01:28.297003 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a043d035b0c84d6290041d1c7c03bc35 (table default.Table_0a2bf60c5def4608bdcaf85341a43520 [id=7484c725195043378c662bc4573904c4]). Expected version 1 got 0
I20260620 07:01:28.297178 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 228af95ef5b24823a4a98b876a50d9af (table default.Table_8658418f64d1429a914ad81355f9cdc0 [id=d01569425ba447b59b2349fe24a75acd]). Expected version 2 got 0
I20260620 07:01:28.297322 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 883d1959ed484c58935db467aa2dc50a (table default.Table_7eafc8e838624e3e9873bc01998b5daa [id=e4ea9f9e77f74312a2ead7c22390b268]). Expected version 2 got 0
I20260620 07:01:28.297554 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 8b77b7ecb5cc47a88dac7181322a7a2b (table default.Table_a7b2b32e8a5c46dd901a9511cd6954d6 [id=0922eff0872d47e78dee52533162e091]). Expected version 1 got 0
I20260620 07:01:28.297927 1167 raft_consensus.cc:348] T 294f8a632f9d4191b925d1da605bd80e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.298087 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet 3dba2e33592f43a7867756a8b93b3a75 (table default.Table_c3b7c5dc4107402d8aa8577850add38d [id=884365bae3b04a509968aa55e38b6335]). Expected version 3 got 0
I20260620 07:01:28.298233 1167 raft_consensus.cc:374] T 294f8a632f9d4191b925d1da605bd80e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.298260 426 catalog_manager.cc:5587] TS 978f112862c64141b1009856bef3d624 (127.0.97.2:39311) does not have the latest schema for tablet a96030064de046e5873bdaab6f3dff60 (table default.Table_4219a4e0a6264d9cb92fdc6b656de6bc [id=cd14c89b450240fcb6bf3b1a3b51346f]). Expected version 2 got 0
I20260620 07:01:28.298400 1167 raft_consensus.cc:729] T 294f8a632f9d4191b925d1da605bd80e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.298974 1167 consensus_queue.cc:260] T 294f8a632f9d4191b925d1da605bd80e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.299500 1170 tablet_bootstrap.cc:492] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:28.299642 1170 ts_tablet_manager.cc:1397] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.098s user 0.001s sys 0.006s
I20260620 07:01:28.300298 1170 raft_consensus.cc:348] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.300494 1170 raft_consensus.cc:374] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.300549 1170 raft_consensus.cc:729] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.300704 2935 raft_consensus.cc:482] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.300740 1170 consensus_queue.cc:260] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.301286 1170 ts_tablet_manager.cc:1428] T 1936a2b27a1f4fda9ceb295c9c00acf8 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:28.301570 1170 tablet_bootstrap.cc:492] T b40e1ea4d1c74be2906381064c73f8c5 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
W20260620 07:01:28.302058 411 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet b17bbf2f844b4c01ad5d6dc36e096ee5 (table default.Table_8d053cfb76e143659a645e3f8eaba768 [id=6f8cad1f8c064ec880389a6c890171dc], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet b17bbf2f844b4c01ad5d6dc36e096ee5 consensus state has no leader
I20260620 07:01:28.300796 2935 raft_consensus.cc:504] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.303686 2935 leader_election.cc:288] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.308146 1170 tablet_bootstrap.cc:654] T b40e1ea4d1c74be2906381064c73f8c5 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.308400 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 30a29b251bfd419c93e0e2dac8693937 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f8c44e24b234e858f1897480ff4fdae) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.314960 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c9d2d029434f37ba23d65f6662893b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:28.315701 681 leader_election.cc:341] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.316026 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_01e9f7064a4f4b23baa77ab1467cffe2" } new_table_name: "default.Table_a5003631dfcb4b198d5cc362a428ec87" modify_external_catalogs: true
I20260620 07:01:28.320672 1169 ts_tablet_manager.cc:1918] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:28.320807 1169 log.cc:1196] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/8b8659e903084f15ac3d9ea8c4c0dc0f
I20260620 07:01:28.320739 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_bed6f45de3c649c88a2726ffc45fc477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.321161 1169 ts_tablet_manager.cc:1939] T 8b8659e903084f15ac3d9ea8c4c0dc0f P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
W20260620 07:01:28.321578 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bed6f45de3c649c88a2726ffc45fc477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:28.216482 830 consensus_peers.cc:487] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.231640 3083 raft_consensus.cc:482] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 07:01:28.323053 830 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.3:42041, user_credentials={real_user=slave}} blocked reactor thread for 106618us
I20260620 07:01:28.323091 3083 raft_consensus.cc:504] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.323758 3083 leader_election.cc:288] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.245383 876 tablet_service.cc:1467] Processing CreateTablet for tablet 881ee619e0bb4200a1979b171a705100 (DEFAULT_TABLE table=default.Table_5dec136895d44411bf4afdb0341d1b07 [id=a558e74bead44fcea9245c1c77c2b108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.324506 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 881ee619e0bb4200a1979b171a705100. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:28.325933 681 consensus_peers.cc:487] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.326681 1170 tablet_bootstrap.cc:492] T b40e1ea4d1c74be2906381064c73f8c5 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:28.248941 870 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d13068f0864e7f90eaa2021e3972b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bfd6c22e367499eb685ba03ade31376) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.326877 1170 ts_tablet_manager.cc:1397] T b40e1ea4d1c74be2906381064c73f8c5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260620 07:01:28.249141 862 tablet_service.cc:1514] Processing DeleteTablet for tablet 59717a2e5c104946b7382f9b9c52bfe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.249418 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 5843215411324504bc0d57139f650cc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.249600 869 tablet_service.cc:1514] Processing DeleteTablet for tablet ce8ed68b221b4215812934844447d60e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:27 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.249732 864 tablet_service.cc:1514] Processing DeleteTablet for tablet a75be0eee2454e0fad995e0f74a82a80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.249855 873 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d15ee88d2814b2e8055f4ca8be415ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.327147 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1196) took 5641 ms. Trace:
I20260620 07:01:28.249981 865 tablet_service.cc:1514] Processing DeleteTablet for tablet 574371fb6915427687df660e733407df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.250089 875 tablet_service.cc:1514] Processing DeleteTablet for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf with delete_type TABLET_DATA_DELETED (replaced by tablet 45788e873c3a4e27b2db531cd02fbbdb) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.250197 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 602f6d47f23e4d7f80f372a6a507d095 with delete_type TABLET_DATA_DELETED (replaced by tablet a54ea2c027bb4d4b82fcdb8aa6eb1475) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.327229 1169 rpcz_store.cc:276] 0620 07:01:22.685314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.685358 (+ 44us) service_pool.cc:227] Handling call
0620 07:01:28.259948 (+5574590us) ts_tablet_manager.cc:1145] Deleting tablet 8b8659e903084f15ac3d9ea8c4c0dc0f
0620 07:01:28.259963 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.289467 (+ 29504us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.320558 (+ 31091us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.327129 (+ 6571us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5574453}
I20260620 07:01:28.250305 866 tablet_service.cc:1514] Processing DeleteTablet for tablet b40e1ea4d1c74be2906381064c73f8c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.250403 872 tablet_service.cc:1514] Processing DeleteTablet for tablet f591ba26b91b47f9a8933878d478655d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.313730 860 tablet_service.cc:1467] Processing CreateTablet for tablet 445bf56c50e34192a5dfc63a669c88c1 (DEFAULT_TABLE table=default.Table_6b2e4f0fd4174f7bb596389267a43d5b [id=50b40cec011345bca642aa32565fc67c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.327589 1169 tablet_replica.cc:330] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:28.327807 1169 raft_consensus.cc:2229] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:28.327947 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 445bf56c50e34192a5dfc63a669c88c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.328300 1169 raft_consensus.cc:2258] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.328799 1169 ts_tablet_manager.cc:1905] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.327807 1170 raft_consensus.cc:348] T b40e1ea4d1c74be2906381064c73f8c5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.314548 867 tablet_service.cc:1467] Processing CreateTablet for tablet 572fc5e8cc3b4169b3c43b43d7859848 (DEFAULT_TABLE table=default.Table_81ae71986307417fb2e9aa73158820bf [id=27b6c3715b50429bbf6c540e4cdd8765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.330776 1170 raft_consensus.cc:374] T b40e1ea4d1c74be2906381064c73f8c5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.330899 1170 raft_consensus.cc:729] T b40e1ea4d1c74be2906381064c73f8c5 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.331173 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 572fc5e8cc3b4169b3c43b43d7859848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.331132 1170 consensus_queue.cc:260] T b40e1ea4d1c74be2906381064c73f8c5 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.331945 1170 ts_tablet_manager.cc:1428] T b40e1ea4d1c74be2906381064c73f8c5 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 07:01:28.332207 1170 tablet_bootstrap.cc:492] T 68066afde80c4a8daf042a52629fe6cd P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:28.334570 1170 tablet_bootstrap.cc:654] T 68066afde80c4a8daf042a52629fe6cd P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.315816 857 tablet_service.cc:1467] Processing CreateTablet for tablet ed698b442fc14f32be7f8411c8c5fcff (DEFAULT_TABLE table=default.Table_4dcddab70ddf4517b28b0f7d19ed8549 [id=691c82b255c9492f9b139dc359bc0f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.335335 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed698b442fc14f32be7f8411c8c5fcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.316207 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 30a29b251bfd419c93e0e2dac8693937 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f8c44e24b234e858f1897480ff4fdae) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.316977 887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60ce7d59a97544fda80a54f7124d1dba" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:28.317571 895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c9d2d029434f37ba23d65f6662893b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:28.339641 895 raft_consensus.cc:2454] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:28.339453 887 raft_consensus.cc:2454] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:28.346303 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 8b8659e903084f15ac3d9ea8c4c0dc0f (table default.Table_5d2a4e7b8377498685861a195b5c2401 [id=91c7f13bfdb84770a1ef410a269a10e0]) successfully deleted
I20260620 07:01:28.350409 422 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_e06eccff5fb24e1d8add984cbf947f32 [id=7230178ddc264a3faaa90ddc66afffd1] alter complete (version 3)
W20260620 07:01:28.353070 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b77b7ecb5cc47a88dac7181322a7a2b consensus state has no leader
I20260620 07:01:28.359601 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 777a6b981b7f43a4ba8978ba6f3971e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.360898 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet a0a5967c84434000a51fe7d819fac439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.361471 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 816218c726a9473e9849b7a97c820678 with delete_type TABLET_DATA_DELETED (replaced by tablet 494a2bc5b3b843c6b29f019974fa0a92) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.361617 1006 tablet_service.cc:1514] Processing DeleteTablet for tablet 960fca9c94764f3d8d2daae20a0f8388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:10 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.361670 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 113dd3d57c144088ae7204dc5229f883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:07 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.361758 1000 tablet_service.cc:1514] Processing DeleteTablet for tablet c73bcb81a0c84cdfb4dea0561647828a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.361816 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet a6c7b3977b604cb69df671318fae1212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.362201 996 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f7e6245c074c82a5a72be79ab1987f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:03 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.363363 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 60ce7d59a97544fda80a54f7124d1dba with delete_type TABLET_DATA_DELETED (replaced by tablet bcdb23f67ac2402b9471748d98b8dae9) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.363487 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet ca86563e5b014bb88ccb74c628670c46 with delete_type TABLET_DATA_DELETED (replaced by tablet ceb16b2060f34a32870bcf6fb143efe7) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.363643 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c9d2d029434f37ba23d65f6662893b with delete_type TABLET_DATA_DELETED (replaced by tablet 8aa5c040d5e84006935e9f06424a34b4) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.363756 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5072c573ce54477881cafb63e18b030" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
I20260620 07:01:28.365650 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_2abd85f9c4824dc4af7b024551e500bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.365729 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_52d79ce6e2874394a07b1408c40f17d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.365939 1169 ts_tablet_manager.cc:1918] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:28.366045 1169 log.cc:1196] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/4260b0c953c14a198dbf9b64a30e7e05
W20260620 07:01:28.366078 830 leader_election.cc:341] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:28.366345 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52d79ce6e2874394a07b1408c40f17d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.366396 1169 ts_tablet_manager.cc:1939] T 4260b0c953c14a198dbf9b64a30e7e05 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:28.367624 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1197) took 5681 ms. Trace:
I20260620 07:01:28.367731 1169 rpcz_store.cc:276] 0620 07:01:22.685718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.685759 (+ 41us) service_pool.cc:227] Handling call
0620 07:01:28.327548 (+5641789us) ts_tablet_manager.cc:1145] Deleting tablet 4260b0c953c14a198dbf9b64a30e7e05
0620 07:01:28.327559 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.338402 (+ 10843us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.365824 (+ 27422us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.367598 (+ 1774us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5641643}
I20260620 07:01:28.367784 419 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_a4c4bb33fc634d93a25e595dde5ff8db" } new_table_name: "default.Table_e6cb83b0e7804be6b76cdc7e32f8efdf" modify_external_catalogs: true
I20260620 07:01:28.368124 1169 tablet_replica.cc:330] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:28.368355 1169 raft_consensus.cc:2229] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:28.368650 1169 pending_rounds.cc:62] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: Trying to abort 1 pending ops.
I20260620 07:01:28.368702 1169 pending_rounds.cc:68] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821677909815296 op_type: NO_OP noop_request { }
W20260620 07:01:28.366349 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2abd85f9c4824dc4af7b024551e500bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.368820 1169 raft_consensus.cc:2866] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:28.368917 1169 raft_consensus.cc:2258] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.369599 1169 ts_tablet_manager.cc:1905] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.373780 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b8659e903084f15ac3d9ea8c4c0dc0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:05 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.374495 746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5072c573ce54477881cafb63e18b030" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:28.375433 683 leader_election.cc:302] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:28.375725 3106 raft_consensus.cc:2781] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:28.375905 3106 raft_consensus.cc:482] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:28.376031 3106 raft_consensus.cc:3037] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.376549 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 4260b0c953c14a198dbf9b64a30e7e05 (table default.Table_d66e26edeccc4a138950de609d6c107f [id=dbe2ab45243b4aeca16c961149135563]) successfully deleted
I20260620 07:01:28.376950 683 leader_election.cc:302] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:28.377162 2741 raft_consensus.cc:2781] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:28.377233 2741 raft_consensus.cc:482] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:28.377302 2741 raft_consensus.cc:3037] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.379844 3106 raft_consensus.cc:504] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.380178 2741 raft_consensus.cc:504] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.380705 2741 leader_election.cc:288] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.380707 3106 leader_election.cc:288] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.385123 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60ce7d59a97544fda80a54f7124d1dba" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
I20260620 07:01:28.385907 1169 ts_tablet_manager.cc:1918] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:28.386025 1169 log.cc:1196] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/91f8c4955c164e6b9061ac607bbe081c
I20260620 07:01:28.386382 1169 ts_tablet_manager.cc:1939] T 91f8c4955c164e6b9061ac607bbe081c P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:28.387516 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c9d2d029434f37ba23d65f6662893b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:28.388295 681 leader_election.cc:341] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260620 07:01:28.388518 681 leader_election.cc:341] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.389245 1024 raft_consensus.cc:3037] T d9a7fab4d1684604be1b81d4d4bbe560 P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.393229 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c9d2d029434f37ba23d65f6662893b" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:28.393473 889 raft_consensus.cc:3037] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.394536 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1198) took 5708 ms. Trace:
I20260620 07:01:28.394645 1169 rpcz_store.cc:276] 0620 07:01:22.686123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.686163 (+ 40us) service_pool.cc:227] Handling call
0620 07:01:28.368059 (+5681896us) ts_tablet_manager.cc:1145] Deleting tablet 91f8c4955c164e6b9061ac607bbe081c
0620 07:01:28.368071 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.374248 (+ 6177us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.385786 (+ 11538us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.394458 (+ 8672us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5681760}
I20260620 07:01:28.394992 1169 tablet_replica.cc:330] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:28.395406 1169 raft_consensus.cc:2229] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:28.395743 1169 raft_consensus.cc:2258] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.396288 889 raft_consensus.cc:2454] T 40c9d2d029434f37ba23d65f6662893b P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:28.396330 1169 ts_tablet_manager.cc:1905] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 07:01:28.402856 969 consensus_peers.cc:487] T 88c01c4e10f345fc84e3e253e8501aff P 06a32ef63b2b495a9ade1de48c024ae9 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88c01c4e10f345fc84e3e253e8501aff. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.403092 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a34f01ce5d4d5696248dc88802dafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:08 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.404430 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60ce7d59a97544fda80a54f7124d1dba" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:28.404671 889 raft_consensus.cc:3037] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.404723 418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_76836e03e3af4d5290e79e81eda0ab64" } modify_external_catalogs: true
I20260620 07:01:28.404948 418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_76836e03e3af4d5290e79e81eda0ab64" } modify_external_catalogs: true
I20260620 07:01:28.406046 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 91f8c4955c164e6b9061ac607bbe081c (table default.Table_95bf37d6a97f41a5ba9d681d07d75283 [id=ceb3d35427694e1099764949625fac6f]) successfully deleted
I20260620 07:01:28.407953 889 raft_consensus.cc:2454] T 60ce7d59a97544fda80a54f7124d1dba P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:28.409488 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet d9a7fab4d1684604be1b81d4d4bbe560 (table default.Table_e85e7f993b574dd1bf681863cdd76b40 [id=a7902aafbaad4905a6b5b03ad669eeae]). Expected version 4 got 0
I20260620 07:01:28.324513 1168 consensus_queue.cc:260] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.409838 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a043d035b0c84d6290041d1c7c03bc35 (table default.Table_0a2bf60c5def4608bdcaf85341a43520 [id=7484c725195043378c662bc4573904c4]). Expected version 1 got 0
I20260620 07:01:28.409862 3083 raft_consensus.cc:482] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.410019 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 883d1959ed484c58935db467aa2dc50a (table default.Table_7eafc8e838624e3e9873bc01998b5daa [id=e4ea9f9e77f74312a2ead7c22390b268]). Expected version 2 got 0
I20260620 07:01:28.409996 3083 raft_consensus.cc:504] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.410180 422 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:28.410889 3083 leader_election.cc:288] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.410985 3106 consensus_queue.cc:1035] T 3d0dd59f4c2a4d8580bcefdcc47fd2fa P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:28.412382 1168 ts_tablet_manager.cc:1428] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.239s user 0.001s sys 0.001s
I20260620 07:01:28.412724 1168 tablet_bootstrap.cc:492] T 1d3868f92cd244e4b0321a0761f51c3f P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:28.414407 683 leader_election.cc:302] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
W20260620 07:01:28.414495 831 leader_election.cc:341] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.414633 831 leader_election.cc:302] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:28.414891 3083 raft_consensus.cc:2726] T f5072c573ce54477881cafb63e18b030 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:28.415189 683 leader_election.cc:302] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:28.415413 1024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26719543504847389de3c3102efcc9b2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:28.415925 683 consensus_peers.cc:487] T 6c4b81f2b92f4363829034d3fe290742 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.416088 2741 raft_consensus.cc:2781] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:28.416188 2741 raft_consensus.cc:686] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
W20260620 07:01:28.416702 830 leader_election.cc:341] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.416395 2741 consensus_queue.cc:237] T 40c9d2d029434f37ba23d65f6662893b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.417807 2831 consensus_queue.cc:1035] T f591ba26b91b47f9a8933878d478655d P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:28.418303 2831 raft_consensus.cc:2781] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:28.418401 2831 raft_consensus.cc:686] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:28.418740 2831 consensus_queue.cc:237] T 60ce7d59a97544fda80a54f7124d1dba P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.422243 1167 ts_tablet_manager.cc:1428] T 294f8a632f9d4191b925d1da605bd80e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.125s user 0.002s sys 0.000s
I20260620 07:01:28.423132 1169 ts_tablet_manager.cc:1918] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:28.423267 1169 log.cc:1196] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/125e8a5e20bf484cade408f0358489a1
I20260620 07:01:28.423913 1169 ts_tablet_manager.cc:1939] T 125e8a5e20bf484cade408f0358489a1 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:28.423856 746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26719543504847389de3c3102efcc9b2" candidate_uuid: "978f112862c64141b1009856bef3d624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84cae646b24bc7bd424eb8434ad425" is_pre_election: true
I20260620 07:01:28.423982 1167 tablet_bootstrap.cc:492] T ce8ed68b221b4215812934844447d60e P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:28.431746 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c01c4e10f345fc84e3e253e8501aff with delete_type TABLET_DATA_DELETED (replaced by tablet 6363d1d9233d4938ba40abff452ed147) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.432122 3098 log.cc:1196] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/4128a4e9a228456cb5cd08eef2bf73d4
I20260620 07:01:28.432662 3098 ts_tablet_manager.cc:1939] T 4128a4e9a228456cb5cd08eef2bf73d4 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:28.433884 424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cdf87d4ae1fc4d17a096825dfe433346" } modify_external_catalogs: true
W20260620 07:01:28.433955 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f6cfeccac77b48be87f3f59810c806ee consensus state has no leader
I20260620 07:01:28.434077 424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_cdf87d4ae1fc4d17a096825dfe433346" } modify_external_catalogs: true
I20260620 07:01:28.434407 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_0354236cf8854458b38d46f5e4ce7582" } new_table_name: "default.Table_7016250869fd46ba943fc59a3efa757b" modify_external_catalogs: true
I20260620 07:01:28.441870 1005 tablet_service.cc:1467] Processing CreateTablet for tablet 4f1fbf496afa4858acf0ea1fc49238f0 (DEFAULT_TABLE table=default.Table_68ef820ecebc4d29aef38e8c12d8f643 [id=ec5e0fb153894e49b20d97891d8b9fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.442972 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 192c6007f88545c79e92396b18b2301f (DEFAULT_TABLE table=default.Table_d5d2c32ec24b4fd6957fe5f4297f5eda [id=9671400e97874020beba1fcf7eca65da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.443899 3098 tablet_replica.cc:330] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:28.444034 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 192c6007f88545c79e92396b18b2301f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.444134 1168 tablet_bootstrap.cc:654] T 1d3868f92cd244e4b0321a0761f51c3f P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.448885 3098 raft_consensus.cc:2229] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:28.449085 3098 raft_consensus.cc:2258] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.449687 3098 ts_tablet_manager.cc:1905] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.449756 732 tablet_service.cc:1467] Processing CreateTablet for tablet a2cb9efad8b345f78abbf321e16a24d0 (DEFAULT_TABLE table=default.Table_e21790f4766445e49a41a34b5f77b037 [id=294dcb9e1320407e9632896ff27b96ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.450548 718 tablet_service.cc:1467] Processing CreateTablet for tablet 27b18032a6014570815f88e112d455fe (DEFAULT_TABLE table=default.Table_75c7cbf049f24b07ae2f6f1027095af2 [id=c164725daaeb4a9591a95889a8807f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.442972 1009 tablet_service.cc:1467] Processing CreateTablet for tablet 455d38c83a434f27b71352be90de4231 (DEFAULT_TABLE table=default.Table_64537400790649eabbf7a0ba6b44a258 [id=c1144b2f8d024a698fc5b45bd368bf4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.451084 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 455d38c83a434f27b71352be90de4231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.451236 727 tablet_service.cc:1467] Processing CreateTablet for tablet 4f1fbf496afa4858acf0ea1fc49238f0 (DEFAULT_TABLE table=default.Table_68ef820ecebc4d29aef38e8c12d8f643 [id=ec5e0fb153894e49b20d97891d8b9fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.451906 729 tablet_service.cc:1467] Processing CreateTablet for tablet 455d38c83a434f27b71352be90de4231 (DEFAULT_TABLE table=default.Table_64537400790649eabbf7a0ba6b44a258 [id=c1144b2f8d024a698fc5b45bd368bf4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.452838 716 tablet_service.cc:1467] Processing CreateTablet for tablet 192c6007f88545c79e92396b18b2301f (DEFAULT_TABLE table=default.Table_d5d2c32ec24b4fd6957fe5f4297f5eda [id=9671400e97874020beba1fcf7eca65da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.453529 715 tablet_service.cc:1467] Processing CreateTablet for tablet 727f5d4d7ad14e8889605bedf27d215f (DEFAULT_TABLE table=default.Table_d161383246cd40ec8ad6511e9959e18b [id=376949e76e014af9832126d6f1e81b01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.455013 861 tablet_service.cc:1467] Processing CreateTablet for tablet 192c6007f88545c79e92396b18b2301f (DEFAULT_TABLE table=default.Table_d5d2c32ec24b4fd6957fe5f4297f5eda [id=9671400e97874020beba1fcf7eca65da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.456089 861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 192c6007f88545c79e92396b18b2301f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:28.458752 419 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3e07585aa754ed59b5f39d5e9dcf1d6 has no consensus state
I20260620 07:01:28.459026 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1192) took 5775 ms. Trace:
I20260620 07:01:28.454663 876 tablet_service.cc:1467] Processing CreateTablet for tablet 27b18032a6014570815f88e112d455fe (DEFAULT_TABLE table=default.Table_75c7cbf049f24b07ae2f6f1027095af2 [id=c164725daaeb4a9591a95889a8807f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.459118 1169 rpcz_store.cc:276] 0620 07:01:22.683690 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.687910 (+ 4220us) service_pool.cc:227] Handling call
0620 07:01:28.394945 (+5707035us) ts_tablet_manager.cc:1145] Deleting tablet 125e8a5e20bf484cade408f0358489a1
0620 07:01:28.394956 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.399789 (+ 4833us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.423000 (+ 23211us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.459003 (+ 36003us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5706779}
I20260620 07:01:28.459815 1169 tablet_replica.cc:330] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:28.459846 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27b18032a6014570815f88e112d455fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.460004 1169 raft_consensus.cc:2229] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 07:01:28.460158 1169 raft_consensus.cc:2258] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.460695 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2cb9efad8b345f78abbf321e16a24d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.460886 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27b18032a6014570815f88e112d455fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.461422 1169 ts_tablet_manager.cc:1905] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.464038 867 tablet_service.cc:1467] Processing CreateTablet for tablet 455d38c83a434f27b71352be90de4231 (DEFAULT_TABLE table=default.Table_64537400790649eabbf7a0ba6b44a258 [id=c1144b2f8d024a698fc5b45bd368bf4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.464507 867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 455d38c83a434f27b71352be90de4231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.465730 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 125e8a5e20bf484cade408f0358489a1 (table default.Table_072aff5d28cf4c61bbecd2cadb3e58c3 [id=bb41cdc85465446193c33f0722351f6a]) successfully deleted
I20260620 07:01:28.465795 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f1fbf496afa4858acf0ea1fc49238f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 07:01:28.455116 831 leader_election.cc:341] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.466092 831 leader_election.cc:302] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9, 2b84cae646b24bc7bd424eb8434ad425
I20260620 07:01:28.455209 872 tablet_service.cc:1467] Processing CreateTablet for tablet 727f5d4d7ad14e8889605bedf27d215f (DEFAULT_TABLE table=default.Table_d161383246cd40ec8ad6511e9959e18b [id=376949e76e014af9832126d6f1e81b01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.466442 872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 727f5d4d7ad14e8889605bedf27d215f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.467025 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 455d38c83a434f27b71352be90de4231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.467283 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_8c6eee16b2794549b57b8ce3e8e600e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.467424 421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_715948cd71c24a039a15b1a9598243ae" } modify_external_catalogs: true
I20260620 07:01:28.467610 421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_715948cd71c24a039a15b1a9598243ae" } modify_external_catalogs: true
W20260620 07:01:28.467871 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c6eee16b2794549b57b8ce3e8e600e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.469137 423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6bd7256e447b419db6c6f79b49b94fc9" } modify_external_catalogs: true
I20260620 07:01:28.469177 419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7fa1a7454e724c24ad01c5ce4eb29ff3" } modify_external_catalogs: true
I20260620 07:01:28.469311 423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_6bd7256e447b419db6c6f79b49b94fc9" } modify_external_catalogs: true
I20260620 07:01:28.469498 3083 raft_consensus.cc:2726] T 26719543504847389de3c3102efcc9b2 P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 07:01:28.469323 419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_7fa1a7454e724c24ad01c5ce4eb29ff3" } modify_external_catalogs: true
I20260620 07:01:28.471060 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 192c6007f88545c79e92396b18b2301f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.472913 860 tablet_service.cc:1467] Processing CreateTablet for tablet 4f1fbf496afa4858acf0ea1fc49238f0 (DEFAULT_TABLE table=default.Table_68ef820ecebc4d29aef38e8c12d8f643 [id=ec5e0fb153894e49b20d97891d8b9fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.473729 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f1fbf496afa4858acf0ea1fc49238f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.475229 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 727f5d4d7ad14e8889605bedf27d215f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.481611 857 tablet_service.cc:1467] Processing CreateTablet for tablet a2cb9efad8b345f78abbf321e16a24d0 (DEFAULT_TABLE table=default.Table_e21790f4766445e49a41a34b5f77b037 [id=294dcb9e1320407e9632896ff27b96ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.482118 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2cb9efad8b345f78abbf321e16a24d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.488350 725 tablet_service.cc:1467] Processing CreateTablet for tablet f43fadede4f74811bb6e0199914b90b6 (DEFAULT_TABLE table=default.Table_62727117a5b94ad5aa59354b192f9de1 [id=50bccb48791b4887a4edeb764ce1dbf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.489663 726 tablet_service.cc:1467] Processing CreateTablet for tablet 7d5e1dd6a9d3463f934479daac9e107e (DEFAULT_TABLE table=default.Table_aac644bb3f1b42539dba61270f047268 [id=dd50bb5c20d949da9eb90157d9be4ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.490006 1169 ts_tablet_manager.cc:1918] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 07:01:28.490146 1169 log.cc:1196] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/88c01c4e10f345fc84e3e253e8501aff
I20260620 07:01:28.490540 1169 ts_tablet_manager.cc:1939] T 88c01c4e10f345fc84e3e253e8501aff P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:28.492031 725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43fadede4f74811bb6e0199914b90b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.495044 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d5e1dd6a9d3463f934479daac9e107e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.495646 1005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f1fbf496afa4858acf0ea1fc49238f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.496433 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 4128a4e9a228456cb5cd08eef2bf73d4 (table default.Table_84d6206e72c44b3aa76c398a1b6fee91 [id=c263c37cb6584037bd9fbd704dd61f5f]) successfully deleted
W20260620 07:01:28.497685 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 4d15ee88d2814b2e8055f4ca8be415ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d15ee88d2814b2e8055f4ca8be415ad already in progress: creating tablet
I20260620 07:01:28.497640 996 tablet_service.cc:1467] Processing CreateTablet for tablet 727f5d4d7ad14e8889605bedf27d215f (DEFAULT_TABLE table=default.Table_d161383246cd40ec8ad6511e9959e18b [id=376949e76e014af9832126d6f1e81b01]), partition=RANGE (key) PARTITION UNBOUNDED
W20260620 07:01:28.497954 412 catalog_manager.cc:4821] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): delete failed for tablet 30a29b251bfd419c93e0e2dac8693937 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30a29b251bfd419c93e0e2dac8693937 already in progress: creating tablet
I20260620 07:01:28.498111 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 727f5d4d7ad14e8889605bedf27d215f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.498567 999 tablet_service.cc:1467] Processing CreateTablet for tablet 27b18032a6014570815f88e112d455fe (DEFAULT_TABLE table=default.Table_75c7cbf049f24b07ae2f6f1027095af2 [id=c164725daaeb4a9591a95889a8807f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.499120 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27b18032a6014570815f88e112d455fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.500021 1000 tablet_service.cc:1467] Processing CreateTablet for tablet 7d5e1dd6a9d3463f934479daac9e107e (DEFAULT_TABLE table=default.Table_aac644bb3f1b42539dba61270f047268 [id=dd50bb5c20d949da9eb90157d9be4ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.500346 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d5e1dd6a9d3463f934479daac9e107e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.501252 1007 tablet_service.cc:1467] Processing CreateTablet for tablet f43fadede4f74811bb6e0199914b90b6 (DEFAULT_TABLE table=default.Table_62727117a5b94ad5aa59354b192f9de1 [id=50bccb48791b4887a4edeb764ce1dbf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.501755 1007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43fadede4f74811bb6e0199914b90b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.530854 2809 hybrid_clock.cc:648] HybridClock initialized: now 1781938888528248 us; error 2574 us; skew 500 ppm
I20260620 07:01:28.531381 2809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 07:01:28.541487 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1193) took 5857 ms. Trace:
I20260620 07:01:28.541618 1169 rpcz_store.cc:276] 0620 07:01:22.684008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:22.688200 (+ 4192us) service_pool.cc:227] Handling call
0620 07:01:28.459771 (+5771571us) ts_tablet_manager.cc:1145] Deleting tablet 88c01c4e10f345fc84e3e253e8501aff
0620 07:01:28.459781 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.481115 (+ 21334us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.489909 (+ 8794us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.541457 (+ 51548us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1408,"tablet-delete.queue_time_us":5771360}
I20260620 07:01:28.542119 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet 88c01c4e10f345fc84e3e253e8501aff (table default.Table_1e18ab4a35f347abb061df0a7db49226 [id=3234298ef6b649e78f3c7c7c61facd36]) successfully deleted
I20260620 07:01:28.542526 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1201) took 5436 ms. Trace:
I20260620 07:01:28.542626 1169 rpcz_store.cc:276] 0620 07:01:23.105958 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:23.116188 (+ 10230us) service_pool.cc:227] Handling call
0620 07:01:28.542395 (+5426207us) ts_tablet_manager.cc:1145] Deleting tablet fbc8c484e491431bbd1c2713662fd22b
0620 07:01:28.542406 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.542508 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5425995}
W20260620 07:01:28.543139 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet fbc8c484e491431bbd1c2713662fd22b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbc8c484e491431bbd1c2713662fd22b already in progress: creating tablet
I20260620 07:01:28.544364 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1205) took 5294 ms. Trace:
I20260620 07:01:28.544451 1169 rpcz_store.cc:276] 0620 07:01:23.249526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:23.249573 (+ 47us) service_pool.cc:227] Handling call
0620 07:01:28.544245 (+5294672us) ts_tablet_manager.cc:1145] Deleting tablet 8fcb1830334a4bb082283d56247a551e
0620 07:01:28.544255 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.544346 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5294481}
W20260620 07:01:28.544855 413 catalog_manager.cc:4821] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): delete failed for tablet 8fcb1830334a4bb082283d56247a551e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fcb1830334a4bb082283d56247a551e already in progress: creating tablet
I20260620 07:01:28.545436 1169 tablet_replica.cc:330] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: stopping tablet replica
I20260620 07:01:28.545639 1169 raft_consensus.cc:2229] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:28.545957 1169 raft_consensus.cc:2258] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.547209 418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet dcb01b8ab6f2440b8612af790a86c858
I20260620 07:01:28.547827 418 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_43035e837b724041adc0d9be08280f83" } new_table_name: "default.Table_d9ec6d15c1ec4f27a0cf44b1d5e79f4f" modify_external_catalogs: true
I20260620 07:01:28.547982 1167 tablet_bootstrap.cc:654] T ce8ed68b221b4215812934844447d60e P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.549605 3083 consensus_queue.cc:1035] T d08b4b09221d46b09dd97c0b7ef9b71d P 978f112862c64141b1009856bef3d624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:28.558036 860 tablet_service.cc:1467] Processing CreateTablet for tablet f43fadede4f74811bb6e0199914b90b6 (DEFAULT_TABLE table=default.Table_62727117a5b94ad5aa59354b192f9de1 [id=50bccb48791b4887a4edeb764ce1dbf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.559695 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet dcb01b8ab6f2440b8612af790a86c858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.562392 1167 tablet_bootstrap.cc:492] T ce8ed68b221b4215812934844447d60e P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:28.564294 426 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: default.Table_d813286aa59b40d58c24c8f081155d38 [id=aa5eb6347e824667b681aa8b7e4a5447] alter complete (version 2)
I20260620 07:01:28.564353 867 tablet_service.cc:1514] Processing DeleteTablet for tablet dcb01b8ab6f2440b8612af790a86c858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:45984
W20260620 07:01:28.567145 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce7a85d8951f4cfa88c2a2efa1a6ba17 consensus state has no leader
I20260620 07:01:28.567363 424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 464614a1d17a464190597f01c8539fba
I20260620 07:01:28.567751 420 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f2d84209f64141849ad5bae389215a82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.568183 424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_80b5e06609f24ec4be8612897227a95b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.568507 420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2d84209f64141849ad5bae389215a82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 07:01:28.568686 424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80b5e06609f24ec4be8612897227a95b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.570042 421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 1c390114ac2646619cb50ce1873e72f7
I20260620 07:01:28.570686 421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_caf0543a86ec481d9089d9b513326820"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.571318 421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_caf0543a86ec481d9089d9b513326820 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.571623 1168 tablet_bootstrap.cc:492] T 1d3868f92cd244e4b0321a0761f51c3f P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:28.571775 1168 ts_tablet_manager.cc:1397] T 1d3868f92cd244e4b0321a0761f51c3f P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.159s user 0.001s sys 0.007s
I20260620 07:01:28.572613 423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 7401e8cbac62479b9cca9c8af78d5b6a
I20260620 07:01:28.572609 1168 raft_consensus.cc:348] T 1d3868f92cd244e4b0321a0761f51c3f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.572815 1168 raft_consensus.cc:374] T 1d3868f92cd244e4b0321a0761f51c3f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.572872 1168 raft_consensus.cc:729] T 1d3868f92cd244e4b0321a0761f51c3f P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.573064 1168 consensus_queue.cc:260] T 1d3868f92cd244e4b0321a0761f51c3f P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.573282 423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_f3728ff746cc4659b997557c728817ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.573524 1168 ts_tablet_manager.cc:1428] T 1d3868f92cd244e4b0321a0761f51c3f P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260620 07:01:28.573823 423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3728ff746cc4659b997557c728817ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.575168 419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 2de8ddbab4c6462999b074d9b375b3f6
I20260620 07:01:28.575399 1167 ts_tablet_manager.cc:1397] T ce8ed68b221b4215812934844447d60e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.153s user 0.004s sys 0.001s
I20260620 07:01:28.576224 1167 raft_consensus.cc:348] T ce8ed68b221b4215812934844447d60e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.576460 1167 raft_consensus.cc:374] T ce8ed68b221b4215812934844447d60e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.576509 1167 raft_consensus.cc:729] T ce8ed68b221b4215812934844447d60e P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.579310 427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_80e45984a0114ae6bbe50db3b07da598" } new_table_name: "default.Table_e2842b66e2584ef2b89af4fc17a2b354" modify_external_catalogs: true
I20260620 07:01:28.584227 419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_96e73558702743218c549c0a18b255bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.584856 419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96e73558702743218c549c0a18b255bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.586752 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_160dd9e654e847eda2e309e930a29b3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.587410 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_160dd9e654e847eda2e309e930a29b3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.575197 3098 ts_tablet_manager.cc:1918] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 07:01:28.588658 3098 log.cc:1196] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-2/wal/wals/777a6b981b7f43a4ba8978ba6f3971e1
I20260620 07:01:28.591904 860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43fadede4f74811bb6e0199914b90b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.593489 3098 ts_tablet_manager.cc:1939] T 777a6b981b7f43a4ba8978ba6f3971e1 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting consensus metadata
I20260620 07:01:28.599165 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 464614a1d17a464190597f01c8539fba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.561694 2809 webserver.cc:460] Webserver started at http://127.0.97.60:44063/ using document root <none> and password file <none>
I20260620 07:01:28.603266 2809 fs_manager.cc:359] Metadata directory not provided
I20260620 07:01:28.603444 2809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 07:01:28.605337 425 master_service.cc:946] ReplaceTablet: received request to replace tablet 969b451c02594e029f1522af54d5a8cd from {username='slave'} at 127.0.0.1:42866
I20260620 07:01:28.599506 867 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c390114ac2646619cb50ce1873e72f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.599835 861 tablet_service.cc:1514] Processing DeleteTablet for tablet 7401e8cbac62479b9cca9c8af78d5b6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.599956 872 tablet_service.cc:1514] Processing DeleteTablet for tablet 2de8ddbab4c6462999b074d9b375b3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.601356 996 tablet_service.cc:1514] Processing DeleteTablet for tablet 2de8ddbab4c6462999b074d9b375b3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.601504 1007 tablet_service.cc:1514] Processing DeleteTablet for tablet 294f8a632f9d4191b925d1da605bd80e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:14 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.601531 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 7401e8cbac62479b9cca9c8af78d5b6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.601702 1005 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c390114ac2646619cb50ce1873e72f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.601832 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 464614a1d17a464190597f01c8539fba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.600673 876 tablet_service.cc:1467] Processing CreateTablet for tablet 7d5e1dd6a9d3463f934479daac9e107e (DEFAULT_TABLE table=default.Table_aac644bb3f1b42539dba61270f047268 [id=dd50bb5c20d949da9eb90157d9be4ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 07:01:28.602267 866 tablet_service.cc:1514] Processing DeleteTablet for tablet f5072c573ce54477881cafb63e18b030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:06 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.602602 868 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8ddfba5500406eba8f184bd5039170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:15 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.602780 875 tablet_service.cc:1514] Processing DeleteTablet for tablet 2057b7689b1c4c65901ed8ec04279568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:04 UTC) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.602177 1167 consensus_queue.cc:260] T ce8ed68b221b4215812934844447d60e P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.607262 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d5e1dd6a9d3463f934479daac9e107e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 07:01:28.603293 1168 tablet_bootstrap.cc:492] T 20fc99f79e7b4df2b74a79468656b6ab P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:28.548475 715 tablet_service.cc:1514] Processing DeleteTablet for tablet dcb01b8ab6f2440b8612af790a86c858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.551115 3106 consensus_queue.cc:1035] T 494a2bc5b3b843c6b29f019974fa0a92 P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:28.551759 2831 raft_consensus.cc:482] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 07:01:28.611177 2831 raft_consensus.cc:504] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.611945 2831 leader_election.cc:288] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.578624 725 tablet_service.cc:1514] Processing DeleteTablet for tablet 88c01c4e10f345fc84e3e253e8501aff with delete_type TABLET_DATA_DELETED (replaced by tablet 6363d1d9233d4938ba40abff452ed147) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.580551 722 tablet_service.cc:1514] Processing DeleteTablet for tablet b40e1ea4d1c74be2906381064c73f8c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:12 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.581604 732 tablet_service.cc:1514] Processing DeleteTablet for tablet f2f5004b6e28431db1a2b9d1e8c0cfcf with delete_type TABLET_DATA_DELETED (replaced by tablet 45788e873c3a4e27b2db531cd02fbbdb) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.582224 726 tablet_service.cc:1514] Processing DeleteTablet for tablet 2de8ddbab4c6462999b074d9b375b3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.587483 729 tablet_service.cc:1514] Processing DeleteTablet for tablet 1936a2b27a1f4fda9ceb295c9c00acf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:16 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.588229 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 7401e8cbac62479b9cca9c8af78d5b6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.612797 1169 ts_tablet_manager.cc:1905] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.589372 727 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c390114ac2646619cb50ce1873e72f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.613884 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883d1959ed484c58935db467aa2dc50a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9" is_pre_election: true
W20260620 07:01:28.614804 681 leader_election.cc:341] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.594355 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 464614a1d17a464190597f01c8539fba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 07:01:28 UTC) from {username='slave'} at 127.0.0.1:49218
W20260620 07:01:28.616138 681 consensus_peers.cc:487] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Couldn't send request to peer 06a32ef63b2b495a9ade1de48c024ae9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.617811 891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883d1959ed484c58935db467aa2dc50a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624" is_pre_election: true
I20260620 07:01:28.618142 891 raft_consensus.cc:2454] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 0.
I20260620 07:01:28.621472 1167 ts_tablet_manager.cc:1428] T ce8ed68b221b4215812934844447d60e P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.046s user 0.002s sys 0.000s
I20260620 07:01:28.624109 1168 tablet_bootstrap.cc:654] T 20fc99f79e7b4df2b74a79468656b6ab P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.629612 1167 tablet_bootstrap.cc:492] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
W20260620 07:01:28.630980 418 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73359f7d59e54f0fb7781114ced2914f consensus state has no leader
I20260620 07:01:28.631304 1167 tablet_bootstrap.cc:654] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.632454 3098 tablet_replica.cc:330] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9: stopping tablet replica
I20260620 07:01:28.632658 3098 raft_consensus.cc:2229] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 07:01:28.632882 3098 pending_rounds.cc:62] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9: Trying to abort 1 pending ops.
I20260620 07:01:28.632926 3098 pending_rounds.cc:68] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298821685823442944 op_type: NO_OP noop_request { }
I20260620 07:01:28.633061 3098 raft_consensus.cc:2866] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 07:01:28.633149 3098 raft_consensus.cc:2258] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 07:01:28.634121 1170 tablet_bootstrap.cc:492] T 68066afde80c4a8daf042a52629fe6cd P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:28.634254 1170 ts_tablet_manager.cc:1397] T 68066afde80c4a8daf042a52629fe6cd P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.302s user 0.019s sys 0.007s
I20260620 07:01:28.634963 1170 raft_consensus.cc:348] T 68066afde80c4a8daf042a52629fe6cd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.635191 1170 raft_consensus.cc:374] T 68066afde80c4a8daf042a52629fe6cd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.635247 1170 raft_consensus.cc:729] T 68066afde80c4a8daf042a52629fe6cd P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.635476 1170 consensus_queue.cc:260] T 68066afde80c4a8daf042a52629fe6cd P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.636188 1170 ts_tablet_manager.cc:1428] T 68066afde80c4a8daf042a52629fe6cd P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:28.636454 1170 tablet_bootstrap.cc:492] T 2057b7689b1c4c65901ed8ec04279568 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:28.639015 1170 tablet_bootstrap.cc:654] T 2057b7689b1c4c65901ed8ec04279568 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.639808 412 catalog_manager.cc:4841] TS 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): tablet 777a6b981b7f43a4ba8978ba6f3971e1 (table default.Table_514f5506c81a4038ad87979a2e476fd0 [id=480d35deefed493692a6b99af40b1f9d]) successfully deleted
I20260620 07:01:28.639387 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet a043d035b0c84d6290041d1c7c03bc35 (table default.Table_0a2bf60c5def4608bdcaf85341a43520 [id=7484c725195043378c662bc4573904c4]). Expected version 1 got 0
I20260620 07:01:28.640311 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet d42118f181da4fa489a919a9b4c6664b (table default.Table_fad68c6e6cfc4535a522d7ffe529d11a [id=d79fe48235ef4ad4be5ffa8663fe9c12]). Expected version 2 got 0
I20260620 07:01:28.640818 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 9ad723586ff545049dad658221e6455b (table default.Table_4417e9fcb14240dcb3f962d49d0fb731 [id=ff75396ba7974241b25eeda39f6974db]). Expected version 1 got 0
I20260620 07:01:28.641270 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet c8aa75356fb54672a0ada533fc634613 (table default.Table_830d1bf5012e446b871ec75b647e73b5 [id=9872a758911d490c98d27afe035475b2]). Expected version 2 got 0
I20260620 07:01:28.641515 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet d9a7fab4d1684604be1b81d4d4bbe560 (table default.Table_e85e7f993b574dd1bf681863cdd76b40 [id=a7902aafbaad4905a6b5b03ad669eeae]). Expected version 4 got 0
I20260620 07:01:28.641774 418 catalog_manager.cc:5587] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639) does not have the latest schema for tablet 50200e70f4d3492083f6da65f867be31 (table default.Table_af0d9826ce374c2596807c0f8ef53481 [id=b28385912d8d4a5ea9c1bce1cb24fa66]). Expected version 1 got 0
I20260620 07:01:28.642849 424 master_service.cc:946] ReplaceTablet: received request to replace tablet 4d23f06461284d6cb950b258e8b39540 from {username='slave'} at 127.0.0.1:42866
W20260620 07:01:28.643522 427 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5580a1cada4b453aa5bff8ea4ab6088b consensus state has no leader
I20260620 07:01:28.645794 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe29008ed9b430ea13d40e54e3ddfcc: Sending DeleteTablet for 3 replicas of tablet 969b451c02594e029f1522af54d5a8cd
I20260620 07:01:28.646232 425 catalog_manager.cc:6565] ReplaceTablet: tablet 969b451c02594e029f1522af54d5a8cd deleted and replaced by tablet 3762707bbc3f4617bea362e2cda6937d
I20260620 07:01:28.647125 1009 tablet_service.cc:1514] Processing DeleteTablet for tablet 969b451c02594e029f1522af54d5a8cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3762707bbc3f4617bea362e2cda6937d) from {username='slave'} at 127.0.0.1:41218
I20260620 07:01:28.649668 683 leader_election.cc:302] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:28.650199 3106 raft_consensus.cc:2781] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 07:01:28.650393 3106 raft_consensus.cc:482] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 07:01:28.650570 3106 raft_consensus.cc:3037] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.651037 716 tablet_service.cc:1514] Processing DeleteTablet for tablet 969b451c02594e029f1522af54d5a8cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3762707bbc3f4617bea362e2cda6937d) from {username='slave'} at 127.0.0.1:49218
I20260620 07:01:28.654446 3106 raft_consensus.cc:504] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.657554 421 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_d66e26edeccc4a138950de609d6c107f" } new_table_name: "default.Table_26802be0f905497381a4ef1c904f2340" modify_external_catalogs: true
I20260620 07:01:28.660564 1032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883d1959ed484c58935db467aa2dc50a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a32ef63b2b495a9ade1de48c024ae9"
W20260620 07:01:28.661368 681 leader_election.cc:341] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260620 07:01:28.662990 3106 leader_election.cc:288] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Requested vote from peers 978f112862c64141b1009856bef3d624 (127.0.97.2:39311), 06a32ef63b2b495a9ade1de48c024ae9 (127.0.97.3:42041)
I20260620 07:01:28.668983 425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_e63c80c42497447f97c97f18cbdb010d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.669163 422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_1b4a0dc508cc40319a898ff5f21efa17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 07:01:28.669690 422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b4a0dc508cc40319a898ff5f21efa17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.668987 420 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "default.Table_814c241fc99a43019b3d93e0b56b6217" } new_table_name: "default.Table_767d14e987274c86a6eb88eaabd2a51d" modify_external_catalogs: true
W20260620 07:01:28.669699 425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63c80c42497447f97c97f18cbdb010d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.678346 418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "default.Table_3307dbcc22c44cffb86b10c7e50a0a47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 07:01:28.681818 1168 tablet_bootstrap.cc:492] T 20fc99f79e7b4df2b74a79468656b6ab P 978f112862c64141b1009856bef3d624: No bootstrap required, opened a new log
I20260620 07:01:28.682109 1168 ts_tablet_manager.cc:1397] T 20fc99f79e7b4df2b74a79468656b6ab P 978f112862c64141b1009856bef3d624: Time spent bootstrapping tablet: real 0.079s user 0.000s sys 0.005s
I20260620 07:01:28.683014 1168 raft_consensus.cc:348] T 20fc99f79e7b4df2b74a79468656b6ab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:28.683252 418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3307dbcc22c44cffb86b10c7e50a0a47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 07:01:28.683310 1168 raft_consensus.cc:374] T 20fc99f79e7b4df2b74a79468656b6ab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.683418 1168 raft_consensus.cc:729] T 20fc99f79e7b4df2b74a79468656b6ab P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978f112862c64141b1009856bef3d624, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.683706 1168 consensus_queue.cc:260] T 20fc99f79e7b4df2b74a79468656b6ab P 978f112862c64141b1009856bef3d624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.684540 1168 ts_tablet_manager.cc:1428] T 20fc99f79e7b4df2b74a79468656b6ab P 978f112862c64141b1009856bef3d624: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 07:01:28.685693 3098 ts_tablet_manager.cc:1905] T a0a5967c84434000a51fe7d819fac439 P 06a32ef63b2b495a9ade1de48c024ae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 07:01:28.666328 1169 ts_tablet_manager.cc:1918] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 07:01:28.674329 1170 tablet_bootstrap.cc:492] T 2057b7689b1c4c65901ed8ec04279568 P 2b84cae646b24bc7bd424eb8434ad425: No bootstrap required, opened a new log
I20260620 07:01:28.686945 1169 log.cc:1196] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: Deleting WAL directory at /tmp/dist-test-task4u_93S/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781938850261076-388-0/minicluster-data/ts-0/wal/wals/b6dca84adc5940e5a5505378e7276731
I20260620 07:01:28.687165 1170 ts_tablet_manager.cc:1397] T 2057b7689b1c4c65901ed8ec04279568 P 2b84cae646b24bc7bd424eb8434ad425: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.002s
I20260620 07:01:28.687383 1169 ts_tablet_manager.cc:1939] T b6dca84adc5940e5a5505378e7276731 P 2b84cae646b24bc7bd424eb8434ad425: Deleting consensus metadata
I20260620 07:01:28.687959 2809 fs_manager.cc:709] Time spent opening directory manager: real 0.067s user 0.003s sys 0.002s
I20260620 07:01:28.688258 1170 raft_consensus.cc:348] T 2057b7689b1c4c65901ed8ec04279568 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.688747 1170 raft_consensus.cc:374] T 2057b7689b1c4c65901ed8ec04279568 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.688869 1170 raft_consensus.cc:729] T 2057b7689b1c4c65901ed8ec04279568 P 2b84cae646b24bc7bd424eb8434ad425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.689558 1170 consensus_queue.cc:260] T 2057b7689b1c4c65901ed8ec04279568 P 2b84cae646b24bc7bd424eb8434ad425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:28.690497 421 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb6f3c39a49c4e7d8fb28c14e0fcf04a consensus state has no leader
W20260620 07:01:28.692495 420 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f8767b1f8cb41e3ad3aebfd269fd2ef consensus state has no leader
I20260620 07:01:28.693496 1167 tablet_bootstrap.cc:492] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:28.693655 1167 ts_tablet_manager.cc:1397] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.000s
I20260620 07:01:28.693743 2741 consensus_queue.cc:1035] T d42118f181da4fa489a919a9b4c6664b P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 07:01:28.691032 887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883d1959ed484c58935db467aa2dc50a" candidate_uuid: "2b84cae646b24bc7bd424eb8434ad425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978f112862c64141b1009856bef3d624"
I20260620 07:01:28.694268 887 raft_consensus.cc:3037] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [term 0 FOLLOWER]: Advancing to term 1
I20260620 07:01:28.694541 1167 raft_consensus.cc:348] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
W20260620 07:01:28.694685 683 consensus_peers.cc:487] T 58a4f3b5450948768c8db382d200cc19 P 2b84cae646b24bc7bd424eb8434ad425 -> Peer 978f112862c64141b1009856bef3d624 (127.0.97.2:39311): Couldn't send request to peer 978f112862c64141b1009856bef3d624. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58a4f3b5450948768c8db382d200cc19. This is attempt 1: this message will repeat every 5th retry.
I20260620 07:01:28.694746 1167 raft_consensus.cc:374] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 07:01:28.694825 1167 raft_consensus.cc:729] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 06a32ef63b2b495a9ade1de48c024ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a32ef63b2b495a9ade1de48c024ae9, State: Initialized, Role: FOLLOWER
I20260620 07:01:28.695070 1167 consensus_queue.cc:260] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 06a32ef63b2b495a9ade1de48c024ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b84cae646b24bc7bd424eb8434ad425" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 34639 } } peers { permanent_uuid: "978f112862c64141b1009856bef3d624" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 39311 } } peers { permanent_uuid: "06a32ef63b2b495a9ade1de48c024ae9" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 42041 } }
I20260620 07:01:28.695521 1167 ts_tablet_manager.cc:1428] T f0e6ef65b5f44f6d9f2100dd404b2e5f P 06a32ef63b2b495a9ade1de48c024ae9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 07:01:28.697307 1167 tablet_bootstrap.cc:492] T 9647383a4f1b46278348bc25aae2d621 P 06a32ef63b2b495a9ade1de48c024ae9: Bootstrap starting.
I20260620 07:01:28.697511 887 raft_consensus.cc:2454] T 883d1959ed484c58935db467aa2dc50a P 978f112862c64141b1009856bef3d624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84cae646b24bc7bd424eb8434ad425 in term 1.
I20260620 07:01:28.699322 1168 tablet_bootstrap.cc:492] T 18d08c30bf7e4c04b01368b9b4a6273c P 978f112862c64141b1009856bef3d624: Bootstrap starting.
I20260620 07:01:28.699549 1170 ts_tablet_manager.cc:1428] T 2057b7689b1c4c65901ed8ec04279568 P 2b84cae646b24bc7bd424eb8434ad425: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260620 07:01:28.699913 1170 tablet_bootstrap.cc:492] T a13a60f7f3e74f7dbf5204c974e0e346 P 2b84cae646b24bc7bd424eb8434ad425: Bootstrap starting.
I20260620 07:01:28.704627 1168 tablet_bootstrap.cc:654] T 18d08c30bf7e4c04b01368b9b4a6273c P 978f112862c64141b1009856bef3d624: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.709168 1170 tablet_bootstrap.cc:654] T a13a60f7f3e74f7dbf5204c974e0e346 P 2b84cae646b24bc7bd424eb8434ad425: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.714231 1167 tablet_bootstrap.cc:654] T 9647383a4f1b46278348bc25aae2d621 P 06a32ef63b2b495a9ade1de48c024ae9: Neither blocks nor log segments found. Creating new log.
I20260620 07:01:28.713670 860 tablet_service.cc:1514] Processing DeleteTablet for tablet 969b451c02594e029f1522af54d5a8cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3762707bbc3f4617bea362e2cda6937d) from {username='slave'} at 127.0.0.1:45984
I20260620 07:01:28.723534 1167 tablet_bootstrap.cc:492] T 9647383a4f1b46278348bc25aae2d621 P 06a32ef63b2b495a9ade1de48c024ae9: No bootstrap required, opened a new log
I20260620 07:01:28.723690 1167 ts_tablet_manager.cc:1397] T 9647383a4f1b46278348bc25aae2d621 P 06a32ef63b2b495a9ade1de48c024ae9: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260620 07:01:28.726878 3131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.001s user 0.000s sys 0.000s
I20260620 07:01:28.714290 683 leader_election.cc:302] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b84cae646b24bc7bd424eb8434ad425, 978f112862c64141b1009856bef3d624; no voters: 06a32ef63b2b495a9ade1de48c024ae9
I20260620 07:01:28.732460 3106 raft_consensus.cc:2781] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 07:01:28.703346 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49218 (request call id 1203) took 5454 ms. Trace:
I20260620 07:01:28.738200 1169 rpcz_store.cc:276] 0620 07:01:23.249286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 07:01:23.249670 (+ 384us) service_pool.cc:227] Handling call
0620 07:01:28.545373 (+5295703us) ts_tablet_manager.cc:1145] Deleting tablet b6dca84adc5940e5a5505378e7276731
0620 07:01:28.545383 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0620 07:01:28.656207 (+110824us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.666219 (+ 10012us) tablet_metadata.cc:641] Metadata flushed
0620 07:01:28.703319 (+ 37100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5295590}
I20260620 07:01:28.740190 413 catalog_manager.cc:4841] TS 2b84cae646b24bc7bd424eb8434ad425 (127.0.97.1:34639): tablet b6dca84adc5940e5a5505378e7276731 (table default.Table_473db1503a4346f39f7a647f8c55ff3c [id=71fe166d837d4d07a832d5e50bb59f2b]) successfully deleted
I20260620 07:01:28.741478 3106 raft_consensus.cc:686] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [term 1 LEADER]: Becoming Leader. State: Replica: 2b84cae646b24bc7bd424eb8434ad425, State: Running, Role: LEADER
I20260620 07:01:28.741852 3106 consensus_queue.cc:237] T 883d1959ed484c58935db467aa2dc50a P 2b84cae646b24bc7bd424eb8434ad425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "